I tried the inputs and muted them all, it was none of those.
I'm on a laptop so no ports on the back.
The headset that has the noise is Creative EP-660
The headset that broke but did not have the noise Creative EP-630i <-- and why did this not have the noise?
The location of the audio jacks is...