Removing buzzing noises is tricky, honestly.
Are you connecting your microphone directly to your PC's 3.5mm mic jack?
I suspect your pc might be generating that interference, as audio controllers on motherboards often introduce hissing/background noise.
Adding a USB interface should fix the...