What kinda soundcard do you have? if its onboard it's pretty common. Also, if you use front headphone jack on your cabinet, chances for noise is higher.
I don't think your mic is in listen mode, you can check that in audio settings. I'm not sure about this, but if memory serves me well, the AC97...