Turning off wifi fix this issue for me, I'm using laptop though. It definitely isn't the dongle fault cause I just tried my Sony Headset Wireless (PS3) with its USB dongle on my laptop and there's some crack sound too.
edit : Atheros AR5B93 is the driver, maybe someone could look into it.
edit 2...