Update: it is definitely the fan. I installed a fan control program and as I disabled my fan, the noise stopped. It also allowed me to increase the speed and I noticed something very worrying. I was able to feel the fan push the bottom of the pc. I have a feeling that the fan is not spinning...