All modern laptops will have a temp-dependent fan and should turn slowly when idled, u not pushing it. If it does I would return it, 'cuz too me that's unacceptable.
If u are curious I would download any one of the free hardware monitoring app and see what the fan is doing, is it able to slow-down/speed up. If your fan is not following a temperature curve, undervolt may not do anything.
By comparison my fan idles at 2,000 rpm and I can't hear it until it hits ~3,500 rpm, and of course not surprisingly roars like a jet when CPU is maxed out, hitting 70+ C, topping out ~6,000 rpm.