Yes you can do that, as long as you are not using a vacuum tube amplifier with transformer output, which are not very common now. In that situation you can damage the receiver by trying to draw too much power, but solid state systems do not have that problem.
You will get a lower SPL (Sound...