There should be no gap between the chip and the heatsink at all, the thermal paste goes on the chip, the heatsink goes directly on top of the paste. The point of the heat grease is to remove even those gaps that are not seen by the eye and to make as much of a contact between the chip and the heatsink as possible.