Well, it is supposed to do that, but not for to long of a time. Also, did you by any chance hit the volume down key when you tried to reset it? If so, you didn't actually do a "Hard Reset". The following is how to do so...
NOTE: Doing this will clear 'all' the data on your tablet, so it is suggested you not choose this option unless you have to, or aren't worried about losing anything on the device.
Be sure you back up any data you want to keep, to a computer or cloud account, before doing the reset.
To "Hard Reset" the tablet...
1. Make sure that the tablet is actually powered off.
2. Remove your SD card, if there is one in the device.
3. Press the "Power" and the "Volume Up" buttons, together, until you see the start-up logo...