Solved! How do I unfreeze my Samsung Galaxy Tab2 7.0

Solution
Either turn it off (by the power button), remove the battery (yes, I know some devices have batteries that are complicated to remove, and don't do this part if it is under warranty) or let it run out of power.

Those are the only options.