There is a chance of damaging them, but what usually happens is you get really loud volume without being able to adjust it (and some distortion). Ofcourse, these effects are different depending on the specific speaker and amp used. A quick google search of this will lend you more insight of...