If you have an multi-meter - check the resistance of that speaker. If you read between 4 and 8 Ohms - speaker is OK.
If you don't have multimeter - connect wires going to the speaker to a 1.5V battery. If you hear a click from the speaker, it is probably OK.
Or you can just switch speakers.