The battery actually is removable, they just make it hard for people to do it themselves.
Before messing with the battery, make sure the charger isn't the problem first. It could easily have stopped working correctly. Try another charger on the phone.
If it is under warranty, contact the manufacturer about a repair/replacement. If it isn't, then you should try a local tech who can replace the battery for you.