If the battery does not charge, the circuit inside the battery does not draw any current from the adapter to the battery. Thus, no excessive heating, no full charging of the adapter, no risk of fire, no need to replace or remove if you never use the battery.