Well this is not good for your phone , it will disturb its lower charging jack , because it may be possible that charger jack point is going loose day by day.
Cause this not happens with any one regularly, once or twice is not an issue . But as you said it happens again n again in low frequency...