Okay, I finally decided to open to the thing and check if the battery is the problem.
While it does seem to have a budge on one side, it look a bit too rectangle (lines are very straight) to be a sign of bad battery, more like a sticker or something under it.
On the other hand, I tried to use...