Solved! My laptop says my battery is getting near the end of its recharging ability.

Solution
Usually yes you can. It really depends on the laptop.
With the laptop off, remove the battery and plug in the AC. If it turns on and works when running your most demanding software then YES!