Well it could be an app on the device that is using more power than is being sent in by the charger. Try charging the phone when it is off and see if it goes faster. If it does, then you need to figure out what app (or perhaps virus or malware) is on the device causing the over usage.
If it doesn't make much difference turning it off to charge, then you probably need a new battery.