Check the task manager when your playing games. How many % of the RAM is being used? If it is on Max, then yes it will make it faster and smoother, and even better FPS.
If not, then you will need to upgrade your Graphics Card, in which case you will also probably need to upgrade the RAM as you will be running games at higher resolution and graphic settings and 4Gb is not enough.