From my experience, you should not have any problems. If you do though, I would consider removing the 2GB and stay with the 4GB (you lose 2GB, but stay with 4GB in total, win!).
If it does not work, try switching the RAM modules around (rarely, the controller will work with the sticks swapped...