Did you try restarting the phone? That would be the simplest solution.
Should that not work, tap and hold on an empty space on your home screen background. It should bring up apps, and more. The icon you are looking for should be listed in there.
If it isn't, then are you sure it is just the icon you removed from the screen? Or did you delete the app from the device?