If this happens often it maybe time for a new launcher. I find the Google Now launcher really nice. You can download it from the google play store and when installed, press the home button and it will have a pop up message, select Google Now launcher and click for it to always do this. Finally, just rearrange your icons and your good.
This works on almost all launchers and some are better than others, I like google now but there are others like GO! launcher and more.