iPhone 4/4S rear glass isn't as easy to remove as you may think. It should be open like a calculator. Hold it from the bottom with both of your hands and pull the panel with both of your thumbs to make it slide. Once it slides, then you can remove it easily. It requires a "significant" amount of pressure, especially the 1st time on an used smartphone (because of dust).
Hope this helps
Vincent