Once the door clicks, you can open it to reveal the slots holding the memory card and the battery.

Focusing on the larger slot, this holds the battery. Push the orange tab away from the slot, this will eject the old battery if one was previously inside.

Once this slot is open, you can place the new battery inside.