You should now be left with the front panel and the battery.

Gently disconnect the battery connector from the front panel. It's small and the pins are delicate, so be careful not to bend it.

When you install the new battery, you may find it useful to secure it to the back casing with some double-sided tape or even a small amount of glue.