Removing the battery is tough. It's glued into the casing and you'll have to lever it out.

Use something that is reasonably broad to start levering the battery out. It'll probably bend as you do this (it can be flattened again after removal).

Continue to lever it out. Eventually you'll get through all the glue and the battery will pop out.