Use a spudger to gently pry up the battery.

It's best to use a non-metal spudger whenever possible, as a metal spudger is much more likely to accidentally puncture/damage the battery.

The battery is stuck to the plastic case with double sided tape.

Obtain a new battery and place it into the plastic casing using double sided tape or whatever is provided with the new battery.