Remove the tape holding down the wires, and carefully pry the battery off of the base of the device.

Pry carefully to avoid damaging the battery. The battery may start to bend slightly, this is normal and not a cause for concern.

It is best to use a plastic card or nylon spudger to remove the battery. Metal tools can puncture a battery, potentially causing a fire.