Use the point of a spudger or opening pick to push on alternating sides of the battery connector to "walk" it out of its socket and remove the battery cable.

Use a spudger and wedge it between the battery and the mouse.

Work the spudger left and right to slowly lift the adhesive.

Do not poke the spudger into the battery.

Once it is loose, lift and remove the battery.