Use the point of a spudger or opening pick to push on alternating sides of the battery connector to "walk" it out of its socket and remove the battery cable.

Use a spudger and wedge it between the battery and the mouse.

Work the spudger left and right to slowly lift the adhesive.

Once it is loose, lift and remove the battery.