Use a spudger to gently lever the battery out of the controller.

The battery is attached with adhesive, so gently sever the adhesive around the entirety of the battery as you pry.

Take care not to puncture or bend the battery.

If your new battery does not come with adhesive, apply new adhesive to secure the battery.