Use the pointed tip of a spudger to carefully push on each side of the connector.

Use the flat side of the spudger at the top of the battery connector to completely push it out.

Pull the cable by the connector and not the wires to move it out of the way.

It is important to disconnect the battery since touching the components with the battery connected can short-circuit the device. This could cause damage to the components and yourself.