Carefully pull the battery connector away from the socket that is attached to the motherboard. ( Battery connector is circled in black.)

It may be safer to use a tool like tweezers or pliers to pull the battery connector out of the socket.

Now you can dispose of the old battery safely. For example taking old used batteries to a household hazardous waste facility.