Place a spudger or an opening tool under the connector's edge and pry straight up to disconnect the battery.

Make sure to pry under the edge of the connector itself, and not under the socket on the board. Otherwise, you risk permanently damaging the socket.

Work carefully: don't pry on or accidentally scrape any small, surface mounted components on the board.