Carefully lift up the back of the cox box.

The battery is in the part of the cox box you are lifting, connected to the other part of the cox box by a wire at the side of the cox box away from where the boat and charger wires plug in.

When you feel resistance, tilt the back half of the cox box away from the connectors.