When you insert the new battery into the battery compartment, it should remain bulged upwards on the side towards the dent.

Make sure the flat side of the battery is facing upwards.

To finish inserting the new battery into the battery compartment, gently press the bulged corner with your finger until it slides into place.