Gently depress the two plastic tabs on both of the sides of the button casing.

The plastic tabs on the buttons are extremely fragile, handle with care.

Slightly push the button down, out of the controller until it slides out.

During re-assembly, make sure the button tabs align with the slots in the casing when inserting the button back in.