From the outside edge of the device, carefully push the volume button inwards towards the middle of the device.

Make sure to not push too hard. If you push too hard, the button might slip and hit the parts on the inside close to the button.

Once the button is out of its slot, carefully remove it from the device.