The LED is connected to a pin that is connected to the circuit board.

Upon close inspection, you can see that the LED's two ends are bent (red circle of the second image) to prevent it from slipping off of the pin.

Use blunt tweezers to bend and straighten the two ends.

Once the two ends are straight, gently pull the LED out of the pin.