While lifted up, take the key cap with your fingers and gently pull it towards the display.

Again, don't use much force. The cap can easily be pulled when dragged towards the display being fully released afterwards.

When examining the back of the cap (second picture) you'll see that the notches on the upper edge of the key cap are designed to be pulled up (left circle) while the lower edge notches need to be slid (right circle).