Firmly secure the controller with one hand, and use your other hand to lift the thumbstick covers straight off their modules.

This requires significant force. If you're having trouble, try wiggling the cover to help loosen it.

To install a thumbstick cover:

Place and rotate the cover on its module until it slides into place.

Firmly press down on the cover until it snaps into place or bottoms out.