Your XP5 will have one of three pointing devices installed, which are modular - a TrackPoint button module, a trackball (what I have), or a trackpad. They are all removed the same way.

With the keyboard removed, lift the module free from the laptop, starting from the keyboard side. Disconnect its 5-pin cable, which is plugged into a press fit connector.