One Phillips screw secures the headphone jack/microphone assembly to the rear panel.

After lifting it off some adhesive, it can be removed from the Galaxy Tab.

Luckily, the headphone jack is completely separate from the motherboard, making replacement trivial if you happen to break it when you drop your Galaxy Tab with the headphones plugged in.

Apple had similar ideas on the iPad.