I did some research and came to the same conclusion as tkd and sam. Since I don't own the tools and am not very good in repairing those things myself I had mobiletechvideos do it for me [(http://mobiletechvideos.mybigcommerce.com/samsung-galaxy-nexus-usb-port-repair/)]
$35.00 is not super cheap but a fair price for not having to do it myself and risking serious damage to the device. I got my phone back after 9 days and since then it has been working like a charm.
Anyway, it sucks that the micro usb port is that fragile and got damaged so easily in the first place.