Unfortunately, this is a common problem for that model phone. The micro usb is a poor design in my opinion. I would be content with mini usb connectors. Anyways, if you know someone who is experienced with soldering you may be better off getting a new replacement. Just in case the USB is not defective. By the sounds of it the inner pins could be bent if you had to push it a certain way to get a connection. You can get a replacement connector here[http://cgi.ebay.com/USB-CHARGING-SYNC-PORT-CONNECTOR-SOCKET-FIX-HTC-EVO-/160560941656?pt=PDA_Accessories&hash=item25622d8a58]
Still I would only recommend someone who knows how to use a solder iron or heat gun perform the repair. It may cost a little bit but it will likely be way cheaper then $120.