Yes, it's very tricky!
Lower the top case until it is virtually leaning on the top shield, then, use a screwdriver or similar to push the connector back so it is directly above the port. Then, push the top case down at the point directly above the connector, making sure the connector is still in position. This may take a few tries but when you get it right the pins will take a very small amount of force to slide into the holes.