Use your fingers to rotate the other bumper away from the controller until the clip comes off its post.

Remove the bumpers.

During reassembly:

Make sure the tabs on the midframe and bumpers go into their corresponding cutouts.

Hook one of the bumpers onto its post and push the other bumper into the midframe until its clip snaps into place.