The speakers use color coded wires, which don't fit into the wrong side, so you can't get the sides mized up.

To remove a wire, grip it where the wire part meets the metal beneath the plastic protector (which is not necessary to remove)

pull away from the connector. The black socket is narrower than the red socket.