Sockets that hold the cord in with a press-fit design are hard to reuse by design. Unless you can depress the cord, cut the cord at the socket and discard the bulb socket.

After removing the plastic cover and switch, remove the bulb socket with a Phillips #2 screwdriver. If your socket is press fit, these are generally not reusable. Cut the cord unless you can pull the cord and not compromise the socket.

Discard any broken or unwanted components.