The speaker is located on the plate you pulled away in initial disassembly, not connected to the mother board.

Place Jimmy against the edge of the speaker and gently pry out, there are no solder connections holding it in place.

When inserting a new speaker, the orientation matters. It will click into place if it's correct, otherwise it will just fall out of the seating.