Use a Jimmy to pry under the speaker and lift to remove it.

Be sure to place your tool under the entire speaker assembly, against the plastic frame, and pry there.

These photos show an incorrect tool position—prying this high up on the speaker assembly may damage it. Place your tool underneath the speaker assembly, not on the edge as shown here.

The speaker is secured with some light adhesive, so some force may be required.