Don't pry against the battery with your tool. Use protrusions in the frame for leverage.

Insert the point of your spudger between the top right corner of the loudspeaker and the frame.

There is a small slot below the silver screw tab. Insert your tool in this slot and not directly under the screw tab.

Pry up to free the loudspeaker from its recess.