How do I remove the mother board cover?

I am attempting to change the battery and need to remove the mother board cover. I've removed all screws, but the final screw is a white plug which cannot be removed, This prevents me from removing the cover. Does the cover need to be removed to replace the battery?