Alternatively, replace the seal on your new style plastic oil filler cap.

This seal is thinner, and a bit harder to remove. Gently pull it out with needle nose pliers being careful not to damage the cap.

Just like the seal on the fuel cap previously pictured, this seal is somewhat hardened and has a permanent groove in it. Replacing it with a new seal will likely stop the oil staining no the valve cover around it.