Why is my battery not holding a charge?

I think it is the battery but when I put the headphones in the case then pull them out when the earbuds are not fully charged it won't turn. So I'm stuck charging the case if I want to use my earbuds even when both battery are full.