If you still have this problem, just grab a debit card or any kind of card as long as the card is strong and will not rip/break on you, and just tuck the leather into the "slot"

I personally do not like to damage the device by adding glue because adding things can ruin the headset itself so I would rather have to re tuck and have the headset good as new than use other items and ruin it.