Hi!
The first thing I would replace is the charger it self.
If that didn't work, then I would replace the battery.
Green means: battery is full or have plenty of charge
Red means: Battery is almost depleted.
So it's battery related.
An NDS battery should not be able to fit inside the Gameboy Advance SP. Can you please share a picture regarding the battery??