Use the iFixit opening tool to carefully pry the battery out of the case.

After the old battery is removed replace it with a new battery facing the same direction as when the cover was opened.

For some devices, you may be able to remove the battery by flipping the DS over and letting the battery fall into your hand.