Use a soft metal brush to clean any corrosion or dirt from the battery posts.

Then use some mild cleaner on a damp shop towel to wipe down the rest of the battery of dirt and corrosion.

If your battery is really dirty, and has lots of corrosion, consider purchasing a spray can of battery cleaner designed for heavier cleaning.