iPhones tend to be picky about batteries. Try installing your old battery and see if it goes away; if it does your phone dosen't like your replacement battery.

If you are still having issues, a recovery restore may help. Refer to this guide to restore the device. This will erase your data, so make sure you have a backup or don't need the data on the phone.