Many compass apps work by using data from the magnetometer sensor, first you should check if your phone has this feature.

If it does and you have a magnetic case it could be interfering with the compass, try taking the phone out of it, recalibrate and reboot.

Alternatively, you could search the playstore for compass apps relying solely on GPS, such as 'gps compass navigator'.

Hope this helps