If the USB cable is working, and the charging port is clean, and your speaker is still failing to hold a charge then the battery needs replacing.
+
If the USB cable is working, and the charging port is clean, and your speaker is still failing to hold a charge then the battery is defective. The battery might be broken or old and therefore needs replacing.