First thing I did was reset both speakers as suggested by troubleshooting guide.
This was done by holding the Volume + and the Phone button for 3 seconds. This will reset to factory settings.
After that did not work, I downloaded the JBL connect app, and upgraded the firmware on both speakers.
Now I am able to have them connect as long as I pair them both to my iPhone, then press the connect button on both speakers.