CAUTION: Seam rippers have a sharp blade; always use with caution and be aware of surroundings.

Notice how the strap is attached to the rest of the umbrella. The orientation matters.

Expose the broken stitching holding the umbrella and strap together.

Detach the two pieces by using the seam ripper to pull out the threads and rip through them.