Basically go to Sound Settings —> Manage Output —> then disable all other than the headset, speaker, audio device you use.
open