Win 11 must have some sort of contextual HDMI audio switching where it figures out exactly where you want your audio to go and then does the opposite. Because my Win 11 work laptop loves to re-enable HDMI audio and make it the active audio connection despite the fact that neither of my monitors have built in speakers.