On the contrary, it is misleading. By framing the debate in terms of hypothetical potential future problems, you can deliberately discount current, concrete problems. See also FUD.
Yes, this is called a "disagreement". Some people think the future problems are more important.
It's like you think "everyone knows that the ASI thing is bullshit, they're just saying it to distract from algorithmic bias and corporate/military AI worries." I assure you that people who think ASI/UFAI is a real danger do exist. (Hi.)
Jesus, can people please relearn how to debate without these weird underhanded tactics?