The US government has already been rounding people up who haven’t committed a crime. Most notably a student from Columbia college. This is a real danger.
They've also been shipping people off to a prison in El Salvador without due process and, according to them, no way to bring them back if they send the wrong person.
Avoiding travel to the US right now is a perfectly reasonable decision.