This is morally wrong. Seriously, seriously morally wrong. It offends one's sense of humanity. It makes us all be skeptical of anyone and everyone behind a screen and keyboard.
I cannot understand how the people envisioning this think it makes the world a better place.
I sadly agree but I believe its the responsibility of our large institutions like largest tech companies/platforms to try to solve the problem of human verification and filtering AI-generated spam out, not creating new vectors for AI-generated spam to infiltrate into what are currently almost entirely social use cases.
AI is great for an encyclopedia you can talk to that is explicitly labeled as an AI knowledge search tool. AI is horrible for "let's just replace the 1:1 interactions between celebrities and thoughtleaders with their followers with fake conversations".
This product launch feels like humans invented antibiotics and Big Pharma launched a new antibiotic bioterrorism product line themselves rather than explicitly warning against the risks and attempting to mitigate them, while focusing on the good usages.
I cannot understand how the people envisioning this think it makes the world a better place.