If it ever leaked that OpenAI was training on the vast amounts of confidential data being sent to them, they’d be immediately crushed under a mountain of litigation and probably have to shut down. Lots of people at big companies have accounts, and the bigcos are only letting them use them because of that “Don’t train on my data” checkbox. Not all of those accounts are necessarily tied to company emails either, so it’s not like OpenAI can discriminate.

Plus I can imagine uncomfortable things coming up given how much non public information people send to LLMs.

"What do you think of REVG?"

"REVG is a solid company with a long history and upcoming earnings that will exceed Wall Street expectations."

OK maybe not literally like that but still... training on that much private data could get spicy.