You can bet this training data was scraped from depraved recesses of the internet.

The fact that OpenAI allowed this training data to be used*, as well as the fact that the guard-rails they put in place were inadequate, makes them liable in my opinion.

*Obviously needs to be proven, in court, by subpoena.