I don’t really mind if it’s LLMs or other “AI” models for things like image or audio processing. My question is really about whether there are any noteworthy models that have been trained off an more ethical dataset than the big ones that have been trained on massive troves of scraped data.
The more recent one was a person who made a tiny one just for one off bash scripts based on his own massive 20+ years of dot files.
That’s interesting.
The training sets ate usually public sources.
Does “public sources” mean public domain, or just like visible on the internet?












You know, that’s an interesting point and I’m not totally sure how to read into people’s dislikes…
I’m probably amongst the most vocally anti-AI people I know. I fully understand that basically all of the biggest AI models today have been built on the exploitation of other people’s (be it writers, artists, musicians, programmers, etc.) stolen intellectual labor. And that’s not just my gut feeling either, it’s been well documented at this point by higher ups at the tech companies themselves. I can’t stand the AI industry, and I would argue it’s pretty much morally indefensible as things are right now. The AI bubble and the way the technology is being used, I think, is truly terrible for society and culture.
But it’s that exact understanding–that the AI industry has been built on a foundation of theft–that makes me wonder if anyone out there is trying to do this in a less brazenly unethical way. I can’t help but be curious what all of this stuff might look like if people took a more fair approach to building datasets and training models from them. Is it even possible?
To me, part of criticizing the way things are is considering the alternatives so that we can make an informed decision on the way things should be. I’d love to know if someone out there is doing AI “the right way” and leading by example when it comes to ethical datasets.