I did a cursory search on this, and couldn’t find anything, however, is there or could there be an llm trained only on text or data which is in the public domain or is otherwise openly licensed?
I did a cursory search on this, and couldn’t find anything, however, is there or could there be an llm trained only on text or data which is in the public domain or is otherwise openly licensed?
Probably, the more relevant question is what can such models do.
Once there is one, people can test. It would be interesting for sure. (I say that as mostly an LLM hater. But I’d like to see adoption of a solution that is less problematic for everyone. I think most people would agree that would be an improvement.)
Translation would be nice.
Also finding bugs. Just training it on all historic CVEs of Foss like WordPress and the Linux kernel would be a huge plus to CI pipelines.