Im on the fedi doin fedi things.

  • 31 Posts
  • 80 Comments
Joined 2 years ago
cake
Cake day: December 27th, 2024

help-circle



  • mesa@piefed.socialtoAsk Lemmy@lemmy.world•A more ethical AI model?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    2 days ago

    In research (as in papers) you have to use curated results or peer reviewed datasets. So its a grab bag. But some are ONLY available in acadamia. Its a strange world. The stuff AIs are doing are novel but there is many more nitch stuff for very specific reasons.

    For example my research was on using a variant on the Probabilistic Latent Semantic Analysis for specific applications (cancers/medical applications). It was trained on datasets and proven to work. It was 90percent on other peoples work and was more a proof of concept. And there was work for the multi-model version at the time.

    Datasets were all over, some public domain, some very specific medical data with permission.


  • Hey so my research was on AI. Your specifically talking about LLMs which is a very very small subset of AI. There’s a metric TON of public LLMs that are specialty made. The more recent one was a person who made a tiny one just for one off bash scripts based on his own massive 20+ years of dot files. Hugging face has some but others are just all over the internet. The training sets ate usually public sources. Creative commons or data specifically for that purpose.

    Most AI work is happening at university and open source levels.