I coalesce the vapors of human experience into a viable and meaningful comprehension.…

Formerly https://lemm.ee/u/geekwithsoul; alt is at https://lemmy.world/u/geekwithsoul

  • 0 Posts
  • 7 Comments
Joined 1 year ago
cake
Cake day: June 21st, 2025

help-circle
  • Disagree strongly about all this being inevitable. And not taking a stand against mega-billion dollar companies enabling this is ridiculous, IMO.

    To take your example of the photo industry, we have laws on the books against certain types of photography being either produced, in your possession, or sharing them. Why should GenAI be any different? If a server delivers you a nude image of someone without their consent and/or underaged, the company that owns that server has produced and distributed something actionable.

    And sure, local models can and do exist, but hell, most people aren’t even willing to get off Windows and move to Linux - you think many folks are going to be paying for the hardware and developing/training their own local models? The same rules that keep beastiality/CP/etc (mostly) off the net can be used against them if they try and share them. And most importantly, by doing that, society says that kind of thing is not acceptable. Traffic laws aren’t enforced 100% of the time, but can you imagine what kind of hellscape it would be if we didn’t have them at all?


  • I think the thing that you’re missing is a teenager is generally not going to be able to make a photoshop that’s believable, whereas they can currently generate totally believable pictures and even video using GenAI. Sure, some will realize it must be AI, but some won’t and no matter what, the theoretical 13yo is going to feel just as threatened and violated.

    The problem is that no regulation is ever going to work on the endpoints, so things like age-verification are pointless and an invasion of privacy. The only thing that will work is going after the companies, their training data, and the infrastructure. There will be stuff out of the country’s jurisdiction, but we already have laws handling that type of thing, and while imperfect, they do draw a line. And yes, local models will still be a thing, but you don’t enforce against the creation, you enforce against the trafficking of such images. If some modern day teenage da Vinci painted a near-photorealistic nude of a classmate, he can do that. But the minute he shares it, it comes under existing laws in sharing such images. Why should GenAI be treated any differently?


  • There are no guardrails that will work with AI, full stop. They keep talking about that in the hopes of avoiding regulation but the truth is that the models and the stolen data they’re trained on will keep popping up nudes as long as that was in the training data. So you either ban GenAI at scale (great for humanity but oops the economy) or you ban the use of training on data that includes nudes.

    But the issue is not a better version of a photoshop of “some celebrity”, kids are doing this to each other because it’s so easy to do. Do you want to explain to a thirteen year old how it’s not a big deal if someone is passing around realistic nudes of them that were AI-generated? Will people always be dicks to each other? Of course, but that doesn’t mean as a society we should allow it to be so readily available that kids who aren’t even old enough to drive should have one-click access to it.

    Personally I’d prefer if every data center disappeared tomorrow and AI companies were held liable for the theft they’ve orchestrated and the harm they’ve done. Short of that though, something needs to be done and it’s likely going to have to be regulations on the training data because their “guardrails” are shit and always will be. This isn’t inevitable and the only way to stop it is to start telling the AI companies, “No, you can’t do that.” If some clanker wanker in his parents basement wants to make an AI girlfriend, that’s on him.