panos@catodon.rocks to Technology@lemmy.worldEnglish · 4 days agoAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.comexternal-linkmessage-square330linkfedilinkarrow-up11.09Karrow-down18
arrow-up11.09Karrow-down1external-linkAnthropic logged net loss of over $80 billion in first half of 2026www.reuters.companos@catodon.rocks to Technology@lemmy.worldEnglish · 4 days agomessage-square330linkfedilink
minus-squarechrisashtear@lemmy.ziplinkfedilinkEnglisharrow-up3arrow-down1·4 days agoThey said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system. I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
minus-squareSeralth@piefed.seralth.comlinkfedilinkEnglisharrow-up1·3 days agoI started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata?
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up1·3 days agohttps://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher.
They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system.
I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.
I started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata?
https://sh.itjust.works/comment/28041846
Try it out and let me know if you can get higher.