• 2 Posts
  • 28 Comments
Joined 2 months ago
cake
Cake day: June 30th, 2025

help-circle




  • How is this not a “won’t somebody please think of the children” thing?

    Yes it is terrible this has happend, but there is a way to prevent children from accessing AI and its called parenting.

    Kids shouldn’t be using AI if it harms them, kids can’t make this choice so it should be made for them. Same with alcohol, same with porn, same with the other things restricted to children.

    But that doesn’t mean responsible adults shouldn’t be able to use it, but “won’t somebody please think of the children” litigation will make that impossible.


  • I don’t care if openai lose all their money but this ruling would also effect open source AI.

    If somebody releases a AI why would they be liable for how people decide to use it? Its software and like any other program its the user’s choice on how to use it.

    If i decide to run rm / --no-preserve-root is gnu then responsible to fix it?

    AI is already very censored, and if makers become liable for what people do with their AI they will become hyper censored and performance will go down the drain.




  • Streaming services really have become the poster child of enshittifcation. My last experience with netflix:

    • Resolution seems a bit blurry
    • hmmm ok maybe it set to 720p
    • Open the settings, options are high, auto, and data saver.
    • Whatever happend to just selecting the resolution?
    • Have to search on reddit for some obscure key combination that opens the debug menu
    • shows 720p
    • opens first support ticket
    • support agent says to contact “the manufacturer of my device”, upon asking with “the manufacturer of my device” (pc) if he means intel, nvdia, or asus he just says “whoever made your device” and closes the ticket
    • open second support ticket
    • after some useless back and forth they eventually send an obscure netflix support article that full hd and above is not supported on linux
    • immediately cancel because as a paying customer you get a worse experiance then the pirates who get 4k with no issues

    And netflix is “generous” to give 720p, i think disney plus maxes out at 360p without DRM, atleast that’s what it looks like because they also use vague terms like “high” and don’t have a resolution setting.








  • Why do core counts and memory type matter when the table includes memory bandwith and tflop16?

    The H200 has HBM and alot of tensor cores which is reflected in its high stats in the table and the amd gpus don’t have cuda cores.

    I know a major deterioration is to be expected but how major? Even in extreme cases with only 10% efficiency of the total power then its still competitive against the H200 since you can get way more for the price, even if you can only use 10% of that.



  • My target model is Qwen/Qwen3-235B-A22B-FP8. Ideally its maxium context lenght of 131K but i’m willing to compromise. I find it hard to give an concrete t/s awnser, let’s put it around 50. At max load probably around 8 concurrent users, but these situations will be rare enough that oprimizing for single user is probably more worth it.

    My current setup is already: Xeon w7-3465X 128gb DDR5 2x 4090

    It gets nice enough peformance loading 32B models completely in vram, but i am skeptical that a simillar system can run a 671B at higher speeds then a snails space, i currently run vLLM because it has higher peformance with tensor parrelism then lama.cpp but i shall check out ik_lama.cpp.