• 31 Posts
  • 2.45K Comments
Joined 1 year ago
cake
Cake day: March 22nd, 2024

help-circle

  • Completely depends on your laptop hardware, but generally:

    • TabbyAPI (exllamav2/exllamav3)
    • ik_llama.cpp, and its openai server
    • kobold.cpp (or kobold.cpp rocm, or croco.cpp, depends)
    • An MLX host with one of the new distillation quantizations
    • Text-gen-web-ui (slow, but supports a lot of samplers and some exotic quantizations)
    • SGLang (extremely fast for parallel calls if thats what you want).
    • Aphrodite Engine (lots of samplers, and fast at the expense of some VRAM usage).

    I use text-gen-web-ui at the moment only because TabbyAPI is a little broken with exllamav3 (which is utterly awesome for Qwen3), otherwise I’d almost always stick to TabbyAPI.

    Tell me (vaguely) what your system has, and I can be more specific.









  • IMO the AMD 7900 GPU series is in a sweet spot R/N (at least with used listings I can see).

    It’s not really in demand for AI, very fast, but not “4090+” fast to shoot the price through the roof. New but not too new. Plenty of VRAM to give it longevity. Going forward they will probably get more scarce and get swept up in tariff prices.

    So… Maybe get one of those. Or a 7800.

    Others mentions a 5700XD, which I am a huge fan of, except prices for it seem to be sky high, like way more than a 5800.




  • I mean, DLSS looks great. Can’t speak to FSR, but if it’s anywhere close that’s incredible.

    I’m speaking as a major pixel peeper. I’ve spent years pouring over vapoursynth filters, playing with scaling algorithms, being really obsessive about video scaling, calibration, proper processing bit depths, playing games at native res even if I have to run on mostly low, omitting AA because it felt like blur, modding shaders out myself… And to me, DLSS quality or balanced (depending on the situation) looks like free lunch.

    It’s sharp. Edges are good. Overprocessing artifacts are minimal. It’s not perfect, but infinitely better than naive (bilinear or bicubic) scaling to monitor res.

    My only complaint is improper implementations that ghost, but that aside, not once have I ever switched back and fourth (either at native 1440P or 4K) and decided ‘eh, DLSS’s scaling artifacts look bad’ and switched back to native unless the game is trivial to run. And one gets pretty decent AA as a cherry on top.



  • Yeah, I was trying to figure out the argument. She brings up podcasts being treated as journalism by millions when it’s not (a good point), but PP in fact did not take the interview, and her complaint ends up being:

    But whatever the reason for not doing the interview, I think it was a good thing that he didn’t do it. If only because selfishly having to sit through that Jordan Peterson interview with Pierre Polyev really tested my sanity. And I think one with Rogan might genuinely break it.

    Meanwhile, Joe Rogan and whoever he’s with (IDK I don’t watch this podcast) don’t say much of anything? Just comparisons to Kamala and kinda dumb complaints. I don’t get why people would watch that, but I don’t see how they dove in to Canadian politics at all.

    Then it’s talk of right-wing ostensibly pro Canada Twitter accounts being Trump shills. Well, duh, they’re farming the algorithm. Twitter will bury them (and their influencer income) if they bash Trump.

    Then the referendum thing, which i don’t know enough about to comment on… but seems topical I guess.