Matrix 👉 @danny:radiantfig.fyi

  • 0 Posts
  • 12 Comments
Joined 3 months ago
cake
Cake day: August 4th, 2026

help-circle










  • Yeah, I have a fairly useable setup although it’s only accessible on my lan. I have a web server but it doesn’t host the llm as it’s not powerful enough.

    Rx7600 8gb vram GPU 5700x CPU 64gb 3600mts ram

    Hosting ornith 35b a3b iq4_xs Llama.cpp server Pi harness or llama.cpp webui Searxng web search Coding sandbox Restricted filesystem access

    Get around 40 tok / sec and it’s really useable. Not as good as Claude sonnet, but good enough for most things.


  • I host my own Lemmy instance, but only because I spent the last 3 years learning to host other stuff. It’s taken a lot of effort and time to figure it all out and get it working, and the only reason I bothered was because it interested me. Most people aren’t that interested in how it all works and just want to use a working thing.