• 0 Posts
  • 2 Comments
Joined 6 months ago
cake
Cake day: April 8th, 2026

help-circle
  • Monument@piefed.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    8 hours ago

    I wouldn’t say I ‘run’ it, but I mess around with it

    I have a base level Mac Mini I got before the price increase a few years ago, also from when models were smaller and my ambitions were less. I’ve contemplated upgrading it, but I have other things to spend my money on.

    M4 processor, 16 gb ram, 256 gb storage, and a 4tb external HDD drive (an old NAS drive).

    It’s fine. It’s mostly a docker machine, but I do throw AI tasks at it a few times a week. Mostly stuff that I just let it chew on for 5-10 minutes and come back to.

    I run openwebui, and have several models I bounce between. I mostly run Gemma4 (Google) and Granite4.2:8B (IBM).

    Editing to add: the self hosted version of all these models, via llama, just in case that was unclear.


  • I didn’t know who the woman with the misspelled first name was, so I looked her up. I was sure the joke was that she is a porn star. Nah - some kind of social media influencer that moves a lot of products through banal videos.

    In 2026, Earle claimed that the only book she may have read was Dr Suess, and other than that she has “never read a book”, despite having gained a degree in marketing.
    – Wikipedia

    Seems right for Trump.