hyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMEnglish
5·
8 months agoIirc it can run anything llama.cpp can because it just uses that under the hood.
Iirc it can run anything llama.cpp can because it just uses that under the hood.
There’s also llamafile, super simple: download and run it.
Ok. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started”