Setup your own private LLM server
Requirements
Hardware:
Any hardware you'd like to use that has enough memory to support the model gguf file. I recommend a dedicated machine, even better would be in an isolated VM. Also, this is a se
rlmitchell.hashnode.dev3 min read