Skip to content
UPEEC

Local LLMs

Run open models on your own machine for privacy and offline use.

Intermediate
Comments 0

Ollama and llama.cpp (llama-cpp-python) run quantised models on CPU/GPU.

Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.

Discussion (0)

Sign in or join free to ask questions and discuss this topic.