Inference of Facebook's LLaMA model in pure C/C++ so it can run locally on a CPU.
C++MIT Licenseactive
4 projectsArtificial Intelligence › ChatGPT
Inference of Facebook's LLaMA model in pure C/C++ so it can run locally on a CPU.
C++MIT Licenseactive
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
TypeScriptOtheractive
Privacy-focused AI inference server with OpenAI API compatibility, zero cloud dependencies, and local model processing.
RustApache License 2.0active
Privacy proxy for LLM APIs that masks PII and secrets before they reach cloud providers. Self-hosted, OpenAI-compatible, and restores original data in responses.
TypeScriptApache License 2.0active