An open-source LLM app development platform with an intuitive interface that streamlines AI workflows, model management, and production deployment.
TypeScriptOtheractive
LLM LLM Applications
Search all LLM projects →35 projectsLLM Applications
- 54%active
- 32%steady
- 14%slowing
LLM Applications
Reference: awesome-llm-apps
PythonApache License 2.0active
Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.
PythonApache License 2.0steady
DSPy: The framework for programming—not prompting—foundation models.
PythonMIT Licenseactive
Open Source LLM Engineering Platform 🪢 Tracing, Evaluations, Prompt Management, Evaluations and Playground.
TypeScriptOtheractive
A Python/C#/Java library from Microsoft that supports prompt templating, function chaining, vectorized memory, and intelligent planning.
C#MIT Licenseactive
Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
PythonApache License 2.0active
An open-source library for evaluating task performance of language models and prompts.
PythonOthersteady
A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)
C++Apache License 2.0active
Use ChatGPT On Wechat via wechaty
TypeScriptslowing
Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.
TypeScriptMIT Licenseactive
Build your own conversational search engine using less than 500 lines of code by LeptonAI.
TypeScriptApache License 2.0steadyarchived
An open-source framework to evaluate, test and monitor ML and LLM-powered systems.
Jupyter NotebookApache License 2.0active
Locally running websearch using LLM chains
GoApache License 2.0steadyarchived
a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!
SvelteApache License 2.0steadyarchived
An open-source GPU cluster manager for running LLMs
PythonApache License 2.0active
Open source AutoML tool for RAG. Optimize the RAG answer quality automatically. From generation evaluation datset to deploying optimized RAG pipeline.
TypeScriptOtheractive
A small Python library for using language models to perform NLP tasks.
PythonApache License 2.0steady
AdalFlow: The library to build&auto-optimize LLM applications.
PythonMIT Licenseactive
Harness LLMs with Multi-Agent Programming
PythonMIT Licenseactive
An open-source LLM app for building multi-agent LLMs applications in an easy and lazy way, supports model deployment and fine-tuning.
PythonApache License 2.0active
Open-source LLM observability, prompt evaulation, and prompt optimzation platform.
TypeScriptApache License 2.0active
Open-source Python tools for testing and evaluating models, vector DBs, and prompts.
PythonApache License 2.0steady
Seamlessly integrate LLMs as Python functions
PythonMIT Licensesteady
Open Source Hybrid AI Search Engine, Instantly Get Accurate Answers from the Internet, Bookmarks, Notes, and Docs. Support One-Click Deployment
TypeScriptMIT Licenseactive
WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
TypeScriptMIT Licenseactive
Comprehensive set of tools for working with local LLMs for various tasks.
Pythonslowing
Open-source CLI security scanner for agentic workflows. Scans your workflow’s source code, detects vulnerabilities, and generates an interactive visualization along with a detailed security report. Supports LangGraph, CrewAI, n8n, OpenAI Agents, and more.
PythonApache License 2.0steady
Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.
PythonApache License 2.0active
A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.
PythonGNU General Public License v3.0slowing
Simple API for deploying any RAG or LLM that you want adding plugins.
PythonMIT Licenseslowing
An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.
SvelteApache License 2.0steady
Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.
ShellMIT Licenseslowing
Make your LLM agent and chat with it simple and fast!
PythonApache License 2.0steady
simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.
JavaScriptMIT Licenseactive