Open source AI
Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.
5 tools
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
LLM ToolsUnknownOpen sourceAPI
1 sourceView details
vllm.ai
High-throughput and memory-efficient LLM serving engine
LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details
litellm.ai
Open-source AI Gateway for 100+ LLMs
LLM ToolsOpen sourceOpen sourceAPI
2 sourcesView details
npmjs.com
Unified LLM API with automatic model discovery and provider configuration
LLM ToolsUnknownOpen sourceAPI
1 sourceView details
