Open source AI
Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.
36 tools
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
github.com
Lightweight LLM inference and serving framework
inspect.aisi.org.uk
A framework for large language model evaluations
aigateway.envoyproxy.io
Unified access to generative AI services built on Envoy Gateway
github.com
Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs).
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
github.com
A community-oriented 1:1 vLLM-alike engine in C++
chardesk.com
A Unicode canvas for humans and AI to create diagrams and interfaces.
llamatik.com
True on-device AI for Kotlin Multiplatform
huggingface.co
Hugging Face model for text generation (transformers).
github.com
Rust-based document conversion module for LLM processing
huggingface.co
Hugging Face Space built with Gradio.
github.com
Reversed-engineered Codex's web search for use with Claude, a local model
A collection of 65 production-tested prompts for legal work with Claude
vllm.ai
High-throughput and memory-efficient LLM serving engine
litellm.ai
Open-source AI Gateway for 100+ LLMs
pypi.org
Out-of-tree GGUF quantization plugin for vLLM
npmjs.com
Veryfront first-party extension package for ext-llm-openai
