Open source AI
Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.
34 tools
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
github.com
Lightweight LLM inference and serving framework
inspect.aisi.org.uk
A framework for large language model evaluations
aigateway.envoyproxy.io
Unified access to generative AI services built on Envoy Gateway
github.com
Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs).
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
chardesk.com
A Unicode canvas for humans and AI to create diagrams and interfaces.
huggingface.co
Hugging Face model for text generation (transformers).
huggingface.co
Hugging Face Space built with Gradio.
github.com
Reversed-engineered Codex's web search for use with Claude, a local model
A collection of 65 production-tested prompts for legal work with Claude
github.com
Fine-tune MoE LLMs bigger than your RAM
vllm.ai
High-throughput and memory-efficient LLM serving engine
litellm.ai
Open-source AI Gateway for 100+ LLMs
pypi.org
Out-of-tree GGUF quantization plugin for vLLM
npmjs.com
Veryfront first-party extension package for ext-llm-openai
adaline.ai
Adaline Anthropic is an AI tool based on JavaScript.
askoracle.sh
CLI wrapper around OpenAI Responses API
