Open source AI

Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.

9 tools

llama.app

LLM inference in C/C++

LLM ToolsOpen sourceOpen source

1 sourceView details

developers.google.com

Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

LLM ToolsOpen sourceOpen sourceAPI

1 sourceView details

aigateway.envoyproxy.io

Unified access to generative AI services built on Envoy Gateway

LLM ToolsOpen sourceOpen source

1 sourceView details

github.com

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs).

LLM ToolsOpen sourceOpen source

1 sourceView details

chardesk.com

A Unicode canvas for humans and AI to create diagrams and interfaces.

LLM ToolsOpen sourceOpen source

1 sourceView details

github.com

A collection of 65 production-tested prompts for legal work with Claude

LLM ToolsOpen sourceOpen source

1 sourceView details

vllm.ai

High-throughput and memory-efficient LLM serving engine

LLM ToolsOpen sourceOpen sourceAPI

1 sourceView details

litellm.ai

Open-source AI Gateway for 100+ LLMs

LLM ToolsOpen sourceOpen sourceAPI

2 sourcesView details

docs.langchain.com

An integration package connecting Hugging Face and LangChain.

LLM ToolsOpen sourceOpen source

3 sourcesView details