Open source AI

Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.

3 tools

vllm.ai

A high-throughput and memory-efficient inference and serving engine for LLMs

AI ModelsOpen sourceOpen sourceAPI
2 sourcesView details

sglang.io

High-performance serving framework for large language models and multimodal models.

AI ModelsOpen sourceOpen sourceAPI
1 sourceView details

qvac.tether.io

Local AI SDK for building private, cross-platform AI applications

AI ModelsOpen sourceOpen sourceAPI
2 sourcesView details