Open source AI

Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.

12 tools

arxiv.org

Retrieval-Augmented Generation (RAG) system with graph structures for text indexing and retrieval.

AI ModelsOpen sourceOpen source
1 sourceView details

sglang.io

High-performance serving framework for large language models and multimodal models.

AI ModelsOpen sourceOpen sourceAPI
1 sourceView details

nvidia.com

Open platform for building Physical AI with world models, datasets, and tools

AI ModelsOpen sourceOpen source
1 sourceView details

github.com

A custom Swift + Metal runtime for Gemma 4 26B-A4B inference in about 2 GB of RAM on Apple Silicon Macs

AI ModelsOpen sourceOpen source
1 sourceView details

docs.fluidinference.com

Frontier CoreML audio models in Swift, powered by SOTA open source.

AI ModelsOpen sourceOpen source
1 sourceView details

x2v.light-ai.top

Lightweight image and video generation framework

AI ModelsOpen sourceOpen source
1 sourceView details

k2-fsa.github.io

Speech-to-text server framework with next-gen Kaldi

AI ModelsOpen sourceOpen source
1 sourceView details

qvac.tether.io

Local AI SDK for building private, cross-platform AI applications

AI ModelsOpen sourceOpen sourceAPI
2 sourcesView details

technotim.com

Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).

AI ModelsOpen sourceOpen source
1 sourceView details

huggingface.co

Latest text-generation model by META - Meta Llama3 8b.

AI ModelsOpen sourceOpen source
1 sourceView details

huggingface.co

Hugging Face Space built with gradio.

AI ModelsOpen sourceOpen source
1 sourceView details

github.com

Fine-tune MoE LLMs bigger than your RAM

AI ModelsOpen sourceOpen source
1 sourceView details