Open source AI
Projects you can self-host, audit and extend. Licences are taken from the project's own metadata.
36 tools
arxiv.org
Retrieval-Augmented Generation (RAG) system with graph structures for text indexing and retrieval.
sglang.io
High-performance serving framework for large language models and multimodal models.
nvidia.github.io
A Python API for defining Large Language Models and performing inference on NVIDIA GPUs.
nvidia.com
Open platform for building Physical AI with world models, datasets, and tools
github.com
A custom Swift + Metal runtime for Gemma 4 26B-A4B inference in about 2 GB of RAM on Apple Silicon Macs
openr.ag
Comprehensive Retrieval-Augmented Generation platform
docs.fluidinference.com
Frontier CoreML audio models in Swift, powered by SOTA open source.
hub.docker.com
Versatile AI tool with improved language skills and wider support.
github.com
A self-hosted webui for 30+ generative AI
github.com
Operator library for large language models implemented in the Triton Language.
supervisely.com
Supervisely SDK for Python to automate, customize and extend Supervisely Platform for computer vision tasks
github.com
AIPerf is a comprehensive benchmarking tool for generative AI models.
qvac.tether.io
Local AI SDK for building private, cross-platform AI applications
huggingface.co
Rust + CUDA inference engine for serving GGUF models on NVIDIA GPUs.
joligen.com
Generative AI Image and Video Toolset with GANs and Diffusion
swift.readthedocs.io
Provides Megatron-Core model definitions for state-of-the-art large models.
technotim.com
Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).
rag.forwardforever.top
A RAG knowledge base system with Vue.js frontend, Spring Boot backend, and FastAPI LLM service.
github.com
An advanced Java based inference engine for Large Language Models
gitee.com
A repository containing 216 inference models for various tasks.
