All AI tools
Every tool discovered, verified and categorised by the platform.
9 tools
qvac.tether.io
Local AI SDK for building private, cross-platform AI applications
sglang.io
High-performance serving framework for large language models and multimodal models.
github.com
A custom Swift + Metal runtime for Gemma 4 26B-A4B inference in about 2 GB of RAM on Apple Silicon Macs
arxiv.org
Retrieval-Augmented Generation (RAG) system with graph structures for text indexing and retrieval.
huggingface.co
Rust + CUDA inference engine for serving GGUF models on NVIDIA GPUs.
swift.readthedocs.io
Provides Megatron-Core model definitions for state-of-the-art large models.
technotim.com
Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).
github.com
An advanced Java based inference engine for Large Language Models
gitee.com
A repository of 216 inference models for various tasks.
