Free AI tools
Tools with a free plan, a free tier, or an open-source licence. Pricing is only shown when the tool's own website states it.
37 tools
qvac.tether.io
Local AI SDK for building private, cross-platform AI applications
sglang.io
High-performance serving framework for large language models and multimodal models.
github.com
A custom Swift + Metal runtime for Gemma 4 26B-A4B inference in about 2 GB of RAM on Apple Silicon Macs
arxiv.org
Retrieval-Augmented Generation (RAG) system with graph structures for text indexing and retrieval.
docs.fluidinference.com
Frontier CoreML audio models in Swift, powered by SOTA open source.
nvidia.com
Open platform for building Physical AI with world models, datasets, and tools
nvidia.github.io
A Python API for defining Large Language Models and performing inference on NVIDIA GPUs.
huggingface.co
Rust + CUDA inference engine for serving GGUF models on NVIDIA GPUs.
swift.readthedocs.io
Provides Megatron-Core model definitions for state-of-the-art large models.
supervisely.com
Supervisely SDK for Python to automate, customize and extend Supervisely Platform for computer vision tasks
technotim.com
Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).
joligen.com
Generative AI Image and Video Toolset with GANs and Diffusion
github.com
A self-hosted webui for 30+ generative AI
github.com
Operator library for large language models implemented in the Triton Language.
github.com
An advanced Java based inference engine for Large Language Models
npmjs.com
Typescript client for Hugging Face Inference Providers and Endpoints
openr.ag
Comprehensive Retrieval-Augmented Generation platform
huggingface.co
Hugging Face Space built with Gradio.
github.com
AIPerf is a comprehensive benchmarking tool for generative AI models.
gitee.com
A repository containing 216 inference models for various tasks.
