Trending AI tools
Ranked by recent activity, freshness, popularity and the number of independent sources that mention them.
48 tools
qvac.tether.io
Local AI SDK for building private, cross-platform AI applications
arxiv.org
Retrieval-Augmented Generation (RAG) system with graph structures for text indexing and retrieval.
sglang.io
High-performance serving framework for large language models and multimodal models.
nvidia.github.io
A Python API for defining Large Language Models and performing inference on NVIDIA GPUs.
nvidia.com
Open platform for building Physical AI with world models, datasets, and tools
github.com
A custom Swift + Metal runtime for Gemma 4 26B-A4B inference in about 2 GB of RAM on Apple Silicon Macs
haoailab.com
A unified inference and post-training framework for accelerated video generation.
docs.fluidinference.com
Frontier CoreML audio models in Swift, powered by SOTA open source.
x2v.light-ai.top
Lightweight image and video generation framework
github.com
A self-hosted webui for 30+ generative AI
github.com
Operator library for large language models implemented in the Triton Language.
k2-fsa.github.io
Speech-to-text server framework with next-gen Kaldi
github.com
AIPerf is a comprehensive benchmarking tool for generative AI models.
supervisely.com
Supervisely SDK for Python to automate, customize and extend Supervisely Platform for computer vision tasks
huggingface.co
Rust + CUDA inference engine for serving GGUF models on NVIDIA GPUs.
joligen.com
Generative AI Image and Video Toolset with GANs and Diffusion
swift.readthedocs.io
Provides Megatron-Core model definitions for state-of-the-art large models.
technotim.com
Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).
github.com
An advanced Java based inference engine for Large Language Models
gitee.com
A repository of 216 inference models for various tasks.
