Trending AI tools
Ranked by recent activity, freshness, popularity and the number of independent sources that mention them.
36 tools
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
github.com
Lightweight LLM inference and serving framework
inspect.aisi.org.uk
A framework for large language model evaluations
aigateway.envoyproxy.io
Unified access to generative AI services built on Envoy Gateway
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
github.com
Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs).
github.com
A community-oriented 1:1 vLLM-alike engine in C++
chardesk.com
A Unicode canvas for humans and AI to create diagrams and interfaces.
llamatik.com
True on-device AI for Kotlin Multiplatform
huggingface.co
Hugging Face model for text generation (transformers).
github.com
Rust-based document conversion module for LLM processing
npmjs.com
Veryfront first-party extension package for ext-llm-openai
vllm.ai
High-throughput and memory-efficient LLM serving engine
askoracle.sh
CLI wrapper around OpenAI Responses API
pypi.org
Out-of-tree GGUF quantization plugin for vLLM
npmjs.com
Provider-agnostic LLM access runtime SDK for Sentropic.
litellm.ai
Open-source AI Gateway for 100+ LLMs
npmjs.com
Unified LLM API with automatic model discovery and provider configuration
npmjs.com
LLM environment configuration for OpenAI and Ollama
