Trending AI tools
Ranked by recent activity, freshness, popularity and the number of independent sources that mention them.
7 tools
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
LLM ToolsUnknownOpen sourceAPI
1 sourceView details
vllm.ai
High-throughput and memory-efficient LLM serving engine
LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details
litellm.ai
Open-source AI Gateway for 100+ LLMs
LLM ToolsOpen sourceOpen sourceAPI
2 sourcesView details
npmjs.com
Unified LLM API with automatic model discovery and provider configuration
LLM ToolsUnknownOpen sourceAPI
1 sourceView details
eval.16x.engineer
Evaluation and testing platform for AI models and prompts
LLM ToolsUnknownAPI
1 sourceView details
pypi.org
OpenAI LLM integration for Llama Index
LLM ToolsUnknownAPI
1 sourceView details
