Latest AI tools

The most recent additions, newest first.

7 tools

eval.16x.engineer

Evaluation and testing platform for AI models and prompts

LLM ToolsUnknownAPI
1 sourceView details

developers.google.com

Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details

Unified LLM API with automatic model discovery and provider configuration

LLM ToolsUnknownOpen sourceAPI
1 sourceView details

OpenAI LLM integration for Llama Index

LLM ToolsUnknownAPI
1 sourceView details

vllm.ai

High-throughput and memory-efficient LLM serving engine

LLM ToolsOpen sourceOpen sourceAPI
1 sourceView details

litellm.ai

Open-source AI Gateway for 100+ LLMs

LLM ToolsOpen sourceOpen sourceAPI
2 sourcesView details

tensorsharp.ai

Native .NET LLM inference engine for GGUF models

LLM ToolsUnknownOpen sourceAPI
1 sourceView details