LLM Tools
Prompt engineering, evaluation, gateways, fine-tuning and LLM utilities.
42 tools
docs.litellm.ai
Open-source AI gateway for calling 100+ LLMs in OpenAI format
chardesk.com
A Unicode canvas for humans and AI to create diagrams and interfaces.
aigateway.envoyproxy.io
Unified access to generative AI services built on Envoy Gateway
developers.google.com
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
chitu.ai
High-performance large model inference framework
vllm.ai
High-throughput and memory-efficient LLM serving engine
npmjs.com
LangChain.js integrations for OpenAI
tensorsharp.ai
Native .NET LLM inference engine for GGUF models
github.com
Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs).
github.com
Lightweight LLM inference and serving framework
microsoft.github.io
Graph-based Retrieval-Augmented Generation (RAG) system
llamaindex.ai
Interface between LLMs and data
pypi.org
Python library for OpenAI LLM integration
huggingface.co
Hugging Face model for text generation (transformers).
inspect.aisi.org.uk
A framework for large language model evaluations.
askoracle.sh
CLI wrapper around OpenAI Responses API
npmjs.com
Veryfront first-party extension package for ext-llm-openai
eval.16x.engineer
Evaluation and testing platform for AI models and prompts
