All AI tools

kserve

kserve.github.io

A standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes.

Kokoro-FastAPI

github.com

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model

TensorRT-LLM

nvidia.github.io

A Python API for defining Large Language Models and performing inference on NVIDIA GPUs.

Sentence Transformers

sbert.net

Embeddings, Retrieval, and Reranking framework for NLP tasks

Transformers Mlinter

github.com

A linter for Hugging Face Transformers model integration files.