Latest AI tools

instructor

pypi.org

Structured outputs for LLMs

Llm Cost

npmjs.com

Calculates the cost of using LLMs.

Inspect Ai

inspect.aisi.org.uk

A framework for large language model evaluations

llm

npmjs.com

Manipulate any language model from the command line.

AREX-Turbo

huggingface.co

Hugging Face model for text generation (transformers).

Mixtral-46.7B

huggingface.co

Hugging Face Space built with Gradio.

@steipete/oracle

askoracle.sh

CLI wrapper around OpenAI Responses API

vllm

vllm.ai

High-throughput and memory-efficient LLM serving engine

LiteLLM

litellm.ai

Open-source AI Gateway for 100+ LLMs

TensorSharp

tensorsharp.ai

Native .NET LLM inference engine for GGUF models

@adaline/anthropic

adaline.ai

Adaline Anthropic is an AI tool based on JavaScript.

Openai Gpt Token Counter

npmjs.com

Counts the number of OpenAI tokens in a string.

@constructive-io/llm-env

npmjs.com

LLM environment configuration for OpenAI and Ollama

Vllm Gguf Plugin

pypi.org

Out-of-tree GGUF quantization plugin for vLLM

Llama.cpp

llama.app

LLM inference in C/C++

Langchain Huggingface

docs.langchain.com

An integration package connecting Hugging Face and LangChain.