Gpt Tokenizer

A pure JavaScript implementation of a BPE tokenizer for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

Coding & DevelopmentLLM ToolsUnknownOpen source
Visit tool

npmjs.com

About Gpt Tokenizer

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

Description summarised by AI from the sources listed below.

Key features

  • Byte Pair Encoding (BPE) algorithm
  • Support for all current OpenAI models
  • Encoding and decoding text
  • Cost estimation
  • Lazy loading

Pricing

Pricing model: Unknown — we have not been able to confirm pricing from the official website, so nothing is stated here.

Pricing summarised by AI from the sources listed below.