LiteRT-LM
Production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Visit tool
developers.google.com
About LiteRT-LM
LiteRT-LM is an open-source inference framework for deploying Large Language Models on edge devices. It is designed for high-performance, cross-platform execution and supports popular LLMs as well as multi-modality (Vision, Audio) and Tool Use.
Description summarised by AI from the sources listed below.
Key features
- cross-platform execution
- Cross-platform execution
- High-performance
- Hardware acceleration
- hardware acceleration
- Support for popular LLMs
- support for popular LLMs
- multi-modality support
- Multi-modality support
- Multi-modality (Vision, Audio) and Tool Use
Use cases
- On-device GenAI deployments
- Deploying language models on wearables and browser-based platforms
Pricing
Pricing model: Open source. Detailed plans are not recorded; check the official website for current prices.
Pricing from the tool's own website.
