huggingface/candle

Candle is a machine learning framework built in Rust, a programming language known for being fast and memory-efficient. Made by Hugging Face, the company behind many popular AI tools, Candle lets developers run AI models directly in Rust code rather than relying on Python, which is the more common choice for AI work. The core idea is to keep things minimal and fast. Instead of a heavy library full of features you might never use, Candle focuses on performance. It supports running computations on a GPU (a graphics card repurposed for heavy math tasks), which dramatically speeds up AI processing. The code examples in the README show how straightforward it is: you create tensors (grids of numbers that AI models work with), do math on them, and optionally shift computation from CPU to GPU by changing a single line. Candle comes with ready-to-run implementations of many well-known AI models, including text generators like LLaMA, Mistral, Gemma, and Phi, image generators like Stable Diffusion, speech recognition via Whisper, object detection via YOLO, image captioning via BLIP, and many others. Some of these even run in a web browser via WebAssembly, meaning the AI runs on the user's own device, not on a server. You would use Candle if you are building an AI-powered Rust application and want a lightweight, performant foundation instead of wrapping Python libraries. It is particularly useful for production deployments where speed matters, or for running models on edge devices. The project is written in Rust and published on crates.io, Rust's package registry.