A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
rust mllm llama-cpp minicpm-v kokoro-tts minicpm-o spark-tts qwen3 qwen3-tts qwen3-asr voxcpm2 qwen3-8 audio8-tts qwen4 qwen3-9
-
Updated
Sep 20, 2026 - Rust