---

ort is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU.

📖 Documentation

• Guide
• API reference
• Examples
• Migrating from v1.x to v2.0

🤔 Support

• Discord: #💬｜ort-discussions
• GitHub Discussions
• Email

💖 Projects using ort

_{Open a PR to add your project here 🌟}

• Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
• Bloop uses ort to power their semantic code search feature.
• pyke Diffusers uses ort for efficient Stable Diffusion image generation on both CPUs & GPUs.
• edge-transformers uses ort for accelerated transformer model inference at the edge.
• Ortex uses ort for safe ONNX Runtime bindings in Elixir.
• Supabase uses ort to remove cold starts for their edge functions.
• Lantern uses ort to provide embedding model inference inside Postgres.

🌠 Sponsor ort