mirror of
https://github.com/pykeio/ort
synced 2026-04-25 16:34:55 +02:00
42 lines
3.1 KiB
Markdown
42 lines
3.1 KiB
Markdown
<div align=center>
|
||
<img src="https://parcel.pyke.io/v2/cdn/assetdelivery/ortrsv2/docs/trend-banner.png" width="350px">
|
||
<hr />
|
||
<a href="https://app.codecov.io/gh/pykeio/ort" target="_blank"><img alt="Coverage Results" src="https://img.shields.io/codecov/c/gh/pykeio/ort?style=for-the-badge"></a> <a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/d/ort?style=for-the-badge"></a> <a href="https://opencollective.com/pyke-osai" target="_blank"><img alt="Open Collective backers and sponsors" src="https://img.shields.io/opencollective/all/pyke-osai?style=for-the-badge&label=sponsors"></a>
|
||
<br />
|
||
<a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/v/ort?style=for-the-badge&label=ort&logo=rust"></a> <img alt="ONNX Runtime" src="https://img.shields.io/badge/onnxruntime-v1.21.0-blue?style=for-the-badge&logo=cplusplus">
|
||
</div>
|
||
|
||
`ort` is an (unofficial) [ONNX Runtime](https://onnxruntime.ai/) 1.21 wrapper for Rust based on the now inactive [`onnxruntime-rs`](https://github.com/nbigaouette/onnxruntime-rs). ONNX Runtime accelerates ML inference and training on both CPU & GPU.
|
||
|
||
## 📖 Documentation
|
||
- [Guide](https://ort.pyke.io/)
|
||
- [API reference](https://docs.rs/ort/2.0.0-rc.9/ort/)
|
||
- [Examples](https://github.com/pykeio/ort/tree/main/examples)
|
||
- [Migrating from v1.x to v2.0](https://ort.pyke.io/migrating/v2)
|
||
|
||
## 🤔 Support
|
||
- [Discord: `#💬｜ort-discussions`](https://discord.gg/uQtsNu2xMa)
|
||
- [GitHub Discussions](https://github.com/pykeio/ort/discussions)
|
||
- [Email](mailto:contact@pyke.io)
|
||
|
||
## 💖 Projects using `ort`
|
||
<sub>[Open a PR](https://github.com/pykeio/ort/pulls) to add your project here 🌟</sub>
|
||
|
||
- **[Bloop](https://bloop.ai/)** uses `ort` to power their semantic code search feature.
|
||
- **[edge-transformers](https://github.com/npc-engine/edge-transformers)** uses `ort` for accelerated transformer model inference at the edge.
|
||
- **[Ortex](https://github.com/relaypro-open/ortex)** uses `ort` for safe ONNX Runtime bindings in Elixir.
|
||
- **[Supabase](https://supabase.com/)** uses `ort` to remove cold starts for their edge functions.
|
||
- **[Lantern](https://github.com/lanterndata/lantern_extras)** uses `ort` to provide embedding model inference inside Postgres.
|
||
- **[Magika](https://github.com/google/magika)** uses `ort` for content type detection.
|
||
- **[`sbv2-api`](https://github.com/tuna2134/sbv2-api)** is a fast implementation of Style-BERT-VITS2 text-to-speech using `ort`.
|
||
- **[Ahnlich](https://github.com/deven96/ahnlich)** uses `ort` to power their AI proxy for semantic search applications.
|
||
- **[Spacedrive](https://github.com/spacedriveapp/spacedrive)** is a cross-platform file manager with AI features powered by `ort`.
|
||
- **[BoquilaHUB](https://github.com/boquila/boquilahub/)** uses `ort` for local AI deployment in biodiversity conservation efforts.
|
||
|
||
## 🌠 Sponsor `ort`
|
||
<a href="https://opencollective.com/pyke-osai">
|
||
<img src="https://opencollective.com/pyke-osai/sponsors.svg" height="64" />
|
||
<br />
|
||
<img src="https://opencollective.com/pyke-osai/backers.svg" height="64" />
|
||
</a>
|