ORT Ecosystem

ONNX Runtime functions as part of an ecosystem of tools and platforms to deliver an end-to-end machine learning experience. Below are tutorials for some products that work with or integrate ONNX Runtime.

Contents

• Azure Machine Learning Services
• Azure Custom Vision
• Azure SQL Edge
• Azure Synapse Analytics
• ML.NET
• NVIDIA Triton Inference Server

Azure Machine Learning Services

• Azure Container Instance: BERT
• Azure Container Instance: Facial Expression Recognition
• Azure Container Instance: MNIST
• Azure Container Instance: Image classification (Resnet)
• Azure Kubernetes Services: FER+
• Azure IoT Sedge (Intel UP2 device with OpenVINO)
• Automated Machine Learning

Azure Custom Vision

• Export a Custom Vision model to ONNX format
• Use a Custom Vision model with Windows Machine Learning

Azure SQL Edge

• ML predictions in Azure SQL Edge and Azure SQL Managed Instance

Azure Synapse Analytics

• ML predictions in Synapse SQL

ML.NET

• Automated Machine Learning
• Inference: Object detection

NVIDIA Triton Inference Server

• ONNX Runtime backend for Triton