ACL Execution Provider

The integration of ACL as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores. Arm Compute Library is an open source inference engine maintained by Arm and Linaro companies.

Contents

• Build
• Usage
• Performance Tuning

Build

For build instructions, please see the build page.

Usage

C/C++

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions sf;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ACL(sf, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

When/if using onnxruntime_perf_test, use the flag -e acl