This patch series provides ARMv7 compatibility across the GP AI stacks
in meta-arago by addressing architecture-specific build issues.
Changes include:
- tensorflow-lite: Add ARMv7 support with fp16 optimizations for v2.20.0,
including XNNPACK delegate fixes and EMBEDDING_LOOKUP kernel enhancements
- onnx: Fix 32-bit ARM build failure caused by LONG_BIT mismatch
- arm-compute-library: Exclude AARCH64-specific KleiDiAI kernels from
ARMv7 builds to prevent compilation errors
- onnxruntime: NA
- nnstreamer: NA
Benchmarking results on am335x-evm:
- TFLite
- XNNPACK ON
- https://gist.github.com/PrathamTI/2cce31defc047515d3bb205b86ec954d
- XNNPACK OFF
- https://gist.github.com/PrathamTI/734ea8c0aa8b4fb57125cc5a7e032c00
- arm-compute-library
- https://gist.github.com/PrathamTI/fd78e2e8b259e88e33c4efb926aafbad
- nnstreamer
- https://gist.github.com/PrathamTI/46529497cf4b3852619f5f3bf84908a7
- onnxruntime
- https://gist.github.com/PrathamTI/1e7150592d8e1fc6b167548ea62f0904
Link to v1:
- https://patchwork.yoctoproject.org/project/arago/list/?series=44947
Pratham Deshmukh (3):
tensorflow-lite: Add armv7 support with fp16 optimizations for v2.20.0
onnx: fix 32-bit ARM build failure due to LONG_BIT mismatch
arm-compute-library: Exclude AARCH64 KleiDiAI kernels from armv7
...RCH64-specific-KleiDiAI-kernels-from.patch | 37 ++
.../arm-compute-library_52.7.0.bb | 1 +
.../recipes-framework/onnx/onnx_1.18.0.bb | 2 +-
...delegate-target-operations-for-armv7.patch | 38 ++
...pe-infrastructure-to-TensorFlow-Lite.patch | 552 ++++++++++++++++++
...6-support-to-EMBEDDING_LOOKUP-kernel.patch | 447 ++++++++++++++
.../tensorflow-lite/tensorflow-lite_2.20.0.bb | 3 +
7 files changed, 1079 insertions(+), 1 deletion(-)
create mode 100644
meta-arago-extras/recipes-devtools/arm-compute-library/arm-compute-library/0009-cmake-Exclude-AARCH64-specific-KleiDiAI-kernels-from.patch
create mode 100644
meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0004-Disable-xnnpack-delegate-target-operations-for-armv7.patch
create mode 100644
meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0005-Add-fp16-data-type-infrastructure-to-TensorFlow-Lite.patch
create mode 100644
meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0006-Add-float16-support-to-EMBEDDING_LOOKUP-kernel.patch
--
2.34.1
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#17439):
https://lists.yoctoproject.org/g/meta-arago/message/17439
Mute This Topic: https://lists.yoctoproject.org/mt/118514535/21656
Group Owner: [email protected]
Unsubscribe: https://lists.yoctoproject.org/g/meta-arago/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
