grant-arm commented on a change in pull request #8922: URL: https://github.com/apache/tvm/pull/8922#discussion_r723158225
########## File path: apps/microtvm/ethosu/README.md ########## @@ -0,0 +1,78 @@ +<!--- Licensed to the Apache Software Foundation (ASF) under one --> +<!--- or more contributor license agreements. See the NOTICE file --> +<!--- distributed with this work for additional information --> +<!--- regarding copyright ownership. The ASF licenses this file --> +<!--- to you under the Apache License, Version 2.0 (the --> +<!--- "License"); you may not use this file except in compliance --> +<!--- with the License. You may obtain a copy of the License at --> + +<!--- http://www.apache.org/licenses/LICENSE-2.0 --> + +<!--- Unless required by applicable law or agreed to in writing, --> +<!--- software distributed under the License is distributed on an --> +<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY --> +<!--- KIND, either express or implied. See the License for the --> +<!--- specific language governing permissions and limitations --> +<!--- under the License. --> + + +Running TVM on bare metal Arm(R) Cortex(R)-M55 CPU and Ethos(TM)-U55 NPU +======================================================================== + +This folder contains an example of how to use TVM to run a model +on bare metal Cortex(R)-M55 CPU and Ethos(TM)-U55 NPU. + +Prerequisites +------------- +If the demo is run in the ci_cpu Docker container provided with TVM, then the following +software will already be installed. + +If the demo is not run in the ci_cpu Docker container, then you will need the following: +- Software required to build the Ethos(TM)-U driver stack and run the demo (These can all be + installed by running tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh) + - [ Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps) + - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/) + - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2) + - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org) + - [CMSIS](https://github.com/ARM-software/CMSIS_5) +- The python libraries listed in the requirements.txt of this directory + - These can be installed by running the following from the current directory: + ```bash + pip install -r ./requirements.txt + ``` + +You will also need TVM which can either be: + - Built from source (see [Install from Source](https://tvm.apache.org/docs/install/from_source.html)) + - Installed from TLCPACK (see [TLCPack](https://tlcpack.ai/)) + + +Running the demo application +---------------------------- +Type the following command to run the demo application: + +```bash +./run_demo.sh +``` + +This will: +- Download a quantized mobilenet v1 model +- Use tvmc to compile the model for Cortex(R)-M55 CPU and Ethos(TM)-U55 NPU +- Download an image of a kitten to run the model on +- Create a C header file inputs.c containing the image data as a C array +- Create a C header file outputs.c containing a C array where the output of inference will be stored +- Build the Ethos(TM)-U55 core driver +- Build the demo application +- Run the demo application on a Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software +- The application will display what the image has been classified as e.g. "The image has been classified as 'tabby'" + +Using your own image +-------------------- +The create_image.py script takes a single argument on the command line which is the path of the +image to be converted into an array of bytes for consumption by the model. + +The demo can be modified to use an image of your choice by changing the following lines in run_demo.sh + +```bash +curl -sSL https://s3.amazonaws.com/model-server/inputs/kitten.jpg > ./kitten.jpg +python3 ./convert_image.py ./build/kitten.jpg Review comment: Thanks. Changed now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
