echuraev commented on code in PR #13393: URL: https://github.com/apache/tvm/pull/13393#discussion_r1032105732
########## docs/how_to/deploy/adreno.rst: ########## @@ -0,0 +1,336 @@ +.. Licensed to the Apache Software Foundation (ASF) under one + or more contributor license agreements. See the NOTICE file + distributed with this work for additional information + regarding copyright ownership. The ASF licenses this file + to you under the Apache License, Version 2.0 (the + "License"); you may not use this file except in compliance + with the License. You may obtain a copy of the License at + +.. http://www.apache.org/licenses/LICENSE-2.0 + +.. Unless required by applicable law or agreed to in writing, + software distributed under the License is distributed on an + "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + KIND, either express or implied. See the License for the + specific language governing permissions and limitations + under the License. + +Deploy to Adreno GPU +======================================= + +**Authors**: Daniil Barinov, Egor Churaev, Andrey Malyshev + +Introduction +------------ + +Adreno is a series of graphics processing unit (GPU) semiconductor +intellectual property cores developed by Qualcomm and used in many of +their SoCs. + +The Adreno GPU accelerates the rendering of complex geometries to +deliver high-performance graphics and a rich user experience with low +power consumption. + +This guide will demonstrate :ref:`the benefits of using textures with Adreno<advantages_of_the_textures>`, +how to :ref:`build TVM with OpenCL<building_tvm_for_adreno>` (needed by Adreno devices) and TVM RPC +enabled. It will also provide :ref:`example code<build_and_deploy_model_for_adreno>` to better understand the differences in compiling and deploying models +for Adreno devices. + +.. _advantages_of_the_textures: + +Advantages of the Textures +-------------------------- + +One of the Adreno's advantages is the clever handling of textures. At +the moment, TVM is able to benefit from this by having texture support +for Adreno. The graph below shows the Adreno A5x architecture. + +|High-level overview of the Adreno A5x architecture for OpenCL| + +*Fig. 1 High-level overview of the Adreno A5x architecture for OpenCL* + +*source:* `OpenCL Optimization and Best Practices for Qualcomm Adreno GPUs <https://dl.acm.org/doi/10.1145/3204919.3204935>`_ + +Reasons of using textures: + +- Texture processor (TP) has a dedicated L1 cache, which is read-only cache and stores data + fetched from level-2 (L2) cache for texture operations (primary + reason) + +- The handling of image boundaries is built-in. + +- Supports numerous image format and data type combinations with + support for automatic format conversions + +Overall, with textures, it is possible to achieve a significant performance boost +compared to OpenCL buffer based solutions. + +.. _building_tvm_for_adreno: + +Building TVM for Adreno +----------------------- + +This section gives instructions on how to build the Android part of TVM +with OpenCL and TVM RPC Server in order to deploy models on Adreno. + +Since the process of building TVM for Adreno is exactly the same as the +process of building TVM for Android, please refer to these instructions: +`TVM RPC +Server <https://github.com/apache/tvm/tree/main/apps/cpp_rpc>`_. + +Alternatively, to build a TVM via docker using OpenCL-Headers and set-up +with Android TVM RPC, refer to this guide: `Deploy the Pretrained Model on Android <https://tvm.apache.org/docs/how_to/deploy_models/deploy_model_on_android.html>`_. Review Comment: Phrase about `OpenCL-Headers` is not actual now. OpenCL Headers are not necessary for building TVM now and this documentation also was updated in this commit: https://github.com/apache/tvm/commit/2bb3382c89419820dab51a5a0fe4f09bb7ce6ecd ```suggestion Since there are many required packages for Android, you can use the official Docker Image to build TVM. For more information refer to this guide: `Deploy the Pretrained Model on Android <https://tvm.apache.org/docs/how_to/deploy_models/deploy_model_on_android.html>`_. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
