[tvm-vta] branch main updated: Use TVMArrayCopyFromBytes API to replace VTA internal function VTABufferCPUPtr (#23)

[tqchen]

This is an automated email from the ASF dual-hosted git repository.

tqchen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/tvm-vta.git


The following commit(s) were added to refs/heads/main by this push:
     new f11ca65  Use TVMArrayCopyFromBytes API to replace VTA internal 
function VTABufferCPUPtr (#23)
f11ca65 is described below

commit f11ca65fb23d37d50bc214e149f4bdd9722cb3eb
Author: Hua Jiang <h...@xilinx.com>
AuthorDate: Thu Mar 18 13:44:32 2021 -0700

    Use TVMArrayCopyFromBytes API to replace VTA internal function 
VTABufferCPUPtr (#23)
    
    Issue:
    Current vta deploy example directly use VTABufferCPUPtr function to
    access VTA memory, this method may have issue once the VTA memory need
    cache flush/invalide and such logic not leverage VTA runtime memory
    movement logic which can default handle cache related issue.
    
    Solution:
    VTA runtime already implemented memory copy logic which integrate with
    TVMArrayCopy* API and here we use TVMArrayCopyFromBytes function replace 
this
    VTABufferCPUPtr function.
---
 apps/deploy/cpp_deploy.cc | 7 +++++--
 1 file changed, 5 insertions(+), 2 deletions(-)

diff --git a/apps/deploy/cpp_deploy.cc b/apps/deploy/cpp_deploy.cc
index 3f21368..78eb53d 100644
--- a/apps/deploy/cpp_deploy.cc
+++ b/apps/deploy/cpp_deploy.cc
@@ -73,13 +73,16 @@ void graph_test(std::string img,
   tvm::runtime::PackedFunc get_input = mod.GetFunction("get_input");
   x = get_input(0);
   VTACommandHandle cmd;
-  char * vta_ptr = (char *)VTABufferCPUPtr(cmd, static_cast<void*>(x->data));
 
   int in_ndim = 4;
   int64_t in_shape[4] = {1, 3, 224, 224};
+  size_t data_len = 3 * 224 * 224 * 4;
   // load image data saved in binary
   std::ifstream data_fin(img.c_str(), std::ios::binary);
-  data_fin.read(static_cast<char*>(vta_ptr), 3 * 224 * 224 * 4);
+  char * data = (char *) malloc(data_len);
+  data_fin.read(data, data_len);
+  TVMArrayCopyFromBytes(x, data, data_len);
+  free(data);
   // get the function from the module(load parameters)
   tvm::runtime::PackedFunc load_params = mod.GetFunction("load_params");
   load_params(params_arr);