tqchen commented on issue #5060: [uTVM][Runtime] Deprecate uTVM Standalone 
Runtime
URL: https://github.com/apache/incubator-tvm/issues/5060#issuecomment-603374417
 
 
   The workspace memory could have a different strategy. The way it works is 
that we create a different arena for workspace, along with a counter.
   
   - When a memory is allocated, we allocate memory from the arena, and add the 
counter
   - When a memory is de-allocated, we decrease the counter
   - When the counter goes to zero, we free all the memory.
   
   This will work because all workspace memory are temporal. It also guarantees 
a constant time allocation
   
   As a generalization. If most memory allocation happens in a RAII style 
lifecycle. e.g. everything de-allocates onces we exit a scope, then the counter 
based strategy(per scope) is should work pretty well.
   
   I am not fixated about the arena allocator, but would like to challenge us 
to think a bit how much simpler can we make the allocation strategy looks like 
given what we know about the workload. Of course, we could certainly bring 
sub-allocator strategies that are more complicated, or fallback to libraries 
when needed
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to