ekalda commented on PR #13428:
URL: https://github.com/apache/tvm/pull/13428#issuecomment-1326564893

   > > Thanks @Alexey-Yazev, looks good! :)
   > > What I gather is that the instability in the cascader comes from 
nondeterministic sorting when two Plans/Proposals have the same memory usage. 
It makes sense to me then to look at the cycle count as a differentiating 
metric. However, in the case where we have identical performance and memory 
use, I can't think of a reason why one of the Plans/Proposals should be 
advantageous of the other, so I wonder if this could be simplified by just 
removing one of the Plan or Proposal?
   > 
   > Thanks @ekalda! I agree that elements with the same metrics have no 
advantages over each other. It seems that the real problem is in calculation of 
metrics, since resulting proposal from launch to launch is obtained with the 
same metrics, but as a result different amount of memory is allocated. I'll try 
to figure it out.
   
   I suppose there can be two kinds of instability there:
   (1) Choosing a different Pproposal from launch to launch. Even if the 
Proposals have same memory and cycle counts according to the cascader, the more 
accurate memory planner can give a differing results for Proposals with 
different topology
   (2) We choose an identical Proposal every time, but the memory planner 
allocates different amount of memory for the same proposal. That sounds like a 
memory planner instability
   
   (A bit of a stab in the dark there)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to