Johnson9009 commented on issue #17884: URL: https://github.com/apache/tvm/issues/17884#issuecomment-2827578415
@tqchen Thank for the explanation, after reading the relevant code deeply, I found the logic about devices of inputs in Relax is different with that of Relay. In Relay, executable store the virtual device of each input, when VM initialization the real devices will be sorted and extended according to the virtual devices. So each input can get it's own device correctly and there won't any unnecessary data movement for each input. I think Relax's currently logic will crush or do more unnecessary data movement, when device's of the multiple inputs need to be different？ By the way, currently I haven't any real case that must need devices of inputs are different, found this issue just because we are migrating our Relay to Relax, and reading these code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
