apeforest opened a new issue #17331: [mxnet 2.0] Turning on large tensor support by default URL: https://github.com/apache/incubator-mxnet/issues/17331 ## Description Currently, MXNet only supports tensor size smaller than 2^31. To support large tensors, users need to recompile MXNet with USE_INT64_TENSOR_SIZE compiler flag set to ON. Large tensor is used often in applications such as recommendation system with sparse embedding matrix and graph neural networks such as DGL. To provide a better user experience, we would like to turn on this compiler flag by default so that MXNet binary release will support large tensors. RFC: https://lists.apache.org/thread.html/df53b8c26e9e0433378dd803baba9fec4dd922728a5ce9135dc164b3@%3Cdev.mxnet.apache.org%3E ## Current Status: Large tensor support is already implemented in MXNet backend and C API. Over 80 operators have been tested and more are being tested. There was performance degradation in a few operators such as transpose and it has been fixed (https://github.com/apache/incubator-mxnet/pull/16104) ## TODO - update MXNet development doc and FAQ for adding new operators (@ChaiBapchya ) - turning on nightly tests for large tensor (@access2rohit ) - adding end-to-end tests for a list of models (TBD) - setting the flag to ON and clean up
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
