[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368396978 The network is not complex, and it's only including 5 fully connected hidden layer. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368396075 I implement the Iter as followed  I mainly implement KBIter similar to LibSVMIter. I implement KBIter and KBParser, then mend SparsePrefetcherIter, SparseBatchLoader, and i add some base data structure in dmlc-core as followed   This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368396075 I implement the Iter as followed  I mainly implement KBIter similar to LibSVMIter. I implement KBIter and KBParser, then mend SparsePrefetcherIter, SparseBatchLoader, and i add some base data structure as followed   This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368395245 The test of every step's consuming has been done as followed:  loading data is mainly most consuming time step, that is 90 percent of one batch update time. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368394556 My data format of one line is including dense and sparse as followed  The first column is label, the second is dense(csv), and the the third is sparse(libsvm). This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368394300 My data format is including sparse  This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368394300 My data format is including sparse  This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly?
moveforever commented on issue #9819: Sometime MXDataIter load data quickly, sometime it load data slowly? URL: https://github.com/apache/incubator-mxnet/issues/9819#issuecomment-368192685 @sxjscience ? i implement dataiter supporting multi input inheritated MXDataIter. The people of best kowning workflow of MXNet loading data Module to tune performance is mxnet developer. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
