[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172327467 ## File path: python/mxnet/gluon/data/datareader.py ## @@ -0,0 +1,33 @@ +# Licensed

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284803 ## File path: python/mxnet/gluon/data/text/__init__.py ## @@ -0,0 +1,24 @@ +#

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287707 ## File path: python/mxnet/gluon/utils.py ## @@ -218,3 +220,25 @@ def download(url,

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284891 ## File path: python/mxnet/gluon/data/text/_constants.py ## @@ -0,0 +1,26 @@ +#

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172285568 ## File path: python/mxnet/gluon/data/text/base.py ## @@ -0,0 +1,89 @@ +# Licensed

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172285145 ## File path: python/mxnet/gluon/data/text/base.py ## @@ -0,0 +1,89 @@ +# Licensed

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287751 ## File path: python/mxnet/gluon/utils.py ## @@ -218,3 +220,25 @@ def download(url,

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287545 ## File path: python/mxnet/gluon/data/text/lm.py ## @@ -0,0 +1,157 @@ +# Licensed to

[GitHub] piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader

2018-03-05 Thread GitBox
piiswrong commented on a change in pull request #9986: gluon language modeling dataset and text token reader URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284551 ## File path: python/mxnet/gluon/data/datareader.py ## @@ -0,0 +1,33 @@ +# Licensed