This is a Todo item. So far, sheng has managed the datasets. I'd recommend that we review all datasets in terms of their license as well as their necessity. Some datasets are way too overkill for a unit test.
-Marco Am 12.01.2018 5:03 nachm. schrieb "Bhavin Thaker" <[email protected]>: > Ok, Marco. Do all the permitted datasets reside in S3 or is this a todo > item? > > Bhavin Thaker. > > On Fri, Jan 12, 2018 at 7:28 AM Marco de Abreu < > [email protected]> > wrote: > > > It would make sense, but the license does not permit redistribution of > the > > GroupLens-Movie dataset. We already have a few datasets in an S3 bucket > > which is backed up by a CDN, but this is only possible for entirely free > > datasets. > > > > -Marco > > > > On Fri, Jan 12, 2018 at 4:03 PM, Bhavin Thaker <[email protected]> > > wrote: > > > > > Does it make sense to cache the datasets into a (reliable) S3 bucket so > > the > > > tests to run reliably? > > > > > > Does the dataset licensing allow downloading the dataset? > > > > > > Bhavin Thaker. > > > > > > On Fri, Jan 12, 2018 at 5:52 AM kellen sunderland < > > > [email protected]> wrote: > > > > > > > Hey all, since this server seems to be back up and somewhat stable > I've > > > > create a revert PR. > > https://github.com/apache/incubator-mxnet/pull/9379 > > > > > > > > Do you all think we should leave this one disabled until it has been > > > > refactored, or should re-enable the test? > > > > > > > > On Thu, Jan 11, 2018 at 11:04 PM, Haibin Lin <[email protected]> > > wrote: > > > > > > > > > +1 for using free datasets or datasets without license issues and > > host > > > > > them on s3 buckets to reduce external dependencies. > > > > > > > > > > On 2018-01-06 15:26, kellen sunderland < > [email protected]> > > > > > wrote: > > > > > > FYI PRs are currently failing to build. The R "Matrix > > Factorization" > > > > > test > > > > > > is failing to download this dataset: http://files.grouplens.org/ > > > > > datasets/ > > > > > > movielens/ml-100k.zip . The site https://grouplens.org/ appears > > to > > > be > > > > > down. > > > > > > > > > > > > Issue here: https://github.com/apache/ > incubator-mxnet/issues/9332 > > > > > > PR to skip the test here: > > > > > > https://github.com/apache/incubator-mxnet/pull/9333 > > > > > > > > > > > > -Kellen > > > > > > > > > > > > > > > > > > > > >
