Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Ariel Glenn WMF]

Thanks, that's great.

Ariel

On Tue, Sep 27, 2016 at 1:13 PM, Federico Leva (Nemo) 
wrote:

> Ok.
>
> Ariel Glenn WMF, 27/09/2016 11:47:
>
>> http://dumps.wikimedia.your.org/other/mediacounts/daily/2016/   There
>> are mediacounts here, is the download speed acceptable?
>>
>
> Oh yes, that's around 50 MiB/s. I did not see this directory linked from
> their main page so I thought they had removed it; I'll add the link from
> https://meta.wikimedia.org/wiki/Mirroring_Wikimedia_project_XML_dumps
>
> Nemo
>
___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Ariel Glenn WMF]

I got nothing back from my email so I assume that means it's not happening.

http://dumps.wikimedia.your.org/other/mediacounts/daily/2016/   There are
mediacounts here, is the download speed acceptable?

Ariel

On Tue, Sep 27, 2016 at 12:34 PM, Federico Leva (Nemo) 
wrote:

> Federico Leva (Nemo), 17/06/2016 14:59:
>
>> Ariel Glenn WMF, 17/06/2016 13:21:
>>
>>> For folks from specific institutions that suddenly no longer have
>>> access, I can forward instution names along and hope that helps.
>>>
>>
>> It would be nice to whitelist the wmflabs.org servers, which would
>> benefit from a faster server to download this stuff from.
>>
>
> Did this prove impossible? I need mediacounts data on a Labs server now,
> and it would take days do download from dumps.wikimedia.org.
>
>
> Nemo
>
> ___
> Xmldatadumps-l mailing list
> Xmldatadumps-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
>
___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Federico Leva (Nemo)]

Federico Leva (Nemo), 17/06/2016 14:59:

Ariel Glenn WMF, 17/06/2016 13:21:

For folks from specific institutions that suddenly no longer have
access, I can forward instution names along and hope that helps.


It would be nice to whitelist the wmflabs.org servers, which would
benefit from a faster server to download this stuff from.


Did this prove impossible? I need mediacounts data on a Labs server now, 
and it would take days do download from dumps.wikimedia.org.


Nemo

___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Federico Leva (Nemo)]

Ariel Glenn WMF, 17/06/2016 13:21:

For folks from specific institutions that suddenly no longer have
access, I can forward instution names along and hope that helps.


It would be nice to whitelist the wmflabs.org servers, which would 
benefit from a faster server to download this stuff from.


Nemo

___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Ariel Glenn WMF]

Dear all,

The server hosting this service has been moved to a different network, and
as such, it is now "only accessible/routable from select (still many)
members of Internet2 (U.S. universities), ESnet (U.S. national labs), and
Geant in Europe. This restricted list of places is currently limited, but
is continually growing", as email from our contact at that mirror says.
For folks from specific institutions that suddenly no longer have access, I
can forward instution names along and hope that helps.

Ariel

On Wed, May 4, 2016 at 3:33 PM, Ariel Glenn WMF  wrote:

> I'm happy to announce a new mirror for datasets other than the XML dumps.
> This mirror comes to us courtesy of the Center for Research Computing,
> University of Notre Dame, and covers everything "other" [1] which includes
> such goodies as Wikidata entity dumps, pageview counts, titles of all files
> on each wiki (daily), titles of all articles of each wiki (daily), and the
> so-called "adds-changes" dumps, among other things. You can access it at
> http://wikimedia.crc.nd.edu/other/ so please do!
>
> Ariel
>
> [1] https://dumps.wikimedia.org/other/
>
___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

Re: [Xmldatadumps-l] New mirror of 'other' datasets

[Federico Leva (Nemo)]

Ariel Glenn WMF, 04/05/2016 14:33:

You can access it at http://wikimedia.crc.nd.edu/other/ so please do!


Great news, especially because it's ten times faster than 
dumps.wikimedia.org! Finally, every time I need a dataset to quickly 
verify a sudden idea I have, the download becomes a matter of minutes 
rather than hours.


Nemo

___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l

[Xmldatadumps-l] New mirror of 'other' datasets

[Ariel Glenn WMF]

I'm happy to announce a new mirror for datasets other than the XML dumps.
This mirror comes to us courtesy of the Center for Research Computing,
University of Notre Dame, and covers everything "other" [1] which includes
such goodies as Wikidata entity dumps, pageview counts, titles of all files
on each wiki (daily), titles of all articles of each wiki (daily), and the
so-called "adds-changes" dumps, among other things. You can access it at
http://wikimedia.crc.nd.edu/other/ so please do!

Ariel

[1] https://dumps.wikimedia.org/other/
___
Xmldatadumps-l mailing list
Xmldatadumps-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l