Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-22 Thread Julius Gonsior
I'm not Adrian but we work together on this project, and that's indeed what we're doing, and the guess was correct as well. Thanks so far! On Mon 15.05 08:45, Addshore wrote: > I believe in this case data is being crunched, in hadoop, which is where > the WDQS access logs are. > And I think the

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-15 Thread Addshore
I believe in this case data is being crunched, in hadoop, which is where the WDQS access logs are. And I think the page in question that Adrian wanted to load was https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples, at a guess he is looking at how often these example

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-14 Thread Nuria Ruiz
>(i.e. implying that we need to collect the data somewhere else, and move to production for number crunching only)? I think we should probably set up a sync up so you get an overview of how this works cause this is a brief response. Data is harvested in some production machines, it is processed

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-14 Thread Adrian Bielefeldt
Hi Addshore, thanks for the advice, I can now connect. Greetings, Adrian On 05/13/2017 05:47 PM, Addshore wrote: > You should be able to connect to query.wikidata.org > via the webproxy. > > https://wikitech.wikimedia.org/wiki/HTTP_proxy > > On Sat, 13 May 2017 at

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-13 Thread Nuria Ruiz
Adrian, >At the moment I'm working on checking which entries equal one of the example queries at https://www.wikidata.org/>wiki/Wikidata:SPARQL_query_serv ice/queries/examples using this

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-12 Thread Nuria Ruiz
Adrian, Can you give us some context as to what is the project you are working on/what are you trying to do? Thanks, Nuria On Sat, May 13, 2017 at 1:12 AM, Adrian Bielefeldt < adrian.bielefe...@mailbox.tu-dresden.de> wrote: > Hello everyone, > > I wanted to ask how I have to proceed to be

[Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-12 Thread Adrian Bielefeldt
Hello everyone, I wanted to ask how I have to proceed to be able to connect to wikidata.org from a java program running on stat1002.eqiad.wmnet. I am specifically acessing the example queries for query.wikidata.org to check the logs for occurences. Greetings, Adrian