Re: [Analytics] Resources stat1005

Hi Adrian, you should open a phab task like the following: https://phabricator.wikimedia.org/T158053 to get into the nda LDAP group (if you really need it as Nuria mentioned :). Luca 2017-08-13 0:52 GMT+02:00 Adrian Bielefeldt < adrian.bielefe...@mailbox.tu-dresden.de>: > Hi Andrew, > > thanks

Re: [Analytics] Resources stat1005

Adrian, You already have access to use the cluster, which is where you should move your processing, the link to yarn was just to show resource consumption. Thanks, Nuria On Sat, Aug 12, 2017 at 3:52 PM, Adrian Bielefeldt < adrian.bielefe...@mailbox.tu-dresden.de> wrote: > Hi Andrew, > >

Re: [Analytics] Resources stat1005

Hi Andrew, thanks for the advice. Quick follow-up question: Which kind of access/account do I need for yarn.wikimedia.org? Neither my MediaWiki-Account nor my WikiTech-Account work. Greetings, Adrian On 08/12/2017 09:58 PM, Andrew Otto wrote: > I have only 2 comments: > > 1. Please nice

Re: [Analytics] Resources stat1005

I have only 2 comments: 1. Please nice any heavy long running local processes, so that others can continue to use the machine. 2. For large data, consider using the Hadoop cluster! I think you are getting your data from the webrequest logs in Hadoop

Re: [Analytics] Resources stat1005

I will soon start the two Wikistats jobs which run for about several weeks each month, They might use two cores each, one for unzip, one for perl. How many cores are there anyway? Cheers, Erik From: Analytics [mailto:analytics-boun...@lists.wikimedia.org] On Behalf Of Adrian