Charles, it looks like Google authentication is broken, I was able to
reproduce the error.  I will look at it on Monday but in the meantime you
can use Mediawiki authentication.  It will create a separate user for you
and you would have to re-create your cohorts, but it would let you work if
you have urgent reports.

I would appreciate it if you filed a bug in Phabricator about the Google
auth problem.

On Saturday, January 24, 2015, "charles andrès (WMCH)" <
[email protected]> wrote:

> Hello all,
>
> From my side I cannot even connect, I receive the following message, when
> trying to log with WMCH gmail account.
>
> Internal Server Error
>
> The server encountered an internal error and was unable to complete your
> request. Either the server is overloaded or there is an error in the
> application.
> Thanks for your help
>
>
> Charles
>
>
>
> Le 23 janv. 2015 à 18:31, Dan Andreescu <[email protected]
> <javascript:_e(%7B%7D,'cvml','[email protected]');>> a écrit :
>
> Wikimetrics has been having serious connectivity problems for a few days.
> It turned out to be solvable by using some new hostnames (
> labsdb1002.eqiad.wmnet).  I fixed it just now, please retry your reports
> and let me know if anything is still wrong.
>
> On Fri, Jan 23, 2015 at 10:46 AM, Dan Andreescu <[email protected]
> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote:
>
>> Hi everyone.  I will work on this as soon as I get into the office, in
>> about an hour from now.  Yuvi suggested one thing that I wasn't aware of
>> that might make this a simple fix.
>>
>>
>> On Friday, January 23, 2015, Dan Higgins <[email protected]> wrote:
>>
>>> Hi Kevin,
>>>
>>> Sorry to be a pest but do you have any update on sorting out the
>>> Wikimetrics issues? It seems to have gotten worse since we last spoke to
>>> you with around 1 in 10 reports going through.
>>>
>>> Thanks,
>>>
>>> Dan
>>>
>>> On Tue, Jan 20, 2015 at 7:17 PM, Kevin Leduc <[email protected]>
>>> wrote:
>>>
>>>> All the developers are in transit to SF today.  Dan said he'd be in the
>>>> office this afternoon.  First dev I see I'll notify them of problems in
>>>> wikimetrics.
>>>>
>>>> On Tue, Jan 20, 2015 at 11:10 AM, Amanda Bittaker <
>>>> [email protected]> wrote:
>>>>
>>>>> Hello again gentlemen,
>>>>>
>>>>> I think Dan might have already pinged you, but just in case, I wanted
>>>>> to let you know that we are getting these failures again.  It's kind
>>>>> of crunch time for getting this data, so we're just banging our heads
>>>>> against the wall and retrying the reports until they work (1 out of 4
>>>>> times for me.)  Is there any way you all could work your magic again?
>>>>>
>>>>> Many thanks once again,
>>>>> Amanda
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Dec 10, 2014 at 4:30 PM, Kevin Leduc <[email protected]>
>>>>> wrote:
>>>>> > It's good to hear it's working again.  Don't hesitate to reach out
>>>>> to us
>>>>> > here or at [email protected] if you notice this kind
>>>>> of
>>>>> > trouble again.
>>>>> >
>>>>> > On Wed, Dec 10, 2014 at 3:37 PM, Amanda Bittaker <
>>>>> [email protected]>
>>>>> > wrote:
>>>>> >>
>>>>> >> It's working perfectly now--a thousand thank yous, Dan and Marcel.
>>>>> >>
>>>>> >> On Wed, Dec 10, 2014 at 3:24 PM, Edward Galvez <
>>>>> [email protected]>
>>>>> >> wrote:
>>>>> >>>
>>>>> >>> Thanks so much Dan and Marcel!
>>>>> >>>
>>>>> >>> -E
>>>>> >>>
>>>>> >>>
>>>>> >>> On Wed, Dec 10, 2014 at 3:08 PM, Dan Andreescu <
>>>>> [email protected]>
>>>>> >>> wrote:
>>>>> >>>>
>>>>> >>>> forgot Marcel - my fault.  Jaime & folks, in general Marcel rules
>>>>> and
>>>>> >>>> he's probably going to help you out faster / better than I can.
>>>>> >>>>
>>>>> >>>> On Wed, Dec 10, 2014 at 5:57 PM, Dan Andreescu
>>>>> >>>> <[email protected]> wrote:
>>>>> >>>>>
>>>>> >>>>> Ok, Amanda and anyone else who had problems.  Please try again.
>>>>> I
>>>>> >>>>> think I've cleared up some gunk and that might have helped
>>>>> things.  We'll be
>>>>> >>>>> looking at performance more closely soon.
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>> Steps taken, logging mostly for post-mortem purpose
>>>>> >>>>>
>>>>> >>>>> * delete from report where recurrent_parent_id is null and
>>>>> recurrent =
>>>>> >>>>> 0 and created < date('2014-12-01');
>>>>> >>>>> ** This deleted records that are not visible in the system
>>>>> anymore.
>>>>> >>>>> They are recoverable from the wikimetrics database backups but
>>>>> we don't need
>>>>> >>>>> them in the database.  These probably slowed some things down,
>>>>> in total the
>>>>> >>>>> statement deleted 1623628 rows.
>>>>> >>>>>
>>>>> >>>>> * alter table report add column old_recurrent tinyint(1); update
>>>>> report
>>>>> >>>>> set recurrent = 0, old_recurrent = 1 where user_id = 461 and
>>>>> recurrent = 1;
>>>>> >>>>> ** This disables WikimetricsBot recurrent reports, but preserves
>>>>> the
>>>>> >>>>> data so we can deal with them later.  When labs is done
>>>>> re-synchronizing, we
>>>>> >>>>> will be re-running these reports.  They feed data to Vital
>>>>> Signs, in case
>>>>> >>>>> someone's curious about what they are.
>>>>> >>>>>
>>>>> >>>>> * Stopped and rebooted the system.  The backup system seems to be
>>>>> >>>>> hanging or taking a really long time.  I'd like to take a look
>>>>> at this in
>>>>> >>>>> more depth, but my guess is the amount it's transferring has
>>>>> gone beyond
>>>>> >>>>> what we expected.
>>>>> >>>>>
>>>>> >>>>> On Wed, Dec 10, 2014 at 5:23 PM, Dan Andreescu
>>>>> >>>>> <[email protected]> wrote:
>>>>> >>>>>>
>>>>> >>>>>> We're sorry - the problems we were facing last week have
>>>>> probably
>>>>> >>>>>> festered.  I'm going to turn off some things and reset the
>>>>> system.  I'll
>>>>> >>>>>> report back.
>>>>> >>>>>>
>>>>> >>>>>> On Wed, Dec 10, 2014 at 4:47 PM, Amanda Bittaker
>>>>> >>>>>> <[email protected]> wrote:
>>>>> >>>>>>>
>>>>> >>>>>>> Oh yes, and Jaime did have me restart my browser and clear the
>>>>> cache,
>>>>> >>>>>>> but it did not help.
>>>>> >>>>>>>
>>>>> >>>>>>> Thanks again,
>>>>> >>>>>>> Amanda
>>>>> >>>>>>>
>>>>> >>>>>>> On Wed, Dec 10, 2014 at 1:45 PM, Amanda Bittaker
>>>>> >>>>>>> <[email protected]> wrote:
>>>>> >>>>>>>>
>>>>> >>>>>>>> Hello Kevin,
>>>>> >>>>>>>>
>>>>> >>>>>>>> Jaime asked me to email you about some trouble I've been
>>>>> having with
>>>>> >>>>>>>> Wikimetrics.  The whole team has been experiencing a pretty
>>>>> high rate of
>>>>> >>>>>>>> failures in both report creation and cohort uploads.  Almost
>>>>> nothing has
>>>>> >>>>>>>> gotten through for me today:  of the last 13 reports I've
>>>>> run, 3 were
>>>>> >>>>>>>> successful.  Of the failures, I would say maybe only two or
>>>>> three "pended"
>>>>> >>>>>>>> at all before becoming failures.  I've been experiencing the
>>>>> same problem
>>>>> >>>>>>>> with cohort uploads.
>>>>> >>>>>>>>
>>>>> >>>>>>>> The reports have been: Newly Registered, Edits, and Rolling
>>>>> Active
>>>>> >>>>>>>> Editor using expanded cohorts.  Please find attached an
>>>>> example of one of
>>>>> >>>>>>>> the reports.  I tried uploading cohorts using text files of
>>>>> user names and
>>>>> >>>>>>>> pasting user names from Notepad into the "Paste Usernames"
>>>>> field.  I do
>>>>> >>>>>>>> expand the cohorts every time.
>>>>> >>>>>>>>
>>>>> >>>>>>>> Do you know why the failure rate is so high, especially this
>>>>> >>>>>>>> morning, and is there a way to eliminate or mitigate this
>>>>> problem in the
>>>>> >>>>>>>> future?
>>>>> >>>>>>>>
>>>>> >>>>>>>> Many thanks for the assistance, and please do let me know if
>>>>> you
>>>>> >>>>>>>> need any more information from me on this.
>>>>> >>>>>>>>
>>>>> >>>>>>>> Best,
>>>>> >>>>>>>> Amanda
>>>>> >>>>>>>
>>>>> >>>>>>>
>>>>> >>>>>>
>>>>> >>>>>
>>>>> >>>>
>>>>> >>>
>>>>> >>>
>>>>> >>>
>>>>> >>> --
>>>>> >>> Edward Galvez
>>>>> >>> Program Evaluation Associate
>>>>> >>> Wikimedia Foundation
>>>>> >>
>>>>> >>
>>>>> >
>>>>>
>>>>
>>>>
>>>
> _______________________________________________
> Wikimetrics mailing list
> [email protected]
> <javascript:_e(%7B%7D,'cvml','[email protected]');>
> https://lists.wikimedia.org/mailman/listinfo/wikimetrics
>
>
>
_______________________________________________
Wikimetrics mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Reply via email to