[Bug 60032] Pool queue is full and related errors on search api

2014-03-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #10 from Simon de Haan si...@praekeltfoundation.org ---
Created https://github.com/praekelt/vumi-wikipedia/issues/40 so we'll switch
over to the new search backend. Will re-open this is the issue re-occurs.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-03-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

Simon de Haan si...@praekeltfoundation.org changed:

   What|Removed |Added

 Status|UNCONFIRMED |RESOLVED
 Resolution|--- |WONTFIX

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-02-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #9 from Nik Everett neverett+bugzi...@wikimedia.org ---
Shortly is relative.  You can try the new search backend if you like.  Let me
know if you want to set it as the default so I can see how we handle the extra
traffic.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-02-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #8 from Andre Klapper aklap...@wikimedia.org ---
Simon: Could you answer comment 7, please?

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

Yuvi Panda yuvipa...@gmail.com changed:

   What|Removed |Added

 CC||neverett+bugzilla@wikimedia
   ||.org
  Component|Search  |Search
Version|Unspecified |unspecified
Product|Wikipedia App   |MediaWiki

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #1 from Simon de Haan si...@praekeltfoundation.org ---
Created attachment 14305
  -- https://bugzilla.wikimedia.org/attachment.cgi?id=14305action=edit
Graphite screenshot showing timeouts

Screenhot of the Wikipedia Text service traffic. The yellow line is the
response time for the search API. Times shown is in UTC morning of tuesday 14th
of January.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

Andre Klapper aklap...@wikimedia.org changed:

   What|Removed |Added

   Keywords||mobile
   Priority|Unprioritized   |High
 CC||aklap...@wikimedia.org,
   ||maxsem.w...@gmail.com

--- Comment #2 from Andre Klapper aklap...@wikimedia.org ---
Thanks for taking the time to report this!

Is this a recent problem, or has this been ongoing for a while?

Bug 59993 might be related (which got fixed yesterday).

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #3 from Simon de Haan si...@praekeltfoundation.org ---
Bug 59993 looks related but these errors were of this morning, after it had
been resolved.

We see it happening fairly regularly when the Kenyan mobile network operator
does a big SMS based announcement of Wikipedia Text resulting in increased
traffic volumes.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #4 from Nik Everett neverett+bugzi...@wikimedia.org ---
Which Wikis are generating these messages?

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #5 from Simon de Haan si...@praekeltfoundation.org ---
This is from our API calls to the search API on the English Wikipedia. The API
calls are being generated from the Vumi Wikipedia app which handles the SMS 
USSD component of Wikipedia Zero.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #6 from Nik Everett neverett+bugzi...@wikimedia.org ---
I don't see any load spikes on the search backends but I do see latency spikes
on the pool counters:
https://gdash.wikimedia.org/dashboards/poolcounter/
not 60 seconds though.  My 99th percentile times are about 6 seconds.  I
suppose if you are searching for 10 items and trigger the pool counter for each
one _and_ all of them hit the 99th percentile case then you could see this.

The backends have a log of all the searches they've performed and how long they
take.  Could you send me some examples of slow searches and I can rule out that
the backends are taking forever one them?

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 60032] Pool queue is full and related errors on search api

2014-01-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=60032

--- Comment #7 from Yuri Astrakhan yu...@wikimedia.org ---
Simon, would it make sense to test the other search backend? In
http://en.wikipedia.org/w/api.php?action=helpmodules=query+search i see
srbackend parameter, which currently defaults to LuceneSearch, but it also
supports CirrusSearch. I presume that CirrusSearch is our new backend that
will become the default shortly.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l