subject:"\[Wikidata\-bugs\] \[Maniphest\] \[Commented On\] T124418\: Investigate massive increase in htmlCacheUpdate jobs in Dec\/Jan"

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2017-06-01 Thread BBlack

BBlack added a comment.
Yeah that was the plan, for XKey to help here by consolidating that down to a single HTCP / PURGE per article touched.  It's not useful for the mass-scale case (e.g. template/link references), as it doesn't scale well in that direction.  But for the case like "1 article == 7 URLs for different formats/variants/derivatives" it should work great.  The varnish module for it is deployed, but we haven't ever found/made the time to loop back to actually using it (defining standards for how to transmit it over the existing HTCP protocol or the new EventBus and pushing developers to make use of it).  I think last we talked we were going to move cache-purge traffic over to EventBus before tackling this (with kafka consumers on the cache nodes pulling the purges), but I'm not sure what the relative timelines on all related projects look like anymore.TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BBlackCc: Gilles, GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Vali.matei, Zppix, Izno, Wikidata-bugs, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2017-05-31 Thread Gilles

Gilles added a comment.
Would the use of xkey help here? It sounds like a single user action currently generates several purge requests.TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GillesCc: Gilles, GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Vali.matei, Zppix, Izno, Wikidata-bugs, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2017-05-31 Thread BBlack

BBlack added a comment.
We can get broader averages by dividing the values seen in the aggregate client status code graphs using eqiad's text cluster (the remote sites would expect fewer due to some of the bursts being more likely to be dropped by the network)

This shows the past week's average at 33.6K/s avg PURGE rate for text@eqiad: https://grafana.wikimedia.org/dashboard/db/varnish-aggregate-client-status-codes?panelId=6=1=eqiad_type=text_type=1_type=2_type=3_type=4_type=5

There are 7 active servers there the past week (cp1053 has been depooled for the past couple of weeks), so that puts us at ~4800/sec raw rate of HTCP purges.  The numbers from before (100, 400) were htmlCacheUpdate numbers though, before they're multiplied by 4 (desktop/mobile, action="" for actual HTCP purging.  So the comparable number now would be something like ~1200/sec.

It's a little blurrier than that now, though, because in the meantime we've added RB purges as well (e.g. for the mobile content sections).   I think these are 3x per article for mobile-sections, mobile-sections-lead, mobile-sections-remaining, and I'm not sure exactly how it hooks into the updating pipeline.  I would suspect that, indirectly, all 3 of those are triggered for many of the same conditions as regular wiki purges, so we may be seeing a ~7x HTCP multiplier overall for title->URLs, which would divide the 4800/s down to 685s on the htmlCacheUpdate side as perhaps a more-comparable number to the earlier 100 and 400 numbers?TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BBlackCc: GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Vali.matei, Zppix, Izno, Wikidata-bugs, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2017-05-30 Thread Krinkle

Krinkle added a comment.

In T124418#3302573, @BBlack wrote:

In T124418#1985526, @BBlack wrote:
Continuing with some stuff I was saying in IRC the other day.  At the "new normal", we're seeing something in the approximate ballpark of 400/s articles purged (which is then multiplied commonly for ?action="" and mobile and ends up more like ~1600/s actual HTCP packets), whereas the edit rate across all projects is something like 10/s.  That 400/s number used to be somewhere south of 100 before December.





In T124418#1986594, @BBlack wrote:
Regardless, the average rate of HTCP these days is normally-flat-ish (a few scary spikes aside), and is mostly throttled by the jobqueue.  The question still remains: what caused permanent, large bumps in the jobqueue htmlCacheUpdate insertion rate on ~Dec4, ~Dec11, and ~Jan20?



Just to confirm, you're saying before December 2015, the purge rate was below 100/s, and has since then been around ~ 400/s. It'd be nice to have some recent numbers as well, created using the same method as then.

Some of my own:

cp4008:~$ varnishtop -I 'ReqMethod:PURGE' -p 1
cp1055:~$ varnishtop -I 'ReqMethod:PURGE' -p 1

I found numbers typically to be between 900 and 4000 per second.TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Vali.matei, Zppix, Izno, Wikidata-bugs, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2017-05-25 Thread Krinkle

Krinkle added a comment.

In T124418#3276610, @BBlack wrote:
Not resolved, as the purge graphs can attest!


Which graphs?

This issue is about a "massive increase" observed between December 2015 and January 2016, however our graphs don't go back far enough. It seems data prior to June 2016 has been wiped.

https://grafana-admin.wikimedia.org/dashboard/db/job-queue-rate?orgId=1=htmlCacheUpdate=now-2y=now
F8180982: Screen Shot 2017-05-25 at 16.40.47.png

From a quick look through this task I also couldn't find any absolute numbers from before this point to compare against, so I don't know what we're aiming for or what we're investigating here.TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Vali.matei, Zppix, Izno, Wikidata-bugs, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-06-29 Thread gerritbot

gerritbot added a comment.
Change 294876 merged by jenkins-bot:
Improve HTMLCacheUpdate job CDN purge de-duplication

https://gerrit.wikimedia.org/r/294876TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: GWicke, ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-06-17 Thread gerritbot

gerritbot added a comment.
Change 295027 had a related patch set uploaded (by GWicke):
For discussion: Reduce purge volume by moving dependent purges to RefreshLinksJob

https://gerrit.wikimedia.org/r/295027TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: ArielGlenn, Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-06-16 Thread gerritbot

gerritbot added a comment.
Change 294876 had a related patch set uploaded (by Aaron Schulz):
Improve HTMLCacheUpdate job CDN purge de-duplication

https://gerrit.wikimedia.org/r/294876TASK DETAILhttps://phabricator.wikimedia.org/T124418EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Krinkle, Peter, EBernhardson, Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-06-01 Thread ori

ori added a comment.


  We are definitely sending duplicate purges. I added some debug logging and 
saw URLs get purged a half dozen times for the same job.

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ori
Cc: EBernhardson, Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, 
BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, 
Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-06-01 Thread ori

ori added a comment.


  Breakdown of 10,718,138 PURGEs, captured on 2016-06-01 between 18:00 and 
22:00 UTC:
  
  Top PURGE issuers by wiki
  -
  
  | Wiki | Percent |
  |  | --- |
  | svwiki   | 24.64%  |
  | itwiki   | 12.05%  |
  | enwiki   | 11.46%  |
  | frwiki   | 9.44%   |
  | enwiktionary | 8.00%   |
  | dewiki   | 4.91%   |
  | arwiki   | 4.66%   |
  | commonswiki  | 4.58%   |
  | cawiki   | 2.54%   |
  | shwiki   | 1.81%   |
  
  
  
  Top PURGE issuers by host
  -
  
  | Host   | Percent |
  | -- | --- |
  | mw1011 | 7.85%   |
  | mw1163 | 5.95%   |
  | mw1165 | 5.75%   |
  | mw1013 | 5.74%   |
  | mw1167 | 5.73%   |
  | mw1003 | 5.71%   |
  | mw1169 | 5.68%   |
  | mw1005 | 5.66%   |
  | mw1015 | 5.66%   |
  | mw1001 | 5.64%   |
  
  
  
  Top PURGE issuers by entrypoint
  ---
  
  | Entrypoint   | Percent |
  |  | --- |
  | RunJobs.php  | 91.48%  |
  | api.php  | 5.05%   |
  | index.php| 3.46%   |
  | MWScript.php | 0.01%   |
  
  
  
  Top PURGE issuers by user (anonymized)
  --
  
  | User (anonymized) | Percent |
  | - | --- |
  | 127.0.0.1 | 91.57%  |
  || 0.88%   |
  || 0.49%   |
  || 0.42%   |
  || 0.33%   |
  || 0.20%   |
  || 0.18%   |
  || 0.16%   |
  || 0.13%   |
  || 0.10%   |
  
  
  
  Top PURGE issuers by job type
  -
  
  | Job type   | Percent |
  | -- | --- |
  | htmlCacheUpdate| 78.82%  |
  | ChangeNotification | 11.98%  |
  | (not a job)| 8.52%   |
  | LocalGlobalUserPageCacheUpdateJob  | 0.42%   |
  | MassMessageJob | 0.13%   |
  | flaggedrevs_CacheUpdate| 0.10%   |
  | cirrusSearchLinksUpdatePrioritized | 0.01%   |
  | refreshLinksPrioritized| 0.01%   |
  | UpdateRepoOnMove   | 0.01%   |
  | LocalPageMoveJob   | 0.01%   |
  
  
  
  Top PURGE issuers by job + wiki pair
  
  
  | Job + wiki pair| Percent |
  | -- | --- |
  | htmlCacheUpdate / svwiki   | 23.70%  |
  | htmlCacheUpdate / itwiki   | 10.76%  |
  | htmlCacheUpdate / enwiki   | 9.77%   |
  | htmlCacheUpdate / enwiktionary | 7.97%   |
  | htmlCacheUpdate / frwiki   | 6.08%   |
  | htmlCacheUpdate / arwiki   | 4.34%   |
  | htmlCacheUpdate / commonswiki  | 3.87%   |
  | ChangeNotification / frwiki| 3.09%   |
  | ChangeNotification / dewiki| 2.81%   |
  | htmlCacheUpdate / cawiki   | 2.50%   |

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ori
Cc: Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, 
BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, 
Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-05-03 Thread BBlack

BBlack added a comment.


  I really don't think it's specifically Wikidata-related either at this point. 
 Wikidata might be a significant driver of update jobs in general, but the code 
changes driving the several large rate increases were probably generic to all 
update jobs.

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, 
BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, 
Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-05-03 Thread Lydia_Pintscher

Lydia_Pintscher added a comment.


  So when I look at 
http://graphite.wikimedia.org/render/?width=586=308&_salt=1453466175.547=MediaWiki.jobqueue.inserts_actual.htmlCacheUpdate.rate=-180days
 it recently got even worse. But Adam says 
https://grafana.wikimedia.org/dashboard/db/wikipageupdater-calls might indicate 
it is actually not Wikidata.
  Does anyone have further info? Otherwise I am not sure how to move this 
forward.

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, aaron, faidon, Joe, ori, 
BBlack, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331, 
Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-04-07 Thread BBlack

BBlack added a comment.


  F3845100: Screen Shot 2016-04-07 at 7.47.28 PM.png 


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, Denniss, aaron, faidon, 
Joe, ori, BBlack, Aklapper, Lewizho99, TerraCodes, D3r1ck01, Izno, 
Wikidata-bugs, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-03-10 Thread Addshore

Addshore added a comment.


  For easy access from the ticket the dashboard for the above patchset is at 
https://grafana.wikimedia.org/dashboard/db/wikipageupdater-calls

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Smalyshev, gerritbot, Legoktm, Addshore, daniel, hoo, aude, 
Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, Denniss, aaron, faidon, 
Joe, ori, BBlack, Aklapper, Lewizho99, TerraCodes, D3r1ck01, Izno, 
Wikidata-bugs, Mbch331, Jay8g, Dzahn



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-26 Thread gerritbot

gerritbot added a comment.


  Change 268588 merged by jenkins-bot:
  Count calls to WikiPageUpdater methods
  
  https://gerrit.wikimedia.org/r/268588

TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, 
JanZerebecki, MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, 
Aklapper, D3r1ck01, Izno, Wikidata-bugs, Mbch331, Dzahn



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-04 Thread gerritbot

gerritbot added a subscriber: gerritbot.
gerritbot added a comment.

Change 268588 had a related patch set uploaded (by Addshore):
Count calls to WikiPageUpdater methods

https://gerrit.wikimedia.org/r/268588


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, 
JanZerebecki, MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, 
Aklapper, Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-03 Thread daniel

daniel added a comment.

In https://phabricator.wikimedia.org/T124418#1993413, @Addshore wrote:

> In the last 20 minutes we had roughly 7000 edits


...and every such edit naturally causes at least one HTMLCacheUpdate on 
wikidata.org.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: daniel
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-03 Thread Addshore

Addshore added a comment.

In https://phabricator.wikimedia.org/T124418#1985370, @ori wrote:

> Distribution of (indirect) callers of `HTMLCacheUpdate::__construct` for the 
> past 20 minutes:
>
>   [fluorine:/a/mw-log] $ python /home/ori/cacheUpdateGrepper.py | dist
>  Key|Ct   (Pct)
> Histogram
>Wikibase\Repo\Api\ModifyEntity->attemptSaveEntity|6764 (27.07%) 
> ██


So Wikibase appearing at the top of the list of callers for 
HTMLCacheUpdate::__construct is to be expected.
In the last 20 minutes we had roughly 7000 edits


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-03 Thread BBlack

BBlack added a comment.

So, current thinking is that at least one of (maybe two of?) the bumps are from 
moving what used to be synchronous HTCP purge during requests to JobRunner jobs 
which should be doing the same thing.  However, assuming it's that alone (or 
even just investigating that part in isolation), we're still left with "why did 
the resulting rate of HTCP purges go up by unexpected multiples just from 
moving them to the jobqueue?".


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-03 Thread BBlack

BBlack added a comment.

Well then apparently the 10/s edits to all projects number I found before is 
complete bunk :)

http://wikipulse.herokuapp.com/ has numbers for wikidata edits that 
approximately line up with yours, and then shows Wikipedias at about double 
that rate (which might be a reasonable interpretation of the distribution 
shown).


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread BBlack

BBlack added a comment.

@ori - yeah that makes sense for the initial bump, and I think there may have 
even been a followup to do deferred purges, which may be one of the other 
multipliers, but I haven't found it yet (as in, insert an immediate job and 
also somehow insert one that fires a little later to cover race conditions).


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread BBlack

BBlack added a comment.

Another data point from the weekend: In one sample I took Saturday morning, 
when I sampled for 300s, the top site being purged was srwiki, and something 
like 98% of the purges flowing for srwiki were all Talk: pages (well, with 
Talk: as %-encoded something in Serbian).  When I visited random examples of 
the purged Talk pages, the vast majority of the ones I checked were 
content-free (as in, nobody had talked about the given article at all yet, it 
was showing the generic initial blob).  These had to be coming from a job 
obviously, the question is what kind of job wants to rip through (probably) 
every talk page on a wiki, blank ones included, for purging (or alternatively, 
it was ripping through the entire page list, and I just happened to catch it on 
a batch of Talk: ones)?  @faidon suggested a template used in those pages, but 
then what's triggering the template?  Surely not wikidata on a template for 
blank talk pages?


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread daniel

daniel added a comment.

Yea, looks like the srwiki talk pages wasn't us, but an edit to a much-used 
template.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: daniel
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread BBlack

BBlack added a comment.

Regardless, the average rate of HTCP these days is normally-flat-ish (a few 
scary spikes aside), and is mostly throttled by the jobqueue.  The question 
still remains: what caused permanent, large bumps in the jobqueue 
htmlCacheUpdate insertion rate on ~Dec4, ~Dec11, and ~Jan20?


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread Lydia_Pintscher

Lydia_Pintscher added a comment.

Thanks. I looked at one of them and the only thing in the page is the template 
for the header they have. This was also the only edit ever to that page. In the 
header template itself however there was an edit on the 30th: 
https://sr.wikipedia.org/w/index.php?title=%D0%A8%D0%B0%D0%B1%D0%BB%D0%BE%D0%BD:%D0%A1%D1%82%D1%80%D0%B0%D0%BD%D0%B8%D1%86%D0%B0_%D0%B7%D0%B0_%D1%80%D0%B0%D0%B7%D0%B3%D0%BE%D0%B2%D0%BE%D1%80=11598672=11292766
  This might be responsible for a serious number of purges.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread Lydia_Pintscher

Lydia_Pintscher added a comment.

Very strange. Wikidata use on templates on talk pages isn't impossible but I'd 
consider it pretty unlikely. H. @addshore said he'd look into some stats as 
well on our side.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-02-01 Thread daniel

daniel added a comment.

@BBlack can you give a few examples of such pages on srwiki? Were these 
non-existant talk pages, or talk pages emptied by an archival process? Maybe 
someone on srwiki messed with their talkpage archive header template? That 
would purge a *lot* of pages...


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: daniel
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread ori

ori added a comment.

Distribution of purge URLs by hostname:

  [fluorine:/a/mw-log] $ field 7 AdHocDebug.log | sed 's/\.m\./\./' | sort | 
dist | head
Key|Ct (Pct)Histogram
  en.wiktionary.org|893075 (18.66%) 
█
   fr.wikipedia.org|836392 (17.48%) 
██▋
  commons.wikimedia.org|758195 (15.84%) 
█▊
   en.wikipedia.org|435543  (9.10%) 
█▍
   it.wikipedia.org|260668  (5.45%) █▌
   zh.wikipedia.org|184594  (3.86%) █
   ar.wikipedia.org|174000  (3.64%) ███▊
  ko.wiktionary.org|148310  (3.10%) ▉
   ko.wikipedia.org| 76192  (1.59%) ▋
   th.wikipedia.org| 72084  (1.51%) ▎


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ori
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Izno, 
Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread Lydia_Pintscher

Lydia_Pintscher added a comment.

FYI: Wiktionary isn't supported yet by Wikidata so at least that part can't 
come from us.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Izno, 
Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread ori

ori added a comment.

Distribution of (indirect) callers of `HTMLCacheUpdate::__construct` for the 
past 20 minutes:

  [fluorine:/a/mw-log] $ python /home/ori/cacheUpdateGrepper.py | dist
 Key|Ct   (Pct)
Histogram
   Wikibase\Repo\Api\ModifyEntity->attemptSaveEntity|6764 (27.07%) 
██
  SubmitAction->show|6311 (25.26%) 
█▋
 ApiMain->executeActionWithErrorHandling|6291 (25.18%) 
█▌
Wikibase\Repo\Api\ModifyClaim->attemptSaveEntity| 940  (3.76%) 
█▎
ApiMain->execute| 803  (3.21%) 
███▉
MediaWiki->performAction| 579  (2.32%) 
█▊
   LoadBalancer->commitMasterChanges| 392  (1.57%) ███▉
EditAction->show| 331  (1.32%) ███▎
  ApiMain->executeAction| 197  (0.79%) ██
FormlessAction->show| 150  (0.60%) █▌
   Wikibase\Repo\Interactors\ItemMergeInteractor->mergeItems| 120  (0.48%) █▎
 Wikibase\Repo\UpdateRepo\UpdateRepoJob->run| 106  (0.42%) █


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ori
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Izno, 
Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread Legoktm

Legoktm added a subscriber: Legoktm.
Legoktm added a comment.

In https://phabricator.wikimedia.org/T124418#1985525, @BBlack wrote:

> it's not like we gained a 5x increase in human article editing rate...


If templates have been updated to use arbitrary access from Wikidata, one edit 
to an item on Wikidata can easily require updates to hundreds of pages...


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Legoktm
Cc: Legoktm, Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, 
MZMcBride, Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, 
Izno, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread BBlack

BBlack added a comment.

Well, we have 3 different stages of rate-increase in the insert graph, so it 
could well be that we have 3 independent causes to look at here.  And it's not 
necessarily true that any of them are buggy, but we need to understand what 
they're doing and why, because maybe something or other can be tweaked or tuned 
to be less wasteful.  Fundamentally nothing really changed in the past month or 
two; it's not like we gained a 5x increase in human article editing rate...


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Izno, 
Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-31 Thread BBlack

BBlack added a comment.

Continuing with some stuff I was saying in IRC the other day.  At the "new 
normal", we're seeing something in the approximate ballpark of 400/s articles 
purged (which is then multiplied commonly for ?action=history and mobile and 
ends up more like ~1600/s actual HTCP packets), whereas the edit rate across 
all projects is something like 10/s.  That 400/s number used to somewhere south 
of 100 before December.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Izno, 
Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-26 Thread Addshore

Addshore added a subscriber: Addshore.
Addshore added a comment.

As far as I can tell in Wikibase

- WikiPgaeUpdater::scheduleRefereshLinks creates RefreshLinksJobs.
- These jobs call Content::getSecondaryDataUpdates and AbstractContent which 
can create LinksUpdates
- These in turn can create HTMLCacheUpdates

Tracking the number of times wikibase calls scheduleRefreshLinks would be 
possible but might be rather pointless.
Also these are also currently logged:

  wfDebugLog( __CLASS__, __FUNCTION__ . ": scheduling refresh links for " . 
$title->getText() );

I might be missing somemore HTMLCacheUpdates in wikibase but if I am they are 
very well hidden!


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, 
Luke081515, Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Wikidata-bugs, 
Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-25 Thread JanZerebecki

JanZerebecki added a comment.

https://grafana-admin.wikimedia.org/dashboard/db/tmp-t124418


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, 
Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-25 Thread ori

ori added a comment.

In https://phabricator.wikimedia.org/T124418#1963710, @JanZerebecki wrote:

> https://grafana-admin.wikimedia.org/dashboard/db/tmp-t124418


What is that dashboard supposed to be showing? It is very hard to make sense of.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ori
Cc: daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, 
Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-25 Thread JanZerebecki

JanZerebecki added a comment.

I added it so I can look at the things related to this ticket in one graph 
(queue size, htmlCacheUpdate pop, htmlCacheUpdate insert/push, purge, scap). I 
looked at a few other stats related to Wikidata initiated purges. I found 
nothing more yet than what was already mentioned in this ticket. Found neither 
evidence for or against as opposed to my guess that these are Wikidata 
initiated purges. It seems we don't have stats for how many purges Wikidata 
creates, as similar to templates 1 edit can trigger 10 or more purges in 
rare cases with so many inclusions.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JanZerebecki
Cc: daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, 
Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T124418: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan

2016-01-25 Thread BBlack

BBlack added a comment.

Yeah but the rate increase we're looking at is actually in the htmlCacheUpdate 
job insertion rate, regardless of magnification due to 
pages-affected-per-update.  I'm surprised that we don't have any logs/data as 
to the source of those jobs.


TASK DETAIL
  https://phabricator.wikimedia.org/T124418

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BBlack
Cc: daniel, hoo, aude, Lydia_Pintscher, JanZerebecki, MZMcBride, Luke081515, 
Denniss, aaron, faidon, Joe, ori, BBlack, Aklapper, Wikidata-bugs, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

38 matches

Mail list logo