[Wikidata-bugs] [Maniphest] T282222: SPARQL query for all painting stopped returning results

2021-05-08 Thread Multichill 
Multichill closed this task as "Resolved".
Multichill assigned this task to dcausse.
Multichill added a comment.


  In T28#7069792 , 
@dcausse wrote:
  
  > My bad, the depool command I ran this morning did not work due to an error 
running the command (I ran `sudo depool wdqs1012` instead of `sudo depool` so 
it depooled the service `wdqs1012` which is nonexistent).
  >
  > For the record I ran the proper command now:
  >
  >   dcausse@wdqs1012:~$ sudo depool
  >   Depooling all services on wdqs1012.eqiad.wmnet
  >   eqiad/wdqs/wdqs/wdqs1012.eqiad.wmnet: pooled changed yes => no
  >   eqiad/wdqs/wdqs-heavy-queries/wdqs1012.eqiad.wmnet: pooled changed yes => 
no
  >   eqiad/wdqs/wdqs-ssl/wdqs1012.eqiad.wmnet: pooled changed yes => no
  >
  > This server should stop receiving traffic now.
  
  Thanks for the quick reply. I just assume that this solved it. I'll close 
this task. It can always be re-opened.

TASK DETAIL
  https://phabricator.wikimedia.org/T28

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Multichill
Cc: RKemper, dcausse, Lucas_Werkmeister_WMDE, Aklapper, Lydia_Pintscher, 
Multichill, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T280627: Investigation of remaining page_props update issue [timebox: 2 days]

2021-05-08 Thread Addshore 
Addshore added a comment.


  We can use `page.page_links_updated` to see when the page links / a refresh 
links job has last been run on the page!
  (thanks again @Krinkle)
  In PHP we can do ` WikiPage::factory(Title::newFromText('Category:Interior of 
Chapelle des Anges de Neunhoffen à Dambach (Bas-Rhin)'))->getLinksTimestamp() `
  
  If we run the job synchronously on a debug server, we can see the timestamp 
get bumped correctly.
  
>>> WikiPage::factory(Title::newFromText('Category:Interior of Chapelle des 
Anges de Neunhoffen à Dambach (Bas-Rhin)'))->getLinksTimestamp();
=> "20210505193823"
>>> (new RefreshLinksJob( Title::newFromText('Category:Interior of Chapelle 
des Anges de Neunhoffen à Dambach (Bas-Rhin)'), 
['rootJobTimestamp'=>wfTimestampNow()] ))->run();
=> true
>>> WikiPage::factory(Title::newFromText('Category:Interior of Chapelle des 
Anges de Neunhoffen à Dambach (Bas-Rhin)'))->getLinksTimestamp();
=> "20210505195510"
  
  Trying to schedule a job in the queue manually (and wait for it to execute) 
for the commons category:
  
>>> WikiPage::factory(Title::newFromText('Category:Interior of Chapelle des 
Anges de Neunhoffen à Dambach (Bas-Rhin)'))->getLinksTimestamp();
=> "20210505195510"
>>> wfTimestampNow();
=> "20210505195834"
>>> $pu->scheduleRefreshLinks( [ Title::newFromText('Category:Interior of 
Chapelle des Anges de Neunhoffen à Dambach (Bas-Rhin)') ], 
['rootJobTimestamp'=>wfTimestampNow()], 'update', 'uid:addshore' );
=> null

  
  It takes a while and at the time of writing this comment I am still waiting 
for it to execute...
  
  We could see the job enter the kafka queue:
  
addshore@stat1007:~$ kafkacat -b kafka-main1001.eqiad.wmnet -p 0 -t 
'eqiad.mediawiki.job.refreshLinks' -o -100 | grep commons.wikimedia.org | 
grep Neunhoffen

{"$schema":"/mediawiki/job/1.0.0","meta":{"uri":"https://placeholder.invalid/wiki/Special:Badtitle","request_id":"766bd8c164f5e0761ffc3a89","id":"9f61fcb8-85db-4e66-906c-155a16fddb16","dt":"2021-05-05T19:58:17Z","domain":"commons.wikimedia.org","stream":"mediawiki.job.refreshLinks"},"database":"commonswiki","type":"refreshLinks","sha1":"3a14ea46843e2f7b3b687bdf45112fbca14ac89a","params":{"rootJobTimestamp":"20210505195817","causeAction":"update","causeAgent":"uid:addshore","namespace":14,"title":"Interior_of_Chapelle_des_Anges_de_Neunhoffen_à_Dambach_(Bas-Rhin)","requestId":"766bd8c164f5e0761ffc3a89"},"mediawiki_signature":"32c72f98713180f9aefc8059c33016bb221d6950"}
  
  It took a while so at the same time I tried on testwiki:
  
>>> 
WikiPage::factory(Title::newFromText('PagePropsies'))->getLinksTimestamp();
=> "20210505124631"
>>> wfTimestampNow();
=> "20210505201007"
>>> $pu->scheduleRefreshLinks( [ Title::newFromText('PagePropsies') ], 
['rootJobTimestamp'=>wfTimestampNow()], 'update', 'uid:addshore' );
=> null
...
>>> 
WikiPage::factory(Title::newFromText('PagePropsies'))->getLinksTimestamp();
=> "20210505202436"
  
  So on testwiki this took 14 mins 30 seconds (roughly what @Jakob_WMDE 
@Michael & I saw testing).
  And a commonswiki category took TBA a time when it get executed from the 
queue
  
  --
  
  Some more relevant conversation from IRC
  
  > 9:37 PM  addshore: is your job refreshLinks or 
refreshLinksPrioritized?
  > 9:38 PM  How do I know that? I was assuming refreshLinks, but 
perhaps that's where I went wrong?
  > 9:38 PM  since those 2 have VERY different guarantees.. for 
prioritize one mean delay is a few seconds, while for regular it's 6 hours
  > 9:45 PM  kafkacat -b kafka-main1001.equad.wmnet
  > 9:45 PM  kafka-jumbo is an analytics cluster where jobs were 
replicated at some point, but ottomata is in the process of stopping the 
mirroring
  > 9:47 PM  so, with kafka-main you should see you job in 
non-prioritized non-partitioned topic. e.g kafkacat -b 
kafka-main1001.eqiad.wmnet:9092 -p 0 -t eqiad.mediawiki.job.refreshLinks
  > 9:47 PM  if you are sending it via wikibase WikiPageUpdater like 
in your paste on phab
  
  
  
  --
  
  So applying this to investigate another one of these seemingly more "randon" 
failures:
  
  - I grabbed a commons category page from 
https://www.wikidata.org/w/index.php?title=Special:Contributions=20210503061116=500=Pi+bot=all==1==
  - 2 May 18:48 the sitelink was added 
https://www.wikidata.org/w/index.php?title=Q106686114=1413255927=1413255916
  - I confirm with 
`(MediaWiki\MediaWikiServices::getInstance()->getParserCache())->get(Title::newFromText('Category:Views_from_Palacio_Municipal_(Montevideo)')->toPageRecord(),ParserOptions::newCanonical())->getProperty('wikibase_item');`
 that the property exists in the parser output
  - I confirm with 
`PageProps::getInstance()->getProperties([Title::newFromText('Category:Views_from_Palacio_Municipal_(Montevideo)')],'wikibase_item');`
 that no page_prop is currently in the db.
  - I look for

[Wikidata-bugs] [Maniphest] T282301: Move icinga-wm from #wikidata to #wikidata-feed

2021-05-08 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T282301

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Legoktm, RhinosF1, Nikki, Aklapper, 1997kB, Invadibot, Lalamarie69, 
Ramtin0071, Devnull, maantietaja, lmata, Muchiri124, Alter-paule, Beast1978, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, Legado_Shulgin, ReaperDawn, 
CucyNoiD, Nandana, Gaboe420, Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, 
Techguru.pc, Lahi, Gq86, Af420, Bsandipan, herron, GoranSMilovanovic, 
Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Lewizho99, Zppix, 
Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, 
aude, faidon, Addshore, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T282301: Move icinga-wm from #wikidata to #wikidata-feed

2021-05-08 Thread gerritbot 
gerritbot added a comment.


  Change 686697 had a related patch set uploaded (by 1997kB; author: 1997kB):
  
  [operations/puppet@production] Icinga: changing channel for Wikidata
  
  https://gerrit.wikimedia.org/r/686697

TASK DETAIL
  https://phabricator.wikimedia.org/T282301

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Legoktm, RhinosF1, Nikki, Aklapper, 1997kB, Invadibot, Ramtin0071, Devnull, 
maantietaja, lmata, Muchiri124, Akuckartz, Legado_Shulgin, ReaperDawn, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, herron, GoranSMilovanovic, 
Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, Volans, _jensen, 
rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, faidon, Addshore, 
Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T282301: Move icinga-wm from #wikidata to #wikidata-feed

2021-05-08 Thread Legoktm 
Legoktm added a comment.


  For reference 
https://gerrit.wikimedia.org/g/operations/puppet/+/7bbfebf8e5c99a90923fc200f270a8654e384ca9/modules/profile/manifests/icinga/ircbot.pp#11
 is what needs to be changed.

TASK DETAIL
  https://phabricator.wikimedia.org/T282301

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Legoktm
Cc: Legoktm, RhinosF1, Nikki, Aklapper, 1997kB, Invadibot, Ramtin0071, Devnull, 
maantietaja, lmata, Muchiri124, Akuckartz, Legado_Shulgin, ReaperDawn, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, herron, GoranSMilovanovic, 
Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, Volans, _jensen, 
rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, faidon, Addshore, 
Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T282301: Move icinga-wm from #wikidata to #wikidata-feed

2021-05-08 Thread Addshore 
Addshore added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T282301

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: RhinosF1, Nikki, Aklapper, 1997kB, Invadibot, Ramtin0071, Devnull, 
maantietaja, lmata, Muchiri124, Akuckartz, Legado_Shulgin, ReaperDawn, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, herron, GoranSMilovanovic, 
Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, Volans, _jensen, 
rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, faidon, Addshore, 
Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org