[Wikidata-bugs] [Maniphest] T307718: Migrate wikidata-analysis tool away from Stretch Grid Engine

[Addshore]

Addshore closed this task as "Resolved".
Addshore added a comment.


  Webservice looks like it may have already been on k8s?
  It definitely is now though:)
  
  F35105270: image.png 
  
  So I think that wraps this up!

TASK DETAIL
  https://phabricator.wikimedia.org/T307718

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, Lucas_Werkmeister_WMDE, Aklapper, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T307718: Migrate wikidata-analysis tool away from Stretch Grid Engine

[Addshore]

Addshore claimed this task.
Addshore added a comment.


  Just disabled the cron
  F35105268: image.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T307718

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, Lucas_Werkmeister_WMDE, Aklapper, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T307718: Migrate wikidata-analysis tool away from Stretch Grid Engine

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE created this task.
Lucas_Werkmeister_WMDE added a project: Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  Reportedly we want to keep using this tool 
 (toolsadmin 
), so we need to 
migrate it off of the legacy infrastructure.
  
  As far as I can tell, this tool uses the Stretch Grid Engine in two ways:
  
  - For the lighttpd webservice. I think this is just providing static web 
serving (I don’t see any `.php` files in `public_html/`), so this should be 
trivial to move to Kubernetes.
  - For the `maplatest-cron` cronjob, which runs five times a day. It has also 
failed to produce output since February 2021, as far as I can tell, so I think 
it’s at least questionable whether this is actually needed.
  
  name=~tools.wikidata-analysis/maplatest-cron.out
Running for latest

***   Wikidata Toolkit: ToolkitAnalyzer  ***
*** Data Directory Layout **
* Target storage directory : data/ *
* Downloaded dump locations: data/dumpfiles/json-/-all.json.gz *
* Processor output location: data//  *

Targeting latest dump: 20220427
Error: Data directory specified does not exist.
Error: Data directory specified does not exist.
Cleaning up empty public_html dirs

TASK DETAIL
  https://phabricator.wikimedia.org/T307718

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Addshore, Lucas_Werkmeister_WMDE, Aklapper, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org