[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-25 Thread RKemper
RKemper added a comment.


  Note: Puppet is still disabled on `wdqs2008` while the reload runs. It 
occurred to me that I'm not sure if puppet actually **needs** to be disabled 
during data reloads or if that's just a precaution we've historically taken - 
any insight here @Gehel?

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Zbyszko, Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T274751: Upgrade firmware on wdqs1009

2021-02-25 Thread RKemper
RKemper added a comment.


  @Cmjohnson The data reload is complete on `wdqs1009`, so the host can now 
have its firmware upgraded and be rebooted at its convenience. Note this is an 
internal wdqs test host, so there is no public-facing service for us to worry 
about.
  
  Feel free to proceed when convenient for you - just shoot me a ping or drop a 
line in #wikimedia-discovery, but no need to schedule a formal window.

TASK DETAIL
  https://phabricator.wikimedia.org/T274751

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cmjohnson, RKemper
Cc: Jclark-ctr, RKemper, Cmjohnson, Gehel, MoritzMuehlenhoff, Ramtin0071, 
MPhamWMF, Devnull, lmata, Muchiri124, CBogen, Akuckartz, Legado_Shulgin, 
Nandana, Namenlos314, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, 
merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Southparkfan, faidon, Addshore, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-25 Thread RKemper
RKemper added a comment.


  Downtimed `wdqs2008` until `2021-03-04 21:56:59`

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Zbyszko, Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-08 Thread RKemper
RKemper added a comment.


  Still waiting for the latest dumps to be downloaded (few more hours), then 
need to reboot WDQS hosts as part of https://phabricator.wikimedia.org/T274213, 
then can do the actual data-reload

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T266495: Create Debian Package for Flink

2021-02-08 Thread RKemper
RKemper added a comment.


  (See https://phabricator.wikimedia.org/T273097#6805355 for why this ticket 
has been closed)

TASK DETAIL
  https://phabricator.wikimedia.org/T266495

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, elukey, EBernhardson, Aklapper, Gehel, Mstyles, Ottomata, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273636: Blazegraph journal for wcqs is too big

2021-02-08 Thread RKemper
RKemper added a comment.


  Updated:
  
  [X] https://commons.wikimedia.org/wiki/Commons:SPARQL_query_service#Updates
  [X] 
https://commons.wikimedia.org/wiki/Commons:Village_pump#Unscheduled_maintenance%3A_Wikimedia_Commons_Query_Service
  [X] WikiData ML mailing list (note: A community member pointed out that 
sending an e-mail to a Commons mailing list would have made more sense, which 
is a great point. We'll do that in the future)

TASK DETAIL
  https://phabricator.wikimedia.org/T273636

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: MPhamWMF, RKemper, Aklapper, dcausse, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273636: Blazegraph journal for wcqs is too big

2021-02-08 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  WCQS is back in service; updating the notification channels right now and 
will comment back here after

TASK DETAIL
  https://phabricator.wikimedia.org/T273636

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: MPhamWMF, RKemper, Aklapper, dcausse, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273636: Blazegraph journal for wcqs is too big

2021-02-08 Thread RKemper
RKemper claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T273636

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: MPhamWMF, RKemper, Aklapper, dcausse, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-05 Thread RKemper
RKemper added a comment.


  `sudo cookbook sre.wdqs.data-reload wdqs1009.eqiad.wmnet 
--reuse-downloaded-dump --reload-data wikidata --skolemize --reason 'T267927: 
Reload wikidata jnl from fresh dumps' --task-id T267927 ` is failing with:
  
- OUTPUT of 'test -f /srv/wdq...test-all.ttl.bz2' -

- OUTPUT of 'test -f /srv/wdq...-lexemes.ttl.bz2' -

- OUTPUT of 'dump_size=`du /s...avail+$db_size))' -

- OUTPUT of 'rm -rf /srv/wdqs...d -- --skolemize' -
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - 
%msg%n
22:46:13.025 [main] ERROR org.wikidata.query.rdf.tool.Munge - Fatal error 
munging RDF
org.openrdf.rio.RDFParseException: Expected an RDF value here, found '{' 
[line 2]
at 
org.openrdf.rio.helpers.RDFParserHelper.reportFatalError(RDFParserHelper.java:440)
at 
org.openrdf.rio.helpers.RDFParserBase.reportFatalError(RDFParserBase.java:685)
at 
org.openrdf.rio.turtle.TurtleParser.reportFatalError(TurtleParser.java:1405)
at org.openrdf.rio.turtle.TurtleParser.parseValue(TurtleParser.java:662)
at 
org.openrdf.rio.turtle.TurtleParser.parsePredicate(TurtleParser.java:505)
at 
org.openrdf.rio.turtle.TurtleParser.parsePredicateObjectList(TurtleParser.java:420)
at 
org.openrdf.rio.turtle.TurtleParser.parseImplicitBlank(TurtleParser.java:613)
at 
org.openrdf.rio.turtle.TurtleParser.parseTriples(TurtleParser.java:394)
at 
org.openrdf.rio.turtle.TurtleParser.parseStatement(TurtleParser.java:259)
at org.openrdf.rio.turtle.TurtleParser.parse(TurtleParser.java:214)
at org.wikidata.query.rdf.tool.Munge.run(Munge.java:105)
at org.wikidata.query.rdf.tool.Munge.main(Munge.java:59)
22:46:13.024 
[org.wikidata.query.rdf.tool.rdf.AsyncRDFHandler$RDFActionsReplayer] INFO  
org.wikidata.query.rdf.tool.Munge - Switching to 
/srv/wdqs/munged/wikidump-1.ttl.gz

  
  `sudo cookbook sre.wdqs.data-reload wdqs1010.eqiad.wmnet 
--reuse-downloaded-dump --reload-data wikidata --reason 'T267927: Reload 
wikidata jnl from fresh dumps' --task-id T267927`is failing with:
  
ryankemper@cumin1001:~$ sudo cookbook sre.wdqs.data-reload 
wdqs1010.eqiad.wmnet --reuse-downloaded-dump --reload-data wikidata --reason 
'T267927: Reload wikidata jnl from fresh dumps' --task-id T267927
START - Cookbook sre.wdqs.data-reload
- OUTPUT of 'test -f /srv/wdq...test-all.ttl.bz2' -

PASS 
||
 100% (1/1) [00:00<00:00,  1.92hosts/s]
FAIL |  
  |   0% (0/1) 
[00:00= 100.0% threshold) for command: 'test -f 
/srv/wdq...test-all.ttl.bz2'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully 
executed all commands.
Detected dump (/srv/wdqs/latest-all.ttl.bz2). Skipping download
- OUTPUT of 'test -f /srv/wdq...-lexemes.ttl.bz2' -

PASS 
||
 100% (1/1) [00:00<00:00,  2.44hosts/s]
FAIL |  
  |   0% (0/1) 
[00:00= 100.0% threshold) for command: 'test -f 
/srv/wdq...-lexemes.ttl.bz2'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully 
executed all commands.
Detected dump (/srv/wdqs/latest-lexemes.ttl.bz2). Skipping download
checking available disk space
- OUTPUT of 'dump_size=`du /s...avail+$db_size))' -

PASS 
||
 100% (1/1) [00:00<00:00,  2.45hosts/s]
FAIL |  
  |   0% (0/1) 
[00:00= 100.0% threshold) for command: 
'dump_size=`du /s...avail+$db_size))'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully 
executed all commands.
Running munger for main database and then lexeme
munging /srv/wdqs/munged (skolemizaton: False)
- OUTPUT of 'rm -rf /srv/wdqs.../wdqs/munged -- ' -
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - 
%msg%n
22:50:03.137 [main] ERROR org.wikidata.query.rdf.tool.Munge - Fatal error 
munging RDF
org.openrdf.rio.RDFParseException: Expected an RDF value here, found '{' 
[line 2]
at 
org.openrdf.rio.helpers.RDFParserHelper.reportFatalError(RDFPar

[Wikidata-bugs] [Maniphest] T266470: Expose wdqs1009 to wdqs users and gather feedback

2021-02-04 Thread RKemper
RKemper added a comment.


  TODO from IRC meeting with bblack/gehel: create a DNS entry (CNAME to 
dyna.wm.o), another set of entries in backend.yaml map, create another minisite 
(with the appropriate configuration)

TASK DETAIL
  https://phabricator.wikimedia.org/T266470

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, Lea_Lacroix_WMDE, dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273636: Blazegraph journal for wcqs is too big

2021-02-03 Thread RKemper
RKemper added a comment.


  Notified WikiData mailing list and also posted here: 
https://commons.wikimedia.org/wiki/Commons:SPARQL_query_service#Updates

TASK DETAIL
  https://phabricator.wikimedia.org/T273636

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273636: Blazegraph journal for wcqs is too big

2021-02-03 Thread RKemper
RKemper added a comment.


  `wcqs-beta-01.eqiad.wmflabs` is running low on disk space due to its 
blazegraph journal dataset size. In order to free up space we will need to take 
the service down, delete the journal and re-import from the latest dump. 
Service interruption will begin at Feb 4 18:30 UTC and continue until the data 
reload is complete.

TASK DETAIL
  https://phabricator.wikimedia.org/T273636

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273097: Create Flink Base Image

2021-02-03 Thread RKemper
RKemper added a comment.


  @akosiaris Is your concern with the idea of using a`flink` base image 
solution mainly just centered around the inefficiency/inconvenience of needing 
SRE to merge any flink version upgrades? Since we have an embedded SRE on 
search (me) and to a lesser extent Guillaume, I think it wouldn't be too much 
of a problem. In general having our dependencies managed by a docker image will 
make it easier for us to be explicit about what version we're using, and it 
seems like the default docker-y way of doing things. Is there a technical 
reason why a base image might not be a good idea?

TASK DETAIL
  https://phabricator.wikimedia.org/T273097

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, Aklapper, Gehel, akosiaris, Mstyles, MPhamWMF, CBogen, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-03 Thread RKemper
RKemper added a comment.


  We'll want to reload these this Friday, because the latest dumps should be 
available thursday evening.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

2021-02-01 Thread RKemper
RKemper claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T267927

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T266470: Expose wdqs1009 to wdqs users and gather feedback

2021-02-01 Thread RKemper
RKemper triaged this task as "Medium" priority.
RKemper claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T266470

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, Lea_Lacroix_WMDE, dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T273097: Create Flink Base Image

2021-02-01 Thread RKemper
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T273097

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: dcausse, Aklapper, Gehel, akosiaris, Mstyles, MPhamWMF, CBogen, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T271851: Clean up gui from the wdqs deploy repo and puppet

2021-01-21 Thread RKemper
RKemper added a comment.


  In T271851#6765207 <https://phabricator.wikimedia.org/T271851#6765207>, 
@Ladsgroup wrote:
  
  > @RKemper I'm so sorry it was buggy, the cleanest way forward here is to 
deploy wcqs using microsites and we can easily drop everything from puppet 
then. Does that make sense?
  
  Makes sense! I'm working on getting the wcqs microsite working and then we 
can revert my earlier revert and nuke the remaining gui file at the same time. 
I'll tag you on the patch(es) when ready.

TASK DETAIL
  https://phabricator.wikimedia.org/T271851

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup, RKemper
Cc: Addshore, dcausse, RKemper, Gehel, Aklapper, Ladsgroup, MPhamWMF, 
Hazizibinmahdi, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, 
LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

2021-01-20 Thread RKemper
RKemper added a comment.


  Post deploy check:
  
  `wdqs-updater.service` is now running without the `--import-async` flag as 
expected:
  
  `ExecStart=/bin/bash /srv/deployment/wdqs/wdqs/runUpdate.sh -n wdq -- --kafka 
kafka-main1001.eqiad.wmnet:9092,kafka-main1002.eqiad.wmnet:9092,kafka-main1003.eqiad.wmnet:9092
 --consumer wdqs1003 -b 700 --clusters eqiad,codfw --constraints --oldRevision 
3 --entityNamespaces 0,120,146`
  
  I think now we just wait and see if the issue in the ticket description pops 
up again.

TASK DETAIL
  https://phabricator.wikimedia.org/T267175

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Skim, Strepon, Multichill, Zbyszko, RKemper, Epidosis, dcausse, 
Tagishsimon, Lydia_Pintscher, CBogen, Z_thomas, agray, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, M2k_dewiki, MPhamWMF, Alter-paule, Beast1978, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

2021-01-19 Thread RKemper
RKemper added a comment.


  (Puppet run successful on wdqs nodes following deploy)

TASK DETAIL
  https://phabricator.wikimedia.org/T267175

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Skim, Strepon, Multichill, Zbyszko, RKemper, Epidosis, dcausse, 
Tagishsimon, Lydia_Pintscher, CBogen, Z_thomas, agray, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, M2k_dewiki, MPhamWMF, Alter-paule, Beast1978, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

2021-01-19 Thread RKemper
RKemper moved this task from In Progress to To Be Deployed on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  Deploying https://gerrit.wikimedia.org/r/656833 now

TASK DETAIL
  https://phabricator.wikimedia.org/T267175

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Skim, Strepon, Multichill, Zbyszko, RKemper, Epidosis, dcausse, 
Tagishsimon, Lydia_Pintscher, CBogen, Z_thomas, agray, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, M2k_dewiki, MPhamWMF, Alter-paule, Beast1978, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T270476: Linked Data Fragments endpoint returns IllegalStateException

2021-01-12 Thread RKemper
RKemper added a comment.


  I responded to Maciej (the one who reported the problem originally) on the 
mailing list. Looks like we accidentally gave them the wrong ticket number 
earlier: https://lists.wikimedia.org/pipermail/wikidata/2021-January/014451.html
  
  Looks like this ticket hasn't been triaged/assigned yet

TASK DETAIL
  https://phabricator.wikimedia.org/T270476

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T271412: Investigate an alert on statements volume in Blazegraph instances

2021-01-11 Thread RKemper
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T271412

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T244753: Migrate WDQS to Debian Buster

2020-12-17 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  This is all done. No issues currently.

TASK DETAIL
  https://phabricator.wikimedia.org/T244753

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, MoritzMuehlenhoff, Gehel, Ramtin0071, MPhamWMF, Devnull, lmata, 
Muchiri124, CBogen, Akuckartz, Legado_Shulgin, Nandana, Namenlos314, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, 
Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T270236: wdqs1005: disk space critical on /srv/

2020-12-16 Thread RKemper
RKemper triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T270236

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, RKemper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T270236: wdqs1005: disk space critical on /srv/

2020-12-16 Thread RKemper
RKemper added a project: Wikidata-Query-Service.
Restricted Application added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T270236

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, RKemper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on select wdqs instances

2020-12-14 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  The above two patches (really one patch with a followup patch to fix a typo) 
seem to have fixed the problem. I'll want to circle back to verify we're 
getting all the metrics we expect, but at a minimum the prometheus blazegraph 
exporter for wdqs-categories is working again.

TASK DETAIL
  https://phabricator.wikimedia.org/T269872

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, Aklapper, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

2020-12-14 Thread RKemper
RKemper added a comment.


  Restarting `prometheus-blazegraph-exporter-wdqs-blazegraph.service` after 
switching from Counter to Gauge now shows the correct `blazegraph_lastupdated` 
metric when running `curl localhost:9193` (9193 is the port for 
wdqs-blazegraph).
  
  Still waiting to see if the downstream consumers of this metric are working 
properly now, but that *should* have fixed it.

TASK DETAIL
  https://phabricator.wikimedia.org/T269204

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, dcausse, Aklapper, lmata, Alter-paule, Beast1978, CBogen, 
Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
herron, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, 
EBjune, merbst, LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on select wdqs instances

2020-12-10 Thread RKemper
RKemper renamed this task from "wdqs-categories prometheus exporter failing on 
wdqs1011" to "wdqs-categories prometheus exporter failing on select wdqs 
instances".
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T269872

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on wdqs1011

2020-12-10 Thread RKemper
RKemper created this task.
RKemper added projects: Wikidata-Query-Service, Discovery-Search (Current work).
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
ryankemper@wdqs1011:~$ sudo systemctl status 
prometheus-blazegraph-exporter-wdqs-categories.service
● prometheus-blazegraph-exporter-wdqs-categories.service - Prometheus 
Blazegraph Exporter (wdqs-categories)
   Loaded: loaded 
(/lib/systemd/system/prometheus-blazegraph-exporter-wdqs-categories.service; 
enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Thu 2020-12-10 17:10:22 UTC; 
12min ago
  Process: 21672 ExecStart=/usr/local/bin/prometheus-blazegraph-exporter 
--listen :9194 --port 9990 (code=exited, status=1/FAILURE)
 Main PID: 21672 (code=exited, status=1/FAILURE)

Dec 10 17:10:22 wdqs1011 systemd[1]: 
prometheus-blazegraph-exporter-wdqs-categories.service: Service 
RestartSec=100ms expired, scheduling restart.
Dec 10 17:10:22 wdqs1011 systemd[1]: 
prometheus-blazegraph-exporter-wdqs-categories.service: Scheduled restart job, 
restart counter is at 5.
Dec 10 17:10:22 wdqs1011 systemd[1]: Stopped Prometheus Blazegraph Exporter 
(wdqs-categories).
Dec 10 17:10:22 wdqs1011 systemd[1]: 
prometheus-blazegraph-exporter-wdqs-categories.service: Start request repeated 
too quickly.
Dec 10 17:10:22 wdqs1011 systemd[1]: 
prometheus-blazegraph-exporter-wdqs-categories.service: Failed with result 
'exit-code'.
Dec 10 17:10:22 wdqs1011 systemd[1]: Failed to start Prometheus Blazegraph 
Exporter (wdqs-categories).
  
  This exporter relies on `localhost:9194`, which is refusing connections 
currently. It seems like the actual categories service on the "other side" is 
failing:
  
ryankemper@wdqs1011:~$ sudo systemctl status wdqs-categories.service
● wdqs-categories.service - Query Service - Blazegraph - wdqs-categories
   Loaded: loaded (/lib/systemd/system/wdqs-categories.service; static; 
vendor preset: enabled)
   Active: active (running) since Thu 2020-12-10 17:04:48 UTC; 19min ago
 Main PID: 18590 (java)
Tasks: 114 (limit: 1)
   Memory: 2.3G
   CGroup: /system.slice/wdqs-categories.service
   └─18590 java -server -XX:+UseG1GC -Xmx8g 
-Xloggc:/var/log/wdqs/wdqs-categories_jvm_gc.%p-%t.log -XX:+PrintGCDetails 
-XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintAdaptiveSizePolicy -X

Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]:   
SELECT ( COUNT( * ) AS ?count ) { ?s ?p ?o }
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: } 
UNION {
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]:   
SELECT * WHERE { <http://www.wikidata.org> schema:dateModified ?y }
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: } 
} req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, 
req.queryString=format=json=+prefix+schema%3A+%3Cht
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: 
com.bigdata.rdf.sail.webapp.DatasetNotFoundException: namespace=wdq
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: at 
com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.(BigdataSail.java:2071)
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: Wrapped by: 
java.lang.RuntimeException: 
com.bigdata.rdf.sail.webapp.DatasetNotFoundException: namespace=wdq
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: at 
com.bigdata.rdf.sail.BigdataSail.getReadOnlyConnection(BigdataSail.java:1506)
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: Wrapped by: 
java.util.concurrent.ExecutionException: java.lang.RuntimeException: 
com.bigdata.rdf.sail.webapp.DatasetNotFoundException: namespace=wdq
Dec 10 17:10:21 wdqs1011 wdqs-categories[18590]: at 
java.util.concurrent.FutureTask.report(FutureTask.java:122)

TASK DETAIL
  https://phabricator.wikimedia.org/T269872

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269693: mediawiki_job_wikidata-updateQueryServiceLag failing

2020-12-09 Thread RKemper
RKemper added a comment.


  Job lives here: 
https://github.com/wikimedia/mediawiki-extensions-Wikidata.org/blob/60c5f96ebf424b792077bb7c6b533a68702e7aea/maintenance/updateQueryServiceLag.php#L70
  
  I have a patch open here: 
https://gerrit.wikimedia.org/r/c/operations/puppet/+/646888 that addresses a 
different manifestation of this same issue with `blazegraph_lastupdated`. 
Currently it looks like we'll want to switch `blazegraph_lastupdated` from a 
`Counter` to a `Gauge`, but I need to figure out if changing the metric type 
will break the behavior in `updateQueryServiceLag.php` or elsewhere.

TASK DETAIL
  https://phabricator.wikimedia.org/T269693

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Dzahn, RLazarus, RKemper, Aklapper, Ramtin0071, Devnull, lmata, Muchiri124, 
CBogen, Akuckartz, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, 
Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269693: mediawiki_job_wikidata-updateQueryServiceLag failing

2020-12-09 Thread RKemper
RKemper added a comment.


  There's some context in the description of 
https://phabricator.wikimedia.org/T269204 that mentions that the counter metric 
`blazegraph_lastupdated` is now `blazegraph_lastupdated_total`, so if 
the`mediawiki_job_wikidata-updateQueryServiceLag`  job has to do with that 
metric then the re-image is likely the source of the problem

TASK DETAIL
  https://phabricator.wikimedia.org/T269693

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Dzahn, RLazarus, RKemper, Aklapper, Ramtin0071, Devnull, lmata, Muchiri124, 
CBogen, Akuckartz, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, 
Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259588: Reload categories once 1.36.0-wmf.3 is running on all groups

2020-12-08 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  All categories reloads/transfers are complete

TASK DETAIL
  https://phabricator.wikimedia.org/T259588

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, Aklapper, Wilmanbeno, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, jayvdb, 
Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

2020-12-07 Thread RKemper
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T269302

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Lydia_Pintscher, Vojtech.dostal, Dipsacus_fullonum, Aklapper, Muchiri124, 
CBogen, Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, 
PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Taiwania_Justo, Scott_WUaS, Jonas, Xmlizer, Susannaanas, Ixocactus, Wong128hk, 
Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, aude, 
Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, Ricordisamoa, Wesalius, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269331: wdqs.data-reload cookbook fails when switching

2020-12-03 Thread RKemper
RKemper added a comment.


  Here's something interesting: On a server where I've recently run the 
`data-reload` for `categories` (`wdqs1006` in this case), the categories 
journal looks like so:
  
  `-rw-rw-r-- 1 blazegraph blazegraph  21G Dec  3 07:19 categories.jnl`
  
  Yet on a wdqs instance where I have not yet run the reload (`wdqs2007` for 
example), it looks like this:
  
  `-rw-rw-r-- 1 blazegraph blazegraph  23G Dec  3 07:32 categories.jnl`
  
  So the freshly reloaded instances have only a 21G `categories.jnl`, whereas 
the not-freshly-reloaded instances have a 23G `categories.jnl` - a full 2GB 
bigger. I'm not sure if that indicates a problem somewhere, but naively I would 
not expect the journal to be smaller after reloading.

TASK DETAIL
  https://phabricator.wikimedia.org/T269331

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259588: Reload categories once 1.36.0-wmf.3 is running on all groups

2020-12-03 Thread RKemper
RKemper added a comment.


  Note: https://phabricator.wikimedia.org/T269331 was created due to an 
exception encountered every time we run the data reload cookbook. The exception 
only occurs at the very end, so it might not indicate an actual problem

TASK DETAIL
  https://phabricator.wikimedia.org/T259588

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, Aklapper, Wilmanbeno, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, jayvdb, 
Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

2020-12-03 Thread RKemper
RKemper claimed this task.
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T269204

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, herron, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, Volans, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

2020-12-03 Thread RKemper
RKemper added a comment.


  `sudo -i wmf-auto-reimage-host --conftool -p T269204 wdqs2004.codfw.wmnet` is 
an example of how to reimage hosts (run from cumin)

TASK DETAIL
  https://phabricator.wikimedia.org/T269204

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, herron, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, Volans, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259588: Reload categories once 1.36.0-wmf.3 is running on all groups

2020-11-30 Thread RKemper
RKemper moved this task from Ready for Development to In Progress on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  Will start on this today

TASK DETAIL
  https://phabricator.wikimedia.org/T259588

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, dcausse, Aklapper, Wilmanbeno, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, jayvdb, 
Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T255399: Prepare wdqs1009 to run the streaming updater

2020-11-16 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  We need to do another reload but not under this ticket

TASK DETAIL
  https://phabricator.wikimedia.org/T255399

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, Ottomata, Aklapper, dcausse, Alter-paule, Beast1978, CBogen, Un1tY, 
Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T265868: wdqs2002 out of disk space

2020-10-19 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  This should be resolved now; the transfer is complete and the node matches 
others in the fleet.
  
ryankemper@wdqs2002:~$ ls -lh /srv/wdqs/wikidata.jnl
-rw-rw-r-- 1 blazegraph blazegraph 806G Oct 19 22:57 /srv/wdqs/wikidata.jnl
  
  vs
  
ryankemper@wdqs2004:~$ ls -lh /srv/wdqs/wikidata.jnl
-rw-rw-r-- 1 blazegraph blazegraph 806G Oct 19 22:57 /srv/wdqs/wikidata.jnl

TASK DETAIL
  https://phabricator.wikimedia.org/T265868

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel, RKemper
Cc: RKemper, dcausse, Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262009: Add an entry in the WDQS Runbook on killer queries

2020-10-14 Thread RKemper
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T262009

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, RKemper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258835: Update Commons query service favicon

2020-09-24 Thread RKemper
RKemper moved this task from Needs review to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  Applied this today

TASK DETAIL
  https://phabricator.wikimedia.org/T258835

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, RKemper
Cc: RKemper, Jarekt, CBogen, Gehel, Aklapper, Multichill, Akuckartz, 
darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86, Ramsey-WMF, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Poyekhali, _jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Jonas, 
Xmlizer, Ixocactus, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, Isarra, Steinsplitter, Mbch331, 
Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261204: Wikidata lexeme ttl dumps should be in a "predictable" folder

2020-09-12 Thread RKemper
RKemper moved this task from Needs review to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  We'll want to monitor across the next week to verify all looks good.

TASK DETAIL
  https://phabricator.wikimedia.org/T261204

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, ArielGlenn, dcausse, Alter-paule, jannee_e, Beast1978, CBogen, 
Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, CucyNoiD, 
Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Lunewa, QZanden, EBjune, 
merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, gnosygnu, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261204: Wikidata lexeme ttl dumps should be in a "predictable" folder

2020-09-12 Thread RKemper
RKemper added a comment.


dumpsgen  58563  0.0  0.0   4276   700 ?Ss   20:50   0:00 /bin/sh 
-c python3 /srv/deployment/dumps/dumps/xmldumps-backup/generatemiscdumps.py 
--configfile /etc/dumps/confs/addschanges.conf --dumptype incrdumps --quiet
dumpsgen  58565  0.0  0.0  57976 18128 ?S20:50   0:03 python3 
/srv/deployment/dumps/dumps/xmldumps-backup/generatemiscdumps.py --configfile 
/etc/dumps/confs/addschanges.conf --dumptype incrdumps --quiet
dumpsgen  63246  3.9  0.0 456952 64728 ?S21:08   2:51 
/usr/bin/php7.2 /srv/mediawiki/multiversion/MWScript.php dumpTextPass.php 
--wiki=commonswiki 
--stub=gzip:/mnt/dumpsdata/otherdumps/incr/commonswiki/20200912/commonswiki-20200912-stubs-meta-hist-incr.xml.gz
 --quiet --spawn=/usr/bin/php7.2 
--output=bzip2:/mnt/dumpsdata/otherdumps/incr/commonswiki/20200912/commonswiki-20200912-pages-meta-hist-incr.xml.bz2
dumpsgen  63248  0.0  0.0   4276   740 ?S21:08   0:00 sh -c 
bzip2 > 
'/mnt/dumpsdata/otherdumps/incr/commonswiki/20200912/commonswiki-20200912-pages-meta-hist-incr.xml.bz2'
dumpsgen  63249  2.9  0.0  13604  8492 ?S21:08   2:08 bzip2
dumpsgen  63250  0.0  0.0   4276   736 ?S21:08   0:00 sh -c 
'/usr/bin/php7.2' 
'/srv/mediawiki/php-1.36.0-wmf.8/../multiversion/MWScript.php' 'fetchText.php' 
'--wiki' 'commonswiki'
dumpsgen  63251 18.5  0.0 453812 63484 ?S21:08  13:24 
/usr/bin/php7.2 /srv/mediawiki/php-1.36.0-wmf.8/../multiversion/MWScript.php 
fetchText.php --wiki commonswiki
  
  Dumps before merging. Nothing specific to `wikidata` is running so I just 
merged it now.

TASK DETAIL
  https://phabricator.wikimedia.org/T261204

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, ArielGlenn, dcausse, Alter-paule, jannee_e, Beast1978, CBogen, 
Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, CucyNoiD, 
Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Lunewa, QZanden, EBjune, 
merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, gnosygnu, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258739: wdqs admins should have access to nginx logs, jstack on wdqs machines

2020-07-27 Thread RKemper
RKemper added a comment.


  We discussed this during this week's SRE meeting and resolved to enable full 
root access for wdqs admins, rather than granularly expanding access one file 
at a time. This also lines up better with how we currently manage 
Elasticsearch, where admins have root access.

TASK DETAIL
  https://phabricator.wikimedia.org/T258739

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Joe, RKemper
Cc: herron, RKemper, CDanis, dcausse, Aklapper, Dzahn, lmata, Alter-paule, 
Beast1978, CBogen, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, 
joker88john, Legado_Shulgin, CucyNoiD, Nandana, Namenlos314, jijiki, 
Klaas_Z4us_V, Gaboe420, Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, 
Techguru.pc, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Lewizho99, Zppix, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, mark, JanZerebecki, faidon, Mbch331, Rxy, Jay8g, Krenair, 
fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258739: wdqs admins should have access to nginx logs, jstack on wdqs machines

2020-07-23 Thread RKemper
RKemper added a project: Sustainability (Incident Followup).

TASK DETAIL
  https://phabricator.wikimedia.org/T258739

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, CDanis, dcausse, Aklapper, Dzahn, lmata, Alter-paule, Beast1978, 
CBogen, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, 
Legado_Shulgin, CucyNoiD, Nandana, Namenlos314, jijiki, Klaas_Z4us_V, Gaboe420, 
Giuliamocci, Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, 
QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, elukey, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, mark, JanZerebecki, 
faidon, Mbch331, Rxy, Jay8g, Krenair, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258739: wdqs admins should have access to nginx logs, jstack on wdqs machines

2020-07-23 Thread RKemper
RKemper renamed this task from "wdqs admins should have access to nginx logs on 
wdqs machines" to "wdqs admins should have access to nginx logs, jstack on wdqs 
machines".

TASK DETAIL
  https://phabricator.wikimedia.org/T258739

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, CDanis, dcausse, Aklapper, Dzahn, lmata, Alter-paule, Beast1978, 
CBogen, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, 
Legado_Shulgin, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, 
Davinaclare77, Qtn1293, Cpaulf30, Techguru.pc, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, 
merbst, LawExplorer, Lewizho99, Zppix, Maathavan, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, mark, JanZerebecki, faidon, Mbch331, Rxy, Jay8g, 
Krenair, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T230588: Wikidata Query Service is swapping items and properties

2020-05-19 Thread RKemper
RKemper closed subtask T252068: WQDS Data Reload as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T230588

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko, RKemper
Cc: Ghuron, Nikki, Toni_001, Dipsacus_fullonum, Larske, Mathew.onipe, Esc3300, 
agray, Jakub.klimek, Gehel, bennofs, Magnus, Robby, Mmarx, jeremyb, 
Lea_Lacroix_WMDE, Manu1400, Lucas_Werkmeister_WMDE, Smalyshev, Moebeus, 
Aklapper, Fnielsen, CBogen, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T240831: Sometimes Q77104211 shows up in sparql query as having a wrong value for P2397, however item is deleted since December 3rd 2019

2020-05-19 Thread RKemper
RKemper closed subtask T252068: WQDS Data Reload as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T240831

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, Aklapper, Mbch331, CBogen, darthmon_wmde, Nandana, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T252068: WQDS Data Reload

2020-05-19 Thread RKemper
RKemper closed this task as "Resolved".
RKemper added a comment.


  Still need to circle back to dependent tickets and verify that those problems 
are solved

TASK DETAIL
  https://phabricator.wikimedia.org/T252068

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, Aklapper, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, 
Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T245135: Too many values for wikibase:geoLatitude and wikibase:geoLongitude in WDQS

2020-05-19 Thread RKemper
RKemper closed subtask T252068: WQDS Data Reload as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T245135

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Lucas_Werkmeister_WMDE, Aklapper, Dipsacus_fullonum, CBogen, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T252068: WQDS Data Reload

2020-05-19 Thread RKemper
RKemper added a comment.


  Data transfer is done across all instances as of last friday, along with a 
wdqs-categories reload that we tacked on.
  
  Circling back to mark this ticket as done.

TASK DETAIL
  https://phabricator.wikimedia.org/T252068

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Gehel, RKemper, Aklapper, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, 
Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T252068: WQDS Data Reload

2020-05-06 Thread RKemper
RKemper added a comment.


  should also circle back and fix 
https://github.com/wikimedia/puppet/blob/production/manifests/site.pp#L2207-L2242,`
 wdqs200[78]` are declared twice

TASK DETAIL
  https://phabricator.wikimedia.org/T252068

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, 
Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T252068: WQDS Data Reload

2020-05-06 Thread RKemper
RKemper added a comment.


  `wdqs1010` is one of our test servers
  
  Therefore can screw up `wdqs1010` as much as we want, but not the others
  
  ---
  
  we need to transfer that data to each server
  which implies we need to open a port for data transfer
  
  we have 2 primary DC: eqiad and codfw
  due to the magic of geo DNS, the servers in codfw see much less traffic than 
eqiad
  in each DC, we have 2 wdqs clusters, one public, one internal
  one place to find which server is where: 
https://github.com/wikimedia/puppet/blob/production/manifests/site.pp#L2207-L2242
  
  
https://github.com/wikimedia/puppet/blob/production/manifests/site.pp#L2207-L2242
 to find where each server is

TASK DETAIL
  https://phabricator.wikimedia.org/T252068

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, 
Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, 
Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T252068: WQDS Data Reload

2020-05-06 Thread RKemper
RKemper created this task.
RKemper added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  We have already done the reload on `wdqs1010`, so now we need to xfer to the 
various other relevant servers

TASK DETAIL
  https://phabricator.wikimedia.org/T252068

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: RKemper, Aklapper, CBogen, darthmon_wmde, Nandana, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs