[Wikidata-bugs] [Maniphest] T349118: Migrate node-based services in production to node18

2023-11-28 Thread elukey
elukey added a comment. I filed https://gerrit.wikimedia.org/r/c/mediawiki/services/recommendation-api/+/977751 for the recommendation-api service, if anybody has time to review it I will take care of the build/deploy :) TASK DETAIL https://phabricator.wikimedia.org/T349118 EMAIL

[Wikidata-bugs] [Maniphest] T349118: Migrate node-based services in production to node18

2023-11-20 Thread elukey
elukey closed subtask T348950: Upgrade change propagation to nodejs18 as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T349118 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Michael, gmodena, Ottomata, elukey, WDoranWMF

[Wikidata-bugs] [Maniphest] T349118: Migrate node-based services in production to node18

2023-11-17 Thread elukey
elukey updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T349118 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Michael, gmodena, Ottomata, elukey, WDoranWMF, Ahoelzl, MSantos, Krinkle, Jdforrester-WMF

[Wikidata-bugs] [Maniphest] T343419: Move Wikidata tools to Lift Wing

2023-08-04 Thread elukey
elukey added a comment. Ack thanks! Then I'd suggest to start with damaging and goodfaith, and then migrate later on when RR Wikidata is ready? TASK DETAIL https://phabricator.wikimedia.org/T343419 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T343419: Move Wikidata tools to Lift Wing

2023-08-04 Thread elukey
elukey added a subscriber: achou. elukey added a comment. @Ladsgroup we have a dedicated Revertrisk model dedicated to Wikidata in staging (more info in T333125 <https://phabricator.wikimedia.org/T333125>), but I think that we just need to do some follow ups and verification before

[Wikidata-bugs] [Maniphest] T343419: Move Wikidata tools to Lift Wing

2023-08-03 Thread elukey
elukey added a comment. https://github.com/Ladsgroup/Vandalism-dashboard/issues/15 TASK DETAIL https://phabricator.wikimedia.org/T343419 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Aklapper, Lydia_Pintscher, elukey

[Wikidata-bugs] [Maniphest] T343419: Move Wikidata tools to Lift Wing

2023-08-03 Thread elukey
elukey added a project: Item Quality Evaluator. TASK DETAIL https://phabricator.wikimedia.org/T343419 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Aklapper, Lydia_Pintscher, elukey, Danny_Benjafield_WMDE, fbalicchia, isarantopoulos

[Wikidata-bugs] [Maniphest] T343419: Move Wikidata tools to Lift Wing

2023-08-03 Thread elukey
elukey created this task. elukey added projects: Wikidata, Machine-Learning-Team. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION List to be expanded: - https://wdvd.toolforge.org - https://item-quality-evaluator.toolforge.org Some useful docs in https

[Wikidata-bugs] [Maniphest] T209611: [Epic] Make ORES scores for wikidata available as a dump

2023-05-29 Thread elukey
elukey closed subtask T209737: Backfill ORES Hadoop scores with historical data as Declined. TASK DETAIL https://phabricator.wikimedia.org/T209611 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: So9q, Ladsgroup, GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T200716: Include ORES predictions in RDF export

2023-05-29 Thread elukey
elukey closed this task as "Declined". elukey added a comment. We are moving to Lift Wing: https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing I am closing old tasks related to ORES since it is being deprecated, please re-open if you feel that any work could be do

[Wikidata-bugs] [Maniphest] T166427: Measure maturity/quality of Wikidata items in a way it can be queried

2023-05-29 Thread elukey
elukey closed subtask T200716: Include ORES predictions in RDF export as Declined. TASK DETAIL https://phabricator.wikimedia.org/T166427 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: dcausse, Ls1g, Lydia_Pintscher, gerritbot, Esc3300

[Wikidata-bugs] [Maniphest] T332953: Migrate PipelineLib repos to GitLab

2023-04-11 Thread elukey
elukey updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T332953 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: elukey, KartikMistry, santhosh, Martaannaj, sbassett, bking, bd808, Ladsgroup, Krinkle, Legoktm

[Wikidata-bugs] [Maniphest] T332953: Migrate PipelineLib repos to GitLab

2023-04-11 Thread elukey
elukey updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T332953 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: elukey, KartikMistry, santhosh, Martaannaj, sbassett, bking, bd808, Ladsgroup, Krinkle, Legoktm

[Wikidata-bugs] [Maniphest] T314835: wdqs space usage on thanos-swift

2022-08-09 Thread elukey
elukey added a comment. root@thanos-fe1001:/home/elukey# source /etc/swift/account_AUTH_wdqs.env root@thanos-fe1001:/home/elukey# swift list rdf-streaming-updater-codfw rdf-streaming-updater-codfw+segments rdf-streaming-updater-eqiad rdf-streaming-updater-eqiad+segments

[Wikidata-bugs] [Maniphest] T266702: Move WDQS UI to microsites

2022-02-03 Thread elukey
elukey closed this task as "Resolved". elukey claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T266702 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: elukey, WMDE-leszek, dcausse, Ladsgroup, BBlack, Gehel, Dzahn

[Wikidata-bugs] [Maniphest] T266702: Move WDQS UI to microsites

2022-02-03 Thread elukey
elukey added a comment. Found the issue: diff --git a/maint.html b/maint.html index 703e17a..e63c70e 100644 --- a/maint.html +++ b/maint.html @@ -1 +1 @@ -Error 503 Service Unavailable503 Service UnavailableThe service is temporary down for maintenance. Please

[Wikidata-bugs] [Maniphest] T266702: Move WDQS UI to microsites

2022-02-02 Thread elukey
elukey reopened this task as "Open". elukey added a comment. Restricted Application added a project: wdwb-tech. Hi folks, on miscweb1002 I see the following in puppet: Feb 3 07:40:34 miscweb1002 puppet-agent[31666]: (/Stage[main]/Profile::Microsites::Query_service/Git::Clon

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-10-16 Thread elukey
elukey added a comment. Hi folks, I was trying to figure out why we had so many UNKNOWNs related to wdqs nodes in icinga and I noticed this task. The new streaming updater metrics seem to have a typo: `wdqs_streaming_updater_kafka_stream_consumer_lag_Value` Meanwhile

[Wikidata-bugs] [Maniphest] T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again)

2021-04-30 Thread elukey
elukey added a comment. I think we should be fine from now on, I wouldn't add more complexity to what we have :) TASK DETAIL https://phabricator.wikimedia.org/T281316 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: elukey

[Wikidata-bugs] [Maniphest] T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again)

2021-04-30 Thread elukey
elukey added a comment. @GoranSMilovanovic sure! During the migration of the hosts where Hive Server/Metastore runs to Debian Buster, we encountered a lot of problems with the only available java lib for mysql, namely the one containing the `org.mariadb.jdbc.Driver` JDBC driver. We have now

[Wikidata-bugs] [Maniphest] T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again)

2021-04-29 Thread elukey
elukey closed this task as "Resolved". elukey claimed this task. elukey added a comment. No issues from our side, going to close, please reopen if necessary! TASK DETAIL https://phabricator.wikimedia.org/T281316 EMAIL PREFERENCES https://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

2021-04-29 Thread elukey
elukey closed subtask T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again) as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic, elukey Cc: elukey, WMDE-leszek

[Wikidata-bugs] [Maniphest] T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again)

2021-04-28 Thread elukey
elukey added a comment. Nice! Let's keep it open since I want to understand if we need to use `--driver com.mysql.jdbc.Driver` or not, it will have some impact also for Analytics, thanks a lot for bringing this up and sorry for the trouble! TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again)

2021-04-28 Thread elukey
elukey added a comment. Hi Goran! We moved the hive server nodes to Debian Buster recently (T231067 <https://phabricator.wikimedia.org/T231067>) and we had a problem with Hive and Mariadb, highlights in https://issues.apache.org/jira/browse/HIVE-25020. As a quick workaround you

[Wikidata-bugs] [Maniphest] T266495: Create Debian Package for Flink

2020-10-28 Thread elukey
elukey added a comment. I see https://issues.apache.org/jira/browse/BIGTOP-3382 to add 1.11.1, but it seems that the work will be done after Bigtop 1.5. We could think about contributing to upstream if we feel the need to have that included to Bigtop 1.5! TASK DETAIL https

[Wikidata-bugs] [Maniphest] T266495: Create Debian Package for Flink

2020-10-28 Thread elukey
elukey added a comment. root@apt1001:/srv/wikimedia# reprepro lsbycomponent flink flink | 1.6.4-1 | stretch-wikimedia | thirdparty/bigtop14 | amd64 flink | 1.6.4-1 | buster-wikimedia | thirdparty/bigtop14 | amd64 This is Bigtop 1.4 version, the last upstream, but they are about

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

2020-10-21 Thread elukey
elukey added a comment. elukey@stat1004:~$ telnet thanos-swift.discovery.wmnet 443 Trying 10.2.2.54... Connected to thanos-swift.discovery.wmnet. Escape character is '^]'. ^] :) TASK DETAIL https://phabricator.wikimedia.org/T246004 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

2020-10-20 Thread elukey
elukey added a comment. term swift { from { destination-address { /* swift.svc.codfw */ 10.2.1.27/32; /* swift.svc.eqiad */ 10.2.2.27/32; } protocol tcp; destination-port

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

2020-09-29 Thread elukey
elukey added a comment. Context in T219544 <https://phabricator.wikimedia.org/T219544> - IIRC your team uses a specific oozie util to push data on swift in the coordinator's definition: https://github.com/wikimedia/wikimedia-discovery-analytics/

[Wikidata-bugs] [Maniphest] [Closed] T255282: mw1384 is misbehaving

2020-06-12 Thread elukey
elukey closed this task as "Resolved". elukey claimed this task. elukey added a comment. Error seem to be gone after the php-fpm restart, but I forgot to dump the status of APC :( My bet is on APC corruption or something similar, will reopen in case it re-happen. TASK DETA

[Wikidata-bugs] [Maniphest] [Updated] T255282: mw1384 is misbehaving

2020-06-12 Thread elukey
elukey added a project: serviceops. TASK DETAIL https://phabricator.wikimedia.org/T255282 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Aklapper, elukey, Addshore, Ladsgroup, wkandek, JMeybohm, darthmon_wmde, Legado_Shulgin, Nandana

[Wikidata-bugs] [Maniphest] [Commented On] T255282: mw1384 is misbehaving

2020-06-12 Thread elukey
elukey added a comment. To add some details - I depooled/repooled doing `scap pull` and it didn't really work. I also depooled, waited hours, repooled and the issue gets back consistently. It may be a single host issue, but not really sure what. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Commented On] T246343: Service implementation on wdqs200[7-8].codfw.wmnet

2020-04-07 Thread elukey
elukey added a comment. - data+categories jnl files copied for both hosts via cookbook - restarted nginx to pick up new mapping for categories (after David's suggestion) - 2007's lag seems ok, 2008 still catching up - both hosts are not pooled in LVS/Pybal TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Closed] T243871: Long query running on dbstore1005:3318

2020-01-29 Thread elukey
elukey closed this task as "Resolved". elukey claimed this task. elukey added a comment. After a chat with @Marostegui I decided to kill the query, since it seems that some optimization is needed (it has been running for 40+ days). Also it is a select and can be re-do

[Wikidata-bugs] [Maniphest] [Commented On] T237319: 502 errors on ATS/8.0.5

2019-11-21 Thread elukey
elukey added a comment. In T237319#5681384 <https://phabricator.wikimedia.org/T237319#5681384>, @darthmon_wmde wrote: > Is there anything that we can quickly do on wikibase to fix this? > if so, please advise what concretely. > Thanks! @darthmon_wmde hi! So

[Wikidata-bugs] [Maniphest] [Commented On] T237319: 502 errors on ATS/8.0.5

2019-11-21 Thread elukey
elukey added a comment. Thanks, will remember to use -v :) On buster + sury's php7.2-fpm + apache 2.4.38 I cannot repro: root@497a89a9ac42:/# curl localhost/test.php -v * Expire in 0 ms for 6 (transfer 0x5604525d2f50) * Expire in 1 ms for 1 (transfer 0x5604525d2f50

[Wikidata-bugs] [Maniphest] [Commented On] T237319: 502 errors on ATS/8.0.5

2019-11-21 Thread elukey
elukey added a comment. I have created a Docker image for Debian stretch installing apache2 (same version of the mw app servers) + php7.2-fpm from Sury's repo + the following trivial config: Options Indexes FollowSymLinks AllowOverride None Require

[Wikidata-bugs] [Maniphest] [Commented On] T237319: 502 errors on ATS/8.0.5

2019-11-21 Thread elukey
elukey added a comment. On mwdebug2001 this seems to be the mod proxy fcgi debug: Nov 21 12:02:13 mwdebug2001 apache2[4516]: [proxy_fcgi:debug] [pid 4516:tid 140373593552640] mod_proxy_fcgi.c(913): [client 10.192.0.98:37452] AH01076: url: fcgi://localhost/srv/mediawiki/docroot

[Wikidata-bugs] [Maniphest] [Commented On] T236895: ArticlePlaceholder dashboard stopped tracking page views

2019-10-30 Thread elukey
elukey added a comment. Hello! Do you have a coordinator that I can check in Hue? https://hue.wikimedia.org/oozie/list_oozie_coordinator/0015017-190822093211873-oozie-oozi-C/ seems the closest one and it works afaics.. TASK DETAIL https://phabricator.wikimedia.org/T236895 EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2019-08-06 Thread elukey
elukey added subscribers: WMDE-leszek, Ladsgroup. elukey added a comment. Adding @WMDE-leszek and @Ladsgroup since afaics they were/are working on this :) TASK DETAIL https://phabricator.wikimedia.org/T176875 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2019-08-06 Thread elukey
elukey added a comment. Changed the following: (Cc: @ayounsi ) elukey@re0.cr2-eqiad# show | compare [edit firewall family inet filter analytics-in4 term wdqs from destination-address] 10.192.48.65/32 { ... } +/* wdqs.svc.eqiad.wmnet

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2019-07-09 Thread elukey
elukey added a subscriber: ayounsi. elukey added a comment. Not really, I wish myself from the past added more info. I asked to @ayounsi and he didn't come up with a reason not to, so in theory we could try to modify the term on the firewall and see how it goes. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Commented On] T223310: Investigate increase in tx bandwidth usage for mc1033

2019-05-21 Thread elukey
elukey added a comment. Thanks a lot for the deploy! I checked metrics and nothing seems changed :( TASK DETAIL https://phabricator.wikimedia.org/T223310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Krenair, Tarrow, alaa_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T223310: Investigate increase in tx bandwidth usage for mc1033

2019-05-21 Thread elukey
elukey added a comment. Would it be possible to deploy https://gerrit.wikimedia.org/r/511612 before the weekly train? TASK DETAIL https://phabricator.wikimedia.org/T223310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: Tarrow

[Wikidata-bugs] [Maniphest] [Commented On] T212550: Implement support for ChronologyProtection in events sent when editing Mediawiki/Wikidata

2019-05-17 Thread elukey
elukey added a comment. Hello everybody, I am investigating https://phabricator.wikimedia.org/T223310, namely the one of the Redis MainStash being constantly hammered by GET to `global:Wikimedia\Rdbms\ChronologyProtector` since after the deployment of 1.34.0-wmf.3. Is it related to https

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Fix inefficient CacheAwarePropertyInfoStore memcached access pattern

2019-05-14 Thread elukey
elukey added a comment. From a quick look with memkeys on mc1033, these are the top talkers keys: memcache key calls objsize req/sec bw(kbps

[Wikidata-bugs] [Maniphest] [Updated] T119536: wikidata.org/entity/Q12345 should do content negotiation immediately, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first

2019-04-16 Thread elukey
elukey removed a project: User-Elukey. TASK DETAIL https://phabricator.wikimedia.org/T119536 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: elukey, PokestarFan, Ladsgroup, gerritbot, Esc3300, thiemowmde, hoo, elf-pavlik, JanZerebecki

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Fix inefficient CacheAwarePropertyInfoStore memcached access pattern

2019-04-09 Thread elukey
elukey added a comment. The train was deployed yesterday, I can see an awesome improvement (green bar dropping): F28597246: Screen Shot 2019-04-09 at 8.09.44 AM.png <https://phabricator.wikimedia.org/F28597246> Thanks a lot for all the work! TASK DETAIL

[Wikidata-bugs] [Maniphest] [Blocker] T215413: Image Classification Working Group

2019-04-02 Thread elukey
elukey changed the status of subtask T148843: Remove computational bottlenecks in stats machine via adding a GPU that can be used to train ML models from Stalled to Open. TASK DETAIL https://phabricator.wikimedia.org/T215413 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Blocker] T215413: Image Classification Working Group

2019-03-28 Thread elukey
elukey changed the status of subtask T148843: Remove computational bottlenecks in stats machine via adding a GPU that can be used to train ML models from Open to Stalled. TASK DETAIL https://phabricator.wikimedia.org/T215413 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Updated] T97368: Fix inefficient CacheAwarePropertyInfoStore memcached access pattern

2019-03-14 Thread elukey
elukey added a project: User-Elukey. TASK DETAIL https://phabricator.wikimedia.org/T97368 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: aaron, elukey, Lydia_Pintscher, Jonas, Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T218197: CacheAwarePropertyInfoStore & CachingPropertyInfoLookup should use WANObjectCache instead of BagOStuff

2019-03-13 Thread elukey
elukey added a comment. Adding also @aaron that knows better what is best (and hopefully can confirm what I am saying). TASK DETAIL https://phabricator.wikimedia.org/T218197 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: elukey Cc: aaron

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Fix inefficient CacheAwarePropertyInfoStore memcached access pattern

2019-03-12 Thread elukey
elukey added a comment. To summarize what I am currently seeing: - after the last mw deployment/train, the key got renamed and moved to mc1022 (was before on mc1021). This can be seen in https://grafana.wikimedia.org/d/00316/memcache?panelId=45=1=1551860994585=1552057232883 - when

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T97368: Fix inefficient CacheAwarePropertyInfoStore memcached access pattern

2019-03-12 Thread elukey
elukey added a subscriber: aaron. elukey added a comment. Another big SET bursts to mc1022 caused timeouts for the MW appservers.. Don't meant to pressure you guys but is there any plan forward to fix this? The SET bursts should be due to a key either being evicted or expired

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

2019-03-11 Thread elukey
elukey added a comment. I found another occurrence of timeouts in mcrouter with SETs for this key, it might be due to TTL expiring or similar. Reducing the traffic volume to memcached is surely a good thing. TASK DETAIL https://phabricator.wikimedia.org/T97368 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

2019-03-10 Thread elukey
elukey added a comment. Correction: the last bursts of mcrouter's timeouts seems to match a high set rate for slab 140 on mc1022, that is exactly where the key is: https://grafana.wikimedia.org/d/00317/memcache-slabs?orgId=1=1552231823147=1552232692113=eqiad%20prometheus%2Fops

[Wikidata-bugs] [Maniphest] [Reopened] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

2019-03-10 Thread elukey
elukey reopened this task as "Open". TASK DETAIL https://phabricator.wikimedia.org/T97368 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, elukey Cc: elukey, Lydia_Pintscher, Jonas, Stashbot, gerritbot, Jdforrester-WMF, Joe, mark

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

2019-03-10 Thread elukey
elukey added a comment. Quick comment: I noticed while checking some memcached metrics that `wikibase_shared/1_33_0-wmf_20-wikidatawiki-hhvm:CacheAwarePropertyInfoStore` generates 30~60MB/s of GET traffic since the last deployment of mediawiki: https://grafana.wikimedia.org/d/00317

[Wikidata-bugs] [Maniphest] [Commented On] T187960: Rack/cable/configure asw2-a-eqiad switch stack

2019-03-05 Thread elukey
elukey added a comment. ge-6/0/25 - mc1019 ge-6/0/26 - mc1020 ge-6/0/27 - mc1021 ge-6/0/28 - mc1022 ge-6/0/29 - mc1023 The above ones are holding the eqiad mediawiki object cache, they are extremely important. IIUC this maintenance will not require any host shutdown

[Wikidata-bugs] [Maniphest] [Commented On] T187960: Rack/cable/configure asw2-a-eqiad switch stack

2019-03-05 Thread elukey
elukey added a comment. About Analytics nodes: - ge-1/0/7 - kafka-jumbo1001 -> Kafka needs to be stopped ~10/15 minutes beforehand to have a graceful shutdown (if possible) - ge-2/0/12 - kafka-jumbo1002 -> same thing, and it is better to have kafka-jumbo1001 up and r

[Wikidata-bugs] [Maniphest] [Commented On] T213894: Modify analytics/wmde/scripts repo to work with the new analytics multisource db setup

2019-02-19 Thread elukey
elukey added a comment. In T213894#4967148, @Ladsgroup wrote: One imporant thing. Ports needs to be addressed too. I completely missed those. 331 + the digit of the section in case of sX. Example: s5 will be accessible to s5-analytics-replica.eqiad.wmnet:3315 3320 for x1. Example: x1-analytics

[Wikidata-bugs] [Maniphest] [Updated] T213894: Modify analytics/wmde/scripts repo to work with the new analytics multisource db setup

2019-02-08 Thread elukey
elukey added a parent task: T215589: Migrate users to dbstore100[3-5]. TASK DETAILhttps://phabricator.wikimedia.org/T213894EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: Ottomata, elukey, GoranSMilovanovic, Ladsgroup, gerritbot, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] [Commented On] T213894: Modify analytics/wmde/scripts repo to work with the new analytics multisource db setup

2019-02-08 Thread elukey
elukey added a comment. @GoranSMilovanovic feel free to ping me anytime on IRC if you have any doubt :) analytics-slave.eqiad.wmnet points to db1108 that contains the log database, it will not change with this move. The only one changing is analytics-store.eqiad.wmnet, that currently points

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread elukey
elukey added a comment. Yep exactly, cache misc (where query.wikidata.org was hosted) has been migrated to cache text, therefore all the Hive queries (and related) should be using 'webrequest_text' from now on.TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Closed] T200954: Lost access to archiva

2018-08-02 Thread elukey
elukey closed this task as "Resolved".elukey claimed this task.elukey added a comment. There you go: elukey@stat1005:/home/smalyshev$ ls -l archiva.txt -rw--- 1 smalyshev root 40 Aug 2 07:16 archiva.txt Please re-open of follow up with me on IRC if it doesn't work :)TASK D

[Wikidata-bugs] [Maniphest] [Lowered Priority] T200954: Lost access to archiva

2018-08-02 Thread elukey
elukey lowered the priority of this task from "Unbreak Now!" to "Normal".elukey added a comment. Hello! The password changed due to an accidental leak to gerrit. We are working on a long term solution that will allow us to use LDAP with Archiva to authenticate, but fo

[Wikidata-bugs] [Maniphest] [Commented On] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2018-07-04 Thread elukey
elukey added a comment. After a chat with Discovery we ended up refreshing the list of hosts in the Analytics VLAN firewall (that is meant for traffic from the analytics hosts towards production, like stat1005 to wdqs): https://phabricator.wikimedia.org/T198623#4396997 It seems

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-11-03 Thread elukey
elukey added a comment. Status: elukey@terbium:~$ mwscript extensions/WikimediaMaintenance/getJobQueueLengths.php |sort -n -k2 | tail -n 20 euwiki 237 tgwiki 3759 cawiki 4822 enwiktionary 17148 zhwiki 19958 nowiki 21167 wikidatawiki 28257 bewiki 110296 arwiki 132139 ukwiki 132246 dewiki 155322

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-11-02 Thread elukey
elukey added a comment. In T173710#3730226, @EBernhardson wrote: It was perhaps noted before, but because of the recursive nature of the refreshLinks and htmlCacheUpdate jobs even if the backlog is being processed it may not look like it, because the jobs are just enqueing new jobs. Will probably

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-10-31 Thread elukey
elukey added a comment. In T173710#3720358, @EBernhardson wrote: All jobs have a requestId parameter, which is passed down through the execution chain. This is the same as the reqId field in logstash. Basically this means if the originating request logged anything to logstash, you should be able

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-10-30 Thread elukey
elukey added a comment. We had some relief after the last change in the configs of the jobrunners, namely the queue started shrinking, but then we got back into the bad behavior in which we have constantly more jobs enqueued vs completed: F10519970: Screen Shot 2017-10-30 at 6.19.11 PM.png I am

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-10-30 Thread elukey
elukey added a comment. In T173710#3717940, @Jack_who_built_the_house wrote: On ruwiki, many editors are complaining about slow updating of pages with their templates. We have a huge job queue, and it keeps growing day by day, while no top-used templates/modules have been changed in the last days

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-10-26 Thread elukey
elukey added a comment. Updated status: elukey@terbium:~$ /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblists/group1.dblist showJobs.php --group | awk '{if ($3 > 1) print $_}' cawiki: refreshLinks: 13566 queued; 6 claimed (6 active, 0 abandoned); 0 delayed commonswiki: refreshLi

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-10-24 Thread elukey
elukey added a project: User-Elukey. TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: Jack_who_built_the_house, elukey, debt, mxn, Daimona, YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-10-20 Thread elukey
elukey added a comment. Updated list (showjob1.txt contains group1, showjob.txt group2) elukey@terbium:~$ awk '{if ($3 > 10) print $_}' showjob1.txt commonswiki: refreshLinks: 1629991 queued; 5 claimed (2 active, 3 abandoned); 0 delayed commonswiki: htmlCacheUpdate: 2470968 queued

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a comment. In T163922#3639504, @Lucas_Werkmeister_WMDE wrote: Is there any way to find out which URLs are garbled? Can we look for RW_PROTO in all the cached redirects, or something like that? There is a way (https://wikitech.wikimedia.org/wiki/Varnish#One-off_purges_.28bans.29

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a subscriber: ema.elukey added a comment. I believe this is only a matter of cleaning up urls that show up garbled, @ema just did it for https://commons.wikimedia.org/data/main/Data:Bundestagswahl2017/wahlkreis46.map via https://wikitech.wikimedia.org/wiki/Multicast_HTCP_purging#One

[Wikidata-bugs] [Maniphest] [Lowered Priority] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey lowered the priority of this task from "Unbreak Now!" to "Normal". TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: elukey, TerraCodes, Jay8g, Liuxinyu970226, Lu

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a comment. All the appservers are now returning the good version of the redirect, I think that some of them are still showing up broken due to caching.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T119536: wikidata.org/entity/Q12345 should do content negotiation immediately, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first

2017-09-21 Thread elukey
elukey added a project: User-Elukey. TASK DETAILhttps://phabricator.wikimedia.org/T119536EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: elukey, PokestarFan, Ladsgroup, gerritbot, Esc3300, thiemowmde, hoo, elf-pavlik, JanZerebecki, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T119536: wikidata.org/entity/Q12345 should do content negotiation immediately, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first

2017-09-21 Thread elukey
elukey added a comment. Hey @daniel, I have a couple of things to ask: I checked on deployment-mediawiki04/5 and I saw that an old version of the code was cherry picked, namely the solution with two rewrites (before the redirect=force). I removed it from puppetmaster02, I guess that we'd need

[Wikidata-bugs] [Maniphest] [Updated] T162245: Enable GC for HHVM CLI (at least for dump runners)

2017-07-27 Thread elukey
elukey removed a project: User-Elukey.Herald added a subscriber: PokestarFan. TASK DETAILhttps://phabricator.wikimedia.org/T162245EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: PokestarFan, MoritzMuehlenhoff, elukey, gerritbot, daniel, ArielGlenn

[Wikidata-bugs] [Maniphest] [Commented On] T162245: Enable GC for HHVM CLI (at least for dump runners)

2017-04-05 Thread elukey
elukey added a comment. Tested with @hoo the settings outlined in https://docs.hhvm.com/hhvm/configuration/INI-settings on mwdebug1002. A script with returns "true" but the GC seems not to be effective. I asked the question on the #hhvm channel and it seems that the options were availab

[Wikidata-bugs] [Maniphest] [Updated] T162245: Enable GC for HHVM CLI (at least for dump runners)

2017-04-05 Thread elukey
elukey added a project: User-Elukey. TASK DETAILhttps://phabricator.wikimedia.org/T162245EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: daniel, ArielGlenn, Joe, Aklapper, hoo, Th3d3v1ls, Hfbn0, QZanden, Salgo60, Zppix, D3r1ck01, Izno, Wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T142944: Performance and caching considerations for article placeholders accesses

2016-10-20 Thread elukey
elukey triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T142944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: DaBPunkt, BBlack, daniel, Lydia_Pintscher, Joe, Lucie, Aklapper, hoo, Zppix, D3r1ck01, Izno

[Wikidata-bugs] [Maniphest] [Triaged] T146468: wdqs - move metric collections to diamond

2016-10-18 Thread elukey
elukey triaged this task as "Low" priority. TASK DETAILhttps://phabricator.wikimedia.org/T146468EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: Addshore, Gehel, Aklapper, mschwarzer, Avner, Zppix, debt, D3r1ck01, Jonas, FloNight, Xml