[Wikidata-bugs] [Maniphest] [Commented On] T205045: Exception from LinksUpdate: Deadlock found in database query (from Wikibase\Client\Usage\Sql\EntityUsageTable::addUsages)

[Addshore]

Addshore added a comment.

Logstash has 835 records matching this error from the past 30 days (at least since 1.32.0-wmf.16).

According to my query this was 5,300 for the last 30 days now?
If my snapshot & query is correct https://logstash.wikimedia.org/goto/1638470f94494c4efb6557f6e550caae
It looks like this has been increasing.

It looks like the main increase was around 2018 1st / 2nd of November

addshore@mwlog1001:/srv/mw-log$ zgrep -c 'Deadlock.*EntityUsageTable::addUsages' archive/DBQuery.log-2018* | grep -v :0
archive/DBQuery.log-20181015.gz:42
archive/DBQuery.log-20181016.gz:22
archive/DBQuery.log-20181017.gz:30
archive/DBQuery.log-20181018.gz:28
archive/DBQuery.log-20181019.gz:26
archive/DBQuery.log-20181020.gz:35
archive/DBQuery.log-20181021.gz:33
archive/DBQuery.log-20181022.gz:32
archive/DBQuery.log-20181023.gz:30
archive/DBQuery.log-20181024.gz:25
archive/DBQuery.log-20181025.gz:33
archive/DBQuery.log-20181026.gz:32
archive/DBQuery.log-20181027.gz:33
archive/DBQuery.log-20181028.gz:34
archive/DBQuery.log-20181029.gz:31
archive/DBQuery.log-20181030.gz:38
archive/DBQuery.log-20181031.gz:18
archive/DBQuery.log-20181101.gz:64
archive/DBQuery.log-20181102.gz:141
archive/DBQuery.log-20181103.gz:243
archive/DBQuery.log-20181104.gz:381
archive/DBQuery.log-20181105.gz:112
archive/DBQuery.log-20181106.gz:134
archive/DBQuery.log-20181107.gz:183
archive/DBQuery.log-20181108.gz:188
archive/DBQuery.log-20181110.gz:346
archive/DBQuery.log-20181111.gz:163
archive/DBQuery.log-20181112.gz:250
archive/DBQuery.log-20181113.gz:181
archive/DBQuery.log-20181114.gz:205
archive/DBQuery.log-20181115.gz:161
archive/DBQuery.log-20181116.gz:185
archive/DBQuery.log-20181117.gz:206
archive/DBQuery.log-20181118.gz:172
archive/DBQuery.log-20181119.gz:152
archive/DBQuery.log-20181120.gz:393
archive/DBQuery.log-20181121.gz:134
archive/DBQuery.log-20181122.gz:167
archive/DBQuery.log-20181123.gz:143
archive/DBQuery.log-20181124.gz:153
archive/DBQuery.log-20181125.gz:211
archive/DBQuery.log-20181126.gz:786
archive/DBQuery.log-20181127.gz:83
archive/DBQuery.log-20181128.gz:65
archive/DBQuery.log-20181129.gz:132
archive/DBQuery.log-20181130.gz:157
archive/DBQuery.log-20181201.gz:164
archive/DBQuery.log-20181202.gz:149
archive/DBQuery.log-20181203.gz:117
archive/DBQuery.log-20181204.gz:108
archive/DBQuery.log-20181205.gz:114
archive/DBQuery.log-20181206.gz:113
archive/DBQuery.log-20181207.gz:127
archive/DBQuery.log-20181208.gz:482
archive/DBQuery.log-20181209.gz:568
archive/DBQuery.log-20181210.gz:170
archive/DBQuery.log-20181211.gz:121
archive/DBQuery.log-20181212.gz:207
archive/DBQuery.log-20181213.gz:152
archive/DBQuery.log-20181214.gz:280
archive/DBQuery.log-20181215.gz:306
archive/DBQuery.log-20181216.gz:266
archive/DBQuery.log-20181217.gz:203
archive/DBQuery.log-20181218.gz:176
archive/DBQuery.log-20181219.gz:160
archive/DBQuery.log-20181220.gz:120
archive/DBQuery.log-20181221.gz:111
archive/DBQuery.log-20181222.gz:117
archive/DBQuery.log-20181223.gz:249
archive/DBQuery.log-20181224.gz:224
archive/DBQuery.log-20181225.gz:116
archive/DBQuery.log-20181226.gz:141
archive/DBQuery.log-20181227.gz:122
archive/DBQuery.log-20181228.gz:187
archive/DBQuery.log-20181229.gz:320
archive/DBQuery.log-20181230.gz:213
archive/DBQuery.log-20181231.gz:124

The increase could be a further regression between 33.1 and 33.2

addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181030.gz |grep addUsages | grep wmf.1 | wc -l
38
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181030.gz |grep addUsages | grep wmf.2 | wc -l
0
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181101.gz |grep addUsages | grep wmf.1 | wc -l
32
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181101.gz |grep addUsages | grep wmf.2 | wc -l
32
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181102.gz |grep addUsages | grep wmf.1 | wc -l
32
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181102.gz |grep addUsages | grep wmf.2 | wc -l
109
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181103.gz |grep addUsages | grep wmf.1 | wc -l
18
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181103.gz |grep addUsages | grep wmf.2 | wc -l
225
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181104.gz |grep addUsages | grep wmf.1 | wc -l
41
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181104.gz |grep addUsages | grep wmf.2 | wc -l
340
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181105.gz |grep addUsages | grep wmf.1 | wc -l
22
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181105.gz |grep addUsages | grep wmf.2 | wc -l
90
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181106.gz |grep addUsages | grep wmf.1 | wc -l
12
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181106.gz |grep addUsages | grep wmf.2 | wc -l
122
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181107.gz |grep addUsages | grep wmf.1 | wc -l
0
addshore@mwlog1001:/srv/mw-log$ zcat archive/DBQuery.log-20181107.gz |grep addUsages | grep wmf.2 | wc -l
183

TASK DETAIL

https://phabricator.wikimedia.org/T205045

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, Marostegui, Aklapper, Krinkle, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Jdforrester-WMF, Mbch331, Jay8g, Krenair

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs