[Wikidata-bugs] [Maniphest] [Commented On] T168036: rebuildTermSqlIndex.php causing beta-update-databases-eqiad to timeout and abort

[Reedy]

Reedy added a comment.

So after nuking hundreds of thousands of items and properties...

...index term_search already set on wb_terms table.
...have term_full_entity_id field in wb_terms table.
        Processed up to page 509402 (Q350016)
        Processed up to page 510931 (Q351021)
        Processed up to page 512461 (Q352026)
        Processed up to page 513986 (Q353031)
        Processed up to page 515516 (Q354036)
        Processed up to page 517045 (Q355041)
        Processed up to page 518567 (Q356046)
        Processed up to page 520117 (Q357051)
        Processed up to page 521626 (Q358056)
        Processed up to page 522645 (Q358707)
        Done rebuilding item terms

It then did properties immediately after...

Done in 9 min 47 s.

If I immediately then run update.php again...

...have term_full_entity_id field in wb_terms table.
        Processed up to page 509402 (Q350016)

There's a major problem of this task not being logged as complete; it shouldn't be being run on EVERY run of update.php. Plus, it shouldn't need to update every row multiple times?

TASK DETAIL

https://phabricator.wikimedia.org/T168036

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Reedy
Cc: Stashbot, Aklapper, Reedy, GoranSMilovanovic, QZanden, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, hashar, greg

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs