https://bugzilla.wikimedia.org/show_bug.cgi?id=60854

       Web browser: ---
            Bug ID: 60854
           Summary: CirrusSearch: Can't reindex commons....
           Product: MediaWiki extensions
           Version: unspecified
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: Unprioritized
         Component: CirrusSearch
          Assignee: wikibugs-l@lists.wikimedia.org
          Reporter: neverett+bugzi...@wikimedia.org
                CC: dga...@wikimedia.org, innocentkil...@gmail.com,
                    neverett+bugzi...@wikimedia.org
    Classification: Unclassified
   Mobile Platform: ---

When I reindex commons, it crashes:
mwscript extensions/CirrusSearch/maintenance/updateSearchIndexConfig.php --wiki
$wiki --reindexAndRemoveOk --indexIdentifier now --reindexProcesses 4 | tee
~/cirrus_log/$wiki.reindex.log
file index...
        Setting index identifier...commonswiki_file_1391550673
        Creating index...ok
        Validating analyzers...ok
        Validating mappings...
                Validating mapping for page type...different...corrected
        Validating aliases...
                Validating file alias...is taken...
                Reindexing...
                        [0] Starting child process reindex
                        [1] Starting child process reindex
                        [2] Starting child process reindex
                        [3] Starting child process reindex
                        [0] About to reindex 5044794 documents
                        [1] About to reindex 5045574 documents
                        [3] About to reindex 5045006 documents
                        [2] About to reindex 5043744 documents
....
                        [0] Reindexed 130000/5044794 documents at 695/second
                        [2] Reindexed 130000/5043744 documents at 689/second
                        [1] Reindexed 140000/5045574 documents at 719/second
                        [0] Reindexed 140000/5044794 documents at 695/second

Warning: Search backend error during reindex.  Error message is:  Error in one
or more bulk request actions:

create: /commonswiki_file_1391550673/page/391846 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8] [page][391846]:
document already exists]
create: /commonswiki_file_1391550673/page/392553 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8] [page][392553]:
document already exists]
create: /commonswiki_file_1391550673/page/392692 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8] [page][392692]:
document already exists]
create: /commonswiki_file_1391550673/page/391163 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8] [page][391163]:
document already exists]
create: /commonswiki_file_1391550673/page/391288 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8] [page][391288]:
document already exists]
create: /commonswiki_file_1391550673/page/392135 caused
DocumentAlreadyExistsException[[commonswiki_file_1391550673][8 in
/usr/local/apache/common-local/php-1.23wmf12/includes/de
bug/Debug.php on line 301

From there on out the [3] process is dead and doesn't log anything else.

We should figure out why rather than just catch the exception, log it, and move
on.  If we can figure out what causes this we can prevent it in the future.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to