[ https://issues.apache.org/jira/browse/SOLR-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765239#comment-13765239 ]
Shalin Shekhar Mangar commented on SOLR-5213: --------------------------------------------- bq. The root cause was eventually tracked down to the disappearing documents not falling into the hash ranges of the sub-shards. Did you investigate how that was possible? It sounds like a bug in the hashing code either in the routing side or the splitting side. A document can never belong to multiple shard ranges because the partitioning code produces disjoint ranges. > collections?action=SPLITSHARD parent vs. sub-shards numDocs > ----------------------------------------------------------- > > Key: SOLR-5213 > URL: https://issues.apache.org/jira/browse/SOLR-5213 > Project: Solr > Issue Type: Improvement > Components: update > Affects Versions: 4.4 > Reporter: Christine Poerschke > Assignee: Shalin Shekhar Mangar > Attachments: SOLR-5213.patch > > > The problem we saw was that splitting a shard took a long time and at the end > of it the sub-shards contained fewer documents than the original shard. > The root cause was eventually tracked down to the disappearing documents not > falling into the hash ranges of the sub-shards. > Could SolrIndexSplitter split report per-segment numDocs for parent and > sub-shards, with at least a warning logged for any discrepancies (documents > falling into none of the sub-shards or documents falling into several > sub-shards)? > Additionally, could a case be made for erroring out when discrepancies are > detected i.e. not proceeding with the shard split? Either to always error or > to have an verifyNumDocs=false/true optional parameter for the SPLITSHARD > action. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org