[
https://issues.apache.org/jira/browse/SOLR-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765239#comment-13765239
]
Shalin Shekhar Mangar commented on SOLR-5213:
---------------------------------------------
bq. The root cause was eventually tracked down to the disappearing documents
not falling into the hash ranges of the sub-shards.
Did you investigate how that was possible? It sounds like a bug in the hashing
code either in the routing side or the splitting side. A document can never
belong to multiple shard ranges because the partitioning code produces disjoint
ranges.
> collections?action=SPLITSHARD parent vs. sub-shards numDocs
> -----------------------------------------------------------
>
> Key: SOLR-5213
> URL: https://issues.apache.org/jira/browse/SOLR-5213
> Project: Solr
> Issue Type: Improvement
> Components: update
> Affects Versions: 4.4
> Reporter: Christine Poerschke
> Assignee: Shalin Shekhar Mangar
> Attachments: SOLR-5213.patch
>
>
> The problem we saw was that splitting a shard took a long time and at the end
> of it the sub-shards contained fewer documents than the original shard.
> The root cause was eventually tracked down to the disappearing documents not
> falling into the hash ranges of the sub-shards.
> Could SolrIndexSplitter split report per-segment numDocs for parent and
> sub-shards, with at least a warning logged for any discrepancies (documents
> falling into none of the sub-shards or documents falling into several
> sub-shards)?
> Additionally, could a case be made for erroring out when discrepancies are
> detected i.e. not proceeding with the shard split? Either to always error or
> to have an verifyNumDocs=false/true optional parameter for the SPLITSHARD
> action.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
