[
https://issues.apache.org/jira/browse/OAK-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nitin Gupta reassigned OAK-9138:
--------------------------------
Assignee: Nitin Gupta
> Have a mechanism to track failed docs in ES
> -------------------------------------------
>
> Key: OAK-9138
> URL: https://issues.apache.org/jira/browse/OAK-9138
> Project: Jackrabbit Oak
> Issue Type: Task
> Reporter: Nitin Gupta
> Assignee: Nitin Gupta
> Priority: Major
>
> Currently we send bulk request with multiple docs to be indexed in ES.
> There could be cases where a request could fail completely or partially (but
> this is async) and the information whether the bulk req passed or failed or
> passed but had some docs that got failed to be indexed is available via
> callbacks of the bulk processor listener ([0]).
>
> The method at [1] returns true if even 1 of the bulk processor updates worked
> for this particular processor instance (this is as per the contract) - while
> this made sense for lucene (where we were sending 1 req at a time), with ES
> this might not make much sense.
>
> So we need a mechanism to track the docs that got failed to get indexed on ES
> and accordingly set the state of the index.
>
> [0]:
> [https://github.com/apache/jackrabbit-oak/blob/trunk/oak-search-elastic/src/main/java/org/apache/jackrabbit/oak/plugins/index/elasticsearch/index/ElasticsearchIndexWriter.java#L210#L239|https://github.com/apache/jackrabbit-oak/blob/trunk/oak-search-elastic/src/main/java/org/apache/jackrabbit/oak/plugins/index/elasticsearch/index/ElasticsearchIndexWriter.java#L210#L239v]
> [1]:
> [https://github.com/apache/jackrabbit-oak/blob/trunk/oak-search-elastic/src/main/java/org/apache/jackrabbit/oak/plugins/index/elasticsearch/index/ElasticsearchIndexWriter.java#L109]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
