[
https://issues.apache.org/jira/browse/SOLR-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036532#comment-17036532
]
Erick Erickson commented on SOLR-14241:
---------------------------------------
Thanks for this [~hossman] ! IIUC, the other thing this allows is for bulk
deletes to work at all while indexing in some scenarios. I _think_ I remember
some clients who had scenarios like this, especially with very large numbers of
docs on each shard:
* Indexing is continuous.
* The DBQ deletes a LOT of documents, enough to keep the index locked longer
than the update timeout
* Either the initial update request would time out, or leaders would put
followers into LIR or both.
So even if the performance is slower in some situations, being able to
reliably succeed will outweigh speed issues for a number of clients IIUC this
approach.
> Streaming Expression for deleting documents by IDs (from tuples)
> ----------------------------------------------------------------
>
> Key: SOLR-14241
> URL: https://issues.apache.org/jira/browse/SOLR-14241
> Project: Solr
> Issue Type: New Feature
> Security Level: Public(Default Security Level. Issues are Public)
> Components: streaming expressions
> Reporter: Chris M. Hostetter
> Assignee: Chris M. Hostetter
> Priority: Major
> Fix For: master (9.0), 8.5
>
> Attachments: DELQ-adds-and-deletes.png, DELQ-only-adds.png,
> SOLR-14241.patch, STREAM-adds-and-deletes.png, STREAM-only-adds.png,
> microbenchmark_scripts.zip
>
>
> Streaming expressions currently supports an {{update(...)}} decorator
> function for wrapping another stream and treating each Tuple from the inner
> stream as a document to be added to an index.
> I've implemented an analogous subclass of the {{UpdateStream}} called
> {{DeleteStream}} that uses the tuples from the inner stream to identify the
> uniqueKeys of documents that should be deleted.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
