[
https://issues.apache.org/jira/browse/SOLR-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641263#comment-16641263
]
Joel Bernstein commented on SOLR-12829:
---------------------------------------
New patch with updates to the ListStream and TupStream to support goals of the
ticket. The TupStream now reads its internal streams into memory in the open
method. This allows the TupStream to be parallelized effectively by the
ParallelListStream. This is important because the TupStream can be used to
partition the output of the ParallelStream rather then simply concatenating
streams.
> Add plist (parallel list) Streaming Expression
> ----------------------------------------------
>
> Key: SOLR-12829
> URL: https://issues.apache.org/jira/browse/SOLR-12829
> Project: Solr
> Issue Type: New Feature
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Priority: Major
> Attachments: SOLR-12829.patch, SOLR-12829.patch
>
>
> The *plist* Streaming Expression wraps any number of streaming expressions
> and opens them in parallel. The results of each of the streams are then
> iterated in the order they appear in the list. Since many streams perform
> heavy pushed down operations when opened, like the FacetStream, this will
> result in the parallelization of these operations. For example plist could
> wrap several facet() expressions and open them each in parallel, which would
> cause the facets to be run in parallel, on different replicas in the cluster.
> Here is sample syntax:
> {code:java}
> plist(tuple(facet1=facet(...)),
> tuple(facet2=facet(...)),
> tuple(facet3=facet(...))) {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
