[
https://issues.apache.org/jira/browse/SOLR-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joel Bernstein updated SOLR-10426:
----------------------------------
Description:
Currently the concept of MapReduce shuffling is lumped into the *search*
Streaming Expression. This causes quite a bit of confusion as users sometimes
perform a search using the /select handler by default, but actually wanted
shuffling behavior which requires the /export handler.
We can solve this problem by creating a separate function called *shuffle* that
always uses the /export handler.
This will also allow us to clean up some behaviors in the search expression
that are somewhat unexpected in future tickets.
{code}
parallel(workers,
unique(shuffle(collection1,
q=*:*,
fl="id,a_s,a_i,a_f",
sort="a_f asc, a_i asc",
partitionKeys="a_f"),
over="a_f"),
workers="2",
sort="a_f asc")
{code}
was:
Currently the concept of MapReduce shuffling is lumped into the *search*
Streaming Expression. This causes quite a bit of confusion as users perform a
search using the /select handler by default, but actually wanted shuffling
behavior which requires the /export handler.
We can solve this problem by creating a separate function called *shuffle* that
always uses the /export handler.
This will also allow us to clean up some behaviors in the search expression
that are somewhat unexpected in future tickets.
{code}
parallel(workers,
unique(shuffle(collection1,
q=*:*,
fl="id,a_s,a_i,a_f",
sort="a_f asc, a_i asc",
partitionKeys="a_f"),
over="a_f"),
workers="2",
sort="a_f asc")
{code}
> Add shuffle Streaming Expression
> --------------------------------
>
> Key: SOLR-10426
> URL: https://issues.apache.org/jira/browse/SOLR-10426
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Fix For: 6.6
>
> Attachments: SOLR-10426.patch
>
>
> Currently the concept of MapReduce shuffling is lumped into the *search*
> Streaming Expression. This causes quite a bit of confusion as users sometimes
> perform a search using the /select handler by default, but actually wanted
> shuffling behavior which requires the /export handler.
> We can solve this problem by creating a separate function called *shuffle*
> that always uses the /export handler.
> This will also allow us to clean up some behaviors in the search expression
> that are somewhat unexpected in future tickets.
> {code}
> parallel(workers,
> unique(shuffle(collection1,
> q=*:*,
> fl="id,a_s,a_i,a_f",
> sort="a_f asc, a_i asc",
> partitionKeys="a_f"),
> over="a_f"),
> workers="2",
> sort="a_f asc")
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
