[
https://issues.apache.org/jira/browse/SOLR-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amrit Sarkar updated SOLR-12572:
--------------------------------
Description:
Today while exporting result through "/export" handler,
{code}
http://localhost:8983/solr/core_name/export?q=my-query&sort=severity+desc,timestamp+desc&fl=severity,timestamp,msg
{code}
Documents are sorted in priority queue, where doc-value sought for all the sort
fields defined. When we stream out docs we again make doc-value seeks against
the fl fields .
In most common use-cases we have fl = sort fields, or atleast the sort fields
are part of "fl", so if we can pre-collect the values while sorting it , we can
reduce the doc-value seeks potentially bringing speed improvement.
was:
Reading docValues is relatively time-consuming operation in Solr.
In Export handler, we read the field values twice, if they are specified in
"sort" param and "fl" param seperately. We should reuse the field values
computed at "sorting" while outputting respective tuples/rows field values.
> Reuse fieldvalues computed while sorting at writing in ExportWriter
> -------------------------------------------------------------------
>
> Key: SOLR-12572
> URL: https://issues.apache.org/jira/browse/SOLR-12572
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: streaming expressions
> Reporter: Amrit Sarkar
> Assignee: Varun Thacker
> Priority: Minor
> Attachments: SOLR-12572.patch, SOLR-12572.patch
>
>
> Today while exporting result through "/export" handler,
> {code}
> http://localhost:8983/solr/core_name/export?q=my-query&sort=severity+desc,timestamp+desc&fl=severity,timestamp,msg
> {code}
> Documents are sorted in priority queue, where doc-value sought for all the
> sort fields defined. When we stream out docs we again make doc-value seeks
> against the fl fields .
> In most common use-cases we have fl = sort fields, or atleast the sort fields
> are part of "fl", so if we can pre-collect the values while sorting it , we
> can reduce the doc-value seeks potentially bringing speed improvement.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
