Re: Solr Stream vs Export Request Handlers

2018-10-25 Thread Joel Bernstein
I'm not sure why /stream is exporting faster then /export. It may be that the different approaches in the client are the reason for the difference. But the /export handler would be used in both scenarios if you specify qt=/export in the search() Streaming Expression. Joel Bernstein

Re: Solr Stream vs Export Request Handlers

2018-10-25 Thread Kamal Kishore Aggarwal
Any update on this. Regards Kamal On Thu, Oct 18, 2018 at 11:50 AM Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi, > > Thanks again Joel for your reply. I have noted your suggestions. > > I observed one more thing while using solrj to fetch the data using > /stream with export and

Re: Solr Stream vs Export Request Handlers

2018-10-18 Thread Kamal Kishore Aggarwal
Hi, Thanks again Joel for your reply. I have noted your suggestions. I observed one more thing while using solrj to fetch the data using /stream with export and direct /export. The solr QTime is almost same, however elapsed time(total time) to fetch response in streaming with export is better

Re: Solr Stream vs Export Request Handlers

2018-10-15 Thread Joel Bernstein
Yes this is correct. But keep in mind Streaming Expression has a wide range of features that have nothing at all to do with the export handler. In general with Streaming Expressions you want to find the functions that get the job done using the least amount of work. The /export handler is often

Re: Solr Stream vs Export Request Handlers

2018-10-15 Thread Kamal Kishore Aggarwal
Hi, After I performed the test on my data, I found out that direct /export and streaming expression with export, both are giving almost same response time. This was also pointed out by *Jan Høydahl* in his reply. Also, the documentation says export feature uses stream sorting technique and

Re: Solr Stream vs Export Request Handlers

2018-10-02 Thread Kamal Kishore Aggarwal
Hi, Thanks Jan & Joel. Though I will evaluate the performance over my data, but based on your experience, which one of the two is better in performance ?. Please suggest Yeah, I know export does not get the data from all shards, but we can write code to aggregate the data from all shards. But

Re: Solr Stream vs Export Request Handlers

2018-09-27 Thread Joel Bernstein
The export handler does not do distributed search. So if you have a multi-shard collection you may have to use Streaming Expressions to get exports from all shards. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 27, 2018 at 4:32 AM Jan Høydahl wrote: > Hi, > > Yes, you can choose

Re: Solr Stream vs Export Request Handlers

2018-09-27 Thread Jan Høydahl
Hi, Yes, you can choose which to use, it should give you about same result. If you already work with the Solr search API it would be the easiest for you to consume /export as you don't need to learn the new syntax and parse the Tuple response. However, if you need to do stuff with the docs as

Solr Stream vs Export Request Handlers

2018-09-27 Thread Kamal Kishore Aggarwal
Hi, I have a requirement to fetch all data from a collection. One way is to use streaming expression and other way is to use export. Streaming expression documentation says *streaming functions are designed to work with entire result sets rather then the top N results like normal search. This is