Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread RAUNAK AGRAWAL
Thank you Joel. Looking forward to the latest version of solr. Thanks On Fri, Sep 28, 2018 at 12:22 PM Joel Bernstein wrote: > The facet expression is currently not as expressive as the JSON facet API. > So for very demanding use cases you can create more highly tuned JSON facet > API call. > >

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread Joel Bernstein
The facet expression is currently not as expressive as the JSON facet API. So for very demanding use cases you can create more highly tuned JSON facet API call. The good news is we are working this. And also working on other expressions that can be wrapped around the facet expression to implement

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread RAUNAK AGRAWAL
Thanks a lot Toki. I will get back to you soon regarding patch update after having discussion with the team. Thanks & Regards On Fri, Sep 28, 2018 at 11:30 AM Toke Eskildsen wrote: > RAUNAK AGRAWAL wrote: > > > curl http://localhost:8983/solr/collection_name/stream -d > > 'expr=facet(collecti

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread Toke Eskildsen
RAUNAK AGRAWAL wrote: > curl http://localhost:8983/solr/collection_name/stream -d > 'expr=facet(collection_name,q="id:953",bucketSorts="week > desc",buckets="week",bucketSizeLimit=200,sum(sales), > sum(amount),sum(days))' Stats on numeric fields then. > Also in my collection, I have almost 10

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread RAUNAK AGRAWAL
Thanks a lot Erick for the documentation. I will go through it and get back to you in case of any queries. Regards, Raunak On Fri, Sep 28, 2018 at 11:09 AM Erick Erickson wrote: > It Depends (tm). The behavior changed with Solr 7.5. Here are all the > gory details: > > > https://lucidworks.com/

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread Erick Erickson
It Depends (tm). The behavior changed with Solr 7.5. Here are all the gory details: https://lucidworks.com/2017/10/13/segment-merging-deleted-documents-optimize-may-bad/ and for 7.5+ https://lucidworks.com/2018/06/20/solr-and-optimizing-your-index-take-ii/ Best, Erick On Fri, Sep 28, 2018 at 10:

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread RAUNAK AGRAWAL
Hey Guys, This is the sample query I am making: curl http://localhost:8983/solr/collection_name/stream -d 'expr=facet(collection_name,q="id:953",bucketSorts="week desc",buckets="week",bucketSizeLimit=200,sum(sales),sum(amount),sum(days))' Also in my collection, I have almost 10 Billion documen

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-28 Thread Toke Eskildsen
On Thu, 2018-09-27 at 15:52 -0700, RAUNAK AGRAWAL wrote: > But for last few days, we are observing now that streaming facet > response is slower that json facets. Also we have increased the > number of documents in collection (30%). Export performance goes down when segment size goes way up, so I

Re: Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-27 Thread Joel Bernstein
Please post the Streaming Expression that you are using. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 27, 2018 at 6:52 PM RAUNAK AGRAWAL wrote: > Hi Guys, > > Just to give you context, we were using JSON Facets for doing analytical > queries in solr but they were slower. Hence we

Solr Streaming Queries Performance Issues [v7.2.1]

2018-09-27 Thread RAUNAK AGRAWAL
Hi Guys, Just to give you context, we were using JSON Facets for doing analytical queries in solr but they were slower. Hence we migrated our application to use solr streaming facet queries. But for last few days, we are observing now that streaming facet response is slower that json facets. Also