Re: solr payloads performance

2020-05-11 Thread Erik Hatcher
Wei -

Here's some details on the various payload capabilities and short-comings: 
https://lucidworks.com/post/solr-payloads/

SOLR-10541 is the main functional constraint (range faceting over functions).

Erik

> On May 8, 2020, at 7:26 PM, Wei  wrote:
> 
> Hi everyone,
> 
> Have a question regarding typical  e-commerce scenario: each item may have
> different price in different store. suppose there are 10 million items and
> 1000 stores.
> 
> Option 1:  use solr payloads, each document have
> store_prices_payload:store1|price1 store2|price2  .
> store1000|price1000
> 
> Option 2: use dynamic fields and have 1000 fields in each document, i.e.
>   field1:  store1_price:  price1
>   field2:  store2_price:  price2
>   ...
>   field1000:  store1000_price: price1000
> 
> Option 2 doesn't look elegant,  but is there any performance benchmark on
> solr payloads? In terms of filtering, sorting or faceting, how would query
> performance compare between the two?
> 
> Thanks,
> Wei



Re: solr payloads performance

2020-05-11 Thread Emir Arnautović
Hi Wei,
In order to use payload you have to use functions and that’s not cheap. In 
order to make it work fast, you could use it as post filter and filter on some 
summary field like minPrice/maxPrice/defaultPrice.

HTH,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/



> On 9 May 2020, at 01:26, Wei  wrote:
> 
> Hi everyone,
> 
> Have a question regarding typical  e-commerce scenario: each item may have
> different price in different store. suppose there are 10 million items and
> 1000 stores.
> 
> Option 1:  use solr payloads, each document have
> store_prices_payload:store1|price1 store2|price2  .
> store1000|price1000
> 
> Option 2: use dynamic fields and have 1000 fields in each document, i.e.
>   field1:  store1_price:  price1
>   field2:  store2_price:  price2
>   ...
>   field1000:  store1000_price: price1000
> 
> Option 2 doesn't look elegant,  but is there any performance benchmark on
> solr payloads? In terms of filtering, sorting or faceting, how would query
> performance compare between the two?
> 
> Thanks,
> Wei



solr payloads performance

2020-05-08 Thread Wei
Hi everyone,

Have a question regarding typical  e-commerce scenario: each item may have
different price in different store. suppose there are 10 million items and
1000 stores.

Option 1:  use solr payloads, each document have
 store_prices_payload:store1|price1 store2|price2  .
store1000|price1000

Option 2: use dynamic fields and have 1000 fields in each document, i.e.
   field1:  store1_price:  price1
   field2:  store2_price:  price2
   ...
   field1000:  store1000_price: price1000

Option 2 doesn't look elegant,  but is there any performance benchmark on
solr payloads? In terms of filtering, sorting or faceting, how would query
performance compare between the two?

Thanks,
Wei