Re: solr payloads performance
Wei - Here's some details on the various payload capabilities and short-comings: https://lucidworks.com/post/solr-payloads/ SOLR-10541 is the main functional constraint (range faceting over functions). Erik > On May 8, 2020, at 7:26 PM, Wei wrote: > > Hi everyone, > > Have a question regarding typical e-commerce scenario: each item may have > different price in different store. suppose there are 10 million items and > 1000 stores. > > Option 1: use solr payloads, each document have > store_prices_payload:store1|price1 store2|price2 . > store1000|price1000 > > Option 2: use dynamic fields and have 1000 fields in each document, i.e. > field1: store1_price: price1 > field2: store2_price: price2 > ... > field1000: store1000_price: price1000 > > Option 2 doesn't look elegant, but is there any performance benchmark on > solr payloads? In terms of filtering, sorting or faceting, how would query > performance compare between the two? > > Thanks, > Wei
Re: solr payloads performance
Hi Wei, In order to use payload you have to use functions and that’s not cheap. In order to make it work fast, you could use it as post filter and filter on some summary field like minPrice/maxPrice/defaultPrice. HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 9 May 2020, at 01:26, Wei wrote: > > Hi everyone, > > Have a question regarding typical e-commerce scenario: each item may have > different price in different store. suppose there are 10 million items and > 1000 stores. > > Option 1: use solr payloads, each document have > store_prices_payload:store1|price1 store2|price2 . > store1000|price1000 > > Option 2: use dynamic fields and have 1000 fields in each document, i.e. > field1: store1_price: price1 > field2: store2_price: price2 > ... > field1000: store1000_price: price1000 > > Option 2 doesn't look elegant, but is there any performance benchmark on > solr payloads? In terms of filtering, sorting or faceting, how would query > performance compare between the two? > > Thanks, > Wei
solr payloads performance
Hi everyone, Have a question regarding typical e-commerce scenario: each item may have different price in different store. suppose there are 10 million items and 1000 stores. Option 1: use solr payloads, each document have store_prices_payload:store1|price1 store2|price2 . store1000|price1000 Option 2: use dynamic fields and have 1000 fields in each document, i.e. field1: store1_price: price1 field2: store2_price: price2 ... field1000: store1000_price: price1000 Option 2 doesn't look elegant, but is there any performance benchmark on solr payloads? In terms of filtering, sorting or faceting, how would query performance compare between the two? Thanks, Wei