Re: optimize boosting parameters

2020-12-08 Thread Derek Poh
ield has docValues? That may be faster, but I don’t know for sure. Best regards, Radu -- Sematext Cloud - Full Stack Observability - https://sematext.com Solr and Elasticsearch Consulting, Training and Production Support On 8 Dec 2020, at 06:17, Derek Poh wrote: Hi Radu Apologies for not making

Re: optimize boosting parameters

2020-12-07 Thread Derek Poh
/blob/main/quaerite-examples/README.md#genetic-algorithms-ga-runga Best regards, Radu -- Sematext Cloud - Full Stack Observability - https://sematext.com Solr and Elasticsearch Consulting, Training and Production Support On 7 Dec 2020, at 10:51, Derek Poh wrote: Hi I have added the following

optimize boosting parameters

2020-12-07 Thread Derek Poh
Hi I have added the following boosting requirements to the search query of a page. Feedback from monitoring team is that the overall response of the page has increased since then. I am trying to find out if the added boosting parameters (below) could have contributed to the increased. The

Re: advice on whether to use stopwords for use case

2020-10-01 Thread Derek Poh
. On Tue, 29 Sep 2020 at 22:28, Derek Poh wrote: Hi I have read in the mailings list that we should try to avoid using stop words. I have a use case where I would like to know if there is other alternative solutions beside using stop words. There is business requirement to return zero result when

Re: advice on whether to use stopwords for use case

2020-10-01 Thread Derek Poh
, Alex. On Tue, 29 Sep 2020 at 22:28, Derek Poh wrote: Hi I have read in the mailings list that we should try to avoid using stop words. I have a use case where I would like to know if there is other alternative solutions beside using stop words. There is business requirement to return zero

advice on whether to use stopwords for use case

2020-09-29 Thread Derek Poh
Hi I have read in the mailings list that we should try to avoid using stop words. I have a use case where I would like to know if there is other alternative solutions beside using stop words. There is business requirement to return zero result when the search is cigarette related words

combined multiple bf into a single bf

2020-06-09 Thread Derek Poh
I have the following boost requirement using bf response_rate is 3, boost by ^0.6 response_rate is 2, boost by ^0.3 response_time is 4, boost by ^0.6 response_time is 3, boost by ^0.3 I am using a bf for each of the boost requirement,

alternative suggestions on how to store product attributes in collection

2019-08-29 Thread Derek Poh
Hi I would like to know if there are suggestions on how I can handle my task below. Please pardon the lengthy description. I need to store product attributes in a collection. Attributes like Size, Color, Material etc. Each product can have up to max of 5 attributes. Between products, their

Re: TolerantUpdateProcessorFactory maxErrors=-1 issue

2018-09-23 Thread Derek Poh
On Thu, Sep 20, 2018 at 6:17 PM Derek Poh wrote: Does any one have any idea whatcould be the causeof this? On 19/9/2018 11:40 AM, Derek Poh wrote: In addition, I tried withmaxErrors=3 and with only 1error document, the indexing process still gets aborted. Could it be the way I defined

Re: TolerantUpdateProcessorFactory maxErrors=-1 issue

2018-09-20 Thread Derek Poh
Does any one have any idea whatcould be the causeof this? On 19/9/2018 11:40 AM, Derek Poh wrote: In addition, I tried withmaxErrors=3 and with only 1error document, the indexing process still gets aborted. Could it be the way I defined the TolerantUpdateProcessorFactory in solrconfg.xml

Re: TolerantUpdateProcessorFactory maxErrors=-1 issue

2018-09-18 Thread Derek Poh
In addition, I tried withmaxErrors=3 and with only 1error document, the indexing process still gets aborted. Could it be the way I defined the TolerantUpdateProcessorFactory in solrconfg.xml? On 18/9/2018 3:13 PM, Derek Poh wrote: Hi I am using CSV formatted indexupdates to index on tab

TolerantUpdateProcessorFactory maxErrors settings issue

2018-09-18 Thread Derek Poh
Hi I am using CSV formatted indexupdates to index on tab delimited file. I have define "TolerantUpdateProcessorFactory" with "maxErrors=-1" in the solrconfig.xml to skip any document update error and proceed to update the remaining documents without failing. Howeverit does not seemto be

TolerantUpdateProcessorFactory maxErrors=-1 issue

2018-09-18 Thread Derek Poh
Hi I am using CSV formatted indexupdates to index on tab delimited file. I have define "TolerantUpdateProcessorFactory" with "maxErrors=-1" in the solrconfig.xml to skip any document update error and proceed to update the remaining documents without failing. Howeverit does not seemto be

Re: change DocExpirationUpdateProcessorFactory deleteByQuery NOW parameter time zone

2018-09-03 Thread Derek Poh
SG refers to Singaporeand the time is UTC +8. That means I need to set the P_TradeShowOnlineEndDate date to UTC instead of UTC +8 as a workaround to it. On 31/8/2018 10:16 PM, Shawn Heisey wrote: On 8/30/2018 7:26 PM, Derek Poh wrote: Can the timezone of the NOW parameter

change DocExpirationUpdateProcessorFactory deleteByQuery NOW parameter time zone

2018-08-30 Thread Derek Poh
Hi Can the timezone of the NOW parameter in the |deleteByQuery| of the DocExpirationUpdateProcessorFactory be change to my timezone? I am in SG and using solr 6.5.1. The timestamp of the entries in the solr.log is in my timezone but the NOW parameter of the |deleteByQuery| is a different

collections replicas still in Recovery Mode after restarting Solr

2018-08-15 Thread Derek Poh
Hi We have a setup of 2 servers, running Solr 6.6.2, on production. There are 5 collections. All collection are created as 1 shard x 2 replicas. 4 of the collections have this issue. A replica of each of this 4 collections is in Recovery Mode. The affected replicas are on the same server or

Re: How to find out which search terms have matches in a search

2018-06-18 Thread Derek Poh
woah Erik Hatcher Senior Solutions Architect, Lucidworks.com On Jun 11, 2018, at 11:16 PM, Derek Poh wrote: Hi How can I find out which search terms have matches in a search? Eg. The search terms are "big brown bear".And only "big" and "brown&quo

Re: How to find out which search terms have matches in a search

2018-06-18 Thread Derek Poh
Seems like theHighlight feature could help but with some workaround. Will need to explore more on it. Thank you. On 12/6/2018 5:32 PM, Alessandro Benedetti wrote: I would recommend to look into the Highlight feature[1] . There are few implementations and they should be all right for your user

Re: How to find out which search terms have matches in a search

2018-06-12 Thread Derek Poh
it does not have a match in the search result. On 12/6/2018 11:16 AM, Derek Poh wrote: Hi How can I find out which search terms have matches in a search? Eg. The search terms are "big brown bear".And only "big" and "brown" have matches in the searchresult

How to find out which search terms have matches in a search

2018-06-11 Thread Derek Poh
Hi How can I find out which search terms have matches in a search? Eg. The search terms are "big brown bear".And only "big" and "brown" have matches in the searchresult. Can Solr return this information that "big" and "brown" have matches in the search result? I want touse this information to

edit gc parameters in solr.in.sh or solr?

2018-03-26 Thread Derek Poh
Hi From your experience, would like to know if It is advisable to change the gc parameters in solr.in.sh or solrfile? It is mentioned in the documentation to edit solr.in.sh but would like toknow which file you actually edit. I am using Solr 6.6.2at the moment. Regards, Derek

Re: ways to check if document is in a huge search result set

2017-09-13 Thread Derek Poh
I see. Thank you. On 9/13/2017 2:36 PM, Michael Kuhlmann wrote: Am 13.09.2017 um 04:04 schrieb Derek Poh: Hi Michael "Then continue using binary search depending on the returned score values." May I know what do you mean by using binary search? An example algorithm is in J

Re: ways to check if document is in a huge search result set

2017-09-12 Thread Derek Poh
there're lots of documents with the same score value. -Michael Am 12.09.2017 um 03:21 schrieb Derek Poh: Some additional information. I have a query from user that a supplier's product(s) is not in the search result. I debugged by adding a fq on the supplier id to the query to verify the s

Re: ways to check if document is in a huge search result set

2017-09-11 Thread Derek Poh
:12 AM, Derek Poh <d...@globalsources.com> wrote: Hi I have a collection of productdocument. Each productdocument has supplier information in it. I need to check if a supplier's products is return in a search resultcontaining over 100,000 products and in which page (assuming pagination

ways to check if document is in a huge search result set

2017-09-10 Thread Derek Poh
Hi I have a collection of productdocument. Each productdocument has supplier information in it. I need to check if a supplier's products is return in a search resultcontaining over 100,000 products and in which page (assuming pagination is 20 products per page). Itis time-consuming and

Re: different length/size of unique 'id' field value in a collection.

2017-05-22 Thread Derek Poh
incorrectly. Could explain more on this? On 5/22/2017 6:12 PM, Rick Leir wrote: On 2017-05-22 02:25 AM, Derek Poh wrote: Hi Due to the source data structure, I need to concatenate the values of 2 fields ('supplier_id' and 'product_id') to form the unique 'id' of each document. However

different length/size of unique 'id' field value in a collection.

2017-05-22 Thread Derek Poh
Hi Due to the source data structure, I need to concatenate the values of 2 fields ('supplier_id' and 'product_id') to form the unique 'id' of each document. However there are cases where some documents only have 'supplier_id' field. This will result in some documents with a longer/larger 'id'

Re: 1 main collection or multiple smaller collections?

2017-04-27 Thread Derek Poh
n April 27, 2017 8:50:59 AM EDT, Shawn Heisey <apa...@elyograg.org> wrote: On 4/26/2017 11:57 PM, Derek Poh wrote: There are some common fields between them. At the source data end (database), the supplier info and product info are updated separately. In this regard, I should separate th

Re: 1 main collection or multiple smaller collections?

2017-04-27 Thread Derek Poh
: XXXYYY supplier id: S1 supplier name: XXX supplier address: XXX I may be influenced by DB concepts. Is such a design logical? On 4/27/2017 8:50 PM, Shawn Heisey wrote: On 4/26/2017 11:57 PM, Derek Poh wrote: There are some common fields between them. At the source data end (database), the supplier

Re: 1 main collection or multiple smaller collections?

2017-04-26 Thread Derek Poh
. Otherwise, probably separate. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) On Apr 26, 2017, at 10:25 PM, Derek Poh <d...@globalsources.com> wrote: Hi I amplanning for a migration of a legacy searchengine to Solr. Basically theda

1 main collection or multiple smaller collections?

2017-04-26 Thread Derek Poh
Hi I amplanning for a migration of a legacy searchengine to Solr. Basically thedata can be categorisedinto suppliersinfo, suppliers products info and products category info. These sets of data are related to each other. suppliers products data, which is the largest, have around 300,000 records

Re: format data at source or format data during indexing?

2017-03-30 Thread Derek Poh
r append the code to the query search words. On 3/30/2017 7:28 PM, Alexandre Rafalovitch wrote: What's you actual business use case? On 30 Mar 2017 1:53 AM, "Derek Poh" <d...@globalsources.com> wrote: Hi Erick So I could also not use the query analyzer stage to append

Re: format data at source or format data during indexing?

2017-03-30 Thread Derek Poh
:38, Derek Poh <d...@globalsources.com> wrote: Hi Ineed to create afield that will be prefix and suffix with code 'z01x'.This field needs to have the code in the index and during query. I can either 1. have the source data of the field formatted with the code before indexing (outside solr

Re: format data at source or format data during indexing?

2017-03-29 Thread Derek Poh
ltiple clients feeding into Solr) but is before individual field processing (so will survive - for example - a copyField). Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 29 March 2017 at 23:38, Derek Poh <d...@globalsources.com> wrote

format data at source or format data during indexing?

2017-03-29 Thread Derek Poh
Hi Ineed to create afield that will be prefix and suffix with code 'z01x'.This field needs to have the code in the index and during query. I can either 1. have the source data of the field formatted with the code before indexing (outside solr). use a charFilter in the query stage of the field

Re: to handle expired documents: collection alias or delete by id query

2017-03-26 Thread Derek Poh
or the moving alias you mentioned? On 3/24/2017 10:23 PM, Tom Evans wrote: On Thu, Mar 23, 2017 at 6:10 AM, Derek Poh <d...@globalsources.com> wrote: Hi I have collections of products. I am doing indexing 3-4 times daily. Every day there are products that expired and I need to remove the

Re: to handle expired documents: collection alias or delete by id query

2017-03-23 Thread Derek Poh
ection, number of deleted items etc. You can even combine approaches, e.g. delete daily and do full reindex once a week. HTH, Emir On 23.03.2017 07:10, Derek Poh wrote: Hi I have collections of products. I am doing indexing 3-4 times daily. Every day there are products that expired and

Re: to handle expired documents: collection alias or delete by id query

2017-03-23 Thread Derek Poh
to make the right decision, you have to look at size of your collection, number of deleted items etc. You can even combine approaches, e.g. delete daily and do full reindex once a week. HTH, Emir On 23.03.2017 07:10, Derek Poh wrote: Hi I have collections of products. I am doing indexing 3-4 times

to handle expired documents: collection alias or delete by id query

2017-03-23 Thread Derek Poh
Hi I have collections of products. I am doing indexing 3-4 times daily. Every day there are products that expired and I need to remove them from these collectionsdaily. Ican think of 2 ways to do this. 1. using collection aliasto switch between a main and temp collection. - clear and index

Re: Break up a supplier's documents (products) from dominating search result.

2016-12-01 Thread Derek Poh
don't have enough items in a list, etc. Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 29 November 2016 at 12:56, Derek Poh <d...@globalsources.com> wrote: Hi Walter You used field collapsing for your case as well? For my case the

Re: Break up a supplier's documents (products) from dominating search result.

2016-11-28 Thread Derek Poh
, probably in 1997 or 1998. With field collapsing, you provide a link to show more results from that source. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) On Nov 28, 2016, at 5:56 PM, Derek Poh <d...@globalsources.com> wrote: Hi Walter You used

Re: Break up a supplier's documents (products) from dominating search result.

2016-11-28 Thread Derek Poh
of our customers was a magazine publisher, and they wanted the best hit from each magazine on the first page. I expect that field collapsing would work for this. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) On Nov 28, 2016, at 4:19 PM, Derek Poh &l

Re: Break up a supplier's documents (products) from dominating search result.

2016-11-28 Thread Derek Poh
. And, most likely, using Collapse and Expand: https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results . Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 28 November 2016 at 20:09, Derek Poh <d...@globalsources.com> wrote:

Break up a supplier's documents (products) from dominating search result.

2016-11-28 Thread Derek Poh
Hi We have a business requirement to breakupa supplier's products from dominating search resultso as to allow othersuppliers' products in the search result to have exposure. Business users are open to implementing this for the first page of the search resultif it is not possible to apply

Re: Split words with period in between into separate tokens

2016-10-12 Thread Derek Poh
Why didn't I thought of that. That's another alternative. Thank you for your suggestion. Appreciate it. On 10/13/2016 5:41 AM, Georg Sorst wrote: You could use a PatternReplaceCharFilter before your tokenizer to replace the dot with a space character. Derek Poh <d...@globalsources.

Re: Split words with period in between into separate tokens

2016-10-12 Thread Derek Poh
, Oct 12, 2016 at 6:24 AM, Derek Poh <d...@globalsources.com> wrote: Hi How can I split words with period in between into separate tokens. Eg. "Co.Ltd" => "Co" "Ltd" . I am using StandardTokenizerFactory and it does notreplace periods (dots) that are not

Re: Split words with period in between ("Co.Ltd") into separate tokens

2016-10-12 Thread Derek Poh
your requirement. You can also try with other available flags enabled. Best, Modassar On Wed, Oct 12, 2016 at 12:44 PM, Derek Poh <d...@globalsources.com> wrote: I tried adding Word Delimiter Filter to the field but it does not process or it truncate away the term "Co.Ltd". On

Re: Split words with period in between ("Co.Ltd") into separate tokens

2016-10-12 Thread Derek Poh
I tried adding Word Delimiter Filter to the field but it does not process or it truncate away the term "Co.Ltd". generateNumberParts="0" catenateWords="0" catenateNumbers="0" catenateAll="0" splitOnCaseChange="0"/> On

Split words with period in between into separate tokens

2016-10-11 Thread Derek Poh
Hi How can I split words with period in between into separate tokens. Eg. "Co.Ltd" => "Co" "Ltd" . I am using StandardTokenizerFactory and it does notreplace periods (dots) that are not followed by whitespace are kept as part of the token, including Internet domain names. This is the field

display filter based on existence of facet

2016-08-10 Thread Derek Poh
I have a couple of filtersthat is text input based, where user will input a value into the text boxes of these filters. The condition is these filters will only be display if the facets exists in the search result. Eg. Min Order Qty filter will be displayif theMin Order Qty facet exists in

Re: moving leader to another replica of a collection?

2016-07-10 Thread Derek Poh
Hi Shawn Got it. Will delete all replicas on thatserver first before shutting down solron it. Thank you, Derek On 7/11/2016 9:43 AM, Shawn Heisey wrote: On 7/10/2016 7:34 PM, Derek Poh wrote: I need to remove a server from the cluster of serversrunning solr in my production environment

moving leader to another replica of a collection?

2016-07-10 Thread Derek Poh
Hi This is my situation. I need to remove a server from the cluster of serversrunning solr in my production environment. 1of the collection's replica is a leader on this server. The collection is setup as 1shard with 5 replicas. With each replica residing on a physical server. How can I

Re: Define search query parameters in Solr or let clients applicationscraft them?

2016-06-14 Thread Derek Poh
think they WOULD BE GLOBALIZED. You can consider our solution. scott.chu,scott@udngroup.com 2016/6/15 (週三) - Original Message - From: Derek Poh To: solr-user CC: Date: 2016/6/13 (週一) 11:21 Subject: Define search query parameters in Solr or let clients applicationscraft them? Hi

Re: Define search query parameters in Solr or let clients applications craft them?

2016-06-14 Thread Derek Poh
be a chance of inefficient queries. Only way to fight that is to have full control of Solr interface and provide some search API, or to do regular search log grooming. Emir On 14.06.2016 03:05, Derek Poh wrote: Hi Emir Thank you for pointing out the cons of defining them in Solr config. One

Re: Define search query parameters in Solr or let clients applications craft them?

2016-06-13 Thread Derek Poh
come with some cons: it is less expressive than what you can do in client code, you have to reload cores when you want to change, people tend to override it from client so you get configs in two places. HTH, Emir On 13.06.2016 05:21, Derek Poh wrote: Hi Would like to get some advice on should

Define search query parameters in Solr or let clients applications craft them?

2016-06-12 Thread Derek Poh
Hi Would like to get some advice on should the queries parameters be define in Solr or let the clients applications define and pass the queries parameters to Solr? Regards, Derek -- CONFIDENTIALITY NOTICE This e-mail (including any attachments) may contain

Re: float or string type for a field with whole number and decimal number values?

2016-05-31 Thread Derek Poh
en changed in any way by creating the new alias. Best, Erick On Mon, May 30, 2016 at 11:15 PM, Derek Poh <d...@globalsources.com> wrote: Hi Erick Thank you for pointing out the sort behaviour of numbers in a string field. I did not think of that. Will use float. Would like to know ho

Re: float or string type for a field with whole number and decimal number values?

2016-05-31 Thread Derek Poh
pact. bq: do I need to delete all documents in the index and do a full indexing That's the way I'd do it. You can always index to a _new_ collection (assuming SolrCloud) and use collection aliasing to switch your search all at once Best, Erick On Sun, May 29, 2016 at 12:56 AM, Derek Poh <d...@globa

Re: float or string type for a field with whole number and decimal number values?

2016-05-29 Thread Derek Poh
I am using solr 4.10.4. On 5/29/2016 3:52 PM, Derek Poh wrote: Hi I have a field that is of "int" type currentlyand it's values are whole numbers. stored="true" multiValued="false"/> Due tochange inbusiness requirement, this field will need to

float or string type for a field with whole number and decimal number values?

2016-05-29 Thread Derek Poh
Hi I have a field that is of "int" type currentlyand it's values are whole numbers. stored="true" multiValued="false"/> Due tochange inbusiness requirement, this field will need to take in decimal numbers as well. This fieldis sorted onand filter by range (field:[ 1 to *]). Should I

Re: Advice to add additional non-related fields to a collection or create a subset of it?

2016-05-16 Thread Derek Poh
Mikhail It was caused by an endless loop in the page's codes that is triggered only under certain conditions. On 5/11/2016 4:07 PM, Mikhail Khludnev wrote: On Wed, May 11, 2016 at 10:16 AM, Derek Poh <d...@globalsources.com> wrote: Hi Erick Yes we have identified and fixed the pag

Re: Advice to add additional non-related fields to a collection or create a subset of it?

2016-05-11 Thread Derek Poh
product searches then stored-only is fine. If you want to perform queries like "show me all the products supplied by supplier X", then you need to index at least some values too. Best, Erick On Sun, May 8, 2016 at 10:36 PM, Derek Poh <d...@globalsources.com> wrote: Hi E

Re: Advice to add additional non-related fields to a collection or create a subset of it?

2016-05-08 Thread Derek Poh
Erick On Wed, May 4, 2016 at 10:28 PM, Derek Poh <d...@globalsources.com> wrote: Hi We have a "product" collection and a "supplier" collection. The "product" collection contains products information and "supplier" collection contains the product's suppl

Advice to add additional non-related fields to a collection or create a subset of it?

2016-05-04 Thread Derek Poh
Hi We have a "product" collection and a "supplier" collection. The "product" collection contains products information and "supplier" collection contains the product's suppliers information. We have a subsidiary page that query on "product" collection for the search. The display result include

Re: make document with more matches rank higher with edismax parser?

2016-04-03 Thread Derek Poh
TieBreaker%29Parameter Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 1 April 2016 at 14:03, Derek Poh <d...@globalsources.com> wrote: Hi Correct me if I am wrong, my understanding of edismax parser is it use the max scor

make document with more matches rank higher with edismax parser?

2016-03-31 Thread Derek Poh
Hi Correct me if I am wrong, my understanding of edismax parser is it use the max score of the matches in a doc. How do I make docs with more matches rank higher with edismax? These 2 docs are from the same query resultand this is their order in the result. P_ProductId: 1116393488

Re: Filter factory to reduce word from plural forms to singular forms correctly?

2016-02-29 Thread Derek Poh
Hi Alex Can you advice how can I make use of copyField to handle this issue? NLP lematisation will be the last resort and subject to budget and business usersdecision. Derek On 3/1/2016 8:13 AM, Alexandre Rafalovitch wrote: On 29 February 2016 at 20:40, Derek Poh <d...@globalsources.

Re: Filter factory to reduce word from plural forms to singular forms correctly?

2016-02-29 Thread Derek Poh
Hi Emir For my use case, it is to do a exact match (enclosed searchkeyword in double quotes) on a search field. Searchon "power banks" should return matches for "power bank" and "power banks", singular and plural forms. I will need to do furthertesting with porterstemfilter to ensure it meet

Filter factory to reduce word from plural forms to singular forms correctly?

2016-02-29 Thread Derek Poh
Hi I am using EnglishMinimalStemFilterFactory to reducewords in plural forms to singular forms. The filter factory is not reducingthe plural formof 'es' to the singular form correctly. It is reducing correctly for plural form of 's'. "boxes" is reduced to "boxe" instead of "box" "glasses" to

Re: "pf" not supported by edismax?

2016-02-14 Thread Derek Poh
ield value is a single term. -- Jack Krupansky On Mon, Feb 15, 2016 at 12:11 AM, Derek Poh <d...@globalsources.com> wrote: It is using KeywordTokenizerFactory. It is still consider as tokenized? Here's the

Re: "pf" not supported by edismax?

2016-02-14 Thread Derek Poh
On 2/15/2016 12:43 PM, Jack Krupansky wrote: pf stands for phrase boosting, which implies tokenized text... spp_keyword_exact sounds like it is not tokenized. -- Jack Krupansky On Sun, Feb 14, 2016 at 10:08 PM, Derek Poh <d...@globalsources.com> wrote: Hi Correct me If I am wr

"pf" not supported by edismax?

2016-02-14 Thread Derek Poh
Hi Correct me If I am wrong, edismax is an extension of dismax, so it will support "pf". But from my testing I noticed "pf" is not working with edismax. From the debug information of a query using "pf" with edismax, there is no phrase match for the "pf" field "spp_keyword_exact". If I

Re: implement exact match for one of the search fields only?

2016-02-04 Thread Derek Poh
Hi Erick << The manual way of doing this would be to construct an elaborate query, like q=spp_keyword_exact:"dvd bracket" OR P_ShortDescription:(dvd bracket) OR NOTE: the parens are necessary or the last part of the above would be parsed as P_ShortDescription:dvd

Re: implement exact match for one of the search fields only?

2016-01-28 Thread Derek Poh
Hi Emir For the other search fields, if they have matches it should be return. On 1/28/2016 8:17 PM, Emir Arnautovic wrote: Hi Derek, It is not clear what you are trying to achieve: "one of the search fields is an exact phrase match while the rest of the search fields can be exact or partial

Re: implement exact match for one of the search fields only?

2016-01-28 Thread Derek Poh
Do you mean for the spp_keyword_exact field, I should use String field with keyword tokenised and lowercase token filtered? On 1/28/2016 10:54 PM, Alessandro Benedetti wrote: I think you are overthinking the problem : I agre the described one is the most obvious solution in your case. Only

implement exact match for one of the search fields only?

2016-01-28 Thread Derek Poh
Hi First of all, sorry for the long post. How do I implement or structured the query such that one of the search fields is an exact phrase match while the rest of the search fields can be exact or partial matches? Is this possible? I have the following search fields - P_VeryShortDescription

Re: implement exact match for one of the search fields only?

2016-01-28 Thread Derek Poh
Hi Erick and all Yes I am trying to apply the same search term to all the 4 search fieldsand 1 of the search field must be an exact match. You mentioned "In particular, the pf parameter will automatically apply the search terms _as a phrase_ against the field specified, relieving you of

Re: StringIndexOutOfBoundsException using spellcheck and synonyms

2015-11-17 Thread Derek Poh
Hi Any advice how to resolve or workaround to this issue? On 11/17/2015 8:28 AM, Derek Poh wrote: Hi Scott I amusing Solr 4.10.4. On 11/16/2015 10:06 PM, Scott Stults wrote: Hi Derek, Could you please add what version of Solr you see this in? I didn't see a related Jira, so this might

Re: StringIndexOutOfBoundsException using spellcheck and synonyms

2015-11-16 Thread Derek Poh
Hi Scott I amusing Solr 4.10.4. On 11/16/2015 10:06 PM, Scott Stults wrote: Hi Derek, Could you please add what version of Solr you see this in? I didn't see a related Jira, so this might warrant a new one. k/r, Scott On Sun, Nov 15, 2015 at 11:01 PM, Derek Poh <d...@globalsources.

StringIndexOutOfBoundsException using spellcheck and synonyms

2015-11-15 Thread Derek Poh
Hi Iam using spellcheck and synonyms.I am getting "java.lang.StringIndexOutOfBoundsException: String index out of range: -1" for some keywords. I think I managed to narrow down to the likely caused of it. I have thisline of entry in the synonyms.txt file, body

Re: 'missing content stream' issuing expungeDeletes=true

2015-09-02 Thread Derek Poh
which kind of indicates you're trying to boost on unique values which is unusual. If you're confident in your model though, the only way to guarantee what you want is to optimize/expungeDeletes. Best, Erick On Tue, Sep 1, 2015 at 7:51 PM, Derek Poh <d...@globalsources.com> wrote: Erick Yes,

Re: 'missing content stream' issuing expungeDeletes=true

2015-09-01 Thread Derek Poh
ble. Upayavira [1] https://issues.apache.org/jira/browse/LUCENE-6711 On Tue, Sep 1, 2015, at 02:43 AM, Derek Poh wrote: Hi Upayavira In fact we are using optimize currently but was advised to use expunge deletes as it is less resource intensive. So expunge deletes will only remove deleted docume

Re: 'missing content stream' issuing expungeDeletes=true

2015-08-31 Thread Derek Poh
ct but did not reflect on dashboard view. On Mon, Aug 31, 2015 at 8:51 AM, Derek Poh <d...@globalsources.com> wrote: Hi I tried doing a expungeDeletes=true with the following but get the message 'missing content stream'. What am I missing? I need to provide additional paramet

'missing content stream' issuing expungeDeletes=true

2015-08-30 Thread Derek Poh
Hi I tried doing a expungeDeletes=true with the following but get the message 'missing content stream'. What am I missing? I need to provide additional parameters? curl 'http://127.0.0.1:8983/solr/supplier/update/json?expungeDeletes=true'; Thanks, Derek --

No query fields MATCH weight info for a doc in debug?

2015-07-11 Thread Derek Poh
Hi I came across a document that does not has the query field MATCH weight information in the debugbut the query fields do have the search term in them. What can cause this? Here is some info of the document. Search keyword is LED The search fields and their values, P_CatConcatKeyword =

Re: understanding collapsingQParser with facet vs group.facet

2015-06-19 Thread Derek Poh
Hi Upayavira Thank you for your explanation onthe difference between traditional grouping and collapsingQParser. I understand more now. On 6/19/2015 7:11 PM, Upayavira wrote: On Fri, Jun 19, 2015, at 06:20 AM, Derek Poh wrote: Hi I read about collapsingQParser returns the facet count

Re: understanding collapsingQParser with facet vs group.facet

2015-06-19 Thread Derek Poh
/ On Fri, Jun 19, 2015 at 6:20 AM, Derek Poh d...@globalsources.com wrote: Hi I read about collapsingQParser returns the facet count the same as group.truncate=true and has this issue with the facet count and the after filter facet count notthe same. Using group.facetdoes not has this issue

understanding collapsingQParser with facet vs group.facet

2015-06-19 Thread Derek Poh
Hi I read about collapsingQParser returns the facet count the same as group.truncate=true and has this issue with the facet count and the after filter facet count notthe same. Using group.facetdoes not has this issue but it's performance is very badcompared to collapsingQParser. I trying to

sort on fields that are not mandatory in each document

2015-05-27 Thread Derek Poh
Hi I am trying to sort on multiple fields. These fields donot necessary exist in every document. sort=sppddrank asc, ddrank asc From the sorted result, it seems that documents which donot have sppddrank field is at the top. How can I make the documents that have the sppddrank field to be

Re: sort on fields that are not mandatory in each document

2015-05-27 Thread Derek Poh
, Ahmet Arslan wrote: Hi, I think you are looking for sortMissing* attributes: sortMissingLast and sortMissingFirst attributes are optional attributes are currently supported on types that are sorted internally as strings and on numeric types. Ahmet On Wednesday, May 27, 2015 11:36 AM, Derek Poh d

Re: sort on fields that are not mandatory in each document

2015-05-27 Thread Derek Poh
PM, Derek Poh d...@globalsources.com wrote: Hi Ahmet The sortMissingLast and sortMissingFirst attributes are defined at the field or fieldType level? field name=P_TSRank type=int indexed=true stored=true multiValued=false/ fieldType name=int class=solr.TrieIntField precisionStep=0

Re: sort on fields that are not mandatory in each document

2015-05-27 Thread Derek Poh
Level. You might find some reference examples in schema.xml using them. https://cwiki.apache.org/confluence/display/solr/Field+Type+Definitions+and+Properties On Wed, May 27, 2015 at 2:30 PM, Derek Poh d...@globalsources.com wrote: Hi Ahmet The sortMissingLast and sortMissingFirst attributes

Re: search or filter by a list of document ids and return them in the same order.

2015-05-03 Thread Derek Poh
on the params that are echoed back. Best, Erick On Thu, Apr 23, 2015 at 2:17 AM, Derek Poh d...@globalsources.com wrote: Hi I am trying to search or filter by alist ofdocuments by their ids (product id field).The requirement is the return documents must be in the same order as search or filter

Re: search or filter by a list of document ids and return them in the same order.

2015-05-03 Thread Derek Poh
Hi Any advise on this? Thanks, Derek On 4/23/2015 5:17 PM, Derek Poh wrote: Hi I am trying to search or filter by alist ofdocuments by their ids (product id field).The requirement is the return documents must be in the same order as search or filter by. Eg.if i search or filter

search or filter by a list of document ids and return them in the same order.

2015-04-23 Thread Derek Poh
Hi I am trying to search or filter by alist ofdocuments by their ids (product id field).The requirement is the return documents must be in the same order as search or filter by. Eg.if i search or filter on the below list of ids, the documents must be return in the same order too 1083342171

spellcheck enabled but not getting any suggestions.

2015-04-17 Thread Derek Poh
Hi I have enabled spellcheck but not getting any suggestions withincorrectly spelled keywords. I added the spellcheck into the/select request handler. What steps did I miss out? spellcheck list in return result: lst name=spellcheck lst name=suggestions/ /lst solrconfig.xml: requestHandler

Re: Collapse and Expand behaviour on result with 1 document.

2015-04-07 Thread Derek Poh
240 suppliers. On 4/1/2015 7:05 PM, Joel Bernstein wrote: Exactly correct. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 1, 2015 at 5:44 AM, Derek Poh d...@globalsources.com wrote: Hi Joel Correct me if my understanding is wrong. Using supplier id as the field to collapse

Re: sort on facet.index?

2015-04-05 Thread Derek Poh
Yonik Isee. Thank you for the updates. On 4/3/2015 12:28 AM, Yonik Seeley wrote: On Thu, Apr 2, 2015 at 10:25 AM, Ryan Josal rjo...@gmail.com wrote: Sorting the result set or the facets? For the facets there is facet.sort=index (lexicographically) and facet.sort=count. So maybe you are

sort on facet.index?

2015-04-02 Thread Derek Poh
Is sorting on facet index supported? I would like to sort on the below facet index lst name=P_SupplierRanking int name=014/int int name=18/int int name=212/int int name=3349/int int name=481/int int

Re: Collapse and Expand behaviour on result with 1 document.

2015-04-01 Thread Derek Poh
group members that aren't being expanded? Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Mar 31, 2015 at 2:00 AM, Derek Poh d...@globalsources.com wrote: If I want to group the results (by a certain field) even if there is only 1 document, I should use the group parameter instead

  1   2   >