Fwd: Mobiles/Tablets for Repair
Hey there, Currently, I am part of a company* ZurePro Warranty* which deals with providing warranties over the mobiles and tablets. If you have any such product which needs to be repaired (only mobiles tablets) you can get in touch with me. ZurePro will arrange a free pick and drop for the gadget, you will only have to bear the repair cost which will be the market price of the repairing. We are looking for faulty smartphones and tablets with any kind of hardware/software problems like motherboard issue, power port malfunction, screen/touch pad problem etc.. If you have any such product kindly let me know, ZurePro will take care of it. :) Cheers!! -- Best Regards, Rohan Thakur
help regarding custom query which returns custom output
hi all I have requirement like I have implemented fulltext search and autosuggestion and spellcorrection functionality in solr but they all are running on different cores so I have to call 3 different request handlers for getting the results which is adding the unnecessary delay so I wanted to know is there any solution that I call just one request URL and get all these three results and json feedback from solr. thanx regards rohan
Sorting solr search results using multiple fields
hi all I wanted to know is there a way I can sort the my documents based on 3 fields I have fields like pop(which is basically frequency of the term searched history) and autosug(auto suggested words) and initial_boost(copy field of autosug such that only match with initial term match having whole sentence saved as one token) Now I want the documents to be returned as: 1. initial_boost with pop of 192 2. initial_boost with pop of 156 3. initial_boost with pop of 120 4. autosug with pop of 205 5. autosug with pop of 180 6. autosug with pop of 112 I have tried using boosting the initial_boost field but without the sort it does the above boost to the initial_boost than autosug but as I add sort=pop desc documents gets sorted according to pop field disturbing the boost on the fields that I had set. help anyone... thanks in advance. regards Rohan
Re: Sorting solr search results using multiple fields
thanks gora I got that
one more thing
what actually I have done is made document consisting of fields:
{
autosug:galaxy,
query_id:1414,
pop:168,
initial_boost:galaxy
_version_:1435669695565922305,
score:1.8908522}
this inital_boost is basically copy field of autosug but saved using
different analysers taking whole sentence as single token and generating
edge ngrams so that what I search on this field only term matching from
first will match...and for any other infix term match I have autosug
field
so now what I want from this is to show the documents returned with
initial_boost first and then the documents with autosug field sorted with
pop field respectively (separately) and return the result...
now from your suggestion I could do this using sort on multiple fields by
separating them by
commas, as described under
http://wiki.apache.org/solr/CommonQueryParameters#sort
but for that I would require 1 field having value greater(all equal say 2)
for initial_boost field and smaller(all same say 1) for autosug field how
can I do this? or is there some better solution..
thanks
regards
Rohan
On Wed, May 22, 2013 at 6:39 PM, Gora Mohanty g...@mimirtech.com wrote:
On 22 May 2013 18:26, Rohan Thakur rohan.i...@gmail.com wrote:
hi all
I wanted to know is there a way I can sort the my documents based on 3
fields
I have fields like pop(which is basically frequency of the term searched
history) and autosug(auto suggested words) and initial_boost(copy field
of
autosug such that only match with initial term match having
whole sentence saved as one token)
[...]
You seem to be confusing boosting with sorting. If you
sort the results, the boosts are irrelevant.
You can sort on multiple fields by separating them by
commas, as described under
http://wiki.apache.org/solr/CommonQueryParameters#sort
Regards,
Gora
Re: Sorting solr search results using multiple fields
k thanks gora that what I was thinking but thought I should ask as there might be some solution in solr it self...the last option fine I would go with that only. thanks rohan On Thu, May 23, 2013 at 9:13 AM, Gora Mohanty g...@mimirtech.com wrote: On 22 May 2013 19:37, Rohan Thakur rohan.i...@gmail.com wrote: [...] this inital_boost is basically copy field of autosug but saved using different analysers taking whole sentence as single token and generating edge ngrams so that what I search on this field only term matching from first will match...and for any other infix term match I have autosug field so now what I want from this is to show the documents returned with initial_boost first and then the documents with autosug field sorted with pop field respectively (separately) and return the result... now from your suggestion I could do this using sort on multiple fields by separating them by commas, as described under http://wiki.apache.org/solr/CommonQueryParameters#sort but for that I would require 1 field having value greater(all equal say 2) for initial_boost field and smaller(all same say 1) for autosug field how can I do this? or is there some better solution.. Um, maybe it would help if you started out by explaining what you are trying to do instead of changing the requirements after a solution is proposed. The above design seems faulty. If the fields have the same values, there is no way to sort them differently. Boosts are not guaranteed to always promote documents in the desired manner, and will not work with sorting in any case. You can try to kludge things together in various ways, e.g., * Add a prefix so that some fields always sort first, e.g., prefix aaa... to a string field to try and ensure that it sorts first * Have not tried this, but it should be possible to use a Solr function query with a function that sorts by the field name: http://wiki.apache.org/solr/FunctionQuery As you seem to be using analysers on the fields, beware that sorting will not work reliably on multi-valued or tokenised fields. You could also index different fields to different Solr cores, fetch the results for individual fields with separate queries, and combine them as desired. This might be the cleanest, if not the most efficient, solution. Regards, Gora
Re: indexing unrelated tables in single core
thanks gora I got that...have to change in the DB itself... On Fri, May 17, 2013 at 6:27 PM, Gora Mohanty g...@mimirtech.com wrote: On 16 May 2013 19:11, Rohan Thakur rohan.i...@gmail.com wrote: hi Mohanty I tried what you suggested of using id as common field and changing the SQL query to point to id and using id as uniqueKey it is working but now what it is doing is just keeping the id's that are not same in both the tables and discarding the id's that are same in both the tablesbut this is not correct as both the product_id and query_id has no relation as such both are representing separate things in each tables. [...] Sorry, was away from email. The last configuration that you posted seemed fine, and as you say above things seem to work for you. What you are facing now is that documents where the product_id is the same as the query_id are being overwritten, as they have the same uniqueKey as far as Solr is concerned. Thus, Solr will update an existing document rather than adding a new one. So, you have to come up with a scheme that makes the IDs unique. There are various ways of doing this depending on how your product_id/query_id are set up. One way might be to make the 'id' field that is used as the uniqueKey a string rather than an integer, and prefix 'P' for product_ids and 'Q' for query_ids. Regards, Gora
Re: indexing unrelated tables in single core
I am not able to index the fields from data base its getting failed... data-config.xml dataSource type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/test user=user password=dfsdf/ document entity name=catalogsearch_query query=select query_id,query_text from catalogsearch_query where num_results!= 0 field column=query_id name=query_id/ field column=query_text name=user_query/ /entity /document its showing all failed and 0 indexed On Wed, May 15, 2013 at 8:31 PM, Alexandre Rafalovitch arafa...@gmail.comwrote: 1. Create a schema that accomodates both types of fields either using optional fields or dynamic fields. 2. Create some sort of differentiator key (e.g. schema), separately from id (which needs to be globally unique, so possibly schema+id) 3. Use that schema in filter queries (fq) to look only at subject of items 4. (Optionally) define separate search request handlers that force that schema parameter (using appends or invariants instead of defaults) That should get you most of the way there. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Wed, May 15, 2013 at 7:07 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I want to index 2 separate unrelated tables from database into single solr core and search in any one of the document separately how can I do it? please help thanks in advance regards Rohan
Re: indexing unrelated tables in single core
its saying in the logs that missing required field title which is no where in the database... On Thu, May 16, 2013 at 3:08 PM, Rohan Thakur rohan.i...@gmail.com wrote: I am not able to index the fields from data base its getting failed... data-config.xml dataSource type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/test user=user password=dfsdf/ document entity name=catalogsearch_query query=select query_id,query_text from catalogsearch_query where num_results!= 0 field column=query_id name=query_id/ field column=query_text name=user_query/ /entity /document its showing all failed and 0 indexed On Wed, May 15, 2013 at 8:31 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: 1. Create a schema that accomodates both types of fields either using optional fields or dynamic fields. 2. Create some sort of differentiator key (e.g. schema), separately from id (which needs to be globally unique, so possibly schema+id) 3. Use that schema in filter queries (fq) to look only at subject of items 4. (Optionally) define separate search request handlers that force that schema parameter (using appends or invariants instead of defaults) That should get you most of the way there. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Wed, May 15, 2013 at 7:07 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I want to index 2 separate unrelated tables from database into single solr core and search in any one of the document separately how can I do it? please help thanks in advance regards Rohan
Re: indexing unrelated tables in single core
hi I got the problem it is with the unique key defined in the schema.xml if i difine it to be query_id then while indexing it says missing mandatory key query_id which is not present in the root entity(data-config.xml) which is indexing the product from the database which has product_id as the unique key and when in schema I set product_id as the unique key then it says missing mandatory key product_id which is not present in the root entity(data-config.xml) which is indiexing the user query from another table in the database which has user_id as the unique key. how can I fix this thanks I want to index both the tables which are basically unrelated that is does not have any *Common* fields thanks rohan On Thu, May 16, 2013 at 3:24 PM, Michael Della Bitta michael.della.bi...@appinions.com wrote: True, it's complaining that your Solr schema has a required field 'title' and your query and data import config aren't providing it. On May 16, 2013 5:51 AM, Rohan Thakur rohan.i...@gmail.com wrote: its saying in the logs that missing required field title which is no where in the database... On Thu, May 16, 2013 at 3:08 PM, Rohan Thakur rohan.i...@gmail.com wrote: I am not able to index the fields from data base its getting failed... data-config.xml dataSource type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/test user=user password=dfsdf/ document entity name=catalogsearch_query query=select query_id,query_text from catalogsearch_query where num_results!= 0 field column=query_id name=query_id/ field column=query_text name=user_query/ /entity /document its showing all failed and 0 indexed On Wed, May 15, 2013 at 8:31 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: 1. Create a schema that accomodates both types of fields either using optional fields or dynamic fields. 2. Create some sort of differentiator key (e.g. schema), separately from id (which needs to be globally unique, so possibly schema+id) 3. Use that schema in filter queries (fq) to look only at subject of items 4. (Optionally) define separate search request handlers that force that schema parameter (using appends or invariants instead of defaults) That should get you most of the way there. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Wed, May 15, 2013 at 7:07 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I want to index 2 separate unrelated tables from database into single solr core and search in any one of the document separately how can I do it? please help thanks in advance regards Rohan
Re: indexing unrelated tables in single core
I mean to say that I want to index 2 tables that is using 2 root entity in data-config.xml one is product table and other is user search table these both have no foreign key and I want to index both of them as document in my solr index what should I do...its taking either one of them and rejecting other table as document when I am taking primary key of one table as unique key in the solr schema...and vice verca.how to solve this? On Thu, May 16, 2013 at 4:24 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi I got the problem it is with the unique key defined in the schema.xml if i difine it to be query_id then while indexing it says missing mandatory key query_id which is not present in the root entity(data-config.xml) which is indexing the product from the database which has product_id as the unique key and when in schema I set product_id as the unique key then it says missing mandatory key product_id which is not present in the root entity(data-config.xml) which is indiexing the user query from another table in the database which has user_id as the unique key. how can I fix this thanks I want to index both the tables which are basically unrelated that is does not have any *Common* fields thanks rohan On Thu, May 16, 2013 at 3:24 PM, Michael Della Bitta michael.della.bi...@appinions.com wrote: True, it's complaining that your Solr schema has a required field 'title' and your query and data import config aren't providing it. On May 16, 2013 5:51 AM, Rohan Thakur rohan.i...@gmail.com wrote: its saying in the logs that missing required field title which is no where in the database... On Thu, May 16, 2013 at 3:08 PM, Rohan Thakur rohan.i...@gmail.com wrote: I am not able to index the fields from data base its getting failed... data-config.xml dataSource type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/test user=user password=dfsdf/ document entity name=catalogsearch_query query=select query_id,query_text from catalogsearch_query where num_results!= 0 field column=query_id name=query_id/ field column=query_text name=user_query/ /entity /document its showing all failed and 0 indexed On Wed, May 15, 2013 at 8:31 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: 1. Create a schema that accomodates both types of fields either using optional fields or dynamic fields. 2. Create some sort of differentiator key (e.g. schema), separately from id (which needs to be globally unique, so possibly schema+id) 3. Use that schema in filter queries (fq) to look only at subject of items 4. (Optionally) define separate search request handlers that force that schema parameter (using appends or invariants instead of defaults) That should get you most of the way there. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Wed, May 15, 2013 at 7:07 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I want to index 2 separate unrelated tables from database into single solr core and search in any one of the document separately how can I do it? please help thanks in advance regards Rohan
Re: indexing unrelated tables in single core
hi mohanty I appreciate it but dint get that can you please elaborate? my dataconfig is like: entity name=catalogsearch_query query=select query_id,query_text from catalogsearch_query where num_results!= 0 field column=query_id name=value_id/ field column=query_text name=user_query/ /entity entity name=catalog_product_entity_varchar query=select value_id,value,entity_id,attribute_id from catalog_product_entity_varchar where attribute_id=60 field column=value_id name=value_id/ field column=value name=title/ field column=entity_id name=product_id/ field column=attribute_id name=attribute/ /entity my schema is like: fields field name=keyfeatures type=text_en_splitting indexed=true stored=true required= false/ field name=value_id type=plong indexed=true stored=false/ field name=product_id type=plong indexed=true stored=true/ field name=features type=text_en_splitting_tight indexed=true stored=false required=false multiValued=true/ !--field name=f_product_id type=plong indexed=true stored=true/ field name=f_value_id type=plong indexed=true stored=true/ -- field name=attribute type=plong indexed=false stored=false/ field name=title type=text_en_splitting indexed=true stored=true required= true/ field name=image type=text_en_splitting_tight indexed=false stored=false/ field name=url type=text_en_splitting_tight indexed=false stored=false/ field name=brand type=text_en indexed=true stored=true/ field name=procat type=text_en indexed=true stored=true/ field name=rootcat type=text_en indexed=true stored=true/ field name=color type=text_en indexed=true stored=true/ field name=sku type=text_en_splitting_tight indexed=true stored=true/ field name=spell type=tSpell indexed=true stored=true / field name=query_id type=plong indexed=true stored=true / field name=user_query type=text_en_splitting_tight indexed=true stored=true required=false/ /fields uniqueKeyvalue_id/uniqueKey !-- field name=solr_value type=text indexed=true stored=true/ -- !-- field for the QueryParser to use when an explicit fieldname is absent DEPRECATED: specify df in your request handler instead. -- defaultSearchFieldtitle/defaultSearchField thanks regards Rohan On Thu, May 16, 2013 at 5:11 PM, Gora Mohanty g...@mimirtech.com wrote: On 16 May 2013 16:24, Rohan Thakur rohan.i...@gmail.com wrote: hi I got the problem it is with the unique key defined in the schema.xml if i difine it to be query_id then while indexing it says missing mandatory key query_id which is not present in the root entity(data-config.xml) which is indexing the product from the database which has product_id as the unique key and when in schema I set product_id as the unique key then it says missing mandatory key product_id which is not present in the root entity(data-config.xml) which is indiexing the user query from another table in the database which has user_id as the unique key. how can I fix this thanks I want to index both the tables which are basically unrelated that is does not have any *Common* fields [...] Fix it in the SELECT statement: SELECT product_id as id,... for one entity, and SELECT query_id as id,... in the other and use id as the uniqueKey for Solr. Regards, Gora
Re: indexing unrelated tables in single core
hi Mohanty I tried what you suggested of using id as common field and changing the SQL query to point to id and using id as uniqueKey it is working but now what it is doing is just keeping the id's that are not same in both the tables and discarding the id's that are same in both the tablesbut this is not correct as both the product_id and query_id has no relation as such both are representing separate things in each tables. regards Rohan On Thu, May 16, 2013 at 5:11 PM, Gora Mohanty g...@mimirtech.com wrote: On 16 May 2013 16:24, Rohan Thakur rohan.i...@gmail.com wrote: hi I got the problem it is with the unique key defined in the schema.xml if i difine it to be query_id then while indexing it says missing mandatory key query_id which is not present in the root entity(data-config.xml) which is indexing the product from the database which has product_id as the unique key and when in schema I set product_id as the unique key then it says missing mandatory key product_id which is not present in the root entity(data-config.xml) which is indiexing the user query from another table in the database which has user_id as the unique key. how can I fix this thanks I want to index both the tables which are basically unrelated that is does not have any *Common* fields [...] Fix it in the SELECT statement: SELECT product_id as id,... for one entity, and SELECT query_id as id,... in the other and use id as the uniqueKey for Solr. Regards, Gora
indexing unrelated tables in single core
hi all I want to index 2 separate unrelated tables from database into single solr core and search in any one of the document separately how can I do it? please help thanks in advance regards Rohan
query regarding the multiple documents
hi all wanted to know that I have indexed documents for search purpose in solr and now for auto suggestion purpose I want to index new data that is the popular query term searched by users and frequency of them to get searched on websitebut as it has no relation with the product data on which I have build search...can I like index this new table in same data-config.xml within new document tag and if so then how to configure request handler for auto suggestion to search in this new index only and not the search index document. thanks regards rohan
Re: solr spell correction help
k thanks jack but then why does cattle not giving kettle as suggestions?? On Fri, Apr 12, 2013 at 6:46 PM, Jack Krupansky j...@basetechnology.comwrote: blandars its not giving correction as blender They have an edit distance of 3. Direct Spell is limited to a maximum ED of 2. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Friday, April 12, 2013 8:45 AM To: solr-user@lucene.apache.org Subject: solr spell correction help hi all I have configured solr direct spell correction on spell field most of the words solr is correcting and giving suggestions but on some words like mentioned below is giving absurd results: 1) blender(indexed) 2) kettle(indexed) 3) electric(indexed) problems: 1) when I search for blandar its giving correct result as blender but when I search for blandars its not giving correction as blender 2) for this when I search for kettle the correct spell its still showing it to be false but not giving suggestions and even the results documents are showing up. and when I search for cettle its giving correct result as kettle but when I search for cattle its not giving any suggestions. 3) for this again when I search for electric the correct spell its showing it to be false in suggestions section but not giving any suggestions and documents are also returning for this spelling as its the correct one. even if I want solr to return samsung as spell suggetion if I search for sam what could be the configuration and what could be the solution for above problems? please help. thanks in advance regards Rohan
Re: solr spell correction help
but jack im not using lavanstine distance measures im using jarowinker distance On Mon, Apr 15, 2013 at 11:50 AM, Rohan Thakur rohan.i...@gmail.com wrote: k thanks jack but then why does cattle not giving kettle as suggestions?? On Fri, Apr 12, 2013 at 6:46 PM, Jack Krupansky j...@basetechnology.comwrote: blandars its not giving correction as blender They have an edit distance of 3. Direct Spell is limited to a maximum ED of 2. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Friday, April 12, 2013 8:45 AM To: solr-user@lucene.apache.org Subject: solr spell correction help hi all I have configured solr direct spell correction on spell field most of the words solr is correcting and giving suggestions but on some words like mentioned below is giving absurd results: 1) blender(indexed) 2) kettle(indexed) 3) electric(indexed) problems: 1) when I search for blandar its giving correct result as blender but when I search for blandars its not giving correction as blender 2) for this when I search for kettle the correct spell its still showing it to be false but not giving suggestions and even the results documents are showing up. and when I search for cettle its giving correct result as kettle but when I search for cattle its not giving any suggestions. 3) for this again when I search for electric the correct spell its showing it to be false in suggestions section but not giving any suggestions and documents are also returning for this spelling as its the correct one. even if I want solr to return samsung as spell suggetion if I search for sam what could be the configuration and what could be the solution for above problems? please help. thanks in advance regards Rohan
Re: spell suggestions help
hi jack I am using whitespace toknizer only and before this im using pattern replace to replace amp; with and but its not working I guess. my query analyser: /analyzer analyzer type=query charFilter class=solr.PatternReplaceCharFilterFactory pattern=amp; replacement=and/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt enablePositionIncrements=true On Thu, Apr 11, 2013 at 6:03 PM, Jack Krupansky j...@basetechnology.comwrote: Try replacing standard tokenizer with whitespace tokenizer in your field types. And make sure not to use any other token filters that might discard special characters (or provide a character map if they support one.) Also, be side to try your test terms in the Solr Admin UI ANalyzer page to see that the is preserved or which stage in term analysis it gets discarded. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Thursday, April 11, 2013 7:39 AM To: solr-user@lucene.apache.org Subject: Re: spell suggestions help urlencode replaces with space thus resulting in results that contains even the single terms like in the case of mobile accessories it replaces it with mobile accessories and results the document containing even accessories which i dont want. how to tackle this I tried using pattern replace filter at query time to replace with and but it did not worked I used amp; = replace with and in this but did not worked any guess our help.. thanks regards rohan On Thu, Apr 11, 2013 at 4:39 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi erick do we have to do urlencoding from the php side or does solr supports urlencode? On Thu, Apr 11, 2013 at 5:57 AM, Erick Erickson erickerick...@gmail.com **wrote: Try URL encoding it and/or escaping the On Tue, Apr 9, 2013 at 2:32 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all one thing I wanted to clear is for every other query I have got correct suggestions but these 2 cases I am not getting what suppose to be the suggestions: 1) I have kettle(doc frequency =5) and cable(doc frequecy=1) word indexed in direct solr spell cheker..but when I query for cattle I get cable as only suggestion and not kettle why is this happening i want to get kettle in suggestion as well im using jarowinkler distance according to which score for cattle = cable which is coming out to be 0.857 and for cattle = kettle which is coming out to be 0.777 kettle should also come in suggestions but its not how can I correct this any one. 2) how to query for sentence like hand blandar chopper as is delimiter for solr query and thus this query is returning error. thanks in advance regards Rohan
solr spell correction help
hi all I have configured solr direct spell correction on spell field most of the words solr is correcting and giving suggestions but on some words like mentioned below is giving absurd results: 1) blender(indexed) 2) kettle(indexed) 3) electric(indexed) problems: 1) when I search for blandar its giving correct result as blender but when I search for blandars its not giving correction as blender 2) for this when I search for kettle the correct spell its still showing it to be false but not giving suggestions and even the results documents are showing up. and when I search for cettle its giving correct result as kettle but when I search for cattle its not giving any suggestions. 3) for this again when I search for electric the correct spell its showing it to be false in suggestions section but not giving any suggestions and documents are also returning for this spelling as its the correct one. even if I want solr to return samsung as spell suggetion if I search for sam what could be the configuration and what could be the solution for above problems? please help. thanks in advance regards Rohan
Re: spell suggestions help
hi erick do we have to do urlencoding from the php side or does solr supports urlencode? On Thu, Apr 11, 2013 at 5:57 AM, Erick Erickson erickerick...@gmail.comwrote: Try URL encoding it and/or escaping the On Tue, Apr 9, 2013 at 2:32 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all one thing I wanted to clear is for every other query I have got correct suggestions but these 2 cases I am not getting what suppose to be the suggestions: 1) I have kettle(doc frequency =5) and cable(doc frequecy=1) word indexed in direct solr spell cheker..but when I query for cattle I get cable as only suggestion and not kettle why is this happening i want to get kettle in suggestion as well im using jarowinkler distance according to which score for cattle = cable which is coming out to be 0.857 and for cattle = kettle which is coming out to be 0.777 kettle should also come in suggestions but its not how can I correct this any one. 2) how to query for sentence like hand blandar chopper as is delimiter for solr query and thus this query is returning error. thanks in advance regards Rohan
Re: spell suggestions help
urlencode replaces with space thus resulting in results that contains even the single terms like in the case of mobile accessories it replaces it with mobile accessories and results the document containing even accessories which i dont want. how to tackle this I tried using pattern replace filter at query time to replace with and but it did not worked I used amp; = replace with and in this but did not worked any guess our help.. thanks regards rohan On Thu, Apr 11, 2013 at 4:39 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi erick do we have to do urlencoding from the php side or does solr supports urlencode? On Thu, Apr 11, 2013 at 5:57 AM, Erick Erickson erickerick...@gmail.comwrote: Try URL encoding it and/or escaping the On Tue, Apr 9, 2013 at 2:32 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all one thing I wanted to clear is for every other query I have got correct suggestions but these 2 cases I am not getting what suppose to be the suggestions: 1) I have kettle(doc frequency =5) and cable(doc frequecy=1) word indexed in direct solr spell cheker..but when I query for cattle I get cable as only suggestion and not kettle why is this happening i want to get kettle in suggestion as well im using jarowinkler distance according to which score for cattle = cable which is coming out to be 0.857 and for cattle = kettle which is coming out to be 0.777 kettle should also come in suggestions but its not how can I correct this any one. 2) how to query for sentence like hand blandar chopper as is delimiter for solr query and thus this query is returning error. thanks in advance regards Rohan
spell suggestions help
hi all one thing I wanted to clear is for every other query I have got correct suggestions but these 2 cases I am not getting what suppose to be the suggestions: 1) I have kettle(doc frequency =5) and cable(doc frequecy=1) word indexed in direct solr spell cheker..but when I query for cattle I get cable as only suggestion and not kettle why is this happening i want to get kettle in suggestion as well im using jarowinkler distance according to which score for cattle = cable which is coming out to be 0.857 and for cattle = kettle which is coming out to be 0.777 kettle should also come in suggestions but its not how can I correct this any one. 2) how to query for sentence like hand blandar chopper as is delimiter for solr query and thus this query is returning error. thanks in advance regards Rohan
query regarding the use of boost across the fields in edismax query
hi all wanted to know what could be the difference between the results if I apply boost accross say 5 fields in query like for first: title^10.0 features^7.0 cat^5.0 color^3.0 root^1.0 and second settings like : title^10.0 features^5.0 cat^3.0 color^2.0 root^1.0 what could be the difference as in the weights are in same order decreasing? thanks in advance regards Rohan
Re: query regarding the use of boost across the fields in edismax query
hi otis can you explain that in some depth like If is search for led in both the cases what could be the difference in the results I get? thanks in advance regards Rohan On Tue, Apr 9, 2013 at 11:25 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Not sure if i'm missing something but in the first case features, cat, and color field have more weight, so matches on them with have bigger contribution to the overall relevancy score. Otis -- Solr ElasticSearch Support http://sematext.com/ On Tue, Apr 9, 2013 at 1:52 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know what could be the difference between the results if I apply boost accross say 5 fields in query like for first: title^10.0 features^7.0 cat^5.0 color^3.0 root^1.0 and second settings like : title^10.0 features^5.0 cat^3.0 color^2.0 root^1.0 what could be the difference as in the weights are in same order decreasing? thanks in advance regards Rohan
help needed for applying patch to solr I am using
hi all I am new to solr and wanted to apply this patch to my solr how can I do this searched on net but did not got any thing useful the patch is: https://issues.apache.org/jira/browse/SOLR-2585 I am using solr 4.1.0 on tomcat6 in redhat centos. thanks regards rohan
Re: solr spell suggestions help
hi all I have resolved all issues(its was relating to the distance measures I was using was by default lavanstine which is very basic and is not good now I am using jarowinkler distance measures which is better and now giving exact results that I was looking for) except the 4th one which I think is solrs issue and they have also released patch for that https://issues.apache.org/jira/browse/SOLR-2585 I am applying this patch now will let you know if its is working correctly. thanks regards Rohan On Fri, Apr 5, 2013 at 4:44 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I had some issues with solr spell suggestions. 1) first of all I wanted to know is indexbased spell suggestions better then directspell suggestions that solr 4.1 provides in any way? 2) then I wanted to know is their way I can get suggestions for words providing only few prefix for the word. like when I query sam I should get samsung as one of suggestion. 3) also I wanted to know why am I not getting suggestions for the words that have more then 2 character difference between them like if I query for wirlpool wich has 8 characters I get suggestion as whirlpool which is 9 characters and correct spelling but when I query for wirlpol which is 7 characters it says that this is false spelling but does not show any suggestions. even like if I search for pansonic(8 char) it provides panasonic(9 char) as suggestion but when I remove one more character that is is search for panonic(7 char) it does not return any suggestions?? how can I correct this? even when I search for ipo it does not return ipod as suggestions? 4) one more thing I want to get clear that when I search for microwave ovan it does not give any miss spell even when ovan is wrong it provides the result for microwave saying the query is correct...this is the case when one of the term in the query is correct while others are incorrect it does not point out the wrong spelling one but reutrns the result for correct word thats it how can I correct this? similar is the case when I query for microvave oven is shows the result for oven saying that the query is correct.. 5) one more case is when I query plntronies (correct word is: plantronics) it does not return any solution but when I query for plantronies it returns the plantronics as suggestions why is that happening? *my schema.xml is:* fieldType name=tSpell class=solr.TextField positionIncrementGap=100 omitNorms=true analyzer type=index charFilter class=solr.PatternReplaceCharFilterFactory pattern=\\\[\]\(\)\-\,\/\+ replacement= / tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LengthFilterFactory min=2 max=20/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LengthFilterFactory min=2 max=20/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer /fieldType field name=spell type=tSpell indexed=true stored=true / copyField source=title dest=spell / *my solrconfig.xml is :* searchComponent name=spellcheck class=solr.SpellCheckComponent !-- Multiple Spell Checkers can be declared and used by this component -- !-- a spellchecker built from a field of the main index -- lst name=spellchecker !-- Optional, it is required when more than one spellchecker is configured. Select non-default name with spellcheck.dictionary in request handler. -- *str name=namedefault/str* str name=classnamesolr.DirectSolrSpellChecker/str !-- the spellcheck distance measure used, the default is the internal levenshtein -- !-- Load tokens from the following field for spell checking, analyzer for the field's type as defined in schema.xml are used -- *str name=fieldspell/str str name=distanceMeasureinternal/str !-- minimum accuracy needed to be considered a valid spellcheck suggestion -- float name=accuracy0.3/float !-- the maximum #edits we consider when enumerating terms: can be 1 or 2 -- int name=maxEdits1/int !-- the minimum shared prefix when enumerating terms -- int name=minPrefix1/int !-- maximum number of inspections per result. -- int name=maxInspections5/int !-- minimum length of a query term to be considered for correction -- int name=minQueryLength4/int !-- maximum threshold
Re: help needed for applying patch to solr I am using
hi all just checked out this issue was already incorporated in solr4.0 alpha and I am using solr4.1.0 so this must have been in this as wellbut still why am I not getting suggestions for word like microvave oven its stating it to be correct and returning results based of oven wordwhy is this happening? any one please help and when I am querying it like microvave oven its providing corrected suggestionhow to handle this any one please help... thanks regards Rohan On Mon, Apr 8, 2013 at 1:18 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I am new to solr and wanted to apply this patch to my solr how can I do this searched on net but did not got any thing useful the patch is: https://issues.apache.org/jira/browse/SOLR-2585 I am using solr 4.1.0 on tomcat6 in redhat centos. thanks regards rohan
Re: help needed for applying patch to solr I am using
hi all I think I have to pass the query in inverted commas then its returning correct results as i needed. thanks regards Rohan On Mon, Apr 8, 2013 at 1:50 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all just checked out this issue was already incorporated in solr4.0 alpha and I am using solr4.1.0 so this must have been in this as wellbut still why am I not getting suggestions for word like microvave oven its stating it to be correct and returning results based of oven wordwhy is this happening? any one please help and when I am querying it like microvave oven its providing corrected suggestionhow to handle this any one please help... thanks regards Rohan On Mon, Apr 8, 2013 at 1:18 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I am new to solr and wanted to apply this patch to my solr how can I do this searched on net but did not got any thing useful the patch is: https://issues.apache.org/jira/browse/SOLR-2585 I am using solr 4.1.0 on tomcat6 in redhat centos. thanks regards rohan
query regarding spell suggestions for multiple word query
hi all I wanted to know how can I generate spell suggestion for more than one word query my suggestions are working well for single word correction but when I pass more then one word query and any one of them is correct and other is wrong spelled the sentence is showns as correct and the results appears based on the correctly spelled word rather than suggesting correction to the word out of them which is wrongly spelled. for example I query for q=microwave ovan in this ovan is miss spelled and must be given suggestion but rather than giving suggestion for ovan as oven solr is stating that the sentence is correct and showing results based on microwave which is indeed correct word but complete sentence is not correct as whole...since ovan is misspelledit should rather provide suggestion and when I query for q=ovan separately it gives corrected suggestion for it as oven.so sugestion is working fine how can I use it for complete sentence not just word? help please thanks regards Rohan
Re: how to avoid single character to get indexed for directspellchecker dictionary
hi james after using this its working file for delll but not for de. what does this minbreaklength signifies? also can you tell me why am I not getting suggestions for smaller words like for del i should get dell as suggestion but its not giving any suggestions and also can I get suggestion for like complete the sentence like if I give sams it should also give samsung as in suggestion? thanks regards Rohan On Fri, Apr 5, 2013 at 12:54 AM, Dyer, James james.d...@ingramcontent.comwrote: I assume if your user queries delll and it breaks it into pieces like de l l l, then you're probably using WordBreakSolrSpellChecker in addition to DirectSolrSpellChecker, right? If so, then you can specify minBreakLength in solrconfig.xml like this: searchComponent name=spellcheck class=solr.SpellCheckComponent ... spellcheckers here ... lst name=spellchecker str name=namewordbreak/str str name=classnamesolr.WordBreakSolrSpellChecker/str ... parameters here ... int name=minBreakLength5/int /lst /searchComponent One note is that both DirectSolrSpellChecker and WordBreakSolrSpellChecker operate directly on the terms dictionary and do not have a separate dictionary like IndexBasedSpellChecker. The only way to prevent a word from being in the dictionary then is to filter this out in the analysis chain. For instance, if you use copyField / to build a field just for spellchecking, you can use LengthFilterFactory to remove the short terms. See http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LengthFilterFactory. James Dyer Ingram Content Group (615) 213-4311 -Original Message- From: Rohan Thakur [mailto:rohan.i...@gmail.com] Sent: Thursday, April 04, 2013 1:42 PM To: solr-user@lucene.apache.org Subject: how to avoid single character to get indexed for directspellchecker dictionary hi all I am using solr directspellcheker for spell suggestions using raw analyses for indexing but I have some fields which have single characters like l L so its is been indexed in the dictionary and when I am using this for suggestions for query like delll its suggesting de and l l l as the spell correction as my index has de and l as single characters in the fields. please help. thanks regards Rohan
Re: how to avoid single character to get indexed for directspellchecker dictionary
hi james I have tried using length filter factory as well but it seems that it is removing the single character from the index but when I qeuery for delll it is still giving dell l in suggestions this I think is due to querying the term like dell l solr can find the result as in it will tokenise dell and l and will return the results with dell in the documents so to remove such thing do I have to use minbreaklenth? and what is the significance of minbreak length number? On Fri, Apr 5, 2013 at 12:20 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi james after using this its working file for delll but not for de. what does this minbreaklength signifies? also can you tell me why am I not getting suggestions for smaller words like for del i should get dell as suggestion but its not giving any suggestions and also can I get suggestion for like complete the sentence like if I give sams it should also give samsung as in suggestion? thanks regards Rohan On Fri, Apr 5, 2013 at 12:54 AM, Dyer, James james.d...@ingramcontent.com wrote: I assume if your user queries delll and it breaks it into pieces like de l l l, then you're probably using WordBreakSolrSpellChecker in addition to DirectSolrSpellChecker, right? If so, then you can specify minBreakLength in solrconfig.xml like this: searchComponent name=spellcheck class=solr.SpellCheckComponent ... spellcheckers here ... lst name=spellchecker str name=namewordbreak/str str name=classnamesolr.WordBreakSolrSpellChecker/str ... parameters here ... int name=minBreakLength5/int /lst /searchComponent One note is that both DirectSolrSpellChecker and WordBreakSolrSpellChecker operate directly on the terms dictionary and do not have a separate dictionary like IndexBasedSpellChecker. The only way to prevent a word from being in the dictionary then is to filter this out in the analysis chain. For instance, if you use copyField / to build a field just for spellchecking, you can use LengthFilterFactory to remove the short terms. See http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LengthFilterFactory. James Dyer Ingram Content Group (615) 213-4311 -Original Message- From: Rohan Thakur [mailto:rohan.i...@gmail.com] Sent: Thursday, April 04, 2013 1:42 PM To: solr-user@lucene.apache.org Subject: how to avoid single character to get indexed for directspellchecker dictionary hi all I am using solr directspellcheker for spell suggestions using raw analyses for indexing but I have some fields which have single characters like l L so its is been indexed in the dictionary and when I am using this for suggestions for query like delll its suggesting de and l l l as the spell correction as my index has de and l as single characters in the fields. please help. thanks regards Rohan
solr spell suggestions help
hi all I had some issues with solr spell suggestions. 1) first of all I wanted to know is indexbased spell suggestions better then directspell suggestions that solr 4.1 provides in any way? 2) then I wanted to know is their way I can get suggestions for words providing only few prefix for the word. like when I query sam I should get samsung as one of suggestion. 3) also I wanted to know why am I not getting suggestions for the words that have more then 2 character difference between them like if I query for wirlpool wich has 8 characters I get suggestion as whirlpool which is 9 characters and correct spelling but when I query for wirlpol which is 7 characters it says that this is false spelling but does not show any suggestions. even like if I search for pansonic(8 char) it provides panasonic(9 char) as suggestion but when I remove one more character that is is search for panonic(7 char) it does not return any suggestions?? how can I correct this? even when I search for ipo it does not return ipod as suggestions? 4) one more thing I want to get clear that when I search for microwave ovan it does not give any miss spell even when ovan is wrong it provides the result for microwave saying the query is correct...this is the case when one of the term in the query is correct while others are incorrect it does not point out the wrong spelling one but reutrns the result for correct word thats it how can I correct this? similar is the case when I query for microvave oven is shows the result for oven saying that the query is correct.. 5) one more case is when I query plntronies (correct word is: plantronics) it does not return any solution but when I query for plantronies it returns the plantronics as suggestions why is that happening? *my schema.xml is:* fieldType name=tSpell class=solr.TextField positionIncrementGap=100 omitNorms=true analyzer type=index charFilter class=solr.PatternReplaceCharFilterFactory pattern=\\\[\]\(\)\-\,\/\+ replacement= / tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LengthFilterFactory min=2 max=20/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LengthFilterFactory min=2 max=20/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer /fieldType field name=spell type=tSpell indexed=true stored=true / copyField source=title dest=spell / *my solrconfig.xml is :* searchComponent name=spellcheck class=solr.SpellCheckComponent !-- Multiple Spell Checkers can be declared and used by this component -- !-- a spellchecker built from a field of the main index -- lst name=spellchecker !-- Optional, it is required when more than one spellchecker is configured. Select non-default name with spellcheck.dictionary in request handler. -- *str name=namedefault/str* str name=classnamesolr.DirectSolrSpellChecker/str !-- the spellcheck distance measure used, the default is the internal levenshtein -- !-- Load tokens from the following field for spell checking, analyzer for the field's type as defined in schema.xml are used -- *str name=fieldspell/str str name=distanceMeasureinternal/str !-- minimum accuracy needed to be considered a valid spellcheck suggestion -- float name=accuracy0.3/float !-- the maximum #edits we consider when enumerating terms: can be 1 or 2 -- int name=maxEdits1/int !-- the minimum shared prefix when enumerating terms -- int name=minPrefix1/int !-- maximum number of inspections per result. -- int name=maxInspections5/int !-- minimum length of a query term to be considered for correction -- int name=minQueryLength4/int !-- maximum threshold of documents a query term can appear to be considered for correction -- float name=maxQueryFrequency0.01/float !-- uncomment this to require suggestions to occur in 1% of the documents float name=thresholdTokenFrequency.01/float -- /lst* !-- a spellchecker that can break or combine words. See /spell handler below for usage -- *lst name=spellchecker str name=namewordbreak/str str name=classnamesolr.WordBreakSolrSpellChecker/str str name=fieldspell/str str name=combineWordstrue/str str name=breakWordstrue/str int name=maxChanges3/int !-- int name=minBreakLength5/int -- /lst*
how to avoid single character to get indexed for directspellchecker dictionary
hi all I am using solr directspellcheker for spell suggestions using raw analyses for indexing but I have some fields which have single characters like l L so its is been indexed in the dictionary and when I am using this for suggestions for query like delll its suggesting de and l l l as the spell correction as my index has de and l as single characters in the fields. please help. thanks regards Rohan
Re: is there a way we can build spell dictionary from solr index such that it only take words leaving all`special characters
hi upayavira you mean to say that I dont have to follow this : http://wiki.apache.org/solr/SpellCheckComponent and directly I can create spell check field from copyfield and use it...I dont have to build dictionary on the fieldjust use copyfield for spell suggetions? thanks regards Rohan On Wed, Mar 13, 2013 at 12:56 PM, Upayavira u...@odoko.co.uk wrote: Use text analysis and copyField to create a new field that has terms as you expect them. Then use that for your spellcheck dictionary. Note, since 4.0, you don't need to create a dictionary. Solr can use your index directly. Upayavira On Wed, Mar 13, 2013, at 06:00 AM, Rohan Thakur wrote: while building the spell dictionary... On Wed, Mar 13, 2013 at 11:29 AM, Rohan Thakur rohan.i...@gmail.com wrote: even do not want to break the words as in samsung to s a m s u n g or sII ti s II ir s2 to s 2 On Wed, Mar 13, 2013 at 11:28 AM, Rohan Thakur rohan.i...@gmail.com wrote: k as in like if the field I am indixing from the database like title that has characters like () - # /n// example: Screenguard for Samsung Galaxy SII (Matt and Gloss) (with Dual Protection, Cleaning Cloth and Bubble Remover) or samsung-galaxy-sii-screenguard-matt-and-gloss.html or /s/a/samsung_galaxy_sii_i9100_pink_.jpg or 4.27-inch Touchscreen, 3G, Android v2.3 OS, 8MP Camera with LED Flash now I do not want to build the spell dictionary to only include the words not any of the - , _ . ( ) /s/a/ or numeric like 4.27 how can I do that? thanks regards Rohan On Tue, Mar 12, 2013 at 11:06 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: Sorry, leaving them where? Can you give a concrete example or problem. Regards, Alex On Mar 12, 2013 1:31 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know is there way we can make spell dictionary from solr index such that it only takes words from the index leaving all the special characters and unwanted characters. thanks regards Rohan
query regarding running solr4.1.0 on tomcat6
hi all I had installed tomcat6 on centos redhat linux os and had configured solr with name on solrt on tomcat and It was running fine now what I did was placed another copy of solr home folder in centos and changed the tomcat directory to this new solr and now every thing is working fine like the full database import and all from the browser and query from browser but when I open the solr-example/admin(the default solr admin panel ) from browser it shows the error that : http://localhost:8080/solr-example/#/ HTTP Status 404 - -- *type* Status report *message* *description* *The requested resource () is not available.* -- Apache Tomcat/6.0.24 and other wise when I hit http://localhost:8080/solr-example/collection1/select?q=samsung%20duoswt=jsonindent=truerows=20 its running fine and even if i hit http://localhost:8080/solr-example/dataimport?command=full-importindent=trueclean=true its running fine and even in the tomcat manager panal I can see solr-example and when I click on it shows the same error. 404 what could be the problem with the solr admin panel help anyone. thanks regards rohan
Re: had query regarding the indexing and analysers
hi
does this means that while indexing also ace is been stored as ac in solr
index?
thanks
regards
Rohan
On Fri, Mar 22, 2013 at 9:49 AM, Jack Krupansky j...@basetechnology.comwrote:
Actually, it's the Porter Stemmer that is turning ace into ac.
Try making a copy of text_en_splitting and delete the
PorterStemFilterFactory filter from both the query and index analyzers.
-- Jack Krupansky
-Original Message- From: Rohan Thakur
Sent: Wednesday, March 20, 2013 8:39 AM
To: solr-user@lucene.apache.org
Subject: Re: had query regarding the indexing and analysers
hi jack
I have been using text_en_splitting initially but what it was doing is it
is changing by query aswell
for example:
if i am searching for ace term it is taking it as ac thus giving split
ac higher score...
see debug statment:
debug:{
rawquerystring:ace,
querystring:ace,
parsedquery:(+**DisjunctionMaxQuery((title:ac^**30.0)))/no_coord,
parsedquery_toString:+(**title:ac^30.0),
explain:{
:\n1.8650155 = (MATCH) weight(title:ac^30.0 in 469)
[DefaultSimilarity], result of:\n 1.8650155 = fieldWeight in 469,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n
0.4375 = fieldNorm(doc=469)\n,
:\n1.8650155 = (MATCH) weight(title:ac^30.0 in 470)
[DefaultSimilarity], result of:\n 1.8650155 = fieldWeight in 470,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n
0.4375 = fieldNorm(doc=470)\n,
:\n1.8650155 = (MATCH) weight(title:ac^30.0 in 471)
[DefaultSimilarity], result of:\n 1.8650155 = fieldWeight in 471,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n
0.4375 = fieldNorm(doc=471)\n,
:\n1.8650155 = (MATCH) weight(title:ac^30.0 in 472)
[DefaultSimilarity], result of:\n 1.8650155 = fieldWeight in 472,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n
0.4375 = fieldNorm(doc=472)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 331)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 331,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=331)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 332)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 332,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=332)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 335)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 335,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=335)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 336)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 336,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=336)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 337)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 337,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=337)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 393)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 393,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=393)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 425)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 425,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=425)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 426)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 426,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=426)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 429)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 429,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375
= fieldNorm(doc=429)\n,
:\n1.5985848 = (MATCH) weight(title:ac^30.0 in 430)
[DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 430,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045
Re: had query regarding the indexing and analysers
in 434) [DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 434, product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 = termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375 = fieldNorm(doc=434)\n, :\n1.5985848 = (MATCH) weight(title:ac^30.0 in 502) [DefaultSimilarity], result of:\n 1.5985848 = fieldWeight in 502, product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 = termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n0.375 = fieldNorm(doc=502)\n, :\n1.332154 = (MATCH) weight(title:ac^30.0 in 411) [DefaultSimilarity], result of:\n 1.332154 = fieldWeight in 411, product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 = termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n 0.3125 = fieldNorm(doc=411)\n, :\n1.332154 = (MATCH) weight(title:ac^30.0 in 424) [DefaultSimilarity], result of:\n 1.332154 = fieldWeight in 424, product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 = termFreq=1.0\n4.2628927 = idf(docFreq=39, maxDocs=1045)\n 0.3125 = fieldNorm(doc=424)\n}, QParser:ExtendedDismaxQParser, On Tue, Mar 19, 2013 at 7:37 PM, Jack Krupansky j...@basetechnology.comwrote: Yeah, one ambiguity in typography is whether a hyphen is internal to a compound term (e.g., CD-ROM) or a phrase separator as in your case. Some people are careful to put spaces around the hyphen for a phrase delimiter, but plenty of people still just drop it in directly adjacent to two words. In your case, text_en_splitting_tight is SPECIFICALLY trying to keep Laptop-DUAL together as a single term, so that wi fi is kept distinct from Wi-Fi. Try text_en_splitting, which specifically is NOT trying to keep them together. The key clue here is that the former does not have generateWordParts=1. That is the option that is needed so that Laptop-DUAL will be indexed as laptop dual. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Tuesday, March 19, 2013 3:35 AM To: solr-user@lucene.apache.org Subject: Re: had query regarding the indexing and analysers my default is title only I have used debug as well it shows that solr divides the query into dual and core and then searches both separately now while calculating the scores it puts the document in which both the terms appear and in my case the document containing this title: Wipro 7710U Laptop-DUAL CORE 1.4 Ghz-120GB HDD solr has found only core term not dual as I guess it is attached to laptop term not as even searching for only dual term this document doesnot show up which is why this document sshows down in the search results thus I am not able to search for partial terms for that I have to apply *dual in the query then it is searching this document but then other search scoring gets affected with this when I put * in the query terms I think I have to remove the - terms from the strings before indexing them point me if i am wrong any where thanks regards Rohan On Sat, Mar 16, 2013 at 7:02 PM, Erick Erickson erickerick...@gmail.com* *wrote: See admin/analysis, it's invaluable. Probably The terms are being searched against your default text field which I'd guess is not title. Also, try adding debug=all to your query and look in the debug info at the parsed form of the query to see what's actually being searched. Best Erick On Fri, Mar 15, 2013 at 2:52 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know I have this string in field title : Wipro 7710U Laptop-DUAL CORE 1.4 Ghz-120GB HDD I have indexed it using text-en-splliting-tight and now I am searching for term like q=dual core but in the relevance part its this title is coming down the order as solr is not searching dual in this string its just searching core term from the query in this string thus multiplying the score for this field by 1/2 decreasing the score. how can I correct this can any one help thanks regards Rohan
Re: wanted to know can we some how know what are the documents that are exact match in solr
yes that I know but I want to know that is there way I can separate them in search results...the exact match one? On Fri, Mar 15, 2013 at 10:18 PM, Jack Krupansky j...@basetechnology.comwrote: The explain section that is returned if you specify the debugQuery=true parameter will provides the details of what terms matched for each document. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Friday, March 15, 2013 9:19 AM To: solr-user@lucene.apache.org Subject: wanted to know can we some how know what are the documents that are exact match in solr hi all I need to pass some variable or some flag with the exact match document than the others like say I have 3 terms in the search query so I need to know the documents in which all three words are found from the other documents in which only 1 or 2 out of three terms are matched. any help would be great thanks regards rohan
Re: removing all fields before full import using DIH
k thanks yes I dint checked it before I was using DIH full import directly and one day I observed that my solr search was giving duplicate results then I deleted all the entries and re index the dataand after that for ensure that this does not happen I always use delete first then do full import...k so this automatically does that... thanks for confirming. regards Rohan On Mon, Mar 18, 2013 at 1:32 PM, Gora Mohanty g...@mimirtech.com wrote: On 18 March 2013 13:09, Rohan Thakur rohan.i...@gmail.com wrote: hi all how can I ensure that I have delete all the fields for solr before doing full import in DIH only? the aim is that my database is pretty small so full import takes only 3-4 sec. thus I do not require delta import for now and I want to ensure that when ever I do full import of the database the duplicate field do not get indexed that is multiple instances of same document does not get indexed so want to delete all the documents first and then reindex using full import. any one help. Have you tried a full-import? What you want is done by default by DIH, unless one specifies clean=false as a query parameter to the full-import URL. Regards, Gora
Re: is there a way we can build spell dictionary from solr index such that it only take words leaving all`special characters
even do not want to break the words as in samsung to s a m s u n g or sII ti s II ir s2 to s 2 On Wed, Mar 13, 2013 at 11:28 AM, Rohan Thakur rohan.i...@gmail.com wrote: k as in like if the field I am indixing from the database like title that has characters like () - # /n// example: Screenguard for Samsung Galaxy SII (Matt and Gloss) (with Dual Protection, Cleaning Cloth and Bubble Remover) or samsung-galaxy-sii-screenguard-matt-and-gloss.html or /s/a/samsung_galaxy_sii_i9100_pink_.jpg or 4.27-inch Touchscreen, 3G, Android v2.3 OS, 8MP Camera with LED Flash now I do not want to build the spell dictionary to only include the words not any of the - , _ . ( ) /s/a/ or numeric like 4.27 how can I do that? thanks regards Rohan On Tue, Mar 12, 2013 at 11:06 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: Sorry, leaving them where? Can you give a concrete example or problem. Regards, Alex On Mar 12, 2013 1:31 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know is there way we can make spell dictionary from solr index such that it only takes words from the index leaving all the special characters and unwanted characters. thanks regards Rohan
Re: is there a way we can build spell dictionary from solr index such that it only take words leaving all`special characters
while building the spell dictionary... On Wed, Mar 13, 2013 at 11:29 AM, Rohan Thakur rohan.i...@gmail.com wrote: even do not want to break the words as in samsung to s a m s u n g or sII ti s II ir s2 to s 2 On Wed, Mar 13, 2013 at 11:28 AM, Rohan Thakur rohan.i...@gmail.comwrote: k as in like if the field I am indixing from the database like title that has characters like () - # /n// example: Screenguard for Samsung Galaxy SII (Matt and Gloss) (with Dual Protection, Cleaning Cloth and Bubble Remover) or samsung-galaxy-sii-screenguard-matt-and-gloss.html or /s/a/samsung_galaxy_sii_i9100_pink_.jpg or 4.27-inch Touchscreen, 3G, Android v2.3 OS, 8MP Camera with LED Flash now I do not want to build the spell dictionary to only include the words not any of the - , _ . ( ) /s/a/ or numeric like 4.27 how can I do that? thanks regards Rohan On Tue, Mar 12, 2013 at 11:06 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: Sorry, leaving them where? Can you give a concrete example or problem. Regards, Alex On Mar 12, 2013 1:31 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know is there way we can make spell dictionary from solr index such that it only takes words from the index leaving all the special characters and unwanted characters. thanks regards Rohan
Re: is there a way we can build spell dictionary from solr index such that it only take words leaving all`special characters
k as in like if the field I am indixing from the database like title that has characters like () - # /n// example: Screenguard for Samsung Galaxy SII (Matt and Gloss) (with Dual Protection, Cleaning Cloth and Bubble Remover) or samsung-galaxy-sii-screenguard-matt-and-gloss.html or /s/a/samsung_galaxy_sii_i9100_pink_.jpg or 4.27-inch Touchscreen, 3G, Android v2.3 OS, 8MP Camera with LED Flash now I do not want to build the spell dictionary to only include the words not any of the - , _ . ( ) /s/a/ or numeric like 4.27 how can I do that? thanks regards Rohan On Tue, Mar 12, 2013 at 11:06 PM, Alexandre Rafalovitch arafa...@gmail.comwrote: Sorry, leaving them where? Can you give a concrete example or problem. Regards, Alex On Mar 12, 2013 1:31 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all wanted to know is there way we can make spell dictionary from solr index such that it only takes words from the index leaving all the special characters and unwanted characters. thanks regards Rohan
Re: query about length normalization in solr for relevance score
k thanks On Wed, Mar 6, 2013 at 5:05 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi Rohan, It's per field. Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Mar 6, 2013 at 3:09 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I wanted to confirm that while taking length normalization of document into count while calculating the scores of the document in solr does solr take length of complete document or the particular field in the document that we are querying on. Like I have 5 fields in each document but when I am querying I am searching on one default single field so I wanted to know does solr not takes the length of this single field in to count for the document or total length of the document that is adding length of all the fields in that document. thanks in advance. regards Rohan
Re: query about length normalization in solr for relevance score
one more thing how does the solr handles the score when we have multiple words as query parameters which are not consecutively present in the filed that is indexed and we are querying on does it first searches for document field containing both the term and then how does is find the scoring on them taking both the words collectively or separating them and adding the scores and if adding the scores then how does is find scores individually? On Wed, Mar 6, 2013 at 5:17 PM, Rohan Thakur rohan.i...@gmail.com wrote: k thanks On Wed, Mar 6, 2013 at 5:05 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi Rohan, It's per field. Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Mar 6, 2013 at 3:09 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I wanted to confirm that while taking length normalization of document into count while calculating the scores of the document in solr does solr take length of complete document or the particular field in the document that we are querying on. Like I have 5 fields in each document but when I am querying I am searching on one default single field so I wanted to know does solr not takes the length of this single field in to count for the document or total length of the document that is adding length of all the fields in that document. thanks in advance. regards Rohan
Re: query about length normalization in solr for relevance score
0.98851484 = (MATCH) weight(value:samsung in 15749) [DefaultSimilarity], result of:\n 0.98851484 = score(doc=15749,freq=1.0 = termFreq=1.0\n), product of:\n 0.4396593 = queryWeight, product of:\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.073329814 = queryNorm\n 2.2483656 = fieldWeight in 15749, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.375 = fieldNorm(doc=15749)\n1.915346 = (MATCH) weight(value:metallic in 15749) [DefaultSimilarity], result of:\n 1.915346 = score(doc=15749,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 = queryWeight, product of:\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.073329814 = queryNorm\n 3.129673 = fieldWeight in 15749, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.375 = fieldNorm(doc=15749)\n 0.667 = coord(2/3)\n, :\n1.9359072 = (MATCH) product of:\n 2.9038608 = (MATCH) sum of:\n0.98851484 = (MATCH) weight(value:samsung in 16803) [DefaultSimilarity], result of:\n 0.98851484 = score(doc=16803,freq=1.0 = termFreq=1.0\n), product of:\n 0.4396593 = queryWeight, product of:\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.073329814 = queryNorm\n 2.2483656 = fieldWeight in 16803, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.375 = fieldNorm(doc=16803)\n1.915346 = (MATCH) weight(value:metallic in 16803) [DefaultSimilarity], result of:\n 1.915346 = score(doc=16803,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 = queryWeight, product of:\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.073329814 = queryNorm\n 3.129673 = fieldWeight in 16803, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.375 = fieldNorm(doc=16803)\n 0.667 = coord(2/3)\n, :\n1.9359072 = (MATCH) product of:\n 2.9038608 = (MATCH) sum of:\n0.98851484 = (MATCH) weight(value:samsung in 21574) [DefaultSimilarity], result of:\n 0.98851484 = score(doc=21574,freq=1.0 = termFreq=1.0\n), product of:\n 0.4396593 = queryWeight, product of:\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.073329814 = queryNorm\n 2.2483656 = fieldWeight in 21574, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.375 = fieldNorm(doc=21574)\n1.915346 = (MATCH) weight(value:metallic in 21574) [DefaultSimilarity], result of:\n 1.915346 = score(doc=21574,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 = queryWeight, product of:\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.073329814 = queryNorm\n 3.129673 = fieldWeight in 21574, product of:\n 1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n 8.345795 = idf(docFreq=38, maxDocs=60437)\n 0.375 = fieldNorm(doc=21574)\n 0.667 = coord(2/3)\n}, thanks in advance regards Rohan On Wed, Mar 6, 2013 at 10:14 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: That's a mighty long sentence, Rohan! :) If you append debugQuery=true to the query URL you will see the scoring explanation in all its glory. Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Mar 6, 2013 at 6:55 AM, Rohan Thakur rohan.i...@gmail.com wrote: one more thing how does the solr handles the score when we have multiple words as query parameters which are not consecutively present in the filed that is indexed and we are querying on does it first searches for document field containing both the term and then how does is find the scoring on them taking both the words collectively or separating them and adding the scores and if adding the scores then how does is find scores individually? On Wed, Mar 6, 2013 at 5:17 PM, Rohan Thakur rohan.i...@gmail.com wrote: k thanks On Wed, Mar 6, 2013 at 5:05 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi Rohan, It's per field. Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Mar 6, 2013 at 3:09 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I wanted to confirm that while taking length normalization of document into count while calculating the scores of the document in solr does solr take length of complete document or the particular field in the document that we are querying on. Like I have 5 fields in each document but when I am querying I am searching on one default single field so I wanted to know does solr not takes the length of this single field
Re: query about length normalization in solr for relevance score
hi
I think its not readable but if you open this in editor that gmail has like
while replying you can se the text in proper format that is indent.I tried
saving this output in other formats aswell but it is still the same...you
can see this properly while replying to the mail...
thanks
regards
Rohan
On Thu, Mar 7, 2013 at 11:48 AM, Rohan Thakur rohan.i...@gmail.com wrote:
yup I got that but can you please explain me how is it going on?
I got this:
rawquerystring:samsung ace metallic,
querystring:samsung ace metallic,
parsedquery:value:samsung value:ace value:metallic,
parsedquery_toString:value:samsung value:ace value:metallic,
explain:{
:\n4.261568 = (MATCH) sum of:\n 0.82376236 = (MATCH)
weight(value:samsung in 31646) [DefaultSimilarity], result of:\n
0.82376236 = score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n
0.4396593 = queryWeight, product of:\n5.9956417 = idf(docFreq=408,
maxDocs=60437)\n0.073329814 = queryNorm\n 1.873638 = fieldWeight
in 31646, product of:\n1.0 = tf(freq=1.0), with freq of:\n
1.0 = termFreq=1.0\n5.9956417 = idf(docFreq=408, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n 1.8416842 = (MATCH) weight(value:ace in
31646) [DefaultSimilarity], result of:\n1.8416842 =
score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n 0.65738964 =
queryWeight, product of:\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.8015108 = fieldWeight in 31646,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n 1.5961217 = (MATCH) weight(value:metallic in
31646) [DefaultSimilarity], result of:\n1.5961217 =
score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 =
queryWeight, product of:\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.6080608 = fieldWeight in 31646,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n,
:\n4.261568 = (MATCH) sum of:\n 0.82376236 = (MATCH)
weight(value:samsung in 31701) [DefaultSimilarity], result of:\n
0.82376236 = score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n
0.4396593 = queryWeight, product of:\n5.9956417 = idf(docFreq=408,
maxDocs=60437)\n0.073329814 = queryNorm\n 1.873638 = fieldWeight
in 31701, product of:\n1.0 = tf(freq=1.0), with freq of:\n
1.0 = termFreq=1.0\n5.9956417 = idf(docFreq=408, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n 1.8416842 = (MATCH) weight(value:ace in
31701) [DefaultSimilarity], result of:\n1.8416842 =
score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n 0.65738964 =
queryWeight, product of:\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.8015108 = fieldWeight in 31701,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n 1.5961217 = (MATCH) weight(value:metallic in
31701) [DefaultSimilarity], result of:\n1.5961217 =
score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 =
queryWeight, product of:\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.6080608 = fieldWeight in 31701,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n,
:\n2.843143 = (MATCH) product of:\n 4.2647142 = (MATCH) sum of:\n
1.3180199 = (MATCH) weight(value:samsung in 1646) [DefaultSimilarity],
result of:\n 1.3180199 = score(doc=1646,freq=1.0 = termFreq=1.0\n),
product of:\n0.4396593 = queryWeight, product of:\n
5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.073329814 =
queryNorm\n2.9978209 = fieldWeight in 1646, product of:\n
1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n
5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.5 =
fieldNorm(doc=1646)\n2.9466946 = (MATCH) weight(value:ace in 1646)
[DefaultSimilarity], result of:\n 2.9466946 = score(doc=1646,freq=1.0 =
termFreq=1.0\n), product of:\n0.65738964 = queryWeight, product of:\n
8.964834 = idf(docFreq=20, maxDocs=60437)\n 0.073329814 =
queryNorm\n4.482417 = fieldWeight in 1646, product of:\n 1.0
= tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n
8.964834 = idf(docFreq=20, maxDocs=60437)\n 0.5 =
fieldNorm(doc=1646)\n
Re: query about length normalization in solr for relevance score
If you can explain any one line of I will figure out othersthanks
On Thu, Mar 7, 2013 at 11:48 AM, Rohan Thakur rohan.i...@gmail.com wrote:
yup I got that but can you please explain me how is it going on?
I got this:
rawquerystring:samsung ace metallic,
querystring:samsung ace metallic,
parsedquery:value:samsung value:ace value:metallic,
parsedquery_toString:value:samsung value:ace value:metallic,
explain:{
:\n4.261568 = (MATCH) sum of:\n 0.82376236 = (MATCH)
weight(value:samsung in 31646) [DefaultSimilarity], result of:\n
0.82376236 = score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n
0.4396593 = queryWeight, product of:\n5.9956417 = idf(docFreq=408,
maxDocs=60437)\n0.073329814 = queryNorm\n 1.873638 = fieldWeight
in 31646, product of:\n1.0 = tf(freq=1.0), with freq of:\n
1.0 = termFreq=1.0\n5.9956417 = idf(docFreq=408, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n 1.8416842 = (MATCH) weight(value:ace in
31646) [DefaultSimilarity], result of:\n1.8416842 =
score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n 0.65738964 =
queryWeight, product of:\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.8015108 = fieldWeight in 31646,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n 1.5961217 = (MATCH) weight(value:metallic in
31646) [DefaultSimilarity], result of:\n1.5961217 =
score(doc=31646,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 =
queryWeight, product of:\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.6080608 = fieldWeight in 31646,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31646)\n,
:\n4.261568 = (MATCH) sum of:\n 0.82376236 = (MATCH)
weight(value:samsung in 31701) [DefaultSimilarity], result of:\n
0.82376236 = score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n
0.4396593 = queryWeight, product of:\n5.9956417 = idf(docFreq=408,
maxDocs=60437)\n0.073329814 = queryNorm\n 1.873638 = fieldWeight
in 31701, product of:\n1.0 = tf(freq=1.0), with freq of:\n
1.0 = termFreq=1.0\n5.9956417 = idf(docFreq=408, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n 1.8416842 = (MATCH) weight(value:ace in
31701) [DefaultSimilarity], result of:\n1.8416842 =
score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n 0.65738964 =
queryWeight, product of:\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.8015108 = fieldWeight in 31701,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.964834 = idf(docFreq=20, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n 1.5961217 = (MATCH) weight(value:metallic in
31701) [DefaultSimilarity], result of:\n1.5961217 =
score(doc=31701,freq=1.0 = termFreq=1.0\n), product of:\n 0.6119956 =
queryWeight, product of:\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.073329814 = queryNorm\n 2.6080608 = fieldWeight in 31701,
product of:\n1.0 = tf(freq=1.0), with freq of:\n 1.0 =
termFreq=1.0\n8.345795 = idf(docFreq=38, maxDocs=60437)\n
0.3125 = fieldNorm(doc=31701)\n,
:\n2.843143 = (MATCH) product of:\n 4.2647142 = (MATCH) sum of:\n
1.3180199 = (MATCH) weight(value:samsung in 1646) [DefaultSimilarity],
result of:\n 1.3180199 = score(doc=1646,freq=1.0 = termFreq=1.0\n),
product of:\n0.4396593 = queryWeight, product of:\n
5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.073329814 =
queryNorm\n2.9978209 = fieldWeight in 1646, product of:\n
1.0 = tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n
5.9956417 = idf(docFreq=408, maxDocs=60437)\n 0.5 =
fieldNorm(doc=1646)\n2.9466946 = (MATCH) weight(value:ace in 1646)
[DefaultSimilarity], result of:\n 2.9466946 = score(doc=1646,freq=1.0 =
termFreq=1.0\n), product of:\n0.65738964 = queryWeight, product of:\n
8.964834 = idf(docFreq=20, maxDocs=60437)\n 0.073329814 =
queryNorm\n4.482417 = fieldWeight in 1646, product of:\n 1.0
= tf(freq=1.0), with freq of:\n1.0 = termFreq=1.0\n
8.964834 = idf(docFreq=20, maxDocs=60437)\n 0.5 =
fieldNorm(doc=1646)\n 0.667 = coord(2/3)\n,
:\n2.2585583 = (MATCH) product of:\n 3.3878374 = (MATCH) sum of:\n
1.1532673 = (MATCH) weight(value:samsung in 3038) [DefaultSimilarity],
result of:\n 1.1532673 = score(doc=3038,freq=1.0
Re: solr search showing irrelevant results
I am using text_en_splitting as while indexing is that the problem?? On Mon, Mar 4, 2013 at 7:02 PM, Rohan Thakur rohan.i...@gmail.com wrote: hi all I wanted to know that why solr is showing irrelevant result as I search for galaxy ace its showing result sony bravia that does not have either of them galaxy or ace in the result but way down the order why is it doing so any Idea please help I do not want that to happen. thanks in advance regards Rohan
Re: solr search showing irrelevant results
thanks I got the problem it was with using *text_en_splitting* filed type for indexingwhich actually includes fuzzy results aswell...but I dont know it will take fuzzy results upto this extentnow im using *text_en_splitting_tight *and its giving correct results without fuzzy results On Tue, Mar 5, 2013 at 2:32 AM, Jack Krupansky j...@basetechnology.comwrote: Add debugQuery=true to your query and look at the explain section for details of why a document was scored as it was. Also look at the parsed query to see what fields it is actually searching. -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Monday, March 04, 2013 8:32 AM To: solr-user@lucene.apache.org Subject: solr search showing irrelevant results hi all I wanted to know that why solr is showing irrelevant result as I search for galaxy ace its showing result sony bravia that does not have either of them galaxy or ace in the result but way down the order why is it doing so any Idea please help I do not want that to happen. thanks in advance regards Rohan
Re: html parsing with dataimport handler from sql column
hi yes I dont have html as documents I have data saved in sql data base in HTML format and I want to index it on solr but not as complete string that is with tags but just want to index the actual text in it...that is strip off the tags. regards Rohan On Wed, Feb 20, 2013 at 6:40 PM, Gora Mohanty g...@mimirtech.com wrote: On 20 February 2013 18:31, Rohan Thakur rohan.i...@gmail.com wrote: hi all I have data stored in HTML format in a column in sql database and want to index the data from that field to solr how can I do that any one has idea please help. right now i am treating it as a string which is indexing complete HTML with tags as one string to solr. How do you want to process the HTML? If you simply want to strip HTML tags, please take a look at the HTMLStripTransformer http://wiki.apache.org/solr/DataImportHandler#HTMLStripTransformer Your title implies that you want to parse the HTML in some fashion. If so, you will need to do that on your own, e.g., by using a transformer. Regards, Gora
Re: solr file based spell suggestions
hi thanks I configured that using synonym mapping its now giving sII results on searching for s2. thanks regards Rohan On Thu, Feb 7, 2013 at 7:15 PM, Jack Krupansky j...@basetechnology.comwrote: Changing x to y (e.g., s2 to sII) is not a function of spell check or suggestion. Synonyms are a closer match, but can be difficult to configure properly. Good luck. You may be better off preprocessing the query at the application level and then generating the appropriate boolean logic, such as: (s2 OR sII). -- Jack Krupansky -Original Message- From: Rohan Thakur Sent: Thursday, February 07, 2013 8:24 AM To: solr-user@lucene.apache.org Subject: solr file based spell suggestions hi all I wanted to know how can I apply file based dictionary for spell suggestions such that if I search for s2 in the query it would take it as sII which also represent same thing in my indexed field...but as in search it can also be interpreted as s2 please help anyone... thanks regards Rohan
Re: auto trigger the delta import to update index in solr if any update in sql database
hi thanks but I think this one is for ms sql not for mysql regards Rohan On Wed, Feb 6, 2013 at 11:53 AM, jp gj...@ramco.com wrote: The following link provides on using external activator for tracking DB changes http://ajitananthram.wordpress.com/2012/05/26/auditing-external-activator/ --JP -- View this message in context: http://lucene.472066.n3.nabble.com/auto-trigger-the-delta-import-to-update-index-in-solr-if-any-update-in-sql-database-tp4038525p4038715.html Sent from the Solr - User mailing list archive at Nabble.com.
auto trigger the delta import to update index in solr if any update in sql database
hi everyone is their any way in which we can auto trigger the delta import to update index in solr if their any update in sql database. thanks regards Rohan
Re: auto trigger the delta import to update index in solr if any update in sql database
that is gud but it will not take care of the field that is dynamical changing like and want to do realtime update for that fieldits not possible to set cron to cal DIH every second... On Tue, Feb 5, 2013 at 5:19 PM, Alexandre Rafalovitch arafa...@gmail.comwrote: If you have your deltaQuery setup in DIH, that should check for updates. Then you just ping DIH Url periodically to get it to check. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Tue, Feb 5, 2013 at 5:39 AM, Rohan Thakur rohan.i...@gmail.com wrote: hi everyone is their any way in which we can auto trigger the delta import to update index in solr if their any update in sql database. thanks regards Rohan
Re: auto trigger the delta import to update index in solr if any update in sql database
hi jp thanks can you provide me any good link for thisthanks regards Rohan On Tue, Feb 5, 2013 at 6:52 PM, jp gj...@ramco.com wrote: You could use SQL service Broker External Activation service to monitor the changes and post the changes into the Solr Index using update request handler in soft commit mode --JP -- View this message in context: http://lucene.472066.n3.nabble.com/auto-trigger-the-delta-import-to-update-index-in-solr-if-any-update-in-sql-database-tp4038525p4038554.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: help with getting error with mysql driver connection in solr 4.1
hi arcadius
I also tried going by this blog but in this too I am not able to use curl
for update now it gives can not resolve host even if I can open the host
using browserplease can you help me with thisI want to do partial
document update for specific field...
thanks
regards
Rohan
On Mon, Feb 4, 2013 at 1:29 PM, Rohan Thakur rohan.i...@gmail.com wrote:
hi arcadius
can you also help me with partial document update...I have followed what
is written in this blog but its giving me error
http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/
error im getting after this command :
C:\Users\rohancurl localhost:8983/solr/update?commit=true -H
Content-type:appli
cation/json -d [{value:samsung-s5610-gray,value:{set:samsung-111}}]
{responseHeader:{status:500,QTime:3},error:{msg:Expected
string: char
=v,position=2 BEFORE='[{v'
AFTER='alue:samsung-s5610-gray,value:{set:sams',tra
ce:org.apache.noggit.JSONParser$ParseException: Expected string:
char=v,positi
on=2 BEFORE='[{v' AFTER='alue:samsung-s5610-gray,value:{set:sams'\r\n\tat
org.ap
ache.noggit.JSONParser.err(JSONParser.java:221)\r\n\tat
org.apache.noggit.JSONPa
rser.nextEvent(JSONParser.java:670)\r\n\tat
org.apache.solr.handler.loader.JsonL
oader$SingleThreadedJsonLoader.parseField(JsonLoader.java:425)\r\n\tat
org.apach
e.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.parseDoc(JsonLoader.ja
va:414)\r\n\tat
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoad
er.handleAdds(JsonLoader.java:386)\r\n\tat
org.apache.solr.handler.loader.JsonLo
ader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:112)\r\n\tat
org.apa
che.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java
:96)\r\n\tat
org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:60)\
r\n\tat
org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler
.java:92)\r\n\tat
org.apache.solr.handler.ContentStreamHandlerBase.handleRequest
Body(ContentStreamHandlerBase.java:74)\r\n\tat
org.apache.solr.handler.RequestHa
ndlerBase.handleRequest(RequestHandlerBase.java:135)\r\n\tat
org.apache.solr.cor
e.SolrCore.execute(SolrCore.java:1816)\r\n\tat
org.apache.solr.servlet.SolrDispa
tchFilter.execute(SolrDispatchFilter.java:448)\r\n\tat
org.apache.solr.servlet.S
olrDispatchFilter.doFilter(SolrDispatchFilter.java:269)\r\n\tat
org.eclipse.jett
y.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)\r\n\t
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
\r\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:
560)\r\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHan
dler.java:231)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(
ContextHandler.java:1072)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler.doSco
pe(ServletHandler.java:382)\r\n\tat
org.eclipse.jetty.server.session.SessionHand
ler.doScope(SessionHandler.java:193)\r\n\tat
org.eclipse.jetty.server.handler.Co
ntextHandler.doScope(ContextHandler.java:1006)\r\n\tat
org.eclipse.jetty.server.
handler.ScopedHandler.handle(ScopedHandler.java:135)\r\n\tat
org.eclipse.jetty.s
erver.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
\r\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollec
tion.java:154)\r\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(Ha
ndlerWrapper.java:116)\r\n\tat
org.eclipse.jetty.server.Server.handle(Server.jav
a:365)\r\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abs
tractHttpConnection.java:485)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConne
ction.handleRequest(BlockingHttpConnection.java:53)\r\n\tat
org.eclipse.jetty.se
rver.AbstractHttpConnection.content(AbstractHttpConnection.java:937)\r\n\tat
org
.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttp
Connection.java:998)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpPar
ser.java:856)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParse
r.java:240)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handle(Block
ingHttpConnection.java:72)\r\n\tat
org.eclipse.jetty.server.bio.SocketConnector$
ConnectorEndPoint.run(SocketConnector.java:264)\r\n\tat
org.eclipse.jetty.util.t
hread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)\r\n\tat
org.eclipse.jet
ty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)\r\n\tat
java.la
ng.Thread.run(Unknown Source)\r\n,code:500}}
and nothing is changed for the field value
am I doing something wrong here?
regards
Rohan
On Mon, Feb 4, 2013 at 11:24 AM, Rohan Thakur rohan.i...@gmail.comwrote:
It worked thanks alot Arcadius..
On Fri, Feb 1, 2013 at 7:56 PM, Arcadius Ahouansou
arcad...@menelic.comwrote:
Hi
Re: help with getting error with mysql driver connection in solr 4.1
hi gora
I have tried what you told but now its giving error like:
C:\Users\rohancurl 127.0.0.1:8983/solr/update?commit=true -H
Content-type:appl
ication/json -d '[{value:samsung-wave-s5253-silver,
value:{set:samsung
-111}}]'
{responseHeader:{status:500,QTime:1},error:{msg:JSON Parse
Error: cha
r=',position=0 BEFORE='''
AFTER='[{value:samsung-wave-s5253-silver,',trace:o
rg.apache.noggit.JSONParser$ParseException: JSON Parse Error:
char=',position=0
BEFORE=''' AFTER='[{value:samsung-wave-s5253-silver,'\r\n\tat
org.apache.noggit.
JSONParser.err(JSONParser.java:221)\r\n\tat
org.apache.noggit.JSONParser.next(JS
ONParser.java:620)\r\n\tat
org.apache.noggit.JSONParser.nextEvent(JSONParser.jav
a:662)\r\n\tat
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoade
r.processUpdate(JsonLoader.java:106)\r\n\tat
org.apache.solr.handler.loader.Json
Loader$SingleThreadedJsonLoader.load(JsonLoader.java:96)\r\n\tat
org.apache.solr
.handler.loader.JsonLoader.load(JsonLoader.java:60)\r\n\tat
org.apache.solr.hand
ler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)\r\n\tat
org.apache
.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBas
e.java:74)\r\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(Requ
estHandlerBase.java:135)\r\n\tat
org.apache.solr.core.SolrCore.execute(SolrCore.
java:1816)\r\n\tat
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispat
chFilter.java:448)\r\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(S
olrDispatchFilter.java:269)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler$Cac
hedChain.doFilter(ServletHandler.java:1307)\r\n\tat
org.eclipse.jetty.servlet.Se
rvletHandler.doHandle(ServletHandler.java:453)\r\n\tat
org.eclipse.jetty.server.
handler.ScopedHandler.handle(ScopedHandler.java:137)\r\n\tat
org.eclipse.jetty.s
ecurity.SecurityHandler.handle(SecurityHandler.java:560)\r\n\tat
org.eclipse.jet
ty.server.session.SessionHandler.doHandle(SessionHandler.java:231)\r\n\tat
org.e
clipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)\r\
n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)\
r\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.j
ava:193)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(Context
Handler.java:1006)\r\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle
(ScopedHandler.java:135)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler
Collection.handle(ContextHandlerCollection.java:255)\r\n\tat
org.eclipse.jetty.s
erver.handler.HandlerCollection.handle(HandlerCollection.java:154)\r\n\tat
org.e
clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)\r\n\t
at org.eclipse.jetty.server.Server.handle(Server.java:365)\r\n\tat
org.eclipse.j
etty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485
)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(Blocking
HttpConnection.java:53)\r\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.
content(AbstractHttpConnection.java:937)\r\n\tat
org.eclipse.jetty.server.Abstra
ctHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)\r\n\tat
org.ec
lipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)\r\n\tat
org.ecli
pse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)\r
\n\tat
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(Socket
Connector.java:264)\r\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJo
b(QueuedThreadPool.java:608)\r\n\tat
org.eclipse.jetty.util.thread.QueuedThreadP
ool$3.run(QueuedThreadPool.java:543)\r\n\tat java.lang.Thread.run(Unknown
Source
)\r\n,code:500}}
curl: (6) Could not resolve host: value:set:samsung-111; Host not found
even in place of 127.0.0.1 i have tried using localhostbut it still
gives this error...im using this from command line in windows
On Mon, Feb 4, 2013 at 2:07 PM, Gora Mohanty g...@mimirtech.com wrote:
On 4 February 2013 13:29, Rohan Thakur rohan.i...@gmail.com wrote:
hi arcadius
can you also help me with partial document update...I have followed what
is
written in this blog but its giving me error
http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/
error im getting after this command :
C:\Users\rohancurl localhost:8983/solr/update?commit=true -H
Content-type:appli
cation/json -d
[{value:samsung-s5610-gray,value:{set:samsung-111}}]
[...]
I am guessing it is a shell-quoting problem. Please follow
the instructions in that blog carefully. You probably need to
double-quote any values that should be strings, e.g.,
samsung-111, and need to put the entire argument of
-d within single quotes (do not put any other single quotes
inside this argument unless you escape them properly).
Regards,
Gora
Re: solr atomic update
hi
were you able to do atomic update for specific field using curlim using
curl from windows cmd but getting error like host can not be resolved im
using this command:
C:\Users\rohancurl www.localhost.com:8983/solr/update?commit=true -H
Content-t
ype:text/json -d '[{value:samsung-wave-s5253-silver,
value:{set:samsun
g-111}}]'
any help would be greatly appreciated.
thanks
regards
Rohan
On Sun, Feb 3, 2013 at 6:16 PM, Erick Erickson erickerick...@gmail.comwrote:
Not that I know of...
Best
Erick
On Thu, Jan 31, 2013 at 7:09 AM, Marcos Mendez mar...@jitisoft.com
wrote:
Is there a way to do an atomic update (inc by 1) and retrieve the updated
value in one operation?
Re: help with getting error with mysql driver connection in solr 4.1
hi
I think I have found the problem its windows which is acctualy not able to
distinguish between double and single quote and thus curl is trying to
resolve the host under double quote individually after -d and thus causing
the error but how do I rectify this in windows that is what I am looking
for any help would be appreciated.
thanks
regards
rohan
On Mon, Feb 4, 2013 at 4:28 PM, Rohan Thakur rohan.i...@gmail.com wrote:
hi gora
I have tried what you told but now its giving error like:
C:\Users\rohancurl 127.0.0.1:8983/solr/update?commit=true -H
Content-type:appl
ication/json -d '[{value:samsung-wave-s5253-silver,
value:{set:samsung
-111}}]'
{responseHeader:{status:500,QTime:1},error:{msg:JSON Parse
Error: cha
r=',position=0 BEFORE='''
AFTER='[{value:samsung-wave-s5253-silver,',trace:o
rg.apache.noggit.JSONParser$ParseException: JSON Parse Error:
char=',position=0
BEFORE=''' AFTER='[{value:samsung-wave-s5253-silver,'\r\n\tat
org.apache.noggit.
JSONParser.err(JSONParser.java:221)\r\n\tat
org.apache.noggit.JSONParser.next(JS
ONParser.java:620)\r\n\tat
org.apache.noggit.JSONParser.nextEvent(JSONParser.jav
a:662)\r\n\tat
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoade
r.processUpdate(JsonLoader.java:106)\r\n\tat
org.apache.solr.handler.loader.Json
Loader$SingleThreadedJsonLoader.load(JsonLoader.java:96)\r\n\tat
org.apache.solr
.handler.loader.JsonLoader.load(JsonLoader.java:60)\r\n\tat
org.apache.solr.hand
ler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)\r\n\tat
org.apache
.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBas
e.java:74)\r\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(Requ
estHandlerBase.java:135)\r\n\tat
org.apache.solr.core.SolrCore.execute(SolrCore.
java:1816)\r\n\tat
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispat
chFilter.java:448)\r\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(S
olrDispatchFilter.java:269)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler$Cac
hedChain.doFilter(ServletHandler.java:1307)\r\n\tat
org.eclipse.jetty.servlet.Se
rvletHandler.doHandle(ServletHandler.java:453)\r\n\tat
org.eclipse.jetty.server.
handler.ScopedHandler.handle(ScopedHandler.java:137)\r\n\tat
org.eclipse.jetty.s
ecurity.SecurityHandler.handle(SecurityHandler.java:560)\r\n\tat
org.eclipse.jet
ty.server.session.SessionHandler.doHandle(SessionHandler.java:231)\r\n\tat
org.e
clipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)\r\
n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)\
r\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.j
ava:193)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(Context
Handler.java:1006)\r\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle
(ScopedHandler.java:135)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler
Collection.handle(ContextHandlerCollection.java:255)\r\n\tat
org.eclipse.jetty.s
erver.handler.HandlerCollection.handle(HandlerCollection.java:154)\r\n\tat
org.e
clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)\r\n\t
at org.eclipse.jetty.server.Server.handle(Server.java:365)\r\n\tat
org.eclipse.j
etty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485
)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(Blocking
HttpConnection.java:53)\r\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.
content(AbstractHttpConnection.java:937)\r\n\tat
org.eclipse.jetty.server.Abstra
ctHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)\r\n\tat
org.ec
lipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)\r\n\tat
org.ecli
pse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)\r
\n\tat
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(Socket
Connector.java:264)\r\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJo
b(QueuedThreadPool.java:608)\r\n\tat
org.eclipse.jetty.util.thread.QueuedThreadP
ool$3.run(QueuedThreadPool.java:543)\r\n\tat java.lang.Thread.run(Unknown
Source
)\r\n,code:500}}
curl: (6) Could not resolve host: value:set:samsung-111; Host not found
even in place of 127.0.0.1 i have tried using localhostbut it still
gives this error...im using this from command line in windows
On Mon, Feb 4, 2013 at 2:07 PM, Gora Mohanty g...@mimirtech.com wrote:
On 4 February 2013 13:29, Rohan Thakur rohan.i...@gmail.com wrote:
hi arcadius
can you also help me with partial document update...I have followed
what is
written in this blog but its giving me error
http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/
error im getting after this command :
C:\Users\rohancurl localhost:8983/solr/update?commit=true -H
Re: help with getting error with mysql driver connection in solr 4.1
yup I am downloading cygwin now...will be working through there let see it should work though... On Mon, Feb 4, 2013 at 5:14 PM, Gora Mohanty g...@mimirtech.com wrote: On 4 February 2013 16:58, Rohan Thakur rohan.i...@gmail.com wrote: hi I think I have found the problem its windows which is acctualy not able to distinguish between double and single quote and thus curl is trying to resolve the host under double quote individually after -d and thus causing the error but how do I rectify this in windows that is what I am looking for any help would be appreciated. [...] Hmm, for some reason I thought that you were using Cygwin rather than the Microsoft Windows CMD client. You would be better off asking on a WIndows-specific list, but searching Google for windows curl quotes turns up some possibilities. Regards, Gora
Re: help with getting error with mysql driver connection in solr 4.1
thanks I have instaled cygwin and its running fine now thanks.. On Mon, Feb 4, 2013 at 6:14 PM, Gora Mohanty g...@mimirtech.com wrote: On 4 February 2013 17:50, Rohan Thakur rohan.i...@gmail.com wrote: yup I am downloading cygwin now...will be working through there let see it should work though... [...] We are getting highly off-topic now, but f you have RAM available on the machine, you should seriously consider running Linux in a VM. Regards, Gora
Re: help with getting error with mysql driver connection in solr 4.1
It worked thanks alot Arcadius.. On Fri, Feb 1, 2013 at 7:56 PM, Arcadius Ahouansou arcad...@menelic.comwrote: Hi Rohan. * * Solr 4.1 uses Jetty 8. You need to put your JDBC driver under SOLR_HOME/lib/ext SOLR_HOME/lib/ being where all jetty *jar sit. You may need to create ext if it does not exists. HTH. Arcadius. On 1 February 2013 13:25, Rohan Thakur rohan.i...@gmail.com wrote: hi everyone I am getting problem regarding mysql driver connection im upgrading to solr 4.1 was using solr 3.6.2 earlier which was working fine but after updating to solr 4.1, I have done all the required configuration but getting error with mysql driver connection. While doing full data import i am getting error : Caused by: java.lang.ClassNotFoundException: com.mysql.jdbc.Driver at java.net.URLClassLoader$1.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at java.net.FactoryURLClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Unknown Source) at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader. java:422) I have done all the configuration I have even set the class path for mysql driver jar file but its getting this same error and import fails everytime ending with this error I have even tried setting the sharedLib=lib in solr.xml and putting mysql connector in lib folder but it still not working i am using solr 4.1 on windows and running it on jetty container and using xammp for mysql database server. It was working fine on 3.6.2 version but 4.1 version not working I dont know why. please help! thanks in advance regards Rohan
Re: help with getting error with mysql driver connection in solr 4.1
hi arcadius
can you also help me with partial document update...I have followed what is
written in this blog but its giving me error
http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/
error im getting after this command :
C:\Users\rohancurl localhost:8983/solr/update?commit=true -H
Content-type:appli
cation/json -d [{value:samsung-s5610-gray,value:{set:samsung-111}}]
{responseHeader:{status:500,QTime:3},error:{msg:Expected string:
char
=v,position=2 BEFORE='[{v'
AFTER='alue:samsung-s5610-gray,value:{set:sams',tra
ce:org.apache.noggit.JSONParser$ParseException: Expected string:
char=v,positi
on=2 BEFORE='[{v' AFTER='alue:samsung-s5610-gray,value:{set:sams'\r\n\tat
org.ap
ache.noggit.JSONParser.err(JSONParser.java:221)\r\n\tat
org.apache.noggit.JSONPa
rser.nextEvent(JSONParser.java:670)\r\n\tat
org.apache.solr.handler.loader.JsonL
oader$SingleThreadedJsonLoader.parseField(JsonLoader.java:425)\r\n\tat
org.apach
e.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.parseDoc(JsonLoader.ja
va:414)\r\n\tat
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoad
er.handleAdds(JsonLoader.java:386)\r\n\tat
org.apache.solr.handler.loader.JsonLo
ader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:112)\r\n\tat
org.apa
che.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java
:96)\r\n\tat
org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:60)\
r\n\tat
org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler
.java:92)\r\n\tat
org.apache.solr.handler.ContentStreamHandlerBase.handleRequest
Body(ContentStreamHandlerBase.java:74)\r\n\tat
org.apache.solr.handler.RequestHa
ndlerBase.handleRequest(RequestHandlerBase.java:135)\r\n\tat
org.apache.solr.cor
e.SolrCore.execute(SolrCore.java:1816)\r\n\tat
org.apache.solr.servlet.SolrDispa
tchFilter.execute(SolrDispatchFilter.java:448)\r\n\tat
org.apache.solr.servlet.S
olrDispatchFilter.doFilter(SolrDispatchFilter.java:269)\r\n\tat
org.eclipse.jett
y.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)\r\n\t
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
\r\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:
560)\r\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHan
dler.java:231)\r\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(
ContextHandler.java:1072)\r\n\tat
org.eclipse.jetty.servlet.ServletHandler.doSco
pe(ServletHandler.java:382)\r\n\tat
org.eclipse.jetty.server.session.SessionHand
ler.doScope(SessionHandler.java:193)\r\n\tat
org.eclipse.jetty.server.handler.Co
ntextHandler.doScope(ContextHandler.java:1006)\r\n\tat
org.eclipse.jetty.server.
handler.ScopedHandler.handle(ScopedHandler.java:135)\r\n\tat
org.eclipse.jetty.s
erver.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
\r\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollec
tion.java:154)\r\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(Ha
ndlerWrapper.java:116)\r\n\tat
org.eclipse.jetty.server.Server.handle(Server.jav
a:365)\r\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abs
tractHttpConnection.java:485)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConne
ction.handleRequest(BlockingHttpConnection.java:53)\r\n\tat
org.eclipse.jetty.se
rver.AbstractHttpConnection.content(AbstractHttpConnection.java:937)\r\n\tat
org
.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttp
Connection.java:998)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpPar
ser.java:856)\r\n\tat
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParse
r.java:240)\r\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handle(Block
ingHttpConnection.java:72)\r\n\tat
org.eclipse.jetty.server.bio.SocketConnector$
ConnectorEndPoint.run(SocketConnector.java:264)\r\n\tat
org.eclipse.jetty.util.t
hread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)\r\n\tat
org.eclipse.jet
ty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)\r\n\tat
java.la
ng.Thread.run(Unknown Source)\r\n,code:500}}
and nothing is changed for the field value
am I doing something wrong here?
regards
Rohan
On Mon, Feb 4, 2013 at 11:24 AM, Rohan Thakur rohan.i...@gmail.com wrote:
It worked thanks alot Arcadius..
On Fri, Feb 1, 2013 at 7:56 PM, Arcadius Ahouansou
arcad...@menelic.comwrote:
Hi Rohan.
*
*
Solr 4.1 uses Jetty 8.
You need to put your JDBC driver under SOLR_HOME/lib/ext
SOLR_HOME/lib/ being where all jetty *jar sit.
You may need to create ext if it does not exists.
HTH.
Arcadius.
On 1 February 2013 13:25, Rohan Thakur rohan.i...@gmail.com wrote:
hi everyone
I am getting problem regarding mysql driver connection im upgrading to
solr
4.1 was using solr 3.6.2 earlier which was working fine but after
updating
to solr 4.1, I
