Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi, We are using Solr 4.0 along with FVH and there is an issue we are facing while highlighting. For our requirement we want the highlighted search result should start with the beginning of the sentence and needed help to get this done. As of now this is not happening and the highlighted

RE: Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi Koji, I have tried using hl.bs.type=SENTENCE and still no improvement. We are storing PDF extracted content in the field which has termVectors enabled. Example the field contains the following data extracted from PDF User-defined resolution functions. The synthesis tool only supports the

RE: Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi Koji, Thanks for the response when I use hl.bs.chars=.!? and hl.bs.maxScan=200 I see improvements, below is the highlighted value The synthesis tool only supports the resolution functions for emstd_logic/em and std_logic_vector. But in other cases I also see that some of the words break

RE: removing write.lock file in solr after indexing

2012-01-31 Thread Shyam Bhaskaran
, Erick Erickson erickerick...@gmail.com wrote: On Mon, Jan 30, 2012 at 2:42 AM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Hi, We are using Solr 4.0 and after indexing every time it is observed that the write.lock remains without getting cleared and for the next indexing we have

RE: removing write.lock file in solr after indexing

2012-01-31 Thread Shyam Bhaskaran
Hi Erick, I was able to resolve the issue with 'write.lock' files. Using container.remove(core1) or using container.shutdown() is helping to remove the 'write.lock' files. -Shyam

removing write.lock file in solr after indexing

2012-01-29 Thread Shyam Bhaskaran
Hi, We are using Solr 4.0 and after indexing every time it is observed that the write.lock remains without getting cleared and for the next indexing we have to delete the file to get the indexing process running. We use SolrServer for our indexing and I do not see any methods to close or

RE: Question on Reverse Indexing

2012-01-20 Thread Shyam Bhaskaran
of setAllowLeadingWildcard() method, in which places does it set allowLeadingWildcard to true? On Thu, Jan 19, 2012 at 3:00 PM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Dimitry, Our custom tokenizer is similar to standard tokenizer, just for testing I changed my custorm tokenizer

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
and searchers from solrconfig. Do you have any custom query parser implementations or any other custom components? On Thu, Jan 19, 2012 at 9:26 AM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Dimitry, I have used lukeall-3.5.0.jar and when trying to open the index it gives me the error No Valid

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
billions (depending on data variation). Also, since you said you use 4.0, did also build it from source code your self or used some pre-built package? On Thu, Jan 19, 2012 at 1:06 PM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Dimitry, Yes my app and the Solr admin search results

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
of that? François On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran wrote: Hi, For reverse indexing we are using the ReversedWildcardFilterFactory on Solr 4.0 filter class=solr.ReversedWildcardFilterFactory withOriginal=true maxPosAsterisk=3 maxPosQuestion=2 maxFractionAsterisk=0.33

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
, Jan 18, 2012 at 12:35 PM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Dimitry, Using http://localhost:7070/solr/docs/admin/analysis.jsp passed the query *lock and did not find ReversedWildcardFilterFactory to the indexer or any other filters that could do the reversing. -Shyam

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
, and see if it still contains reversed sequences. On Wed, Jan 18, 2012 at 1:09 PM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Dimitry, We are using Solr 4.0. To confirm server caching issues I have restarted our tomcat webserver after performing a re-index. For reverseIndexing we

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
Dimitry, I downloaded Luke but it was not working for me against solr indexes. But using the solr analysis page I did not find any reversed sequences on the field. -Shyam -Original Message- From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] Sent: Thursday, January 19, 2012

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
org.getopt.luke.Luke -index C:\solr\home\data\docs_index\index\ We are using Solr 4.0 -Shyam -Original Message- From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] Sent: Thursday, January 19, 2012 11:49 AM To: solr-user@lucene.apache.org Subject: RE: Question on Reverse Indexing Dimitry, I

Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
Hi, For reverse indexing we are using the ReversedWildcardFilterFactory on Solr 4.0 filter class=solr.ReversedWildcardFilterFactory withOriginal=true maxPosAsterisk=3 maxPosQuestion=2 maxFractionAsterisk=0.33/ ReversedWildcardFilterFactory was helping us to perform leading wild card

RE: Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing Using ReversedWildcardFilterFactory will double the size of your dictionary (more or less), maybe the drop in performance that you are seeing is a result of that? François On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran

Re: Profiling Solr

2011-12-22 Thread shyam bhaskaran
Hi Jean, I am also looking into Profiling Solr and wanted to check with you whether you were able to use YourKit successfully for Solr Profiling and were you able to find out the bottleneck with your situation. Can you share how you were able to find out the performance bottleneck and fix the

RE: Profiling Solr

2011-12-22 Thread Shyam Bhaskaran
this highlighting overhead and wanted to find more details using Solr Profiling. Let me know for any suggestions. -Shyam -Original Message- From: shyam bhaskaran [mailto:shyam.bhaska...@gmail.com] Sent: Friday, December 23, 2011 6:26 AM To: solr-user@lucene.apache.org Subject: Re

RE: Highlighter highlighting terms which are not part of the search

2011-12-15 Thread Shyam Bhaskaran
/UsingMailingLists Best Erick On Mon, Dec 12, 2011 at 12:04 AM, Shyam Bhaskaran shyam.bhaska...@synopsys.com wrote: Hi We recently upgraded our Solr to the latest 4.0 trunk and we are seeing a weird behavior with highlighting which was not seen earlier. When a search query for example generate test

Highlighter highlighting terms which are not part of the search

2011-12-11 Thread Shyam Bhaskaran
Hi We recently upgraded our Solr to the latest 4.0 trunk and we are seeing a weird behavior with highlighting which was not seen earlier. When a search query for example generate test pattern is passed in the results et obtained the first few results shows the highlighting properly but in the

highlighting performance poor with *.tar, *.gz files

2011-11-24 Thread Shyam Bhaskaran
Hi, It is observed that highlighting of search results is taking too much time especially for highlighting terms for archived files like *.gz, *.tar, *.zip. What could be the reason behind it ? Is it because these files are unzipped and then highlighted from the index during display time ? Or

Different maxAnalyzedChars value in solrconfig.xml

2011-11-15 Thread Shyam Bhaskaran
Hi, Wanted to know whether we can set different maxAnalyzedChars values in the solrconfig.xml based on different fields. Can someone point if this is possible at all, my requirement needs me to set different values for maxAnalyzedChars parameter based on two different field values. For

Highlighting is not working for wildcard searches when TermVectors (hl.useFastVectorHighlighter) is enabled

2011-11-11 Thread Shyam Bhaskaran
Hi, Highlighting is not working for wildcard searches when TermVectors (hl.useFastVectorHighlighter) is enabled. I wanted to use FastVectorHighlighter to improve the performance of search results but when hl.useFastVectorHighlighter is enabled highlighting does not work in case of wildcard