RE: Can Solr handle large text files?

2011-10-31 Thread Anand.Nigam
Hi, Basically I need to index very large log files. I have modified the ExtractingDocumentLoader to create a new document for every 50 lines (it is made configurable by keeping it as a system property) of the log file being indexed. 'Filename' field for document created from 1 log file is

RE: Can Solr handle large text files?

2011-10-21 Thread Anand.Nigam
Hi, I was also facing the issue of highlighting the large text files. I applied the solution proposed here and it worked. But I am getting following error : Basically 'hitGrouped.vm' is not found. I am using solr-3.4.0. Where can I get this file from. Its reference is present in browse.vm

RE: OutOfMemoryError coming from TermVectorsReader

2011-09-23 Thread Anand.Nigam
Thanks Otis, I am able to show the results such that the last match (500 characters around the match) in the log file is shown highlighted. I can try creating multiple documents from one log file to see if it improves the performance. Can anything else be done to reduce the heap size? Anand

RE: OutOfMemoryError coming from TermVectorsReader

2011-09-22 Thread Anand.Nigam
Hi, I am trying to index application log files and some database tables. Size of the log files range from 1 MB to 100 MB. Database tables also have few thousands of rows. I have used termvector highlighter for the content of the log files as mentioned below: Heap size : 10 GB OS: Linux, 64

OutOfMemoryError coming from TermVectorsReader

2011-09-18 Thread Anand.Nigam
Hi, I am new to solr. I an trying to index text documents of large size. On searching from indexed documents I am getting following OutOfMemoryError. Please help me in resolving this issue. The field which stores file content is configured in schema.xml as below: field name=Content

Highlighting does not works with uniqueField set

2011-08-03 Thread Anand.Nigam
Hi, I am new to solr. Am facing an issue wherein the highlighting of the searchresults for matches is not working when I have set a unique field as: uniqueKeyid/uniqueKey If this is commented then highlighting starts working. I need to have a unique field. Could someone please explain this

java.lang.IllegalStateException: Committed error in the logs

2011-08-03 Thread Anand.Nigam
I am getting following error log on trying to search. Any idea why this error is coming. Search results are coming after a long delay. SEVERE: org.mortbay.jetty.EofException at org.mortbay.jetty.HttpGenerator.flush(HttpGenerator.java:791) at

Problem starting solr on jetty

2011-07-27 Thread Anand.Nigam
Hi, I am new to solr. I have downloaded the solr 3.3.0 distribution and tryign to run it using java -jar start.jar from the apache-solr-3.3.0\example directory (start.jar is present here). But I am getting following error on running this command:

RE: Problem starting solr on jetty

2011-07-27 Thread Anand.Nigam
Thanks for your reply Steve. My environment details: Java version: 1.6.0_24 System: Microsoft Windows XP Professional Version 2002 Service Pack 3 Interestingly my colleagues who have the same environment are not facing this problem. Thanks Regards Anand Nigam -Original Message-

RE: Problem starting solr on jetty

2011-07-27 Thread Anand.Nigam
Thanks for your reply Steve. My environment details: Java version: 1.6.0_24 System: Microsoft Windows XP Professional Version 2002 Service Pack 3 Interestingly my colleagues who have the same environment are not facing this problem. Thanks Regards Anand Nigam -Original Message-

RE: Problem starting solr on jetty

2011-07-27 Thread Anand.Nigam
Hi All, I tried to debug the issue by runing start.jar in eclipse debuger and found that the root of the issue was that the jetty.home system property was not set. If I set the jetty.home property then the server starts properly. Thanks, Anand -Original Message- From: Nigam, Anand,