Lucene for Log file indexing and search

Hi I am learning lucene, I am developing an application do do a search in log files in multi-environment boxes, I have googled for the deeper understanding, but all examples were just referring for just field "File Name" & "Modification (i.e. fieldtypes associated with text search) and they are

Re: Lucene for Log file indexing and search

Hi Paul,Otis & Ivan I thank each one of you for taking time and pouring multiple options for my requirement. I saw the video in elastic search home page and I felt I got what I am searching for, and I need to check Solr and this Logscene from Sema text. I really liked lucene, and this is too pow

Rendexing problem: Indexing folder size is keep on growing for same remote folder

Hi I am reading log files a remote folder and keeping them in local folder and then I am indexing as I shown below, how ever I am not saving the whole content as input stream, I am splitting them with Grok regex and saving as below strings. I am repeating this "copy and indexing" process for ev

RE: Rendexing problem: Indexing folder size is keep on growing for same remote folder

I am afraid, my document in the above code has already a unique-key (will milli-seconds I hope this is enough to differentiate with another records). My requirement is simple, I have a folder with a.log,b.log and c.log files which will be updated every 30 minutes, I want to update the index of the

Re: Rendexing problem: Indexing folder size is keep on growing for same remote folder

Hi Basically my log folder consists of four log files like abc.log,abc1.log,abc2.log,abc3.log, as my log appender is doing. Every 30 minutes content will be changed of all these file , for example after 30 minutes refresh my conent of abc1.log will be replaced with existing abc.log content and ab

Re: Rendexing problem: Indexing folder size is keep on growing for same remote folder

I am really sorry if something made you confuse, as I said I am indexing a folder which contains mylogs.log,mylogs1.log,mylogs2.log etc, I am not indexing them as a flat file. I have tokenized my each line of text with regex and storing them as fields like "messageType", "timeStamp","message". So

Re: Rendexing problem: Indexing folder size is keep on growing for same remote folder

Thank you very much for your time sir, I follow your suggestion. -- View this message in context: http://lucene.472066.n3.nabble.com/Rendexing-problem-Indexing-folder-size-is-keep-on-growing-for-same-remote-folder-tp4092835p4093136.html Sent from the Lucene - Java Users mailing list archive at

New to Apache Lucene: Need help in querying data - text with wildCards

I have an application which is a log-analyzer, and I am using Apache Lucene to index my data, and I am storing only message in it (I am not storing all other fields in my object), and I am not using any database so I am using store for message though its huge) but I am taking care of deleting this

Re: New to Apache Lucene: Need help in querying data - text with wildCards

Hi Michael Thank you very much for your response, before I am trying your solution (writing my own analyzer) I am just using Standard Analyzer which is available in the example in lucene documentation, please see here my code which is writing to lucene, [code] File indexDirFile = new File(this