Hi, Has anyone integrated search ( Luence, Solr or Elastic) with HBase?
We are implementing log search functionality using HBase. Through Flume, the logs from multiple apps are getting streamed into HBase directly. A very basic use case is to search a keyword for an application for a certain timeframe ( for example - last hour). Our row key is app_id:timestamp and all log contents are stored in columns. We started with Regex filter. It worked but do not provide the consistent result. Now, we are exploring the index search capability in HBase. Our thought process is that first create an inverted index table with row key - search documents and column - the row key of the content table. The search will return all the row keys. Additional requirement - We would like to limit the results for certain time frame. Second, we would like to display only limited records in descending time order and come back for more if user want to see more records. Let me know if someone has integrated the search with HBase. Thanks, Saurabh. -----Original Message----- From: Ted Yu [mailto:[email protected]] Sent: Monday, March 19, 2012 12:33 PM To: [email protected] Subject: Re: There is no data value information in HLog? Hi, Have you noticed this in HLogPrettyPrinter ? options.addOption("p", "printvals", false, "Print values"); Looks like you should have specified the above option. On Mon, Mar 19, 2012 at 7:31 AM, yonghu <[email protected]> wrote: > Hello, > > I used the $ ./bin/hbase org.apache.hadoop.hbase.regionserver.wal.HLog > --dump command to check the HLog information. But I can not find any > data information. The output of my HLog file is looks like follows: > > Sequence 933 from region 85986149309dff24ecf7be4873136f15 in table test > Action: > row: Udo > column: Course:Computer > at time: Mon Mar 19 14:09:29 CET 2012 > > Sequence 935 from region 85986149309dff24ecf7be4873136f15 in table test > Action: > row: Udo > column: Course:Math > at time: Mon Mar 19 14:09:29 CET 2012 > > The functionality of HLog is for recovery. But without data value > information, how can hbase use the information in HLog to do recovery. > My hbase version is 0.92.0. > > Regards! > > Yong >
