Hi, What is MR? I am trying to read the logs which is collected from the chukwa and parse and store all the logs into the Hbase table.... and when the user is trying to see the data i will just do a agreegation function which will be using the map/reduce framework.... i was thinking of putting back the aggregated data into the memcached so the later queries doesnt need to go to hbase even.....
But the question is that..... do we have any framework where i can create my own agreegation function which will run on the map reduce job when it is fetching the data.... as u know it will be more faster ? If i dont have alternative then i was thinking of using the hbase to return me the result later i will use a map reduce kick another processing..... Any advice will be helpfull.... i am new to hbase and still trying to learn it.... Regards, </VJ> On Mon, Apr 27, 2009 at 9:12 PM, stack <[email protected]> wrote: > Try MR. Read and write to HBase. Results will be persisted to HDFS. > > Tell us more. Hooking up Chukwa and HBase sounds interesting. > > St.Ack > > On Mon, Apr 27, 2009 at 1:17 PM, Vijay <[email protected]> wrote: > > > Hi, > > I wanted to find do some calculation on a huge table which will have > > millions of rows in it.... Whats the optimal way to do it? should i just > > pass this to a map reduce job and it will take care of it? will the > results > > be stored in the memcached too? how abt the rows which i am intially > > querying (usually the query for all the data from the date range). I am > > trying to use chukwa with hbase as a database. > > > > Regards, > > </VJ> > > >
