MR = MapReduce. St.Ack
On Tue, Apr 28, 2009 at 2:21 PM, Vijay <[email protected]> wrote: > Hi, > What is MR? I am trying to read the logs which is collected from the chukwa > and parse and store all the logs into the Hbase table.... and when the user > is trying to see the data i will just do a agreegation function which will > be using the map/reduce framework.... i was thinking of putting back > the aggregated data into the memcached so the later queries doesnt need to > go to hbase even..... > > But the question is that..... do we have any framework where i can create > my > own agreegation function which will run on the map reduce job when it is > fetching the data.... as u know it will be more faster ? > > If i dont have alternative then i was thinking of using the hbase to return > me the result later i will use a map reduce kick another processing..... > > Any advice will be helpfull.... i am new to hbase and still trying to learn > it.... > > Regards, > </VJ> > > > > > On Mon, Apr 27, 2009 at 9:12 PM, stack <[email protected]> wrote: > > > Try MR. Read and write to HBase. Results will be persisted to HDFS. > > > > Tell us more. Hooking up Chukwa and HBase sounds interesting. > > > > St.Ack > > > > On Mon, Apr 27, 2009 at 1:17 PM, Vijay <[email protected]> wrote: > > > > > Hi, > > > I wanted to find do some calculation on a huge table which will have > > > millions of rows in it.... Whats the optimal way to do it? should i > just > > > pass this to a map reduce job and it will take care of it? will the > > results > > > be stored in the memcached too? how abt the rows which i am intially > > > querying (usually the query for all the data from the date range). I am > > > trying to use chukwa with hbase as a database. > > > > > > Regards, > > > </VJ> > > > > > >
