Hi Harsh, I will look the ImportTSV tools code but in my case, I would like to have some processing on the HDFS file data and then put the data in Hbase Table. Currently I am able to do it using normal Hbase Apis but I wanted to use Map Reduce for such scenario. I want to write my custom map and reduce classes to handle.
I am sure this is not much difficult but the issue is I am getting confused which Classes to use attain this. Issues like 1. If I set setInputPaths() then code also expects to setOutputPath() which in my case is not useful. 2. If I use TableMapReduceUtil() then I have to specify input table also which I don't have. I will be having just output table. I might sound stupid but its just the game of api's that Im tracked in. -----Original Message----- From: Harsh J [mailto:[email protected]] Sent: Tuesday, November 15, 2011 1:26 PM To: [email protected] Cc: [email protected] Subject: Re: Input from HDFS Output To Hbase Stuti, For simple delimited text files, like you describe, have you considered simply using the ImportTSV tool to bulk load the data into HBase? See http://hbase.apache.org/bulk-loads.html On 15-Nov-2011, at 1:19 PM, Stuti Awasthi wrote: > Hi all, > I have a file in HDFS with "KeyValueTextInputFormat". I want to process this > file through Map and put the output in Hbase. > > Input File : > Key1 Val1 > Key2 Val2 > > I am not sure which interfaces and classes to use i.e my customMapper will > extend MapReduceBase or TableMapper. > Output will be stored in table say X with Set column family as : > > Put put = new Put(Bytes.toBytes(Key1)); put.add(Bytes.toBytes("Set"), > Bytes.toBytes(Val1), null); > > Please suggest > Regards, > Stuti Awasthi > > > ::DISCLAIMER:: > ---------------------------------------------------------------------- > ------------------------------------------------- > > The contents of this e-mail and any attachment(s) are confidential and > intended for the named recipient(s) only. > It shall not attach any liability on the originator or HCL or its > affiliates. Any views or opinions presented in this email are solely those of > the author and may not necessarily reflect the opinions of HCL or its > affiliates. > Any form of reproduction, dissemination, copying, disclosure, > modification, distribution and / or publication of this message > without the prior written consent of the author of this e-mail is > strictly prohibited. If you have received this email in error please delete > it and notify the sender immediately. Before opening any mail and attachments > please check them for viruses and defect. > > ---------------------------------------------------------------------- > -------------------------------------------------
