Thanks.
Yea I've got that colFam for sure in the HBase table.
I've been trying to play with rowcounter, and not having much luck either.
I run the command:
hadoop19/bin/hadoop org.apache.hadoop.hbase.mapred.Driver rowcounter
/home/hadoop/dev/rowcounter7 tableA colFam1:
The map/reduce finishes just like it does with my own program, but with all
part files empty in /home/hadoop/dev/rowcounter7.
Any Ideas?
Billy Pearson-2 wrote:
>
> You could try scanning it with shell to make sure there is data
> bin/hbase shell
> help -> hbase> scan 't1', {COLUMNS => ['c1', 'c2'], LIMIT => 10, \
> STARTROW => 'xyz'}
>
> so something like
> scan 'tablename', {COLUMNS => ['col1']}
>
> That will spit out data if there is any
> I thank you might be able to even call
> scan 'tablename'
>
> Billy
>
>
>
>
> "llpind" <[email protected]> wrote in
> message news:[email protected]...
>>
>> Yeah I noticed that shortly after I posted. I have it "colFam1:" now.
>> I'm
>> positive my table has that column family, but my output table still has
>> nothing in it.
>>
>> I'm looking at the source code for rowcounter, and it doesn't even
>> require
>> :. does it need to be passed in?
>>
>>
>> I may be going about this wrong, I'm open to ideas. I need a way to
>> iterate
>> over an entire HBase table, and count columns (column counter instead of
>> rowcounter).
>>
>> Billy Pearson-2 wrote:
>>>
>>> try with out the * in the column
>>> "colFam1:*",
>>> try
>>> "colFam1:",
>>>
>>> I do not thank the * works like a all option just leave it blank
>>> colFam1:
>>> and it will give all results
>>>
>>> Billy
>>>
>>>
>>> "llpind" <[email protected]> wrote in
>>> message
>>> news:[email protected]...
>>>>
>>>> Hi again,
>>>>
>>>> I need some help with a map/reduce program I have which copies data
>>>> from
>>>> one
>>>> table to another. What I would like to do is iterate through an entire
>>>> HBase table, and for a given row key and column family count the number
>>>> of
>>>> records. So the output table will have a single column family named
>>>> 'count'
>>>> (e.g. entry would look something like 'rowKey1',
>>>> 'count:count_for_rowkey1',
>>>> '534', where the rowkey could be the same as input table ).
>>>>
>>>> here is my first attempt:
>>>>
>>>> CONF:
>>>> =========================================================================
>>>>
>>>> c.setInputFormat(TableInputFormat.class);
>>>> c.setOutputFormat(TableOutputFormat.class);
>>>>
>>>> TableMapReduceUtil.initTableMapJob("inputTableName", "colFam1:*",
>>>> MapperClass.class,
>>>> ImmutableBytesWritable.class, RowResult.class, c);
>>>>
>>>> TableMapReduceUtil.initTableReduceJob("outputTableName",
>>>> ReducerClass.class, c );
>>>>
>>>> MapperClass:
>>>> =====================================================================
>>>>
>>>> @Override
>>>> public void map(
>>>> ImmutableBytesWritable key,
>>>> RowResult row,
>>>> OutputCollector<ImmutableBytesWritable, RowResult> collector,
>>>> Reporter reporter) throws IOException {
>>>>
>>>>
>>>> reporter.incrCounter(Counters.ROWS, 1);
>>>> collector.collect(key, row);
>>>> }
>>>>
>>>> ReducerClass:================================================================
>>>>
>>>> @Override
>>>> public void reduce(ImmutableBytesWritable k,
>>>> Iterator<RowResult> v,
>>>> OutputCollector<ImmutableBytesWritable, BatchUpdate> c,
>>>> Reporter r) throws IOException {
>>>>
>>>> while (v.hasNext()){
>>>> BatchUpdate bu = new BatchUpdate(k.get());
>>>> while (v.hasNext()){
>>>> RowResult row = v.next();
>>>> bu.put(Bytes.toBytes("count:rowToCountName"),
>>>> Bytes.toBytes(row.size()));
>>>> }
>>>> c.collect(k, bu);
>>>> }
>>>> }
>>>>
>>>> ========================================================================
>>>>
>>>> It runs the map/reduce, but I get nothing in my output table.
>>>>
>>>> Thanks.
>>>>
>>>> llpind
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Help-with-Map-Reduce-program-tp23952252p23952252.html
>>>> Sent from the HBase User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Help-with-Map-Reduce-program-tp23952252p23954242.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>
>>
>
>
>
>
--
View this message in context:
http://www.nabble.com/Help-with-Map-Reduce-program-tp23952252p23966757.html
Sent from the HBase User mailing list archive at Nabble.com.
