Ah, I see there is one issue left. It's not very likely that it happens,
but it could. My map() looks like this
map() {
if (row.getColumnSize < batchSize && currentRowName != lastRowName) {
DROP ROW
return;
}
if (row.getColumnSize < batchSize && currentRowName = lastRowName) {
STORE FINAL RESULT INTO HBASE
}
--- // do something with the column elements
}
This works fine, BUT there is one special case. If the batch size is 100
and the row has 500 column-elements. The last row will not be stored
because the storing only happens if the last row-batch is smaller than 100
and in this case every map() call has the size 100.
So, is there a way to check if the current result is the last result? Or
maybe a method that will finaly call after all map() calls?
kind regards
2013/10/26 Dhaval Shah <[email protected]>
> Cool
>
> Sent from Yahoo Mail on Android
>
>