Hello all,
I am trying to integrate HBase with SparkStreaming new APIs mentioned here
http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
I am using JavaHBaseContext hbaseContext = new
JavaHBaseContext(jssc.sparkContext(), conf); Then called bulk Get API
hbaseContext.streamBulkGet(TableName.valueOf(tableName), 2, lines, new
GetFunction2(), new ResultFunction());
But this bulk API is invoked during initialization not during each streaming
message. Also used
hbaseContext.foreachPartition(jDStream,new
VoidFunction<Tuple2<Iterator<String>, Connection>>() {
public void call(Tuple2<Iterator<String>, Connection> t)throws Exception
{ ...}
The API exists but somehow it is not working for streaming message.
Do we have example of how to get data using the spark streaming api.
Thanks,
Rachana
