[
https://issues.apache.org/jira/browse/HBASE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14631344#comment-14631344
]
Lars Hofhansl commented on HBASE-13992:
---------------------------------------
Few nits:
* Comments in what's happening in the Scala and JavaHBase*Examples
* Might want to have a comment in *HBaseBulkDeleteExample.java explaining that
it is probably better to use the built-in BulkDeleteEndpoint (which in turn we
have to document better)
* Comment explaining in *HBaseDistributedScan as to why this is preferred over
using Spark's built-in HadoopRDD with TableInputFormat or the included HBaseRDD
(it's obvious, but hey, somebody might look at the classes and wonder why).
* I assume there's quite some heap needed to get the RDD resulting from a scan
into a (RowKey, List[(columnFamily, columnQualifier, Value) (going by the
article here). Can that be avoided if it is a problem? Or in other words, is
there an easy to way to get a raw Result[] or List<Result>? ... sorry if I'm
missing something.
Very excited about having this in HBase proper.
> Integrate SparkOnHBase into HBase
> ---------------------------------
>
> Key: HBASE-13992
> URL: https://issues.apache.org/jira/browse/HBASE-13992
> Project: HBase
> Issue Type: New Feature
> Components: spark
> Reporter: Ted Malaska
> Assignee: Ted Malaska
> Fix For: 2.0.0
>
> Attachments: HBASE-13992.patch, HBASE-13992.patch.3,
> HBASE-13992.patch.4
>
>
> This Jira is to ask if SparkOnHBase can find a home in side HBase core.
> Here is the github:
> https://github.com/cloudera-labs/SparkOnHBase
> I am the core author of this project and the license is Apache 2.0
> A blog explaining this project is here
> http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
> A spark Streaming example is here
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> A real customer using this in produce is blogged here
> http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/
> Please debate and let me know what I can do to make this happen.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
