[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053168#comment-15053168
]
Zhan Zhang commented on HBASE-14849:
------------------------------------
I suggest to put this type of configuration into SparkConf, for example
spark.hbase.blockcache.enable
and we can also migrate existing configurations following the similar way.
spark.hbase.blockcache.size
spark.hbase.batchnum
I also have not think out a good way to test it. One way is to create a new
hbase default sources dedicated for testing (with buildScan overridden), and
based on the configuration we return different result to verify the
configuration is correctly pushed. But it does not test the feature itself.
> Add option to set block cache to false on SparkSQL executions
> -------------------------------------------------------------
>
> Key: HBASE-14849
> URL: https://issues.apache.org/jira/browse/HBASE-14849
> Project: HBase
> Issue Type: New Feature
> Components: spark
> Reporter: Ted Malaska
> Assignee: Ted Malaska
>
> I was working at a client with a ported down version of the Spark module for
> HBase and realized we didn't add an option to turn of block cache for the
> scans.
> At the client I just disabled all caching with Spark SQL, this is an easy but
> very impactful fix.
> The fix for this patch will make this configurable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
