mazhengxuan created HBASE-30513:
-----------------------------------
Summary: Restore SparkConf fallbacks for Spark 4 datasource read
options
Key: HBASE-30513
URL: https://issues.apache.org/jira/browse/HBASE-30513
Project: HBase
Issue Type: Sub-task
Components: hbase-connectors
Reporter: mazhengxuan
The Spark 4 datasource reads hbase.spark.query.cacheblocks,
hbase.spark.query.cachedrows, hbase.spark.query.batchsize and
hbase.spark.bulkget.size from datasource options without the SparkConf fallback
used by Spark 3. Existing applications that set these globally can therefore
silently use different read settings after upgrading.
We should restore the precedence of datasource option, then SparkConf, then
default, and test both global settings and per-read overrides.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
