Lev Bronshtein created PHOENIX-4808:
---------------------------------------
Summary: Phoenix Spark Do not verify zKUrl in DefaultSource.scala
Key: PHOENIX-4808
URL: https://issues.apache.org/jira/browse/PHOENIX-4808
Project: Phoenix
Issue Type: Improvement
Reporter: Lev Bronshtein
Currently verifyParameters will throw an exception
_[zkUrl
check|https://github.com/apache/phoenix/blob/master/phoenix-spark/src/main/scala/org/apache/phoenix/spark/DefaultSource.scala#L56]_
_if (parameters.get("zkUrl").isEmpty)_ however this is unnecessary as
ultimately new PhoenixRelation(...)
[PhoenixRelation|https://github.com/apache/phoenix/blob/master/phoenix-spark/src/main/scala/org/apache/phoenix/spark/DefaultSource.scala#L29]
is called (see PhoenixRelation.scala) which in turn calls new PhoenixRDD(...)
(See PhoenixRDD.scala). PhoenixRDD constructor declares zkUrl as optional.
PhoenixRDD will try to use zkUrl and fall back on HBase Configuration
{code:java}
// Override the Zookeeper URL if present. Throw exception if no address given.
zkUrl match {
case Some(url) => ConfigurationUtil.setZookeeperURL(config, url)
case _ => {
if(ConfigurationUtil.getZookeeperURL(config).isEmpty) {
throw new UnsupportedOperationException(
s"One of zkUrl or '${HConstants.ZOOKEEPER_QUORUM}' config property must be
provided"
)
}
}
{code}
I propose that this check is unnecessary and should be removed. As we will
still get an exception, but a little later
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
