[
https://issues.apache.org/jira/browse/PHOENIX-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791922#comment-17791922
]
Istvan Toth commented on PHOENIX-7132:
--------------------------------------
This a spark classloader issue.
I only see the issue when I add the connector via:
{noformat}
--conf
spark.jars=/opt/cloudera/parcels/CDH/lib/phoenix_connectors/phoenix5-spark-shaded.jar
{noformat}
If I add it via
{noformat}
--conf
spark.executor.extraClassPath=/opt/cloudera/parcels/CDH/lib/phoenix_connectors/phoenix5-spark-shaded.jar
--conf
spark.driver.extraClassPath=/opt/cloudera/parcels/CDH/lib/phoenix_connectors/phoenix5-spark-shaded.jar
{noformat}
It works fine.
> HBase cannot load ClientRpcControllerFactory when adding connector with the
> --jar option to Spark
> -------------------------------------------------------------------------------------------------
>
> Key: PHOENIX-7132
> URL: https://issues.apache.org/jira/browse/PHOENIX-7132
> Project: Phoenix
> Issue Type: Bug
> Components: connectors, core
> Affects Versions: connectors-6.0.0, 5.2.0
> Reporter: Istvan Toth
> Assignee: Istvan Toth
> Priority: Major
>
> I have noticed this today when working with the shaded spark connector jar:
> {noformat}
> 23/12/01 06:01:34 WARN ipc.RpcControllerFactory: Cannot load configured
> "hbase.rpc.controllerfactory.class"
> (org.apache.hadoop.hbase.ipc.controller.ClientRpcControllerFactory) from
> hbase-site.xml, falling back to use default RpcControllerFactory
> {noformat}
> -We should be able to avoid this by not relocating these classes at all.-
> -This is only a problem for shaded artifacts that do not include HBase, like
> the shaded connectors and the planned phoenix-client-byo-hbase variant.-
> -In the full-fat shaded clients phoenix and HBase has the same shading, and
> HBase is able to find the shaded class.-
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
