wangyum opened a new pull request #31177:
URL: https://github.com/apache/spark/pull/31177
### What changes were proposed in this pull request?
This PR upgrade Zookeeper to 3.6.2.
### Why are the changes needed?
To make Spark running on Java 14, otherwise:
```
21/01/13 20:25:32,533 WARN
[Driver-SendThread(apache-spark-zk-3.vip.hadoop.com:2181)]
zookeeper.ClientCnxn:1164 : Session 0x0 for server
apache-spark-zk-3.vip.hadoop.com/<unresolved>:2181, unexpected error, closing
socket connection and attempting reconnect
java.lang.IllegalArgumentException: Unable to canonicalize address
carmel-rno-zk-3.vip.hadoop.ebay.com/<unresolved>:2181 because it's not
resolvable
at
org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:65)
at
org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:41)
at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1001)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
```
Please see
[ZOOKEEPER-3779](https://issues.apache.org/jira/browse/ZOOKEEPER-3779) for more
details.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual test:
1. Replace zookeeper-3.4.14.jar with zookeeper-3.6.2.jar and
zookeeper-jute-3.6.2.jar
2. Run Spark on Java 14.
Some key configurations:
```
# spark-defaults.conf
spark.yarn.appMasterEnv.JAVA_HOME
/apache/releases/jdk-14.0.2
spark.executorEnv.JAVA_HOME
/apache/releases/jdk-14.0.2
# spark-env.sh
export JAVA_HOME=/apache/releases/jdk-14.0.2
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
