GitHub user 10110346 opened a pull request:
https://github.com/apache/spark/pull/20802
[SPARK-23651][core]Add a check for host name
I encountered an error like this:
`org.apache.spark.SparkException: Invalid Spark URL:
spark://HeartbeatReceiver@ci_164:42849 at
org.apache.spark.rpc.RpcEndpointAddress$.apply(RpcEndpointAddress.scala:66) at
org.apache.spark.rpc.netty.NettyRpcEnv.asyncSetupEndpointRefByURI(NettyRpcEnv.scala:134)
at org.apache.spark.rpc.RpcEnv.setupEndpointRefByURI(RpcEnv.scala:101) at
org.apache.spark.rpc.RpcEnv.setupEndpointRef(RpcEnv.scala:109) at
org.apache.spark.util.RpcUtils$.makeDriverRef(RpcUtils.scala:32) at
org.apache.spark.executor.Executor.<init>(Executor.scala:155) at
org.apache.spark.scheduler.local.LocalEndpoint.<init>(LocalSchedulerBackend.scala:59)
at
org.apache.spark.scheduler.local.LocalSchedulerBackend.start(LocalSchedulerBackend.scala:126)
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:164)`
I didn't know why this URL(spark://HeartbeatReceiver@ci_164:42849) is
invalid,
in fact, hostname is only allowed to include 0-9, a-z, A-Z , - and . , so i
think we should give a clearer reminder for this error.
How was this patch tested?
Added a unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/10110346/spark hostname
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20802.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20802
----
commit a86a82c1fa29eeeb369267aa60723c2a28037e57
Author: liuxian <liu.xian3@...>
Date: 2018-03-12T07:39:59Z
fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
