Github user rjurney commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-50419281
Not sure if its related, but when I try to start workers having built from
trunk, I get this:
[hivedata@hivecluster2 spark]$ ./bin/spark-class
org.apache.spark.deploy.worker.Worker spark://hivecluster2:8080
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=128m; support was removed in 8.0
14/07/28 17:05:48 INFO Worker: Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties
14/07/28 17:05:48 INFO Worker: Registered signal handlers for [TERM,
HUP, INT]
14/07/28 17:05:49 INFO SecurityManager: Changing view acls to: hivedata
14/07/28 17:05:49 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(hivedata)
14/07/28 17:05:49 INFO Slf4jLogger: Slf4jLogger started
14/07/28 17:05:49 INFO Remoting: Starting remoting
14/07/28 17:05:49 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkWorker@hivecluster2:36500]
14/07/28 17:05:49 INFO Worker: Starting Spark worker hivecluster2:36500
with 8 cores, 14.6 GB RAM
14/07/28 17:05:49 INFO Worker: Spark home: /home/hivedata/spark
14/07/28 17:05:50 INFO WorkerWebUI: Started WorkerWebUI at
http://hivecluster2:8081
14/07/28 17:05:50 INFO Worker: Connecting to master
spark://hivecluster2:8080...
14/07/28 17:05:50 ERROR EndpointWriter: AssociationError
[akka.tcp://sparkWorker@hivecluster2:36500] ->
[akka.tcp://sparkMaster@hivecluster2:8080]: Error [Association failed with
[akka.tcp://sparkMaster@hivecluster2:8080]] [
akka.remote.EndpointAssociationException: Association failed with
[akka.tcp://sparkMaster@hivecluster2:8080]
Caused by: akka.remote.transport.AkkaProtocolException: The remote system
explicitly disassociated (reason unknown).
]
14/07/28 17:05:50 INFO LocalActorRef: Message
[akka.remote.transport.AssociationHandle$Disassociated] from
Actor[akka://sparkWorker/deadLetters] to
Actor[akka://sparkWorker/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2FsparkMaster%40hivecluster2%3A8080-1#-396559240]
was not delivered. [1] dead letters encountered. This logging can be turned
off or adjusted with configuration settings 'akka.log-dead-letters' and
'akka.log-dead-letters-during-shutdown'.
14/07/28 17:05:50 ERROR EndpointWriter: AssociationError
[akka.tcp://sparkWorker@hivecluster2:36500] ->
[akka.tcp://sparkMaster@hivecluster2:8080]: Error [Association failed with
[akka.tcp://sparkMaster@hivecluster2:8080]] [
akka.remote.EndpointAssociationException: Association failed with
[akka.tcp://sparkMaster@hivecluster2:8080]
Caused by: akka.remote.transport.AkkaProtocolException: The remote system
explicitly disassociated (reason unknown).
]
14/07
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
