Hi Jürgen,
Did you ever find a way to resolve this issue ?
Looking at the implementation of the application master, it seems that there
is no heartbeat/keepalive mechanism for the communication between the driver
and AM, so when something closes the connection for inactivity, the AM shuts
down:
Hi,
I'm using the Spark Thrift Server and after some time the driver and
application master are shutting down because of timeouts. There is a firewall
in between and there is no traffic between them as it seems. Is there a way to
configure TCP keep alive for the connection or some other way to