My users use Spark 1.5.1 in standalone mode on an HPC cluster, with a
smattering still using 1.4.0
I have been getting reports of errors like this:
15/12/21 15:40:33 ERROR FileAppender: Error writing stream to file
/scratch/spark/work/app-20151221150645-/3/stdout
java.io.IOException: Stream
I administer an HPC cluster that runs Spark clusters as jobs. We run Spark
over the backend network (typically used for MPI), which is not accessible
outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not
present a problem. Now the Application Detail UI link is returning the IP
I administer an HPC cluster that runs Spark clusters as jobs. We run Spark
over the backend network (typically used for MPI), which is not accessible
outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not
present a problem. Now the Application Detail UI link is returning the IP