error writing to stdout

2015-12-21 Thread carlilek
My users use Spark 1.5.1 in standalone mode on an HPC cluster, with a smattering still using 1.4.0 I have been getting reports of errors like this: 15/12/21 15:40:33 ERROR FileAppender: Error writing stream to file /scratch/spark/work/app-20151221150645-/3/stdout java.io.IOException: Stream

Applicaiton Detail UI change

2015-12-21 Thread carlilek
I administer an HPC cluster that runs Spark clusters as jobs. We run Spark over the backend network (typically used for MPI), which is not accessible outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not present a problem. Now the Application Detail UI link is returning the IP

spark-1.5.1 application detail ui url

2015-10-29 Thread carlilek
I administer an HPC cluster that runs Spark clusters as jobs. We run Spark over the backend network (typically used for MPI), which is not accessible outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not present a problem. Now the Application Detail UI link is returning the IP