troubleshooting "Missing an output location for shuffle"

2015-12-14 Thread Veljko Skarich
Hi, I keep getting some variation of the following error: org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 2 Does anyone know what this might indicate? Is it a memory issue? Any general guidance appreciated.

Re: troubleshooting "Missing an output location for shuffle"

2015-12-14 Thread Ross.Cramblit
Hey Velijko, I ran into this error a few days ago and it turned out I was out of disk space on a couple nodes. I am not sure if this was the direct cause of the error, but it stopped throwing when I cleared out some unneeded large files. On Dec 14, 2015, at 5:32 PM, Veljko Skarich