This is probably due to SPARK-1931<https://issues.apache.org/jira/browse/SPARK-1931>, which I just fixed in PR #885 <https://github.com/apache/spark/pull/885>. Is the problem resolved if you use the current Spark master?
Ankur <http://www.ankurdave.com/>