Re: SparkR in Spark 1.5.2 jsonFile Bug Found

2015-12-04 Thread Yanbo Liang
I have created SPARK-12146 to track this issue. 2015-12-04 9:16 GMT+08:00 Felix Cheung : > It looks like this has been broken around Spark 1.5. > > Please see JIRA SPARK-10185. This has been fixed in pyspark but > unfortunately SparkR was missed. I have confirmed this

SparkR in Spark 1.5.2 jsonFile Bug Found

2015-12-03 Thread tomasr3
Hello, I believe to have encountered a bug with Spark 1.5.2. I am using RStudio and SparkR to read in JSON files with jsonFile(sqlContext, "path"). If "path" is a single path (e.g., "/path/to/dir0"), then it works fine; but, when "path" is a vector of paths (e.g. path <-

Re: SparkR in Spark 1.5.2 jsonFile Bug Found

2015-12-03 Thread Felix Cheung
It looks like this has been broken around Spark 1.5. Please see JIRA SPARK-10185. This has been fixed in pyspark but unfortunately SparkR was missed. I have confirmed this is still broken in Spark 1.6. Could you please open a JIRA? On Thu, Dec 3, 2015 at 2:08 PM -0800, "tomasr3"