See https://issues.apache.org/jira/browse/SPARK-6351

~ Jonathan

From: Shuai Zheng <szheng.c...@gmail.com<mailto:szheng.c...@gmail.com>>
Date: Monday, March 16, 2015 at 11:46 AM
To: "user@spark.apache.org<mailto:user@spark.apache.org>" 
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: sqlContext.parquetFile doesn't work with s3n in version 1.3.0

Hi All,

I just upgrade the system to use version 1.3.0, but then the 
sqlContext.parquetFile doesn’t work with s3n. I have test the same code with 
1.2.1 and it works.

A simple test running in spark-shell:

val parquetFile = sqlContext.parquetFile("""s3n://****/test/2.parq """)
java.lang.IllegalArgumentException: Wrong FS: s3n://****/test/2.parq, expected: 
file:///<file:///\\>

And same test work with spark-shell under 1.2.1

Regards,

Shuai

Reply via email to