Pei-Lun Lee created SPARK-6351:
----------------------------------
Summary: ParquetRelation2
Key: SPARK-6351
URL: https://issues.apache.org/jira/browse/SPARK-6351
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.3.0
Reporter: Pei-Lun Lee
With new parquet API, if multiple parquet paths with different file systems
(e.g. s3n and hdfs) are given, the error "IllegalArgumentException: Wrong FS"
will be raised. Due to the FileSystem is created from hadoop configuration,
which only allow one default file system. This behavior was supposed to work in
old API.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
