[ https://issues.apache.org/jira/browse/SPARK-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pei-Lun Lee updated SPARK-6351: ------------------------------- Summary: ParquetRelation2 does not support paths for different file systems (was: ParquetRelation2 ) > ParquetRelation2 does not support paths for different file systems > ------------------------------------------------------------------ > > Key: SPARK-6351 > URL: https://issues.apache.org/jira/browse/SPARK-6351 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.3.0 > Reporter: Pei-Lun Lee > > With new parquet API, if multiple parquet paths with different file systems > (e.g. s3n and hdfs) are given, the error "IllegalArgumentException: Wrong FS" > will be raised. Due to the FileSystem is created from hadoop configuration, > which only allow one default file system. This behavior was supposed to work > in old API. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org