Joseph Su created SPARK-3011:
--------------------------------
Summary: _temporary directory should be filtered out by
sqlContext.parquetFile
Key: SPARK-3011
URL: https://issues.apache.org/jira/browse/SPARK-3011
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Joseph Su
Sometimes _temporary directory is not removed after the file committed on S3.
sqlContext.parquetFile will raise because it is trying to read the metadata in
_temporary .sqlContext.parquetFile should just ignore the directory.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
