[
https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-9378:
------------------------------
Description:
The reason why "CTAS with serde" fails is that the {{MetastoreRelation}} gets
converted to a Parquet data source relation by default.
However, this behavior can be reproduced pretty steadily. I'm pretty puzzled
why this test case only fails occasionally. A possible explanation is that,
some test cases may set {{spark.sql.hive.convertMetastoreParquet}} to false
without properly restoring the original value. When such a test case is
executed before "CTAS with serde", no failure occurs.
was:The reason why "CTAS with serde" fails is that the {{MetastoreRelation}}
gets converted to a Parquet data source relation by default.
> Test case "CTAS with serde" fails occasionally
> ----------------------------------------------
>
> Key: SPARK-9378
> URL: https://issues.apache.org/jira/browse/SPARK-9378
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Liang-Chi Hsieh
>
> The reason why "CTAS with serde" fails is that the {{MetastoreRelation}} gets
> converted to a Parquet data source relation by default.
> However, this behavior can be reproduced pretty steadily. I'm pretty puzzled
> why this test case only fails occasionally. A possible explanation is that,
> some test cases may set {{spark.sql.hive.convertMetastoreParquet}} to false
> without properly restoring the original value. When such a test case is
> executed before "CTAS with serde", no failure occurs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
