[
https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-33770.
----------------------------------
Fix Version/s: 2.4.8
3.0.2
3.1.0
Resolution: Fixed
Issue resolved by pull request 30757
[https://github.com/apache/spark/pull/30757]
> Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of
> partition path
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-33770
> URL: https://issues.apache.org/jira/browse/SPARK-33770
> Project: Spark
> Issue Type: Test
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Maxim Gekk
> Assignee: Maxim Gekk
> Priority: Major
> Fix For: 3.1.0, 3.0.2, 2.4.8
>
>
> For example:
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132719/testReport/org.apache.spark.sql.hive.execution.command/AlterTableAddPartitionSuite/ALTER_TABLE____ADD_PARTITION_Hive_V1__SPARK_33521__universal_type_conversions_of_partition_values/
> {code:java}
> org.apache.spark.sql.hive.execution.command.AlterTableAddPartitionSuite.ALTER
> TABLE .. ADD PARTITION Hive V1: SPARK-33521: universal type conversions of
> partition values
> sbt.ForkMain$ForkError: org.apache.spark.sql.AnalysisException:
> org.apache.hadoop.hive.ql.metadata.HiveException: File
> file:/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/spark-38fe2706-33e5-469a-ba3a-682391e02179
> does not exist;
> at
> org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:112)
> at
> org.apache.spark.sql.hive.HiveExternalCatalog.dropPartitions(HiveExternalCatalog.scala:1014)
> at
> org.apache.spark.sql.catalyst.catalog.ExternalCatalogWithListener.dropPartitions(ExternalCatalogWithListener.scala:211)
> at
> org.apache.spark.sql.catalyst.catalog.SessionCatalog.dropPartitions(SessionCatalog.scala:1036)
> at
> org.apache.spark.sql.execution.command.AlterTableDropPartitionCommand.run(ddl.scala:582)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
