[
https://issues.apache.org/jira/browse/SPARK-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-16119.
------------------------------------
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.1.0
> Support "DROP TABLE ... PURGE" if Hive client supports it
> ---------------------------------------------------------
>
> Key: SPARK-16119
> URL: https://issues.apache.org/jira/browse/SPARK-16119
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Fix For: 2.1.0
>
>
> There's currently code that explicitly disables the "PURGE" flag when
> dropping a table:
> {code}
> if (ctx.PURGE != null) {
> throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
> }
> {code}
> That flag is necessary in certain situations where the table data cannot be
> moved to the trash (which will be tried unless "PURGE" is requested). If the
> client supports it (Hive >= 0.14.0 according to the Hive docs), we should
> allow that option to be defined.
> For non-Hive tables, as far as I can understand, "PURGE" is the current
> behavior of Spark.
> The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
> should probably also be covered by this change.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
