[
https://issues.apache.org/jira/browse/SPARK-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-16119:
-----------------------------------
Description:
There's currently code that explicitly disables the "PURGE" flag when dropping
a table:
{code}
if (ctx.PURGE != null) {
throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
}
{code}
That flag is necessary in certain situations where the table data cannot be
moved to the trash (which will be tried unless "PURGE" is requested). If the
client supports it (Hive >= 0.14.0 according to the Hive docs), we should allow
that option to be defined.
For non-Hive tables, as far as I can understand, "PURGE" is the current
behavior of Spark.
The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
should probably also be covered by this change.
was:
There's currently code that explicitly disables the "PURGE" flag when dropping
a table:
{code}
if (ctx.PURGE != null) {
throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
}
{code}
That flag is necessary in certain situations where the table data cannot be
moved to the trash (which will be tried unless "PURGE" is requested). If the
client supports it (Hive >= 0.14.0 according to the Hive docs), we should allow
that option to be defined.
For non-Hive tables, as far as I can understand, "PURGE" is the current
behavior of Spark.
The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
should probably be covered.
> Support "DROP TABLE ... PURGE" if Hive client supports it
> ---------------------------------------------------------
>
> Key: SPARK-16119
> URL: https://issues.apache.org/jira/browse/SPARK-16119
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Marcelo Vanzin
>
> There's currently code that explicitly disables the "PURGE" flag when
> dropping a table:
> {code}
> if (ctx.PURGE != null) {
> throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
> }
> {code}
> That flag is necessary in certain situations where the table data cannot be
> moved to the trash (which will be tried unless "PURGE" is requested). If the
> client supports it (Hive >= 0.14.0 according to the Hive docs), we should
> allow that option to be defined.
> For non-Hive tables, as far as I can understand, "PURGE" is the current
> behavior of Spark.
> The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
> should probably also be covered by this change.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
