Github user tigerquoll commented on the issue:
https://github.com/apache/spark/pull/21308
@rdblue what about those data sources that support record deletion and
partition dropping as two semantically different operations - Kudu and Hbase
being two examples.
All systems that support partitions have a different api for dealing with
partition level ops. Even file based table storage systems support the
different levels of manipulation. (look at the sql DDL that impala supports for
parquet partition for an example - they use a filter, but the command is
âthis partition op applies to the partiton that is defined by this filterâ,
not âapply this op to all records that match this filter)â
The difference is subtle, but it is an important one, and every system that
supports partitions enforces that difference for a reason.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
