LuciferYang opened a new issue, #10925:
URL: https://github.com/apache/paimon/issues/10925

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   ### Paimon version
   
   master (30d91278af)
   
   ### Compute Engine
   
   Flink
   
   ### Minimal reproduce step
   
   On a partitioned table whose manifests reference missing data files in 
partitions `pt=0` and `pt=1`, run the action for one partition only:
   
   ```bash
   <FLINK_HOME>/bin/flink run paimon-flink-action.jar remove_unexisting_files \
       --warehouse <warehouse> --database mydb --table t \
       --partition pt=0
   ```
   
   ### What doesn't meet your expectations?
   
   The missing files of `pt=1` are removed from the manifests as well. The help 
of the action documents `[--partition <partition_name> [--partition 
<partition_name> ...]]` and says "If partitions are not specified, this action 
will remove unexisting files from all partitions", but 
`RemoveUnexistingFilesActionFactory` never reads `--partition`, so the action 
always runs on every partition of the table. The action rewrites manifests, and 
its help warns that it may cause data loss when used outside the documented 
cases, so running it on more partitions than asked for is not harmless.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to