cb149 commented on issue #4830:
URL: https://github.com/apache/hudi/issues/4830#issuecomment-1048927415
> @cb149 Are you still seeing this issue where every day the last partition
(that was cleaned) is not showing up in select count(*) ? I have couple
questions just to make sure you have already checked these
>
> * Are the missing partitions showing up in show partitions statement?
> * clustering and cleaning has happened and this is the last partition
correct? Is this consistently happening every day in a rolling fashion?
> Can you also paste the corresponding .commit/.replacecommit/.clean files
for the missing partition? Have you taken a look into those files to see if
anything strange is happening?
- Yes, the missing partition show up in `show partitions myTable`, but shows
0 files and 0 Bytes
- Yes, happens in a rolling fashion, every day the partition from 3 days ago
is missing, all other partitions show up
Today, where `day=20` is missing, using hudi-cli I can see the following for
the latest clean:
```
clean showpartitions --clean 20220223030128861
╔══════════════════════════╤═════════════════════╤══════════════════════════════════╤════════════════════════╗
║ Partition Path │ Cleaning policy │ Total Files Successfully
Deleted │ Total Failed Deletions ║
╠══════════════════════════╪═════════════════════╪══════════════════════════════════╪════════════════════════╣
║ year=2022/month=2/day=20 │ KEEP_LATEST_COMMITS │ 50
│ 0 ║
╟──────────────────────────┼─────────────────────┼──────────────────────────────────┼────────────────────────╢
║ year=2022/month=2/day=21 │ KEEP_LATEST_COMMITS │ 0
│ 0 ║
╚══════════════════════════╧═════════════════════╧══════════════════════════════════╧════════════════════════╝
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
