sivabalan narayanan created HUDI-7556:
-----------------------------------------
Summary: Fix MDT validator to account for additional partitions in
MDT
Key: HUDI-7556
URL: https://issues.apache.org/jira/browse/HUDI-7556
Project: Apache Hudi
Issue Type: Bug
Components: metadata
Reporter: sivabalan narayanan
There is a chance that MDT could list additional partitions when compared to FS
based listing.
reason is:
We load active timeline from metaclient and poll FS based listing for completed
commits. And then we poll MDT for list of all partitions. in between these two,
there could be a commit that could have been completed and hence MDT could be
serving that as well. So, lets account for that in our validation tool
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
