prashantwason commented on issue #4719:
URL: https://github.com/apache/hudi/issues/4719#issuecomment-1026075330


   Being in 0.9, this may be because of[ pending 
compaction](https://issues.apache.org/jira/browse/HUDI-2923)
   
   The file system slices are read in 
[HoodieBackedTableMetadata](https://github.com/apache/hudi/blob/178767948e906f673d6d4a357c65c11bc574f619/hudi-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadata.java#L107)
 as:
        latestFileSystemMetadataSlices = 
fsView.getLatestFileSlices(MetadataPartitionType.FILES.partitionPath()).collect(Collectors.toList());
   
   If the files partition is under compaction, the number of file slices 
returned can be > 1 which leads to this exception being raised.
   
   To validate, check if:
   1. There is a pending/failed compaction by listing the .hoodie folder. It 
should have a .commit.requested or .commit.inflight 
   
   I think we need to port these two PRs to fix this:
   https://github.com/apache/hudi/pull/4206
   https://github.com/apache/hudi/pull/4218
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to