[ 
https://issues.apache.org/jira/browse/HUDI-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17452829#comment-17452829
 ] 

Prashant Wason commented on HUDI-2926:
--------------------------------------

Patch to fix this issue in 0.9

 

diff --git 
a/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
 
b/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
index dfb2fc8fc..4196fa869 100644
--- 
a/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
+++ 
b/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
@@ -450,6 +450,10 @@ public abstract class AbstractHoodieWriteClient<T extends 
HoodieRecordPayload, I

   protected void runTableServicesInline(HoodieTable<T, I, K, O> table, 
HoodieCommitMetadata metadata, Option<Map<String, String>> extraMetadata) {
     if (config.inlineTableServices()) {
+      if (config.isMetadataTableEnabled()) {
+        table.getHoodieView().sync();
+      }
+
       // Do an inline compaction if enabled
       if (config.inlineCompactionEnabled()) {
         runAnyPendingCompactions(table);

> Inline compaction of MOR table does not merge last log blocks when metadata 
> table is enabled
> --------------------------------------------------------------------------------------------
>
>                 Key: HUDI-2926
>                 URL: https://issues.apache.org/jira/browse/HUDI-2926
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Prashant Wason
>            Priority: Major
>
> This issue happens when:
>  # Metadata Table is enabled
>  # It is a MOR Table
>  # Append is not supported
> See HUDI-2925 for more detailed reasoning in the context of clean operations.
>  
> Summary: HoodieTable has a cached metadata reader which should be synced to 
> pick up changes on the dataset.
> Assume last deltacommit was 99.deltacommit and the log file version is 15. 
> The next commit will be 100.deltacommit which will write log file 16 (new log 
> file as APPEND not supported). If postWrite we [read from the cached metadata 
> reader 
> |https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java#L108]
>  then it will not report log version 16.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to