dat-vikash commented on issue #8060:
URL: https://github.com/apache/hudi/issues/8060#issuecomment-1654771005
I'm seeing this issue on Flink 1.16.1 and Hudi 0.13.1.
Error :
```
org.apache.flink.util.FlinkException: Global failure triggered by
OperatorCoordinator for 'bucket_write:
events_FULFILLMENT_DELIVERY_ATTEMPT_FAILURE' (operator
e14cabb235e02aeecfe502ccf28ffead).
at
org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:617)
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$start$0(StreamWriteOperatorCoordinator.java:191)
at
org.apache.hudi.sink.utils.NonThrownExecutor.handleException(NonThrownExecutor.java:142)
at
org.apache.hudi.sink.utils.NonThrownExecutor.lambda$wrapAction$0(NonThrownExecutor.java:133)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.hudi.exception.HoodieException: Executor executes
action [commits the instant 20230727230043276] error
... 6 more
Caused by: java.lang.IllegalArgumentException: Instant [20230727223026767]
should have newer timestamp than instant [20230727225634581]
at
org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:40)
at
org.apache.hudi.util.StreamerUtil.medianInstantTime(StreamerUtil.java:311)
at
org.apache.hudi.util.CompactionUtil.getCompactionInstantTime(CompactionUtil.java:89)
at
org.apache.hudi.util.CompactionUtil.scheduleCompaction(CompactionUtil.java:70)
at
org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$notifyCheckpointComplete$2(StreamWriteOperatorCoordinator.java:250)
at
org.apache.hudi.sink.utils.NonThrownExecutor.lambda$wrapAction$0(NonThrownExecutor.java:130)
... 3 more
```
My MoR table config is
```
connector' = 'hudi',
'table.type' = 'MERGE_ON_READ',
'path'='<path>',
'read.streaming.enabled'='false',
'hoodie.datasource.write.recordkey.field' = 'event_uuid,company_id',
'hoodie.datasource.write.precombine.field'='event_timestamp',
'compaction.schedule.enabled' = 'true',
'hoodie.layout.optimize.enable'='true',
'hoodie.layout.optimize.strategy'='z-order',
'hoodie.clustering.plan.strategy.sort.columns'='company_id',
'hoodie.datasource.write.hive_style_partitioning' = 'true',
'compaction.trigger.strategy'='num_or_time',
'compaction.delta_seconds'='90',
'hoodie.datasource.write.partitionpath.field'='pt_year,pt_month,pt_day,pt_hour',
'read.data.skipping.enabled'='true',
'index.type'='BUCKET',
'hoodie.index.bucket.engine'='SIMPLE',
'hoodie.parquet.compression.codec' = 'snappy',
'hoodie.bucket.index.hash.field'='company_id',
'hoodie.cleaner.policy.failed.writes'='LAZY',
'hoodie.bucket.index.num.buckets'='8',
'write.tasks'='1',
'hive_sync.enable' = 'true',
'hive_sync.mode' = 'hms',
'hive_sync.metastore.uris' = '<THRIFT_PLACE_HOLDER>'
```
Appreciate any advice @danny0405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
