voonhous commented on PR #7997:
URL: https://github.com/apache/hudi/pull/7997#issuecomment-1475802636
# JM
```log
2023-02-20 11:36:34,826 INFO org.apache.hudi.client.BaseHoodieWriteClient
[] - Begin rollback of instant 20230220112929727
2023-02-20 11:36:34,833 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
HoodieTableMetaClient from hdfs://hudi_path
2023-02-20 11:36:34,947 INFO org.apache.hudi.common.table.HoodieTableConfig
[] - Loading table properties from
hdfs://hudi_path/.hoodie/hoodie.properties
2023-02-20 11:36:34,952 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Finished
Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from
hdfs://hudi_path
2023-02-20 11:36:34,952 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
Active commit timeline for hdfs://hudi_path
2023-02-20 11:36:35,320 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220112929727__commit__INFLIGHT]}
2023-02-20 11:36:35,321 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating View
Manager with storage type :REMOTE_FIRST
2023-02-20 11:36:35,321 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating
remote first table view
2023-02-20 11:36:35,323 INFO org.apache.hudi.client.BaseHoodieWriteClient
[] - Scheduling Rollback at instant time : 20230220113634829
(exists in active timeline: true), with rollback plan: false
2023-02-20 11:36:35,612 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220113634829__rollback__REQUESTED]}
2023-02-20 11:36:35,612 INFO
org.apache.hudi.table.action.rollback.BaseRollbackPlanActionExecutor [] -
Requesting Rollback with instant time
[==>20230220113634829__rollback__REQUESTED]
2023-02-20 11:36:35,620 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220113634829__rollback__REQUESTED]}
2023-02-20 11:36:35,694 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Checking for
file exists ?hdfs://hudi_path/.hoodie/20230220113634829.rollback.requested
2023-02-20 11:36:35,706 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Create new
file for toInstant ?hdfs://hudi_path/.hoodie/20230220113634829.rollback.inflight
2023-02-20 11:36:35,709 INFO
org.apache.hudi.table.action.rollback.CopyOnWriteRollbackActionExecutor [] -
Clean out all base files generated for commit:
[==>20230220112929727__commit__INFLIGHT]
2023-02-20 11:36:35,720 INFO
org.apache.hudi.table.action.rollback.CopyOnWriteRollbackActionExecutor [] -
Time(in ms) taken to finish rollback 11
2023-02-20 11:36:35,720 INFO
org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor [] - Rolled
back inflight instant 20230220112929727
2023-02-20 11:36:35,721 INFO
org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor [] - Index
rolled back for commits [==>20230220112929727__commit__INFLIGHT]
2023-02-20 11:36:35,725 INFO
org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor [] - Deleting
instant=[==>20230220112929727__commit__INFLIGHT]
2023-02-20 11:36:35,725 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Deleting
instant [==>20230220112929727__commit__INFLIGHT]
2023-02-20 11:36:35,728 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Removed
instant [==>20230220112929727__commit__INFLIGHT]
2023-02-20 11:36:35,728 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Deleting
instant [==>20230220112929727__commit__REQUESTED]
2023-02-20 11:36:35,731 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Removed
instant [==>20230220112929727__commit__REQUESTED]
2023-02-20 11:36:35,732 INFO
org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor [] - Deleted
pending commit [==>20230220112929727__commit__REQUESTED]
2023-02-20 11:36:35,733 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Checking for
file exists ?hdfs://hudi_path/.hoodie/20230220113634829.rollback.inflight
2023-02-20 11:36:35,786 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Create new
file for toInstant ?hdfs://hudi_path/.hoodie/20230220113634829.rollback
2023-02-20 11:36:35,786 INFO
org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor [] - Rollback
of Commits [20230220112929727] is complete
2023-02-20 11:36:35,805 INFO org.apache.hudi.common.fs.FSUtils
[] - Removed directory at
hdfs://hudi_path/.hoodie/.temp/20230220112929727
2023-02-20 11:36:35,806 INFO org.apache.hudi.metrics.HoodieMetrics
[] - Sending rollback metrics (duration=973, numFilesDeleted=2)
2023-02-20 11:36:35,812 INFO org.apache.hudi.client.BaseHoodieWriteClient
[] - Generate a new instant time: 20230220113635812 action: commit
2023-02-20 11:36:35,815 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[20230220113634829__rollback__COMPLETED]}
```
# TM
```log
11:36:33,837 INFO org.apache.hudi.common.table.HoodieTableMetaClient
[] - Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from hdfs://hdfs_path
2023-02-20 11:36:33,837 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
Active commit timeline for hdfs://hdfs_path
2023-02-20 11:36:33,840 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220112929727__commit__INFLIGHT]}
2023-02-20 11:36:33,841 INFO org.apache.hudi.client.BaseHoodieClient
[] - Embedded Timeline Server is disabled. Not starting timeline
service
2023-02-20 11:36:33,843 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating View
Manager with storage type :REMOTE_FIRST
2023-02-20 11:36:33,843 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating
remote first table view
2023-02-20 11:36:33,849 INFO
org.apache.hudi.common.table.view.AbstractTableFileSystemView [] - Took 2 ms to
read 0 instants, 0 replaced file groups
2023-02-20 11:36:33,850 INFO
org.apache.hudi.sink.common.AbstractStreamWriteFunction [] - Send
bootstrap write metadata event to coordinator, task[0].
2023-02-20 11:36:33,850 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220112929727__commit__INFLIGHT]}
2023-02-20 11:36:33,853 INFO org.apache.flink.runtime.taskmanager.Task
[] - bucket_write: dim_buyer_info_test (1/2)#0
(e2e7a38d69393b8d814ad48544573435_829468138015e9cb689e833f1800885e_0_0)
switched from INITIALIZING to RUNNING.
2023-02-20 11:36:33,857 INFO org.apache.hudi.sink.CleanFunction
[] - Executor executes action [wait for cleaning finish] success!
2023-02-20 11:36:33,860 INFO
org.apache.hudi.sink.bucket.BucketStreamWriteFunction [] - Loading
Hoodie Table dim_buyer_info_test, with path hdfs://hdfs_path/age=0
2023-02-20 11:36:33,860 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
HoodieTableMetaClient from hdfs://hdfs_path
2023-02-20 11:36:33,867 INFO org.apache.hudi.common.table.HoodieTableConfig
[] - Loading table properties from
hdfs://hdfs_path/.hoodie/hoodie.properties
2023-02-20 11:36:33,868 INFO org.apache.hudi.common.util.ClusteringUtils
[] - Found 0 files in pending clustering operations
2023-02-20 11:36:33,868 INFO
org.apache.hudi.common.table.view.AbstractTableFileSystemView [] - Building
file system view for partition (age=1)
2023-02-20 11:36:33,872 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Finished
Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from
hdfs://hdfs_path
2023-02-20 11:36:33,872 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
Active commit timeline for hdfs://hdfs_path
2023-02-20 11:36:33,878 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline [] - Loaded
instants upto : Option{val=[==>20230220112929727__commit__INFLIGHT]}
2023-02-20 11:36:33,879 INFO
org.apache.hudi.common.table.view.AbstractTableFileSystemView [] -
addFilesToView: NumFiles=2, NumFileGroups=1, FileGroupsCreationTime=6,
StoreTimeTaken=1
2023-02-20 11:36:33,880 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating View
Manager with storage type :REMOTE_FIRST
2023-02-20 11:36:33,880 INFO
org.apache.hudi.common.table.view.FileSystemViewManager [] - Creating
remote first table view
2023-02-20 11:36:33,880 INFO
org.apache.hudi.sink.bucket.BucketStreamWriteFunction [] -
bootstrapIndexIfNeed with timeline: [[==>20230220112929727__commit__INFLIGHT]]
2023-02-20 11:36:33,880 INFO
org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading
HoodieTableMetaClient from hdfs://hdfs_path
2023-02-20 11:36:33,880 INFO
org.apache.hudi.sink.bucket.BucketStreamWriteFunction [] - Should load
this partition bucket 0 with fileID 00000000-ee86-4b41-a704-9e075dd253d8
2023-02-20 11:36:33,880 INFO
org.apache.hudi.sink.bucket.BucketStreamWriteFunction [] - Adding fileID
00000000-ee86-4b41-a704-9e075dd253d8 to the bucket 0 of partition age=1.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
