nsivabalan edited a comment on issue #4433: URL: https://github.com/apache/hudi/issues/4433#issuecomment-1001852996
this worked for me. setting valid start commit time. I tried using our docker demo and tried our quick start commands. ``` set hoodie.hudi_trips_cow.consume.max.commits=2; No rows affected (0.006 seconds) 0: jdbc:hive2://hiveserver:10000> set hoodie.hudi_trips_cow.consume.start.timestamp=20211228032849365; No rows affected (0.006 seconds) 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, fare, begin_lon, begin_lat, ts from hudi_trips_cow ; +----------------------+---------------------+----------------------+-----------------------+----------------+--+ | _hoodie_commit_time | fare | begin_lon | begin_lat | ts | +----------------------+---------------------+----------------------+-----------------------+----------------+--+ | 20211228033135331 | 54.16944371261484 | 0.7548086309564753 | 0.5535762898838785 | 1640063732033 | | 20211228033135331 | 38.4828225162323 | 0.20404106962358204 | 0.1450793330198833 | 1640259862723 | | 20211228033135331 | 16.098476392187365 | 0.6286940931025506 | 0.16172715555352513 | 1640455374466 | | 20211228033135331 | 19.48472236694032 | 0.3748535764638379 | 0.7567233311397606 | 1640468596981 | | 20211228033135331 | 55.31092276192561 | 0.826183030502974 | 0.391583018565109 | 1640149189400 | | 20211228033135331 | 37.35848234860164 | 0.9084944020139248 | 0.6330100459693088 | 1640343218265 | | 20211228033135331 | 67.28087880304021 | 0.5045582154226707 | 0.9927159674996295 | 1640254742720 | | 20211228033135331 | 27.603571822228822 | 0.67243450582925 | 0.9312237784651692 | 1640339546062 | | 20211228033152850 | 21.39416477932461 | 0.44639610064697444 | 0.6034474295461695 | 1640367702446 | | 20211228033152850 | 91.77262409248691 | 0.07294020039857341 | 0.038623454452973216 | 1640350942826 | | 20211228033152850 | 94.67524853429937 | 0.5495072745774239 | 0.18126217829655766 | 1640583846213 | | 20211228033152850 | 69.36363684236434 | 0.621688297381891 | 0.13625652434397972 | 1640337289114 | | 20211228033152850 | 18.462706550963716 | 0.7048003036630716 | 9.842943407509797E-4 | 1640650323702 | | 20211228033152850 | 41.57780462795554 | 0.5609292266131617 | 0.6718059599888331 | 1640599440037 | +----------------------+---------------------+----------------------+-----------------------+----------------+--+ ``` my dataset has 4 commits in total ``` hdfs dfs -ls /tmp/hudi_trips_cow1/.hoodie/ Found 17 items drwxr-xr-x - root supergroup 0 2021-12-28 03:28 /tmp/hudi_trips_cow1/.hoodie/.aux drwxr-xr-x - root supergroup 0 2021-12-28 03:32 /tmp/hudi_trips_cow1/.hoodie/.temp -rw-r--r-- 1 root supergroup 2279 2021-12-28 03:28 /tmp/hudi_trips_cow1/.hoodie/20211228032849365.commit -rw-r--r-- 1 root supergroup 0 2021-12-28 03:28 /tmp/hudi_trips_cow1/.hoodie/20211228032849365.commit.requested -rw-r--r-- 1 root supergroup 1187 2021-12-28 03:28 /tmp/hudi_trips_cow1/.hoodie/20211228032849365.inflight -rw-r--r-- 1 root supergroup 2277 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033135331.commit -rw-r--r-- 1 root supergroup 0 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033135331.commit.requested -rw-r--r-- 1 root supergroup 1186 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033135331.inflight -rw-r--r-- 1 root supergroup 2277 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033152850.commit -rw-r--r-- 1 root supergroup 0 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033152850.commit.requested -rw-r--r-- 1 root supergroup 1186 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033152850.inflight -rw-r--r-- 1 root supergroup 2277 2021-12-28 03:32 /tmp/hudi_trips_cow1/.hoodie/20211228033158272.commit -rw-r--r-- 1 root supergroup 0 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033158272.commit.requested -rw-r--r-- 1 root supergroup 1186 2021-12-28 03:31 /tmp/hudi_trips_cow1/.hoodie/20211228033158272.inflight drwxr-xr-x - root supergroup 0 2021-12-28 03:28 /tmp/hudi_trips_cow1/.hoodie/archived ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
