eisig edited a comment on issue #789: HoodieMergeOnReadTable rollback hangs URL: https://github.com/apache/incubator-hudi/issues/789#issuecomment-512741943 Stop the demo (./stop_demo.sh) Add a new line to batch_2.json ``` {"volume": 9205, "symbol": "TEST", "ts": "2018-08-31 10:59:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST_2018-08-31 10", "year": 2018, "date": "2018/08/31", "close": 153.48, "open": 153.36, "day": "31"} ``` rerun the demo, and the rt and ro view is the same! ``` 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close from stock_ticks_mor_rt where symbol = 'GOOG'; +----------------------+---------+----------------------+---------+------------+-----------+--+ | _hoodie_commit_time | symbol | ts | volume | open | close | +----------------------+---------+----------------------+---------+------------+-----------+--+ | 20190718092114 | GOOG | 2018-08-31 09:59:00 | 6330 | 1230.5 | 1230.02 | | 20190718092214 | GOOG | 2018-08-31 10:59:00 | 9021 | 1227.1993 | 1227.215 | +----------------------+---------+----------------------+---------+------------+-----------+--+ 2 rows selected (0.487 seconds) 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close from stock_ticks_mor where symbol = 'GOOG'; +----------------------+---------+----------------------+---------+------------+-----------+--+ | _hoodie_commit_time | symbol | ts | volume | open | close | +----------------------+---------+----------------------+---------+------------+-----------+--+ | 20190718092114 | GOOG | 2018-08-31 09:59:00 | 6330 | 1230.5 | 1230.02 | | 20190718092214 | GOOG | 2018-08-31 10:59:00 | 9021 | 1227.1993 | 1227.215 | +----------------------+---------+----------------------+---------+------------+-----------+--+ ``` --- Another example Add these to batch_1.json, they are in different partitions ``` {"volume": 9205, "symbol": "TEST1", "ts": "2018-08-31 10:29:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST1_2018-08-30 10", "year": 2018, "date": "2018/08/30", "close": 153.48, "open": 153.36, "day": "30"} {"volume": 9205, "symbol": "TEST2", "ts": "2018-08-31 10:29:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST2_2018-08-31 10", "year": 2018, "date": "2018/08/31", "close": 153.48, "open": 153.36, "day": "31"} ``` Add these to batch_2.json ``` {"volume": 9205, "symbol": "TEST1", "ts": "2018-08-31 10:59:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST1_2018-08-30 10", "year": 2018, "date": "2018/08/30", "close": 153.48, "open": 153.36, "day": "30"} {"volume": 9205, "symbol": "TEST2", "ts": "2018-08-31 10:59:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST2_2018-08-31 10", "year": 2018, "date": "2018/08/31", "close": 153.48, "open": 153.36, "day": "31"} {"volume": 9205, "symbol": "TEST3", "ts": "2018-08-31 10:59:00", "month": "08", "high": 153.48, "low": 153.36, "key": "TEST3_2018-08-31 10", "year": 2018, "date": "2018/08/31", "close": 153.48, "open": 153.36, "day": "31"} ``` the results ``` 0: jdbc:hive2://hiveserver:10000> select key,ts from stock_ticks_mor where symbol like 'TEST%'; +----------------------+----------------------+--+ | key | ts | +----------------------+----------------------+--+ | TEST1_2018-08-30 10 | 2018-08-31 10:29:00 | | TEST2_2018-08-31 10 | 2018-08-31 10:59:00 | | TEST3_2018-08-31 10 | 2018-08-31 10:59:00 | +----------------------+----------------------+--+ 3 rows selected (0.441 seconds) ``` Some changes return, some not.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
