eisig opened a new issue #695: quickstart demo stock_ticks_mor and stock_ticks_mor_rt return the same result URL: https://github.com/apache/incubator-hudi/issues/695 I follow https://hudi.incubator.apache.org/docker_demo.html Step 6(a): Run Hive Queries The docs say that` ReadOptimized view will still return “10:29 am” as it will only read from the Parquet file. Realtime View will do on-the-fly merge and return latest committed data which is “10:59 a.m”.` But I get the same result. latest master brach(commit d0d2fa03379525e8156d5dc0adae9eb852603899) ``` 0: jdbc:hive2://hiveserver:10000> select symbol, max(ts) from stock_ticks_mor group by symbol HAVING symbol = 'GOOG'; WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. +---------+----------------------+--+ | symbol | _c1 | +---------+----------------------+--+ | GOOG | 2018-08-31 10:59:00 | +---------+----------------------+--+ 1 row selected (1.779 seconds) 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close from stock_ticks_mor where symbol = 'GOOG'; +----------------------+---------+----------------------+---------+------------+-----------+--+ | _hoodie_commit_time | symbol | ts | volume | open | close | +----------------------+---------+----------------------+---------+------------+-----------+--+ | 20190527012650 | GOOG | 2018-08-31 09:59:00 | 6330 | 1230.5 | 1230.02 | | 20190527013023 | GOOG | 2018-08-31 10:59:00 | 9021 | 1227.1993 | 1227.215 | +----------------------+---------+----------------------+---------+------------+-----------+--+ 2 rows selected (0.334 seconds) 0: jdbc:hive2://hiveserver:10000> select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG'; WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. +---------+----------------------+--+ | symbol | _c1 | +---------+----------------------+--+ | GOOG | 2018-08-31 10:59:00 | +---------+----------------------+--+ 1 row selected (1.99 seconds) 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close from stock_ticks_mor_rt where symbol = 'GOOG'; +----------------------+---------+----------------------+---------+------------+-----------+--+ | _hoodie_commit_time | symbol | ts | volume | open | close | +----------------------+---------+----------------------+---------+------------+-----------+--+ | 20190527012650 | GOOG | 2018-08-31 09:59:00 | 6330 | 1230.5 | 1230.02 | | 20190527013023 | GOOG | 2018-08-31 10:59:00 | 9021 | 1227.1993 | 1227.215 | +----------------------+---------+----------------------+---------+------------+-----------+--+ 2 rows selected (0.434 seconds) ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
