Toroidals commented on issue #11714: URL: https://github.com/apache/hudi/issues/11714#issuecomment-2264886035
> @Toroidals Can you share code what are you using to read using spark. By default it uses the snapshot view. OR are you trying to read _ro itself and not using path. > > Both spark and hive will read parquet files only so ideally should give similar performance for RO. Hive uses HiveServer2 to read the RO table, and Spark uses Spark SQL to read the RO table, using the same query SQL. For example: "select * from table_name_01_ro order by last_update_date desc". When querying, Spark SQL can retrieve the last_update_date values up to 5 minutes before the current time, but Hive can only retrieve the last_update_date values up to 2 hours before the current time. Phenomenon: Spark SQL queries the RO table with a delay of around 5 minutes, while HiveServer2 queries the RO table with a delay of around 2 hours. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
