JoshuaZhuCN opened a new issue, #9418:
URL: https://github.com/apache/hudi/issues/9418
**the cached view created through Spark SQL syntax ```cache table``` does
not use cached data when querying,
but instead re queries the hudi table data according to view logic.**
**To Reproduce**
Steps to reproduce the behavior:
1. create a cached view using sql below
```CACHE TABLE spark_view OPTIONS ('storageLevel'='MEMORY_AND_DISK_SER') AS
SELECT * FROM hudi_table```
2.check the storage in spark ui
4.query this cached view
```SELECT * FROM spark_view LIMIT 1```
5. see the dag and plan, It still queries from the hudi table instead of
memory caching
**The following figure shows the query plan after caching the hive table**
**Environment Description**
* Hudi version : 0.12.1
* Spark version : 3.1.3
* Hive version : 3.1.0
* Hadoop version : 3.1.3
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no) : no
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
