sfiend opened a new issue #2645:
URL: https://github.com/apache/iceberg/issues/2645


   In many scenarios, flink streaming source table will consume kafka topics 
and join with a dimension table like hive, due to flink hive table source will 
cache all hive partitions and then look up the match rows from cache for now, 
the performance of hive is not good  enough if the hive table is large. Iceberg 
table has metadata and support primary key now, and also can push down the 
filters when scan data files, so I think maybe it's prefect if the iceberg 
table can used to be a dimension table.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to