waywtdcc opened a new pull request, #9228:
URL: https://github.com/apache/hudi/pull/9228
### Change Logs
Supports flink lookup join
can use
`CREATE TABLE `datagen_source`(
id int,
name STRING,
proctime as PROCTIME()
) WITH (
'connector' = 'datagen',
'rows-per-second'='1',
'number-of-rows' = '2',
'fields.id.kind'='sequence',
'fields.id.start'='1',
'fields.id.end'='2'
);select o.id,o.name,b.id as id2
from datagen_source AS o
join hudi_table/*+ OPTIONS('lookup.join.cache.ttl'= '2 day') */ FOR
SYSTEM_TIME AS OF o.proctime AS b on o.id = b.id; `
This is basically the same as hive's lookup principle. Cache the hudi table
data into the memory, set the ttl time, and read it with lookup
### Impact
Supports flink lookup join
### Risk level (write none, low medium or high below)
low
### Contributor's checklist
- [X] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [X] Change Logs and Impact were stated clearly
- [X] Adequate tests were added if applicable
- [X] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
