bithw1 commented on issue #11933: URL: https://github.com/apache/hudi/issues/11933#issuecomment-2347905085
> I think you are talking about regular join, that is `select ... from table A join B where ... on ...`, if both A and B are streaming, then each time a new record from one side comes, it will trigger a full join of the other side. > > There is also a dimention table join, which will just use the records from left stream to join the right table, and the right table needs to refresh itself at some interval. Thanks @danny0405 , `for the regular join, each time a new record from one side comes, it will trigger a full join of the other side`, looks to me that both tables are kept in the flink state? As of underlying hudi tableļ¼the table is also saved in flink state? Are there hudi configutions to support this streaming tables join, such as index.state.ttl? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
