Hello, I have data sets in s3 and want to use them as lookup tables in Flink. I defined tables with the filesystem connector and joined the tables to a table, defined with the Kinesis connector, in my Flink application. I expected its output to be written to s3, but no data was written to a sink table.
According to the Flink doc ( https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/overview/#supported-connectors), filesystem is available for a lookup source. I wonder if this is true. If the filesystem connector is not available for lookup tables, is there any alternative way to use data from s3 as a lookup table in Flink? Flink version: 1.14.0 (on EMR 6.5) Kinesis source table: a watermark was defined. Lookup data: CSV data in s3. Sink table: Hudi connector Please let me know if I'm missing anything. Thanks in advance. Jason.
