Hi Hengyu,
currently, metadata between Flink programs can only be shared via code.
For this, we recently introduced a programmatic descriptor-based way of
specifying sources and sinks [1].
However, a catalog such as Hive metastore would be much easier and the
community is currently working on making this possible [2].
Regards,
Timo
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/table/connect.html
[2]
https://docs.google.com/document/d/1SkppRD_rE3uOKSN-LuZCqn4f7dz0zW5aa6T_hBZq5_o/edit?usp=sharing
Am 27.11.18 um 09:44 schrieb Henry Dai:
Hi,
Is there a way to get table's metadata in flink?
if I emit a table to kafka, then how can I know the table columns when
I subscribe the kafka topic and restore the table using
/tableEnv.registerDataStream("t1", source, "field1, field2 ...") /in
another flink program?
Flink should provide something like Hive's metastore to keep metadata
of tables.
--
best wishes
hengyu
