Mehmet Aktas created FLINK-34553:
------------------------------------
Summary: Time travel support by Flink catalogs
Key: FLINK-34553
URL: https://issues.apache.org/jira/browse/FLINK-34553
Project: Flink
Issue Type: Technical Debt
Reporter: Mehmet Aktas
I am trying to add time travel support for the Flink backend in
[Ibis|https://github.com/ibis-project/ibis].
I found that Flink requires the {{catalog}} to implement {{getTable(ObjectPath
tablePath, long timestamp)}} for time travel support:
Attention: Currently, time travel requires the corresponding catalog that the
table belongs to implementing the getTable(ObjectPath tablePath, long
timestamp) method. See more details in Catalog.
[[https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/time-travel/]]
The default {{GenericInMemoryCatalog}} does not seem to implement
{{getTable()}} . I set up a {{hive metastore}} and created a {{{}hive
catalog{}}}, but it turns out that, hive catalog also does not implement
{{getTable()}} -- I wish Flink docs were more detailed about these ...
py4j.protocol.Py4JJavaError: An error occurred while calling o8.sqlQuery. :
org.apache.flink.table.api.ValidationException: SQL validation failed.
getTable(ObjectPath, long) is not implemented for class
org.apache.flink.table.catalog.hive.HiveCatalog.
I have two options now to continue with this: * Try another catalog, like
Iceberg catalog, to see if that one implements {{getTable()}}
** {{{}{}}}I am not able to find information on whether a given catalog
implements this function. Should I dig into their source code to figure this
out, or is there any other way to find out?
* Implement a custom catalog with {{{}getTable(){}}}, following the
*very-brief-instructions* given in the [Flink
doc|https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/#interface-in-catalog-for-supporting-time-travel].
Is there a doc, article, mailing list or anything else that I can use to get
more information on
* Which catalogs implement time travel support?
* If there is not readily available catalog supporting time travel, then how
can we implement a custom catalog with time travel support?
** The instructions given
[here|https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/#interface-in-catalog-for-supporting-time-travel]
are unfortunately not sufficient for a Java-illiterate person like myself.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
