Hi Iceberg folks, I'm working on a project where we're migrating tables from hive to iceberg. We are revamping our ingestion pipeline in parallel from batch to stream. Originally, our plan was to have two separate tables, a backfill table and a live table, that would be stitched together via a view for downstream consumers. This is proving rather difficult. In the absence of engine agnostic views we were going to prepend views with the engine type (ie trino_my_table and spark_my_table) but I receive a org.apache.spark.sql.AnalysisException: Catalog iceberg_catalog does not support views error when trying to create the spark view. With the ongoing work towards engine agnostic views I'm unsure if this limitation is expected or easily surpassed with some config/spark change?
Thank you for your time, Marc