Hi all, I have an inquiry about the proper use of SparkTable’s refreshEagerly. When SparkTable is instantiated, it derives Spark Schema from the wrapped icebergTable object’s current snapshot. If refreshEagerly=true, by the time of newScanBuilder, icebergTable.refresh is invoked. In case Iceberg table schema has evolved in-between, won’t a newer schema be passed to SparkScanBuilder to build the scan? Won’t this has potential schema mismatch issue?
Any clarifications/suggestions? Thanks, Limin
