danielcweeks commented on issue #1485: URL: https://github.com/apache/iceberg/issues/1485#issuecomment-698405831
I would tend to agree with @RussellSpitzer's original point. I don't feel like cache should be invalidated. Keep in mind that `createOrReplaceTempView()` is a Dataset operation and though in these examples we are referring to a single table, the query can be arbitrarily complex. Expiring the caches to reflect the source tables in the more complicated case would result in the cache being more like a materialized view than simply a cache and possibly result in side-effects if you expect the cache to be constant (say using it to update the original table). I feel like the cache is more like a temporary table that should reflect the state of the Dataset at the time it was created (though I recognize that cache is not an action, so it may not accurately reflect the table state at the time it's called). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
