aokolnychyi commented on PR #6655: URL: https://github.com/apache/iceberg/pull/6655#issuecomment-1416560469
@singhpk234, oh, now I got what you meant. The new behavior seems reasonable to me for two reasons: - It is only triggered if someone explicitly passes an option to enable locality. In Spark, read options is the most specific level of configs used to override all defaults. - It allows us to support hybrid use cases when a table stores its metadata in s3 but has some files in HDFS. Right now, the initial check if locality is enabled is based on the table root location, which may be different than some data locations. Do you think that's reasonable, @singhpk234? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
