laserninja commented on code in PR #14354: URL: https://github.com/apache/iceberg/pull/14354#discussion_r2441577749
########## spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/actions/ExpireSnapshotsSparkAction.java: ########## @@ -67,6 +67,9 @@ public class ExpireSnapshotsSparkAction extends BaseSparkAction<ExpireSnapshotsS public static final String STREAM_RESULTS = "stream-results"; public static final boolean STREAM_RESULTS_DEFAULT = false; + public static final String LOG_EXPIRE_FILES = "log-expire-files"; + public static final boolean LOG_EXPIRE_FILES_DEFAULT = false; + private static final int LOG_BATCH_SIZE = 10000; Review Comment: Were you able to test this at scale `LOG_BATCH_SIZE = 10000;`? Usually The batch size is less, right? Should we make this configurable? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
