steveloughran commented on a change in pull request #2399:
URL: https://github.com/apache/hadoop/pull/2399#discussion_r522091672
##########
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/CommitConstants.java
##########
@@ -264,4 +283,25 @@ private CommitConstants() {
/** Extra Data key for task attempt in pendingset files. */
public static final String TASK_ATTEMPT_ID = "task.attempt.id";
+ /**
+ * Require the spark UUID to be passed down: {@value}.
+ * This is to verify that SPARK-33230 has been applied to spark, and that
+ * {@link InternalCommitterConstants#SPARK_WRITE_UUID} is set.
+ * <p>
+ * MUST ONLY BE SET WITH SPARK JOBS.
+ * </p>
+ */
Review comment:
+1. adding two new constants and referring to them in the production
code
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
