cloud-fan commented on a change in pull request #33012:
URL: https://github.com/apache/spark/pull/33012#discussion_r656094564
##########
File path:
core/src/main/scala/org/apache/spark/internal/io/FileCommitProtocol.scala
##########
@@ -174,3 +233,12 @@ object FileCommitProtocol extends Logging {
new Path(path, ".spark-staging-" + jobId)
}
}
+
+/**
+ * The specification for Spark output file name.
+ * This is used by [[FileCommitProtocol]] to create full path of file.
+ *
+ * @param prefix Prefix of file.
+ * @param ext Extension of file.
+ */
+final case class FileNameSpec(prefix: String, ext: String)
Review comment:
shall we rename `ext` to `suffix`? it reality it includes more than
extension, such as file count.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]