sarutak commented on a change in pull request #35603:
URL: https://github.com/apache/spark/pull/35603#discussion_r811662486
##########
File path: python/pyspark/context.py
##########
@@ -1278,6 +1278,53 @@ def addPyFile(self, path: str) -> None:
importlib.invalidate_caches()
+ def addArchive(self, path: str) -> None:
+ """
+ Add an archive to be downloaded with this Spark job on every node.
+ The `path` passed can be either a local file, a file in HDFS
+ (or other Hadoop-supported filesystems), or an HTTP, HTTPS or
+ FTP URI.
+
+ To access the file in Spark jobs, use :meth:`SparkFiles.get` with the
+ filename to find its download/unpacked location. The given path should
+ be one of .zip, .tar, .tar.gz, .tgz and .jar.
+
+ .. versionadded:: 3.3.0
+
+ Notes
+ -----
+ A path can be added only once. Subsequent additions of the same path
are ignored.
+
+ Examples
+ --------
+
Review comment:
nit: blank line is not needed here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
