[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400162#comment-17400162 ]
Hyukjin Kwon commented on SPARK-36518: -------------------------------------- Can you try {{SparkContext.addFile("...", recursive = true)}}? > spark should support distribute directory to cluster > ---------------------------------------------------- > > Key: SPARK-36518 > URL: https://issues.apache.org/jira/browse/SPARK-36518 > Project: Spark > Issue Type: Improvement > Components: Deploy > Affects Versions: 3.1.0, 3.1.1, 3.1.2 > Reporter: YuanGuanhu > Priority: Major > > Spark now only supports distribute files to cluster, but in some scenario, we > need upload a directory to cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org