[jira] [Updated] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17585: Description: Users would like to add a directory as dependency in some cases, they can use {{SparkContext.addFile}} with argument {{recursive=true}} to recursively add all files under the directory by using Scala. But Python users can only add file not directory, we should also make it supported. (was: PySpark {{SparkContext.addFile}} should support adding files recursively under a directory similar with Scala. Users would like to add a directory as dependency in some cases, they can use {{SparkContext.addFile}} with argument {{recursive=true}} to recursively add all files under the directory by using Scala. But Python users can only add file not directory, we should also make it supported.) > PySpark SparkContext.addFile supports adding files recursively > -- > > Key: SPARK-17585 > URL: https://issues.apache.org/jira/browse/SPARK-17585 > Project: Spark > Issue Type: Improvement > Components: PySpark, Spark Core >Reporter: Yanbo Liang >Priority: Minor > > Users would like to add a directory as dependency in some cases, they can use > {{SparkContext.addFile}} with argument {{recursive=true}} to recursively add > all files under the directory by using Scala. But Python users can only add > file not directory, we should also make it supported. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17585: Description: PySpark {{SparkContext.addFile}} should support adding files recursively under a directory similar with Scala. Users would like to add a directory as dependency in some cases, they can use {{SparkContext.addFile}} with argument {{recursive=true}} to recursively add all files under the directory by using Scala. But Python users can only add file not directory, we should also make it supported. was:PySpark {{SparkContext.addFile}} should support adding files recursively under a directory similar with Scala. > PySpark SparkContext.addFile supports adding files recursively > -- > > Key: SPARK-17585 > URL: https://issues.apache.org/jira/browse/SPARK-17585 > Project: Spark > Issue Type: Improvement > Components: PySpark, Spark Core >Reporter: Yanbo Liang >Priority: Minor > > PySpark {{SparkContext.addFile}} should support adding files recursively > under a directory similar with Scala. > Users would like to add a directory as dependency in some cases, they can use > {{SparkContext.addFile}} with argument {{recursive=true}} to recursively add > all files under the directory by using Scala. But Python users can only add > file not directory, we should also make it supported. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17585: Component/s: Spark Core > PySpark SparkContext.addFile supports adding files recursively > -- > > Key: SPARK-17585 > URL: https://issues.apache.org/jira/browse/SPARK-17585 > Project: Spark > Issue Type: Improvement > Components: PySpark, Spark Core >Reporter: Yanbo Liang >Priority: Minor > > PySpark {{SparkContext.addFile}} should support adding files recursively > under a directory similar with Scala. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org