[jira] [Commented] (SPARK-8605) Exclude files in StreamingContext. textFileStream(directory)

2018-02-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377999#comment-16377999 ] Apache Spark commented on SPARK-8605: - User 'ConcurrencyPractitioner' has created a pull request for

[jira] [Commented] (SPARK-8605) Exclude files in StreamingContext. textFileStream(directory)

2016-12-19 Thread Adam Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760867#comment-15760867 ] Adam Wang commented on SPARK-8605: -- How about change FileInputDStream.defaultFilter(path) to fix this

[jira] [Commented] (SPARK-8605) Exclude files in StreamingContext. textFileStream(directory)

2016-12-19 Thread Adam Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760858#comment-15760858 ] Adam Wang commented on SPARK-8605: -- How about change FileInputDStream.defaultFilter(path) to fix this

[jira] [Commented] (SPARK-8605) Exclude files in StreamingContext. textFileStream(directory)

2016-12-19 Thread Adam Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760854#comment-15760854 ] Adam Wang commented on SPARK-8605: -- How about change defaultFilter() to fix this bug? > Exclude files in

[jira] [Commented] (SPARK-8605) Exclude files in StreamingContext. textFileStream(directory)

2016-10-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556785#comment-15556785 ] holdenk commented on SPARK-8605: This is semi-documented (namely only atomic moves are supported), but