[
https://issues.apache.org/jira/browse/SPARK-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-16335:
--------------------------------
Description:
In structured streaming, Spark does not report errors when the specified
directory does not exist. This is a behavior different from the batch mode.
This patch changes the behavior to fail if the directory does not exist (when
the path is not a glob pattern).
> Streaming source should fail if file does not exist
> ---------------------------------------------------
>
> Key: SPARK-16335
> URL: https://issues.apache.org/jira/browse/SPARK-16335
> Project: Spark
> Issue Type: Bug
> Components: SQL, Streaming
> Reporter: Reynold Xin
> Assignee: Reynold Xin
>
> In structured streaming, Spark does not report errors when the specified
> directory does not exist. This is a behavior different from the batch mode.
> This patch changes the behavior to fail if the directory does not exist (when
> the path is not a glob pattern).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
