LvDongrong created SPARK-20572:
----------------------------------
Summary: Spark Streaming fail to read file on Hdfs
Key: SPARK-20572
URL: https://issues.apache.org/jira/browse/SPARK-20572
Project: Spark
Issue Type: Bug
Components: DStreams
Affects Versions: 2.1.0
Reporter: LvDongrong
When I move a file on hdfs to the target directory where Spark Streaming read
from, Spark Streaming fail to read the file. Then I found the Spark Streaming
Hdfs interface only read the file whose modtime is in the interval of the
current batch,but when we move the file to the target directory,the modtime of
the file is never changed. May be the method to find new file is not
appropriate.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
