williamhyun commented on a change in pull request #29796:
URL: https://github.com/apache/spark/pull/29796#discussion_r490710569
##########
File path:
streaming/src/main/scala/org/apache/spark/streaming/util/HdfsUtils.scala
##########
@@ -58,7 +58,7 @@ private[streaming] object HdfsUtils {
// If we are really unlucky, the file may be deleted as we're opening
the stream.
// This can happen as clean up is performed by daemon threads that may
be left over from
// previous runs.
- if (!dfs.isFile(dfsPath)) null else throw e
+ if (!dfs.getFileStatus(dfsPath).isFile) null else throw e
Review comment:
This is safe because of lines 53 and 55.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
