Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19247#discussion_r161353643
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala
---
@@ -233,7 +233,7 @@ class FileStreamSource(
}
val files = allFiles.sortBy(_.getModificationTime)(fileSortOrder).map
{ status =>
- (status.getPath.toUri.toString, status.getModificationTime)
+ (status.getPath.toUri.getPath, status.getModificationTime)
--- End diff --
FYI, `getPath` will drop scheme and credentials.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
