[
https://issues.apache.org/jira/browse/SPARK-19633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871876#comment-15871876
]
Liwei Lin commented on SPARK-19633:
-----------------------------------
Hi [~marmbrus], I'd like to take this if it's ok by you.
Just to confirm, you meant FileSource should also use MetadataLogFileIndex over
InMemoryFileIndex whenever possible, right?
> FileSource read from FileSink
> -----------------------------
>
> Key: SPARK-19633
> URL: https://issues.apache.org/jira/browse/SPARK-19633
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Affects Versions: 2.1.0
> Reporter: Michael Armbrust
> Priority: Critical
>
> Right now, you can't start a streaming query from a location that is being
> written to by the file sink.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
