Github user zsxwing commented on the issue:
    > @zsxwing Will this break streaming jobs if someone upgrades their Spark 
version, since they won't be able to deserialize the class correctly?
    @brkyvz No. This doesn't change the file format. `FileEntry(..., batchId = 
-1)` is only used in `SeenFilesMap` which is only in memory.
    By the way, people cannot just upgrade the Spark version since 
`FileStreamSource`'s format has been changed in #13513.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to