spark git commit: [SPARK-15698][SQL][STREAMING] Add the ability to remove the old MetadataLog in FileStreamSource (branch-2.0)

2016-09-20 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 2bd37ce96 -> 8d8e2332c [SPARK-15698][SQL][STREAMING] Add the ability to remove the old MetadataLog in FileStreamSource (branch-2.0) ## What changes were proposed in this pull request? Backport #13513 to branch 2.0. ## How was this

spark git commit: [SPARK-15698][SQL][STREAMING] Add the ability to remove the old MetadataLog in FileStreamSource

2016-09-20 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master eb004c662 -> a6aade004 [SPARK-15698][SQL][STREAMING] Add the ability to remove the old MetadataLog in FileStreamSource ## What changes were proposed in this pull request? Current `metadataLog` in `FileStreamSource` will add a checkpoint