Can you please post here your code? Em 25 de dez de 2017 19:24, "M Singh" <mans2si...@yahoo.com.invalid> escreveu:
> Hi: > > I am using spark structured streaming (v 2.2.0) to read data from files. I > have configured checkpoint location. On stopping and restarting the > application, it looks like it is reading the previously ingested files. Is > that expected behavior ? > > Is there anyway to prevent reading files that have already been ingested ? > If a file is partially ingested, on restart - can we start reading the > file from previously checkpointed offset ? > > Thanks >
