Can you please post here your code?
Em 25 de dez de 2017 19:24, "M Singh"
escreveu:
> Hi:
>
> I am using spark structured streaming (v 2.2.0) to read data from files. I
> have configured checkpoint location. On stopping and restarting the
> application, it looks like it is reading the previously
Hi:
I am using spark structured streaming (v 2.2.0) to read data from files. I have
configured checkpoint location. On stopping and restarting the application, it
looks like it is reading the previously ingested files. Is that expected
behavior ?
Is there anyway to prevent reading files that