Some of the options of workflows https://medium.com/@xunnan.xu/workflow-processing-engine-overview-2018-airflow-vs-azkaban-vs-conductor-vs-oozie-vs-amazon-step-90affc54d53b
Streaming is a kind of infinitely running job, so, you just have to trigger it only once unless you re not using it with Trigger = Once. Regards, ..Piyush On Sun, Jul 19, 2020 at 11:01 PM anbutech <anbutec...@outlook.com> wrote: > Hi Team, > > I'm very new to spark structured streaming.could you please guide me how to > Schedule/Orchestrate spark structured streaming job.Any scheduler similar > like airflow.I knew airflow doesn't support streaming jobs. > > Thanks > Anbu > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >