You not need Spark Streaming.To avoid the time job apply resources on yarn, you could select the spark thrift server or apache livy. Both of them applying resources when start.
At 2018-12-28 06:52:21, "Nicolas Paris" <[email protected]> wrote: >Hi > >I have this living RDBMS and I d'like to apply a spark job on several >tables once new data get in. > >I could run batch spark jobs thought cron jobs every minutes. But the >job takes time and resources to begin (sparkcontext, yarn....) > >I wonder if I could run one instance of a spark streaming job to save >those resources. However I haven't seen about structured streaming from >jdbc source in the documentation. > >Any recommendation ? > > >-- >nicolas > >--------------------------------------------------------------------- >To unsubscribe e-mail: [email protected]
