Hi, I want to submit a job in YARN cluster to read data from Cassandra and write them in HDFS, every hour, for example.
Is it possible to make Spark Application sleep in a while true loop and awake every hour to process data?
Hi, I want to submit a job in YARN cluster to read data from Cassandra and write them in HDFS, every hour, for example.
Is it possible to make Spark Application sleep in a while true loop and awake every hour to process data?