Hi All, I feel like I am not able to spawn multiple dstream jobs using Livy however I can spawn multiple structured streaming jobs.Can anyone tell me if spawning multiple dstream jobs with KafkaDirectStream is even possible? currently I am able to spawn one dstream job and I am trying to spawn another one but it throws an error because the first one is running. can anyone shine some light here?
Thanks!