Hi All, I have a scenario where I want to process a message in various ways in parallel. For instance a message is coming inside spark stream(DStream) and I want to send this message to 4 different tasks in parallel. I want these 4 different tasks to be separate streams in the original spark stream and are always active and waiting for input. Can I implement such a process with spark streaming ? How ? Thanks in advance.
Thanks, Udbhav Agarwal