I have an flow in which messages are emitted to an output and apache-spark will pull the messages from the port , I see the messages are pulled by spark but cannot see the data pulled(cannot do any computations)
I tried a different way , the messages are pushed apache kafka and spark pulls messages from kafka queue instead of output port and this one worked. my question is why it didn't work for output port and using kafka instead of output port is it a good flow ?
