Hi,
I am experimenting Spark Streaming and Kafka Integration, To read messages
from Kafka in parallel, basically there are two ways
1. Create many Receivers like (1 to 6).map(_ => KakfaUtils.createStream).
2. Specifiy many threads when calling KakfaUtils.createStream like val
topicMap("myTopic"=>6), this will create one receiver with 6 reading threads.
My question is which option is better, sounds option 2 is better is to me
because it saves a lot of cores(one Receiver one core), but I learned from
somewhere else that choice 1 is better, so I would ask and see how you guys
elaborate on this. Thank
[email protected]