Hi, We are running a a job on spark using mesos. We are using Mesos framework messages to communicate intermediate results between the Spark master and workers. The number of messages per second is really big . The spark worker spawns a new thread for receiving each framework message but stops receiving these message very soon. We think its probably because too many threads are being launched.
Is there any way to control/ configure the thread behavior for receiving Framework messages. We do intend to switch to actors for sending and receiving these messages in the near future. Thanks Arpan, Joseph, Rajesh
