ReceiverStream SPARK not able to cope up with 20,000 events /sec .

[anshu shukla]

My eventGen is emitting 20,000  events/sec ,and I am using store(s1)
in receive()  method to push data to receiverStream .

But this logic is working fine for upto 4000 events/sec and no batch
are seen emitting for larger rate .

*CODE:TOPOLOGY -*


*JavaDStream<String> sourcestream = ssc.receiverStream(        new
TetcCustomEventReceiver(datafilename,spoutlog,argumentClass.getScalingFactor(),datasetType));*

*CODE:TetcCustomEventReceiver -*

public void receive(List<String> event) {
StringBuffer tuple=new StringBuffer();
msgId++;
for(String s:event)
        {
            tuple.append(s).append(",");
        }
String s1=MsgIdAddandRemove.addMessageId(tuple.toString(),msgId);
store(s1);
    }




-- 
Thanks & Regards,
Anshu Shukla