Hi , i read the document even am not able to find solution for my problem as described below or above. even , i faced one more problem , when i use number of executors more than one for bolt duplicate processing of tuples are coming ............please help me
Thanks !* > Date: Mon, 27 Apr 2015 10:52:05 +0200 > From: [email protected] > To: [email protected] > Subject: Re: Unable To understand parallelism in storm > > This is a very nice explanation of parallelism (executors and tasks) in > Storm: > > https://storm.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html > > > -Matthias > > > > On 04/26/2015 10:51 AM, prasad ch wrote: > > Hi , am not understand the difference of executors and tasks in storm. > > > > I need to read list of files very fast , and i need to perform some > > operation on that data in side bolt, > > > > here how can i read list of files as fast and emit tuples to bolt. > > > > I tried following cases........... > > > > initially i tested 10 files each file contain 1000 records at that time > > i used 10 executors i did logic each tread pick different file. > > this is good when each file having 1000 records while when i do same > > thing with each file having 10000 records it is slow to process , > > > > how can i do , even in production i need to do lot of files with more > > number of records ......please help me > > > > > > > > Thanks ! > > > > > > prasad ch! > > 9493653509 >
