You can use https://github.com/ptgoetz/storm-hdfs
It supports writing to HDFS with both Storm bolts and trident states. Thanks Parth On Jul 16, 2014, at 10:41 AM, amjad khan <[email protected]> wrote: > Can anyone provide the code for bolt to write its data to hdfs. Kindly tell > me the jar's required to run that bolt. > > > On Mon, Jul 14, 2014 at 2:33 PM, Max Evers <[email protected]> wrote: > Can you expand on your use case? What is the query selecting on? Is the > column you are querying on indexed? Do you really need to look at the entire > 20 gb every 20ms? > > On Jul 14, 2014 6:39 AM, "amjad khan" <[email protected]> wrote: > I made a storm topoogy where spout was fetching data from mysql using select > query. The select query was fired after every 30 msec but because the size of > the table is more than 20 GB the select query takes more than 10 sec to > execute therefore this is not working. I need to know what are the possible > alternatives for this situation. Kindly reply as soon as possible. > > Thanks, > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
