Hi, Have a look at ActionGenerator we put together for Solr & ElasticSearch so far - it has the framework that's extensible and that allows one to easily add support for Flume, for example.
https://github.com/sematext/ActionGenerator A pull request with code that can push stuff in Flume would be great. Otis ---- Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm >________________________________ > From: Patrick Wendell <[email protected]> >To: [email protected] >Sent: Tuesday, July 17, 2012 12:28 AM >Subject: Does Flume need a workload generator? > >Hi All, > >I was trying to debug a memory leak and it doesn't seem like there is >a good way to generate workload for Flume at a configurable rate, or >with configurable characteristics like payload size and header size. >The sequence source is something like this, but you can't control the >rate of event generation at all. > >What do people do now when benchmarking or debugging Flume? I was >thinking of writing a source that generates event streams with >configurable properties. Would that be useful? Or is this need already >met somehow else? > >- Patrick > > >
