On Fri, Apr 13, 2012 at 7:05 PM, Bruno Mahé <[email protected]> wrote: > On 04/13/2012 11:00 AM, Brock Noland wrote: >> >> I have been thinking about this for a while. Let's say that we wanted >> to write some integration tests, that is programmatically startup >> flume node with a specific configuration. Given the current module >> layout, where would we do this? It seems like the node module would be >> the correct module but then it would have to have knowledge of all >> other modules. >> > Could you define "integration"? > Depending on your definition, Apache Bigtop may be more suitable for > such integration tests.
Start up a flume agent with a SequenceGeneratingSource, using RecoverableMemoryChannel, and writing to HDFSSink using file:/// as the FileSystem run it for a few seconds and shut it down. The reason is, at present flume is not calling Channel.start() and important logic during a code review was moved to that method. Unit tests passed fine but a test using the Flume Infrastructure would have easily caught the error. Brock Brock
