Some of the flume NG config options are a little strange. This is one of them.
You have to specify agent.sinks.file-sink.sink.directory = /some/dir It doesn't make a lot of sense, but it's historical. HTH, Mike On Monday, May 21, 2012 at 11:57 PM, Guillaume Polaert wrote: > Thank you for helping me out. > > Guillaume Polaert | Cyrès Conseil > > > -----Message d'origine----- > De : alo alt [mailto:[email protected]] > Envoyé : mardi 22 mai 2012 08:34 > À : [email protected] (mailto:[email protected]) > Objet : Re: RollingFile Sink problems > > created https://issues.apache.org/jira/browse/FLUME-1222 > > -- > Alexander Alten-Lorenz > http://mapredit.blogspot.com > German Hadoop LinkedIn Group: http://goo.gl/N8pCF > > On May 21, 2012, at 6:27 PM, alo alt wrote: > > > Looks like a config.parser issue in RollingFileSink.java or > > Configuration.java. Please open a Jira for. > > The error messages comes from the Preconditions check (Google Guava > > library) in RollingFileSink.java, indeed the variable for the directory is > > empty. > > > > - Alex > > > > -- > > Alexander Alten-Lorenz > > http://mapredit.blogspot.com > > German Hadoop LinkedIn Group: http://goo.gl/N8pCF > > > > On May 21, 2012, at 3:50 PM, Guillaume Polaert wrote: > > > > > Thank you for the link. > > > I've created a empty directory /tmp/log (mkdir+chmod). > > > > > > Do I have to create other things ? > > > > > > -----Message d'origine----- > > > De : alo alt [mailto:[email protected]] Envoyé : lundi 21 mai > > > 2012 15:31 À : [email protected] > > > (mailto:[email protected]) Objet : Re: > > > RollingFile Sink problems > > > > > > Hi, > > > > > > http://archive.cloudera.com/cdh4/cdh/4/flume-ng-1.1.0-cdh4.0.0b2/Flum > > > eUserGuide.html#h.frlqql6vu68 > > > > > > Means, /tmp/log is empty or non existent, isn't it? > > > > > > - Alex > > > > > > -- > > > Alexander Alten-Lorenz > > > http://mapredit.blogspot.com > > > German Hadoop LinkedIn Group: http://goo.gl/N8pCF > > > > > > On May 21, 2012, at 3:03 PM, Guillaume Polaert wrote: > > > > > > > Hi everybody, > > > > > > > > I've problems with RollingFile sink. > > > > First, I'm seeking about the sink's properties. I've found two > > > > properties in RollingFileSink.java : rollInterval and directory. Are > > > > there anymore ? > > > > > > > > Then, I've this error when I'm running the node : > > > > > > > > . > > > > SINKS: {sink=ComponentConfiguration[sink] > > > > CONFIG: {directory=/tmp/log, type=file_roll} > > > > RUNNER: ComponentConfiguration[runner] > > > > CONFIG: {} > > > > > > > > > > > > , log-sink1=ComponentConfiguration[log-sink1] > > > > CONFIG: {type=logger, channel=ch1} > > > > RUNNER: ComponentConfiguration[runner] > > > > CONFIG: {} > > > > > > > > } > > > > . > > > > 2012-05-21 08:29:15,246 (conf-file-poller-0) [INFO - > > > > org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.j > > > > av a:69)] Creating instance of sink sink typefile_roll > > > > 2012-05-21 08:29:15,253 (conf-file-poller-0) [ERROR - > > > > org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:205)] > > > > Failed to load configuration data. Exception follows. > > > > java.lang.IllegalArgumentException: Directory may not be null > > > > at > > > > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > > > > at > > > > org.apache.flume.sink.RollingFileSink.configure(RollingFileSink.java:74) > > > > at > > > > org.apache.flume.conf.Configurables.configure(Configurables.java:41) > > > > . > > > > > > > > Flume.conf > > > > > > > > # Define a memory channel called ch1 on agent1 > > > > agent1.channels.ch1.type = memory > > > > > > > > # Define an Avro source called avro-source1 on agent1 and tell it # > > > > to bind to 0.0.0.0:41414. Connect it to channel ch1. > > > > agent1.sources.avro-source1.channels = ch1 > > > > agent1.sources.avro-source1.type = avro > > > > agent1.sources.avro-source1.bind = 0.0.0.0 > > > > agent1.sources.avro-source1.port = 41414 > > > > > > > > # Define a logger sink that simply logs all events it receives # and > > > > connect it to the other end of the same channel. > > > > agent1.sinks.log-sink1.channel = ch1 agent1.sinks.log-sink1.type = > > > > logger agent1.sinks.sink.channel = ch1 agent1.sinks.sink.type = > > > > file_roll agent1.sinks.sink.directory=/tmp/log > > > > > > > > # Finally, now that we've defined all of our components, tell # > > > > agent1 which ones we want to activate. > > > > agent1.channels = ch1 > > > > agent1.sources = avro-source1 > > > > agent1.sinks = sink > > > > > > > > What is wrong ? I don't understand the problem. > > > > > > > > Guillaume
