> On Oct. 21, 2014, 7:30 p.m., Gwen Shapira wrote: > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java, > > lines 101-103 > > <https://reviews.apache.org/r/26820/diff/1/?file=723287#file723287line101> > > > > Producers don't need to access ZK directly, so the error should be > > "Check whether Kafka broker is up..."
Thanks! Will fix in next iter! > On Oct. 21, 2014, 7:30 p.m., Gwen Shapira wrote: > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java, > > line 181 > > <https://reviews.apache.org/r/26820/diff/1/?file=723287#file723287line181> > > > > Are you sure we want "smallest"? This will cause the channel to read > > everything in the topic when we first start. > > I can see why this would be good when Flume Source is the only one > > writing to the topic, but it can be a disaster if we attach the channel to > > a pre-existing topic. Perhaps make it user-configurable with "smallest" as > > the default and explain when to change it? Ah yes. Maybe set this to smallest if parseAsFlumeEvent is true, else read configuration value. - Hari ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26820/#review57638 ----------------------------------------------------------- On Oct. 16, 2014, 8:22 p.m., Hari Shreedharan wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/26820/ > ----------------------------------------------------------- > > (Updated Oct. 16, 2014, 8:22 p.m.) > > > Review request for Flume. > > > Bugs: FLUME-2500 > https://issues.apache.org/jira/browse/FLUME-2500 > > > Repository: flume-git > > > Description > ------- > > Add a channel that uses Kafka > > > Diffs > ----- > > flume-ng-channels/flume-kafka-channel/pom.xml PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannelConfiguration.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/java/org/apache/flume/channel/kafka/TestKafkaChannel.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/resources/kafka-server.properties > PRE-CREATION > flume-ng-channels/flume-kafka-channel/src/test/resources/log4j.properties > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/resources/zookeeper.properties > PRE-CREATION > flume-ng-channels/pom.xml dc8dbc6 > flume-ng-sinks/flume-ng-kafka-sink/pom.xml 746a395 > > flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/KafkaConsumer.java > 1c98922 > > flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/TestUtil.java > 8855c53 > pom.xml 4f550d3 > > Diff: https://reviews.apache.org/r/26820/diff/ > > > Testing > ------- > > Added tests that simulate a Kafka cluster. > > > Thanks, > > Hari Shreedharan > >
