upgraded to kafka to 0.10.1, however it didn't fix flume's issue. [INFO] ------------------------------------------------------------- [ERROR] /ws/build/flume/rpm/BUILD/apache-flume-1.7.0-src/flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/TestKafkaSink.java:[526,14] error: method createTopic in class AdminUtils cannot be applied to given types; [INFO] 1 error [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Flume ....................................... SUCCESS [ 3.642 s] [INFO] Flume NG SDK ....................................... SUCCESS [ 9.699 s] [INFO] Flume NG Configuration ............................. SUCCESS [ 1.846 s] [INFO] Flume Auth ......................................... SUCCESS [ 5.191 s] [INFO] Flume NG Core ...................................... SUCCESS [ 6.490 s] [INFO] Flume NG Sinks ..................................... SUCCESS [ 0.088 s] [INFO] Flume NG HDFS Sink ................................. SUCCESS [ 3.230 s] [INFO] Flume NG IRC Sink .................................. SUCCESS [ 1.301 s] [INFO] Flume NG Channels .................................. SUCCESS [ 0.049 s] [INFO] Flume NG JDBC channel .............................. SUCCESS [ 3.273 s] [INFO] Flume NG file-based channel ........................ SUCCESS [ 3.655 s] [INFO] Flume NG Spillable Memory channel .................. SUCCESS [ 1.506 s] [INFO] Flume NG Node ...................................... SUCCESS [ 2.082 s] [INFO] Flume NG Embedded Agent ............................ SUCCESS [ 1.402 s] [INFO] Flume NG HBase Sink ................................ SUCCESS [ 10.648 s] [INFO] Flume NG ElasticSearch Sink ........................ SUCCESS [ 7.959 s] [INFO] Flume NG Morphline Solr Sink ....................... SUCCESS [ 41.525 s] [INFO] Flume Shared Utils ................................. SUCCESS [ 0.030 s] [INFO] Flume Shared Kafka Test Utils ...................... SUCCESS [ 5.097 s] [INFO] Flume Kafka Sink ................................... FAILURE [ 1.421 s] [INFO] Flume NG Kite Dataset Sink ......................... SKIPPED [INFO] Flume NG Hive Sink ................................. SKIPPED
On Tue, Dec 6, 2016 at 6:35 PM, Roman Shaposhnik <[email protected]> wrote: > 0.10.1 then perhaps? > > Thanks, > Roman. > > On Sun, Dec 4, 2016 at 7:02 PM, MrAsanjar . <[email protected]> wrote: > > the upgrade was done to resolve Kafka build failure caused by Spark 2.0.x > > and subsequent SCALA upgrades.. Kafka 0.10.0 supports the latest scala. > > > > Build error msg: > > > > Building project 'core' with Scala version 2.10.5 > > > > FAILURE: Build failed with an exception. > > > > * Where: > > Build file '/ws/output/kafka/kafka-0.9.0.1/build.gradle' line: 309 > > > > > > On Sun, Dec 4, 2016 at 3:07 PM, Olaf Flebbe <[email protected]> wrote: > > > >> Hi Amir, > >> > >> Is there a specific reason you chose kafka 0.10.0.0 ? There are plenty > of > >> other versions to chose from. > >> > >> I like to point you to the flume compilation error introduced by > >> BIGTOP-2609, since flume has problems with the kafka 0.10.x API. > >> > >> There is a patch FLUME-3026 , but the author uses kafka 0.10.1.0 ... > >> > >> Olaf >
