Olaf/Roman, Looking at what other distributions have done, it appears they have updated TestKafkaSink.java in Flume to be compatible with Kafka 1.x APIs. We either should do the same or disable build/packaging of Flume's testcases.
On Wed, Dec 7, 2016 at 1:46 AM, MrAsanjar . <[email protected]> wrote: > upgraded to kafka to 0.10.1, however it didn't fix flume's issue. > [INFO] ------------------------------------------------------------- > [ERROR] /ws/build/flume/rpm/BUILD/apache-flume-1.7.0-src/flume- > ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/TestKafkaSink.java:[526,14] > error: method createTopic in class AdminUtils cannot be applied to given > types; > [INFO] 1 error > [INFO] ------------------------------------------------------------- > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Flume ....................................... SUCCESS [ > 3.642 s] > [INFO] Flume NG SDK ....................................... SUCCESS [ > 9.699 s] > [INFO] Flume NG Configuration ............................. SUCCESS [ > 1.846 s] > [INFO] Flume Auth ......................................... SUCCESS [ > 5.191 s] > [INFO] Flume NG Core ...................................... SUCCESS [ > 6.490 s] > [INFO] Flume NG Sinks ..................................... SUCCESS [ > 0.088 s] > [INFO] Flume NG HDFS Sink ................................. SUCCESS [ > 3.230 s] > [INFO] Flume NG IRC Sink .................................. SUCCESS [ > 1.301 s] > [INFO] Flume NG Channels .................................. SUCCESS [ > 0.049 s] > [INFO] Flume NG JDBC channel .............................. SUCCESS [ > 3.273 s] > [INFO] Flume NG file-based channel ........................ SUCCESS [ > 3.655 s] > [INFO] Flume NG Spillable Memory channel .................. SUCCESS [ > 1.506 s] > [INFO] Flume NG Node ...................................... SUCCESS [ > 2.082 s] > [INFO] Flume NG Embedded Agent ............................ SUCCESS [ > 1.402 s] > [INFO] Flume NG HBase Sink ................................ SUCCESS [ > 10.648 s] > [INFO] Flume NG ElasticSearch Sink ........................ SUCCESS [ > 7.959 s] > [INFO] Flume NG Morphline Solr Sink ....................... SUCCESS [ > 41.525 s] > [INFO] Flume Shared Utils ................................. SUCCESS [ > 0.030 s] > [INFO] Flume Shared Kafka Test Utils ...................... SUCCESS [ > 5.097 s] > [INFO] Flume Kafka Sink ................................... FAILURE [ > 1.421 s] > [INFO] Flume NG Kite Dataset Sink ......................... SKIPPED > [INFO] Flume NG Hive Sink ................................. SKIPPED > > > > On Tue, Dec 6, 2016 at 6:35 PM, Roman Shaposhnik <[email protected]> > wrote: > >> 0.10.1 then perhaps? >> >> Thanks, >> Roman. >> >> On Sun, Dec 4, 2016 at 7:02 PM, MrAsanjar . <[email protected]> wrote: >> > the upgrade was done to resolve Kafka build failure caused by Spark >> 2.0.x >> > and subsequent SCALA upgrades.. Kafka 0.10.0 supports the latest scala. >> > >> > Build error msg: >> > >> > Building project 'core' with Scala version 2.10.5 >> > >> > FAILURE: Build failed with an exception. >> > >> > * Where: >> > Build file '/ws/output/kafka/kafka-0.9.0.1/build.gradle' line: 309 >> > >> > >> > On Sun, Dec 4, 2016 at 3:07 PM, Olaf Flebbe <[email protected]> wrote: >> > >> >> Hi Amir, >> >> >> >> Is there a specific reason you chose kafka 0.10.0.0 ? There are plenty >> of >> >> other versions to chose from. >> >> >> >> I like to point you to the flume compilation error introduced by >> >> BIGTOP-2609, since flume has problems with the kafka 0.10.x API. >> >> >> >> There is a patch FLUME-3026 , but the author uses kafka 0.10.1.0 ... >> >> >> >> Olaf >> > >
