[jira] [Commented] (STORM-2008) kafka jars must be part of the storm-kafka topology

[ASF GitHub Bot (JIRA)]

    [ 
https://issues.apache.org/jira/browse/STORM-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394716#comment-15394716
 ] 

ASF GitHub Bot commented on STORM-2008:
---------------------------------------

GitHub user raghavgautam opened a pull request:

    https://github.com/apache/storm/pull/1596

    STORM-2008: 

    This is for solving following exception that we see when we try to run 
TridentKafkaWordCount topology.
    ``
        Exception in thread "main" java.lang.NoClassDefFoundError: 
kafka/api/OffsetRequest
            at org.apache.storm.kafka.KafkaConfig.<init>(KafkaConfig.java:48)
            at 
org.apache.storm.kafka.trident.TridentKafkaConfig.<init>(TridentKafkaConfig.java:30)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.createTransactionalKafkaSpout(TridentKafkaWordCount.java:102)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.addTridentState(TridentKafkaWordCount.java:131)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.buildConsumerTopology(TridentKafkaWordCount.java:149)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.runMain(TridentKafkaWordCount.java:249)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.main(TridentKafkaWordCount.java:240)
        Caused by: java.lang.ClassNotFoundException: kafka.api.OffsetRequest
            at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
            at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
            ... 7 more
    ``

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/raghavgautam/storm master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/storm/pull/1596.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1596
    
----
commit 2813a79a0fb93ce57c80169e7ec5954e0edf21a0
Author: Raghav Kumar Gautam <rag...@apache.org>
Date:   2016-07-26T18:30:51Z

    kafka jars must be part of the topology
    
        This is for solving following exception:
        Exception in thread "main" java.lang.NoClassDefFoundError: 
kafka/api/OffsetRequest
            at org.apache.storm.kafka.KafkaConfig.<init>(KafkaConfig.java:48)
            at 
org.apache.storm.kafka.trident.TridentKafkaConfig.<init>(TridentKafkaConfig.java:30)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.createTransactionalKafkaSpout(TridentKafkaWordCount.java:102)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.addTridentState(TridentKafkaWordCount.java:131)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.buildConsumerTopology(TridentKafkaWordCount.java:149)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.runMain(TridentKafkaWordCount.java:249)
            at 
org.apache.storm.starter.trident.TridentKafkaWordCount.main(TridentKafkaWordCount.java:240)
        Caused by: java.lang.ClassNotFoundException: kafka.api.OffsetRequest
            at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
            at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
            ... 7 more

----


> kafka jars must be part of the storm-kafka topology
> ---------------------------------------------------
>
>                 Key: STORM-2008
>                 URL: https://issues.apache.org/jira/browse/STORM-2008
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-kafka
>            Reporter: Raghav Kumar Gautam
>
> As of now the dependency is present but it's scope is provided, this is 
> incorrect.
> https://github.com/apache/storm/blob/master/external/storm-kafka/pom.xml#L121
> {code}
>         <dependency>
>             <groupId>org.apache.kafka</groupId>
>             <artifactId>${storm.kafka.artifact.id}</artifactId>
>             <version>${storm.kafka.version}</version>
>             <scope>provided</scope>
>         </dependency>
> {code}
> This leads to following stacktrace in worker, when we try to run 
> TridentKafkaWordCount topology.
> {code}
>     This is for solving following exception:
>     Exception in thread "main" java.lang.NoClassDefFoundError: 
> kafka/api/OffsetRequest
>         at org.apache.storm.kafka.KafkaConfig.<init>(KafkaConfig.java:48)
>         at 
> org.apache.storm.kafka.trident.TridentKafkaConfig.<init>(TridentKafkaConfig.java:30)
>         at 
> org.apache.storm.starter.trident.TridentKafkaWordCount.createTransactionalKafkaSpout(TridentKafkaWordCount.java:102)
>         at 
> org.apache.storm.starter.trident.TridentKafkaWordCount.addTridentState(TridentKafkaWordCount.java:131)
>         at 
> org.apache.storm.starter.trident.TridentKafkaWordCount.buildConsumerTopology(TridentKafkaWordCount.java:149)
>         at 
> org.apache.storm.starter.trident.TridentKafkaWordCount.runMain(TridentKafkaWordCount.java:249)
>         at 
> org.apache.storm.starter.trident.TridentKafkaWordCount.main(TridentKafkaWordCount.java:240)
>     Caused by: java.lang.ClassNotFoundException: kafka.api.OffsetRequest
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         ... 7 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)