Hari,
I'm sorry for the late response.
mvn clean install worked. However, I created a modified flume Avro source
(which does some custom deserialization on the event message contents). I
have a similar issue with that now.
Also, I've been ignoring this issue for a bit, but when I do mvn package -X
, I get an error:
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ...................................... SUCCESS
[1:40.855s]
[INFO] Flume NG SDK ...................................... SUCCESS
[1:22.960s]
[INFO] Flume NG Configuration ............................ SUCCESS [6.114s]
[INFO] Flume NG Core ..................................... FAILURE [5.355s]
[INFO] Flume NG Sinks .................................... SKIPPED
[INFO] Flume NG HDFS Sink ................................ SKIPPED
[INFO] Flume NG IRC Sink ................................. SKIPPED
[INFO] Flume NG HBase Sink ............................... SKIPPED
[INFO] Flume Sources ..................................... SKIPPED
[INFO] Flume Scribe Source ............................... SKIPPED
[INFO] Flume NG Channels ................................. SKIPPED
[INFO] Flume NG JDBC channel ............................. SKIPPED
[INFO] Flume NG Node ..................................... SKIPPED
[INFO] Flume NG file-based channel ....................... SKIPPED
[INFO] Flume NG file backed Memory channel ............... SKIPPED
[INFO] Flume legacy Sources .............................. SKIPPED
[INFO] Flume legacy Avro source .......................... SKIPPED
[INFO] Flume legacy Thrift Source ........................ SKIPPED
[INFO] Flume NG Clients .................................. SKIPPED
[INFO] Flume NG Log4j Appender ........................... SKIPPED
[INFO] Flume NG distribution ............................. SKIPPED
[INFO] Flume NG Integration Tests ........................ SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 3:17.262s
[INFO] Finished at: Fri Oct 05 06:59:29 PDT 2012
[INFO] Final Memory: 80M/191M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
project flume-ng-core: Execution default-test of goal
org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
java.lang.reflect.InvocationTargetException; nested exception is
java.lang.reflect.InvocationTargetException: null: AvroSourceProtocol ->
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test
(default-test) on project flume-ng-core: Execution default-test of goal
org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
java.lang.reflect.InvocationTargetException; nested exception is
java.lang.reflect.InvocationTargetException: null
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
default-test of goal
org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
java.lang.reflect.InvocationTargetException; nested exception is
java.lang.reflect.InvocationTargetException: null
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
Caused by: org.apache.maven.surefire.util.SurefireReflectionException:
java.lang.reflect.InvocationTargetException; nested exception is
java.lang.reflect.InvocationTargetException: null
at
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:197)
at
org.apache.maven.surefire.util.ReflectionUtils.invokeGetter(ReflectionUtils.java:69)
at
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.getSuites(ProviderFactory.java:148)
at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.getSuitesIterator(ForkStarter.java:317)
at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:149)
at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:118)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:199)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAllProviders(AbstractSurefireMojo.java:176)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:135)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:98)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
... 20 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
... 30 more
Caused by: java.lang.NoClassDefFoundError: AvroSourceProtocol
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2442)
at java.lang.Class.getDeclaredMethods(Class.java:1808)
at
org.apache.maven.surefire.common.junit4.JUnit4TestChecker.checkforTestAnnotatedMethod(JUnit4TestChecker.java:82)
at
org.apache.maven.surefire.common.junit4.JUnit4TestChecker.isValidJUnit4Test(JUnit4TestChecker.java:71)
at
org.apache.maven.surefire.common.junit4.JUnit4TestChecker.accept(JUnit4TestChecker.java:51)
at
org.apache.maven.surefire.util.DefaultDirectoryScanner.locateTestClasses(DefaultDirectoryScanner.java:84)
at
org.apache.maven.surefire.junit4.JUnit4Provider.scanClassPath(JUnit4Provider.java:186)
at
org.apache.maven.surefire.junit4.JUnit4Provider.getSuites(JUnit4Provider.java:180)
... 35 more
Caused by: java.lang.ClassNotFoundException: AvroSourceProtocol
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
at
org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:97)
... 44 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :flume-ng-core
Regards,
Harish
On Wed, Oct 3, 2012 at 5:05 PM, Harish Mandala <[email protected]>wrote:
> Hello,
>
> Avro Sink does not seem to work. From flume.log :
>
> 03 Oct 2012 20:47:42,575 ERROR [lifecycleSupervisor-1-5]
> (org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run:238) -
> Unable to start SinkRunner: {
> policy:org.apache.flume.sink.DefaultSinkProcessor@7eda18ac counterGroup:{
> name:null counters:{} } } - Exception follows.
> java.lang.Error: Unresolved compilation problems:
> The import org.apache.flume.source cannot be resolved
> The import org.apache.flume.source cannot be resolved
> The import org.apache.flume.source cannot be resolved
> AvroSourceProtocol cannot be resolved to a type
> Callback cannot be resolved to a type
> The method getClient(Class<Callback>, Transceiver) from the type
> SpecificRequestor refers to the missing type Callback
> AvroSourceProtocol cannot be resolved to a type
> Status cannot be resolved to a type
> Status cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> Callback cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> AvroFlumeEvent cannot be resolved to a type
> Status cannot be resolved to a type
> Status cannot be resolved to a type
> Callback cannot be resolved to a type
> Status cannot be resolved to a type
> Status cannot be resolved to a type
> Status cannot be resolved to a variable
>
> at
> org.apache.flume.api.NettyAvroRpcClient.<init>(NettyAvroRpcClient.java:51)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
> at java.lang.Class.newInstance0(Class.java:372)
> at java.lang.Class.newInstance(Class.java:325)
> at
> org.apache.flume.api.RpcClientFactory.getInstance(RpcClientFactory.java:80)
> at org.apache.flume.sink.AvroSink.createConnection(AvroSink.java:182)
> at org.apache.flume.sink.AvroSink.start(AvroSink.java:242)
> at
> org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
> at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
> at
> org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
>
> /////////////////
>
> The relevant section from flume.conf:
>
> agent1.sinks.avro-sink1.channel = ch_httpsource_avrosink
> agent1.sinks.avro-sink1.type = avro
> agent1.sinks.avro-sink1.bind = 127.0.0.1
> agent1.sinks.avro-sink1.hostname = 127.0.0.1
> agent1.sinks.avro-sink1.port = 41414
>
> /////////////////
>
> Also, the tests conducted for "mvn package" fail.
>
> What could the problem be?
>
> Regards,
> Harish
>
>
>