Hi,
Below is the running environment:
Hadoop version 3.1.0
java version “1.8.0_151"
samza-api-1.1.0.jar
samza-core_2.12-1.1.0.jar
samza-kafka_2.12-1.1.0.jar
samza-kv_2.12-1.1.0.jar
samza-kv-inmemory_2.12-1.1.0.jar
samza-kv-rocksdb_2.12-1.1.0.jar
samza-log4j_2.12-1.1.0.jar
samza-shell-1.1.0-dist.tgz
samza-yarn_2.12-1.1.0.jar
scala-compiler-2.12.1.jar
scala-library-2.12.1.jar
scala-logging_2.12-3.7.2.jar
scala-parser-combinators_2.12-1.0.4.jar
scala-reflect-2.12.4.jar
scalate-core_2.12-1.8.0.jar
scalate-util_2.12-1.8.0.jar
scalatra_2.12-2.5.0.jar
scalatra-common_2.12-2.5.0.jar
scalatra-scalate_2.12-2.5.0.jar
scala-xml_2.12-1.0.6.jar
kafka_2.12-1.1.0.jar
kafka-clients-1.1.0.jar
Below is the exception when starting app in Yarn:
2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka version : 1.1.0
2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka commitId :
fdcf75ea326b8e07
2019-05-29 09:52:47.862 [main] Log4jControllerRegistration$ [INFO] Registered
kafka:type=kafka.Log4jController MBean
2019-05-29 09:52:47.877 [main] KafkaSystemAdmin [INFO] Created KafkaSystemAdmin
for system kafka
Exception in thread "main" org.apache.samza.SamzaException: Failed to run
application
at
org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:79)
at
org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:49)
at
org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53)
Caused by: java.lang.NullPointerException
at java.util.HashMap.merge(HashMap.java:1225)
at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)
at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
at
java.util.HashMap$EntrySpliterator.forEachRemaining(HashMap.java:1696)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at
org.apache.samza.config.JavaSystemConfig.getSystemAdmins(JavaSystemConfig.java:84)
at org.apache.samza.system.SystemAdmins.<init>(SystemAdmins.java:38)
at
org.apache.samza.execution.StreamManager.<init>(StreamManager.java:55)
at
org.apache.samza.execution.JobPlanner.buildAndStartStreamManager(JobPlanner.java:64)
at
org.apache.samza.execution.JobPlanner.getExecutionPlan(JobPlanner.java:94)
at
org.apache.samza.execution.RemoteJobPlanner.prepareJobs(RemoteJobPlanner.java:57)
at
org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:67)
... 2 more
Thanks for your help!
Qi Shu
