Hi Yi, This is aonther issue. I overwrote it in our rapper library called athena-core-lib. The mvn dependency tree shows that it's picking up the version 1.9.13, plus the command line that runs the program shows 1.9.13. We are currently testing on different Yarn versions to see if that's related since our current version is 2.6.0.
Thanks! Yuanchi On Wed, Mar 23, 2016 at 2:57 PM, Yi Pan <nickpa...@gmail.com> wrote: > Hi, Yuanchi, > > Is this related w/ the issue you reported earlier regarding to "problem > picking up checkpoint after upgrade" in another thread? I assume that you > are using the official Samza 0.10 release? That has jackson version 1.8.5 > by default. How do you change it in your own build/package to 1.9.13? > > Thanks! > > -Yi > > On Wed, Mar 23, 2016 at 12:00 PM, Yuanchi Ning <ningyuanchi...@gmail.com> > wrote: > >> Hi All, >> >> When we upgrade our existing samza job from 0.9 to 0.10, we found this >> error below: >> >> >> /var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh: >> line 63: OpenJDK: command not found >> java version "1.7.0_95" >> OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1) >> OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode) >> Exception in thread "main" java.lang.NullPointerException >> at java.io.StringReader.<init>(StringReader.java:50) >> at >> org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636) >> at >> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863) >> at >> org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71) >> at >> org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala) >> >> >> And that line 71 in SamzaAppMaster is: >> >> val coordinatorSystemConfig = new >> >> MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG), >> classOf[Config])) >> >> And our checkpoint/ new version related properties are as below: >> >> ##################### Job config ##################### >> >> job.factory.class=org.apache.samza.job.yarn.YarnJobFactory >> >> job.name=trip-counter >> >> job.datacenter=sjc1 >> >> job.environment=sandbox >> >> job.coordinator.system=kafka >> >> job.coordinator.replication.factor=3 >> >> >> ##################### Task config ##################### >> >> task.class=com.uber.athena.TripCounterTask >> >> task.inputs=kafka.trip_details,kafka.hp-api-client_signups >> >> task.outputTripTopic=trip_count_details >> >> task.outputClientSignUpsTopic=client_sign_ups_count_details >> >> >> task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory >> >> task.checkpoint.system=kafka >> >> task.checkpoint.replication.factor=3 >> >> >> Plus our version for codehaus jackson dependencies is 1.9.13 as >> suggested in other dev email threads. >> >> >> Any ideas what would cause this issue? >> >> Thanks! >> >> Yuanchi >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> -- >> Yuanchi Ning >> > >
