Hi, Yuanchi, Is this related w/ the issue you reported earlier regarding to "problem picking up checkpoint after upgrade" in another thread? I assume that you are using the official Samza 0.10 release? That has jackson version 1.8.5 by default. How do you change it in your own build/package to 1.9.13?
Thanks! -Yi On Wed, Mar 23, 2016 at 12:00 PM, Yuanchi Ning <ningyuanchi...@gmail.com> wrote: > Hi All, > > When we upgrade our existing samza job from 0.9 to 0.10, we found this > error below: > > > /var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh: > line 63: OpenJDK: command not found > java version "1.7.0_95" > OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1) > OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode) > Exception in thread "main" java.lang.NullPointerException > at java.io.StringReader.<init>(StringReader.java:50) > at > org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636) > at > org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863) > at > org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71) > at > org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala) > > > And that line 71 in SamzaAppMaster is: > > val coordinatorSystemConfig = new > > MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG), > classOf[Config])) > > And our checkpoint/ new version related properties are as below: > > ##################### Job config ##################### > > job.factory.class=org.apache.samza.job.yarn.YarnJobFactory > > job.name=trip-counter > > job.datacenter=sjc1 > > job.environment=sandbox > > job.coordinator.system=kafka > > job.coordinator.replication.factor=3 > > > ##################### Task config ##################### > > task.class=com.uber.athena.TripCounterTask > > task.inputs=kafka.trip_details,kafka.hp-api-client_signups > > task.outputTripTopic=trip_count_details > > task.outputClientSignUpsTopic=client_sign_ups_count_details > > > task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory > > task.checkpoint.system=kafka > > task.checkpoint.replication.factor=3 > > > Plus our version for codehaus jackson dependencies is 1.9.13 as > suggested in other dev email threads. > > > Any ideas what would cause this issue? > > Thanks! > > Yuanchi > > > > > > > > > > > > > > > > > > -- > Yuanchi Ning >
