But by in 0.10 release it's using 1.8.5 by default, you mean that other people are fine with this version when upgrading?
On Wed, Mar 23, 2016 at 3:13 PM, Yuanchi Ning <yuan...@uber.com> wrote: > Hi Yi, > > This is aonther issue. I overwrote it in our rapper library called > athena-core-lib. The mvn dependency tree shows that it's picking up the > version 1.9.13, plus the command line that runs the program shows 1.9.13. > We are currently testing on different Yarn versions to see if that's > related since our current version is 2.6.0. > > Thanks! > Yuanchi > > On Wed, Mar 23, 2016 at 2:57 PM, Yi Pan <nickpa...@gmail.com> wrote: > >> Hi, Yuanchi, >> >> Is this related w/ the issue you reported earlier regarding to "problem >> picking up checkpoint after upgrade" in another thread? I assume that you >> are using the official Samza 0.10 release? That has jackson version 1.8.5 >> by default. How do you change it in your own build/package to 1.9.13? >> >> Thanks! >> >> -Yi >> >> On Wed, Mar 23, 2016 at 12:00 PM, Yuanchi Ning <ningyuanchi...@gmail.com> >> wrote: >> >>> Hi All, >>> >>> When we upgrade our existing samza job from 0.9 to 0.10, we found this >>> error below: >>> >>> >>> /var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh: >>> line 63: OpenJDK: command not found >>> java version "1.7.0_95" >>> OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1) >>> OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode) >>> Exception in thread "main" java.lang.NullPointerException >>> at java.io.StringReader.<init>(StringReader.java:50) >>> at >>> org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636) >>> at >>> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863) >>> at >>> org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71) >>> at >>> org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala) >>> >>> >>> And that line 71 in SamzaAppMaster is: >>> >>> val coordinatorSystemConfig = new >>> >>> MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG), >>> classOf[Config])) >>> >>> And our checkpoint/ new version related properties are as below: >>> >>> ##################### Job config ##################### >>> >>> job.factory.class=org.apache.samza.job.yarn.YarnJobFactory >>> >>> job.name=trip-counter >>> >>> job.datacenter=sjc1 >>> >>> job.environment=sandbox >>> >>> job.coordinator.system=kafka >>> >>> job.coordinator.replication.factor=3 >>> >>> >>> ##################### Task config ##################### >>> >>> task.class=com.uber.athena.TripCounterTask >>> >>> task.inputs=kafka.trip_details,kafka.hp-api-client_signups >>> >>> task.outputTripTopic=trip_count_details >>> >>> task.outputClientSignUpsTopic=client_sign_ups_count_details >>> >>> >>> task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory >>> >>> task.checkpoint.system=kafka >>> >>> task.checkpoint.replication.factor=3 >>> >>> >>> Plus our version for codehaus jackson dependencies is 1.9.13 as >>> suggested in other dev email threads. >>> >>> >>> Any ideas what would cause this issue? >>> >>> Thanks! >>> >>> Yuanchi >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> Yuanchi Ning >>> >> >> >
