Hi, Yuanchi, At LinkedIn, we have teams using Samza 0.10 with jackson-1.8.5 packaged within. We have not heard any issue w/ that. One difference though: the minimum supported (i.e. tested YARN version) in Samza 0.10 is 2.6.1 and LinkedIn is running 2.7.1.
-Yi On Wed, Mar 23, 2016 at 3:15 PM, Yuanchi Ning <yuan...@uber.com> wrote: > But by in 0.10 release it's using 1.8.5 by default, you mean that other > people are fine with this version when upgrading? > > On Wed, Mar 23, 2016 at 3:13 PM, Yuanchi Ning <yuan...@uber.com> wrote: > >> Hi Yi, >> >> This is aonther issue. I overwrote it in our rapper library called >> athena-core-lib. The mvn dependency tree shows that it's picking up the >> version 1.9.13, plus the command line that runs the program shows 1.9.13. >> We are currently testing on different Yarn versions to see if that's >> related since our current version is 2.6.0. >> >> Thanks! >> Yuanchi >> >> On Wed, Mar 23, 2016 at 2:57 PM, Yi Pan <nickpa...@gmail.com> wrote: >> >>> Hi, Yuanchi, >>> >>> Is this related w/ the issue you reported earlier regarding to "problem >>> picking up checkpoint after upgrade" in another thread? I assume that you >>> are using the official Samza 0.10 release? That has jackson version 1.8.5 >>> by default. How do you change it in your own build/package to 1.9.13? >>> >>> Thanks! >>> >>> -Yi >>> >>> On Wed, Mar 23, 2016 at 12:00 PM, Yuanchi Ning <ningyuanchi...@gmail.com >>> > wrote: >>> >>>> Hi All, >>>> >>>> When we upgrade our existing samza job from 0.9 to 0.10, we found this >>>> error below: >>>> >>>> >>>> /var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh: >>>> line 63: OpenJDK: command not found >>>> java version "1.7.0_95" >>>> OpenJDK Runtime Environment (IcedTea 2.6.4) >>>> (7u95-2.6.4-0ubuntu0.12.04.1) >>>> OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode) >>>> Exception in thread "main" java.lang.NullPointerException >>>> at java.io.StringReader.<init>(StringReader.java:50) >>>> at >>>> org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636) >>>> at >>>> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863) >>>> at >>>> org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71) >>>> at >>>> org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala) >>>> >>>> >>>> And that line 71 in SamzaAppMaster is: >>>> >>>> val coordinatorSystemConfig = new >>>> >>>> MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG), >>>> classOf[Config])) >>>> >>>> And our checkpoint/ new version related properties are as below: >>>> >>>> ##################### Job config ##################### >>>> >>>> job.factory.class=org.apache.samza.job.yarn.YarnJobFactory >>>> >>>> job.name=trip-counter >>>> >>>> job.datacenter=sjc1 >>>> >>>> job.environment=sandbox >>>> >>>> job.coordinator.system=kafka >>>> >>>> job.coordinator.replication.factor=3 >>>> >>>> >>>> ##################### Task config ##################### >>>> >>>> task.class=com.uber.athena.TripCounterTask >>>> >>>> task.inputs=kafka.trip_details,kafka.hp-api-client_signups >>>> >>>> task.outputTripTopic=trip_count_details >>>> >>>> task.outputClientSignUpsTopic=client_sign_ups_count_details >>>> >>>> >>>> task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory >>>> >>>> task.checkpoint.system=kafka >>>> >>>> task.checkpoint.replication.factor=3 >>>> >>>> >>>> Plus our version for codehaus jackson dependencies is 1.9.13 as >>>> suggested in other dev email threads. >>>> >>>> >>>> Any ideas what would cause this issue? >>>> >>>> Thanks! >>>> >>>> Yuanchi >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> -- >>>> Yuanchi Ning >>>> >>> >>> >> >
