Hello Madhu, There are 2 approaches for this:
1) Programmatically, for user code running in tasks, you would need to use either DAG::addTaskLocalFiles() or Vertex::addTaskLocalFiles() - former if the same jars are needed in all tasks of the DAG. TezClient::addAppMasterLocalFiles only impacts the ApplicationMaster. 2) Configure tez.aux.uris. This will ensure that all files specified here will be available in the AM and all tasks. thanks — Hitesh > On Aug 25, 2016, at 11:46 AM, Madhusudan Ramanna <m.rama...@ymail.com> wrote: > > Hello, > > I'm trying to extend TezExamplesBase and get a dag running on yarn (pseudo > cluster mode on my host). > > For some reason, I'm running into class not found exception on the node > > Vertex failed, vertexName=v1, vertexId=vertex_1471907702278_0030_1_00, > diagnostics=[Task failed, taskId=task_1471907702278_0030_1_00_000000, > diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( > failure ) : > attempt_1471907702278_0030_1_00_000000_0:org.apache.tez.dag.api.TezReflectionException: > Unable to load class: sample.sampletez.OnetoOne$V1Processor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:46) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:87) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:668) > > > Should I be adding my application jar somewhere so that it can get > distributed ? I tried adding my jar via tezClient.addAppMasterLocalFiles() > but it didn't help. > > What am I not doing ? > > thanks! > Madhu > > > > >
