[ https://issues.apache.org/jira/browse/OOZIE-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369982#comment-16369982 ]
Prabhu Joseph commented on OOZIE-3091: -------------------------------------- [~andras.piros] Have tried a simple test case by just adding the " --as-avrodatafile" into the SQOOP_COMMAND part of TestSqoopActionExecutor.java but it succeeds. Looks the avro import runs fine on local mode but not on actual distributed mode. SQOOP_COMMAND = "import --connect \{0} --table TT --as-avrodatafile --target-dir \{1} -m 1"; > Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: > org/apache/avro/mapred/AvroWrapper" > ------------------------------------------------------------------------------------------------------- > > Key: OOZIE-3091 > URL: https://issues.apache.org/jira/browse/OOZIE-3091 > Project: Oozie > Issue Type: Bug > Components: action > Affects Versions: 4.2.0 > Reporter: Prabhu Joseph > Assignee: Prabhu Joseph > Priority: Major > Attachments: OOZIE-3091.1.patch, OOZIE-3091.2.patch, > Oozie_Sqoop_Avro_import > > > Oozie Sqoop Action which does Import as avro fails with below. > avro-mapred-1.8.0-hadoop2.jar need to be included in Oozie Sqoop Sharelib > {code} > 2017-10-19 09:45:25,349 WARN [main] org.apache.hadoop.mapred.YarnChild: > Exception running child : java.lang.RuntimeException: > java.lang.reflect.InvocationTargetException > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:745) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132) > ... 7 more > Caused by: java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper > at > org.apache.sqoop.mapreduce.AvroImportMapper.<init>(AvroImportMapper.java:43) > ... 12 more > Caused by: java.lang.ClassNotFoundException: > org.apache.avro.mapred.AvroWrapper > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 13 more > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)