[
https://issues.apache.org/jira/browse/TEZ-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376235#comment-15376235
]
lishaoguang edited comment on TEZ-3343 at 7/14/16 6:43 AM:
-----------------------------------------------------------
Sorry.This is my first time to submit the issue to jira.
Today I create the hive table with ' hive.execution.engine=tez ' ,when i insert
data into the table , It doesn't work.The logs are as follows:
--------------------------------------------------------------------------------
16/07/14 02:59:15 [main]: INFO SessionState: Map 1: -/-
Status: Failed
16/07/14 02:59:15 [main]: ERROR SessionState: Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1468464343019_0002_1_00,
diagnostics=[Vertex vertex_1468464343019_0002_1_00 [Map 1] killed/failed due
to:ROOT_INPUT_INIT_FAILURE, Vertex Input: values__tmp__table__1 initializer
failed, vertex=vertex_1468464343019_0002_1_00 [Map 1],
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/MRVersion
at
org.apache.hadoop.hive.shims.Hadoop23Shims.isMR2(Hadoop23Shims.java:852)
at
org.apache.hadoop.hive.shims.Hadoop23Shims.getHadoopConfNames(Hadoop23Shims.java:923)
at
org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:358)
at
org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:371)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:296)
at
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:106)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MRVersion
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
]
Can you help me?
was (Author: shaoguang):
Sorry.This is my first time to submit the issue to jira.
Today I create the hive table with ' hive.execution.engine=tez ' ,but It
doesn't work.The logs are as follows:
--------------------------------------------------------------------------------
16/07/14 02:59:15 [main]: INFO SessionState: Map 1: -/-
Status: Failed
16/07/14 02:59:15 [main]: ERROR SessionState: Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1468464343019_0002_1_00,
diagnostics=[Vertex vertex_1468464343019_0002_1_00 [Map 1] killed/failed due
to:ROOT_INPUT_INIT_FAILURE, Vertex Input: values__tmp__table__1 initializer
failed, vertex=vertex_1468464343019_0002_1_00 [Map 1],
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/MRVersion
at
org.apache.hadoop.hive.shims.Hadoop23Shims.isMR2(Hadoop23Shims.java:852)
at
org.apache.hadoop.hive.shims.Hadoop23Shims.getHadoopConfNames(Hadoop23Shims.java:923)
at
org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:358)
at
org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:371)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:296)
at
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:106)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MRVersion
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
]
Can you help me?
> sqoop import can't success
> --------------------------
>
> Key: TEZ-3343
> URL: https://issues.apache.org/jira/browse/TEZ-3343
> Project: Apache Tez
> Issue Type: Bug
> Environment: hadoop-2.6.0,sqoop-1.4.6,tez-0.8.4
> Reporter: lishaoguang
>
> I deployed the hadoop environment,and i tried import data from mysql to
> hdfs,without tez.When I deployed the tez ,I tried the 'orderedwordcount' and
> It success,but when I use sqoop to import data from mysql to hdfs ,It stop at
> 0% map and failed at last.How can I do ?Can anyone help me?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)