openinx commented on issue #3393:
URL: https://github.com/apache/iceberg/issues/3393#issuecomment-952764767
Seems all the unit tests are broken when we enabled the `mr` hive engine and
`hive.cbo.enable=true` switch.
Pasted the following error message for future google index:
```
2021-10-27T18:13:06,601 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] ql.Driver (Driver.java:logMrWarning(2591)) - Hive-on-MR is
deprecated in Hive 2 and may not be available in the future versions. Consider
using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = openinx_20211027181306_a82b61b6-bbbe-437a-9c0e-d554fd4da945
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-27T18:13:06,762 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - Number of
reduce tasks is set to 0 since there's no reduce operator
2021-10-27T18:13:06,982 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] mapreduce.JobResourceUploader
(JobResourceUploader.java:uploadResourcesInternal(149)) - Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
Job running in-process (local Hadoop)
2021-10-27T18:13:07,989 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - Job running
in-process (local Hadoop)
2021-10-27T18:13:07,992 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] mapreduce.Counters (AbstractCounters.java:getGroup(235)) -
Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2021-10-27 18:13:07,992 Stage-2 map = 0%, reduce = 0%
2021-10-27T18:13:07,994 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - 2021-10-27
18:13:07,992 Stage-2 map = 0%, reduce = 0%
2021-10-27 18:13:08,144 Stage-2 map = 100%, reduce = 0%
2021-10-27T18:13:08,145 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - 2021-10-27
18:13:08,144 Stage-2 map = 100%, reduce = 0%
Ended Job = job_local939205783_0004
2021-10-27T18:13:08,438 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - Ended Job =
job_local939205783_0004
MapReduce Jobs Launched:
Stage-Stage-2: HDFS Read: 0 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
2021-10-27T18:13:08,760 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] calcite.RelOptHiveTable
(RelOptHiveTable.java:updateColStats(578)) - No Stats for default@process_info,
Columns: dt, emr_cluster_id, engine, bytes_read, application_id
No Stats for default@process_info, Columns: dt, emr_cluster_id, engine,
bytes_read, application_id
2021-10-27T18:13:08,834 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] calcite.RelOptHiveTable
(RelOptHiveTable.java:updateColStats(578)) - No Stats for
default@engine_config, Columns: dt, emr_cluster_id, application_id
No Stats for default@engine_config, Columns: dt, emr_cluster_id,
application_id
2021-10-27T18:13:08,842 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] calcite.RelOptHiveTable
(RelOptHiveTable.java:updateColStats(578)) - No Stats for default@mr_job_info,
Columns: dt, emr_cluster_id, user_name, application_id, queue
No Stats for default@mr_job_info, Columns: dt, emr_cluster_id, user_name,
application_id, queue
2021-10-27T18:13:08,853 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] calcite.RelOptHiveTable
(RelOptHiveTable.java:updateColStats(578)) - No Stats for default@mr_task_info,
Columns: dt, emr_cluster_id, application_id
No Stats for default@mr_task_info, Columns: dt, emr_cluster_id,
application_id
2021-10-27T18:13:09,289 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] ql.Driver (Driver.java:logMrWarning(2591)) - Hive-on-MR is
deprecated in Hive 2 and may not be available in the future versions. Consider
using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = openinx_20211027181308_02698dee-1f3d-46b5-976d-1ddf65b0598b
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks not specified. Estimated from input data size: 1
2021-10-27T18:13:09,304 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - Number of
reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
2021-10-27T18:13:09,305 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - In order to
change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
2021-10-27T18:13:09,305 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - set
hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
2021-10-27T18:13:09,306 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - In order to
limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
2021-10-27T18:13:09,306 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - set
hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
2021-10-27T18:13:09,306 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - In order to
set a constant number of reducers:
set mapreduce.job.reduces=<number>
2021-10-27T18:13:09,307 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - set
mapreduce.job.reduces=<number>
2021-10-27T18:13:09,433 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] mapreduce.JobResourceUploader
(JobResourceUploader.java:uploadResourcesInternal(149)) - Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
Job running in-process (local Hadoop)
2021-10-27T18:13:10,080 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - Job running
in-process (local Hadoop)
2021-10-27T18:13:10,082 WARN [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] mapreduce.Counters (AbstractCounters.java:getGroup(235)) -
Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2021-10-27 18:13:10,082 Stage-4 map = 0%, reduce = 0%
2021-10-27T18:13:10,083 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - 2021-10-27
18:13:10,082 Stage-4 map = 0%, reduce = 0%
2021-10-27 18:13:10,390 Stage-4 map = 100%, reduce = 0%
2021-10-27T18:13:10,390 INFO [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printInfo(1227)) - 2021-10-27
18:13:10,390 Stage-4 map = 100%, reduce = 0%
Ended Job = job_local28430332_0005 with errors
2021-10-27T18:13:10,441 ERROR [eff51fd5-d1c7-48c6-ae87-7c0e8785f493
Time-limited test] exec.Task (SessionState.java:printError(1250)) - Ended Job =
job_local28430332_0005 with errors
Error during job, obtaining debugging information...
2021-10-27T18:13:10,443 ERROR [Thread-646] exec.Task
(SessionState.java:printError(1250)) - Error during job, obtaining debugging
information...
2021-10-27T18:13:10,439 WARN [Thread-636] mapred.LocalJobRunner
(LocalJobRunner.java:run(590)) - job_local28430332_0005
java.lang.Exception: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:492)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:552)
[hadoop-mapreduce-client-common-3.1.3.jar:?]
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
Caused by: java.lang.RuntimeException: Map operator initialization failed
at
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:137)
~[hive-exec-3.1.2-core.jar:3.1.2]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
Caused by: java.lang.RuntimeException: cannot find field queue from
[IcebergRecordStructField{field=1: application_id: optional string,
ObjectInspector type=string, ObjectInspector category=PRIMITIVE, position=0},
IcebergRecordStructField{field=4: dt: optional string, ObjectInspector
type=string, ObjectInspector category=PRIMITIVE, position=1},
IcebergRecordStructField{field=5: emr_cluster_id: optional string,
ObjectInspector type=string, ObjectInspector category=PRIMITIVE, position=2}]
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardStructFieldRef(ObjectInspectorUtils.java:538)
~[hive-serde-3.1.2.jar:3.1.2]
at
org.apache.iceberg.mr.hive.serde.objectinspector.IcebergRecordObjectInspector.getStructFieldRef(IcebergRecordObjectInspector.java:71)
~[iceberg-mr-release-base-0.12.0-167-g34eabe3.jar:?]
at
org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(ExprNodeColumnEvaluator.java:56)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluators(Operator.java:1130)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluatorsAndReturnStruct(Operator.java:1156)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:75)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:573)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:525)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:386)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:573)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:525)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:386)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:509)
~[hive-exec-3.1.2-core.jar:3.1.2]
at
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:116)
~[hive-exec-3.1.2-core.jar:3.1.2]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_221]
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
~[hadoop-common-3.1.3.jar:?]
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
~[hadoop-mapreduce-client-core-3.1.3.jar:?]
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
~[hadoop-mapreduce-client-common-3.1.3.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_221]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_221]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_221]
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
