[
https://issues.apache.org/jira/browse/IMPALA-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong resolved IMPALA-8991.
-----------------------------------
Resolution: Cannot Reproduce
> Data loading failed in Hive with error initializing MapReduce cluster
> ---------------------------------------------------------------------
>
> Key: IMPALA-8991
> URL: https://issues.apache.org/jira/browse/IMPALA-8991
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Michael Ho
> Priority: Major
>
> Data loading with {noformat} insert into table functional_seq_gzip.a
> ^Mlltypesaggmultifilesnopart SELECT id, bool_col, tinyint_col, smallint_col,
> int_c ^Mol, bigint_col, float_col, double_col, date_string_col, string_col,
> timestamp_co ^Ml FROM functional.alltypesaggmultifilesnopa
> rt where id % 4 = 2; {noformat} failed in Hive with unexpected exception:
> {noformat}
> java.io.IOException: Cannot initialize Cluster. Please check your
> configuration for mapreduce.framework.name and the correspond server
> addresses.
> at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:116)
> at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:109)
> at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:102)
> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:475)
> at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:454)
> at
> org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:402)
> at
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:151)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2200)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1843)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1563)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1339)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1334)
> at
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:256)
> at
> org.apache.hive.service.cli.operation.SQLOperation.access$600(SQLOperation.java:92)
> at
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:345)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
> at
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:357)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Suppressed: java.io.IOException: Failed to use
> org.apache.hadoop.mapred.LocalClientProtocolProvider due to error:
> at
> org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:148)
> ... 25 more
> Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics
> source LocalJobRunnerMetrics-1803220940 already exists!
> at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:152)
> at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:125)
> at
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:229)
> at
> org.apache.hadoop.mapred.LocalJobRunnerMetrics.create(LocalJobRunnerMetrics.java:46)
> at
> org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:777)
> at
> org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:770)
> at
> org.apache.hadoop.mapred.LocalClientProtocolProvider.create(LocalClientProtocolProvider.java:42)
> at
> org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:130)
> ... 25 more
> Number of reduce tasks is set to 0 since there's no reduce operator
> Job Submission failed with exception 'java.io.IOException(Cannot initialize
> Cluster. Please check your configuration for mapreduce.framework.name and the
> correspond server addresses.)'
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Cannot initialize Cluster.
> Please check your configuration for mapreduce.framework.name and the
> correspond server addresses.
> {noformat}
> cc'ing [~stakiar], [~vihangk1] and [~joemcdonnell]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
