[
https://issues.apache.org/jira/browse/TEZ-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059321#comment-15059321
]
Bikas Saha commented on TEZ-2976:
---------------------------------
lgtm. + 1
Separately, IMO we need to make the TestRecovery avoid random selections. If
the idea is to reduce the test time then its probably not worth it. Instead, we
could separate the cases into core and full sets such that core runs always and
full can be run manually to verify recovery in more detail.
> Recovery fails when InputDescriptor is changed during input initialization
> --------------------------------------------------------------------------
>
> Key: TEZ-2976
> URL: https://issues.apache.org/jira/browse/TEZ-2976
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.8.2
> Reporter: Jeff Zhang
> Assignee: Jeff Zhang
> Attachments: TEZ-2976-1.patch, TEZ-2976-2.patch
>
>
> {code}
> 2015-12-07 10:17:00,742 [main] ERROR org.apache.pig.tools.grunt.GruntParser -
> ERROR 2998: Unhandled internal error. Vertex failed, vertexName=scope-106,
> vertexId=vertex_1448526568607_13994_1_00, diagnostics=[Task failed,
> taskId=task_1448526568607_13994_1_00_000008, diagnostics=[TaskAttempt 0
> killed, TaskAttempt 1 failed, info=[Error: Failure while running task:
> attempt_1448526568607_13994_1_00_000008_1:java.lang.IllegalArgumentException:
> Split information not expected in org.apache.tez.mapreduce.input.MRInput
> at
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
> at
> org.apache.tez.mapreduce.input.base.MRInputBase.initialize(MRInputBase.java:68)
> at org.apache.tez.mapreduce.input.MRInput.initialize(MRInput.java:436)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:432)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:414)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:399)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> ],
> {code}
> might related with PIG-4443
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)