[
https://issues.apache.org/jira/browse/TEZ-863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan reopened TEZ-863:
----------------------------------
Thanks Sid. I tried the patch and it still throws the NPE. It was throwing
NPE before the following line got printed
"org.apache.tez.runtime.library.input.ShuffledMergedInput: NoAutoStart delay in
processing first event: 8"
Appears that, handleEvents is getting called before shuffle.configureAndStart()
> NullPointerException in shuffle phase
> -------------------------------------
>
> Key: TEZ-863
> URL: https://issues.apache.org/jira/browse/TEZ-863
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.3.0
> Environment: Hadoop 2.3.0, Hive 0.13, Tez 0.3.0
> Reporter: Rajesh Balamohan
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.3.0
>
> Attachments: TEZ-863.1.txt,
> syslog_attempt_1392875986731_0052_2_00_000030_0.log
>
>
> When running amplab-benchmark (query 2a, 2b, 2c), randomly the following
> exception is thrown. It is not very consistent though.
> Amplab query reference: https://amplab.cs.berkeley.edu/benchmark/
> >>>
> SELECT SUBSTR(sourceIP, 1, 10), SUM(adRevenue) FROM uservisits GROUP BY
> SUBSTR(sourceIP, 1, 10)
> >>>
> Vertex re-running, vertexName=Map 1, vertexId=vertex_1392875986731_0052_2_01
> Vertex failed, vertexName=Reducer 2, vertexId=vertex_1392875986731_0052_2_00,
> diagnostics=[Task failed, taskId=task_1392875986731_0052_2_00_000030,
> diagnostics=[AttemptID:attempt_1392875986731_0052_2_00_000030_0 Info:Error:
> java.lang.NullPointerException
> at
> org.apache.tez.runtime.library.common.shuffle.impl.Shuffle.handleEvents(Shuffle.java:175)
> at
> org.apache.tez.runtime.library.input.ShuffledMergedInput.handleEvents(ShuffledMergedInput.java:195)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:566)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:81)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:628)
> at java.lang.Thread.run(Thread.java:744)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
