[jira] [Commented] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060646#comment-17060646
 ] 

Syed Shameerur Rahman commented on TEZ-4129:


Sure, Meanwhile i have fixed the checkstyle errors in TEZ-4129.03.patch

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch, TEZ-4129.02.patch, TEZ-4129.03.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman updated TEZ-4129:
---
Attachment: TEZ-4129.03.patch

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch, TEZ-4129.02.patch, TEZ-4129.03.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4134) Upgrade maven surefire plugin to 3.0.0-M4

2020-03-16 Thread Jonathan Turner Eagles (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060469#comment-17060469
 ] 

Jonathan Turner Eagles commented on TEZ-4134:
-

[~abstractdog], could you review this small surefire plugin version bump? There 
are some know tests failures, but they are unrelated to the patch.  For 
Example, TestRecovery

> Upgrade maven surefire plugin to 3.0.0-M4
> -
>
> Key: TEZ-4134
> URL: https://issues.apache.org/jira/browse/TEZ-4134
> Project: Apache Tez
>  Issue Type: Improvement
>Reporter: Jonathan Turner Eagles
>Assignee: Jonathan Turner Eagles
>Priority: Major
> Attachments: TEZ-4134.001.patch
>
>
> When a test hangs and is killed by the maven surefire plugin, it tries to 
> capture information about the process to aid in debugging one of those being 
> the dump file.
> 2020-03-09T02-27-30_920-jvmRun1.dump
> {noformat:title=maven-surefire-plugin:3.0.0-M1}
> # Created at 2020-03-09T03:05:40.609
> Killing self fork JVM. Received SHUTDOWN command from Maven shutdown hook.
> {noformat}
> With 3.0.0-M4 it also captures the stack trace as part of the dump file.
> {noformat:title=maven-surefire-plugin:3.0.0-M4}
> # Created at 2020-03-09T15:18:40.510
> Killing self fork JVM. Received SHUTDOWN command from Maven shutdown hook.
> Thread dump before killing the process (45086@hostname):
> "Netty IPC Socket Reader #1 for port 59611"
>java.lang.Thread.State: RUNNABLE
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.Native.keventWait(Native 
> Method)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.Native.keventWait(Native.java:94)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.kqueueWait(KQueueEventLoop.java:147)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.kqueueWait(KQueueEventLoop.java:139)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.run(KQueueEventLoop.java:208)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:905)
> at java.lang.Thread.run(Thread.java:748)
> at 
> org.apache.hadoop.ipc.NettyServer$NettyThreadFactory$1.run(NettyServer.java:659)
> "Netty IPC Socket Reader #4 for port 59597"
>java.lang.Thread.State: RUNNABLE
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.Native.keventWait(Native 
> Method)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.Native.keventWait(Native.java:94)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.kqueueWait(KQueueEventLoop.java:147)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.kqueueWait(KQueueEventLoop.java:139)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.channel.kqueue.KQueueEventLoop.run(KQueueEventLoop.java:208)
> at 
> org.apache.hadoop.ipc.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:905)
> at java.lang.Thread.run(Thread.java:748)
> at 
> org.apache.hadoop.ipc.NettyServer$NettyThreadFactory$1.run(NettyServer.java:659)
> "DeletionService #0"
>java.lang.Thread.State: WAITING
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at 
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> at 
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> ...
> ...
> ...
> {noformat}
> Upgrading to a later version will improve debugging hung tests in Tez



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Jonathan Turner Eagles (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060412#comment-17060412
 ] 

Jonathan Turner Eagles commented on TEZ-4129:
-

Thanks for the patch, [~srahman]. It will take some time to get to this patch 
as it needs thorough testing.

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch, TEZ-4129.02.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread TezQA (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060389#comment-17060389
 ] 

TezQA commented on TEZ-4129:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
34s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green}  0m  
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 2 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
9s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  3m 
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
56s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue}  0m 
35s{color} | {color:blue} Used deprecated FindBugs config; considering 
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m  
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  1m  
2s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 13s{color} | {color:orange} tez-runtime-library: The patch generated 1 new + 
22 unchanged - 0 fixed = 23 total (was 22) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 21s{color} | {color:orange} tez-dag: The patch generated 8 new + 196 
unchanged - 0 fixed = 204 total (was 196) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 11s{color} | {color:orange} tez-plugins/tez-aux-services: The patch 
generated 2 new + 84 unchanged - 0 fixed = 86 total (was 84) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m  
9s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m  
6s{color} | {color:red} tez-dag generated 1 new + 0 unchanged - 0 fixed = 1 
total (was 0) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  1m 
44s{color} | {color:green} tez-api in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  4m 
36s{color} | {color:green} tez-runtime-library in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  4m  
2s{color} | {color:green} tez-dag in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  2m 
30s{color} | {color:green} tez-aux-services in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
33s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 36m 25s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:tez-dag |
|  |  Inconsistent synchronization of 
org.apache.tez.dag.app.DAGAppMaster.amConf; locked 86% of time  Unsynchronized 
access at DAGAppMaster.java:86% of time  Unsynchronized access at 
DAGAppMaster.java:[line 2773] |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.8 Server=19.03.8 base: 

[jira] [Commented] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060351#comment-17060351
 ] 

Syed Shameerur Rahman commented on TEZ-4129:


Fixed failing unit tests in TEZ-4129.02.patch

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch, TEZ-4129.02.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman updated TEZ-4129:
---
Attachment: TEZ-4129.02.patch

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch, TEZ-4129.02.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread TezQA (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060272#comment-17060272
 ] 

TezQA commented on TEZ-4129:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 10m 
15s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green}  0m  
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  3m  
3s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  7m 
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
45s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  2m 
21s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  2m  
2s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue}  0m 
35s{color} | {color:blue} Used deprecated FindBugs config; considering 
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m  
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  1m  
5s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 14s{color} | {color:orange} tez-runtime-library: The patch generated 1 new + 
22 unchanged - 0 fixed = 23 total (was 22) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 21s{color} | {color:orange} tez-dag: The patch generated 8 new + 195 
unchanged - 0 fixed = 203 total (was 195) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m  9s{color} | {color:orange} tez-plugins/tez-aux-services: The patch 
generated 2 new + 84 unchanged - 0 fixed = 86 total (was 84) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
10s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m  
8s{color} | {color:red} tez-dag generated 1 new + 0 unchanged - 0 fixed = 1 
total (was 0) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  1m 
49s{color} | {color:green} tez-api in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  4m 
29s{color} | {color:green} tez-runtime-library in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red}  4m  0s{color} 
| {color:red} tez-dag in the patch failed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  2m 
29s{color} | {color:green} tez-aux-services in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
40s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 53m 58s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:tez-dag |
|  |  Inconsistent synchronization of 
org.apache.tez.dag.app.DAGAppMaster.amConf; locked 86% of time  Unsynchronized 
access at DAGAppMaster.java:86% of time  Unsynchronized access at 
DAGAppMaster.java:[line 2773] |
| Failed junit tests | tez.dag.app.launcher.TestContainerLauncherWrapper |
|   | 

[jira] [Created] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4135:
-

 Summary: Improve memory allocation when executing in-memory reads
 Key: TEZ-4135
 URL: https://issues.apache.org/jira/browse/TEZ-4135
 Project: Apache Tez
  Issue Type: Improvement
Reporter: Rajesh Balamohan
 Attachments: Screenshot 2020-03-16 at 6.34.42 PM.jpg

!Screenshot 2020-03-16 at 6.34.42 PM.jpg|width=824,height=575!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-16 Thread Rajesh Balamohan (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060232#comment-17060232
 ] 

Rajesh Balamohan commented on TEZ-4135:
---

Example scenario can be Q78 in Hive.

> Improve memory allocation when executing in-memory reads
> 
>
> Key: TEZ-4135
> URL: https://issues.apache.org/jira/browse/TEZ-4135
> Project: Apache Tez
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Priority: Major
> Attachments: Screenshot 2020-03-16 at 6.34.42 PM.jpg
>
>
> !Screenshot 2020-03-16 at 6.34.42 PM.jpg|width=824,height=575!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (TEZ-4130) Config for max task parallelism in shuffle - tez.shuffle-vertex-manager.max-task-parallelism

2020-03-16 Thread David Mollitor (Jira)


[ 
https://issues.apache.org/jira/browse/TEZ-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060231#comment-17060231
 ] 

David Mollitor commented on TEZ-4130:
-

Where is the maximum number of buckets defined?  Is there a global static 
variable somewhere that specifies the maximum number of buckets?

> Config for max task parallelism in shuffle - 
> tez.shuffle-vertex-manager.max-task-parallelism
> 
>
> Key: TEZ-4130
> URL: https://issues.apache.org/jira/browse/TEZ-4130
> Project: Apache Tez
>  Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
>
> During the investigation of a customer issue, I found that tez generated a 
> dag plan containing >4k tasks. It failed for hive because of bucket number 
> limitations (4k). It can be configured properly, e.g. bigger splits 
> (tez.grouping.min-size), but maybe it would be more convenient for users to 
> config a hard limit for shuffle vertex manager.
> However, I'm not really sure if it's correct to force changing the max task 
> parallelism after split generation already happened (e.g. 
> [HiveSplitGenerator|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/HiveSplitGenerator.java#L192-L244]):
> https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/dag/library/vertexmanager/ShuffleVertexManager.java#L477



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman updated TEZ-4129:
---
Labels: ShuffleHandler  (was: )

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman updated TEZ-4129:
---
Labels: ShuffleHandler  (was: )

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
>  Labels: ShuffleHandler
> Attachments: TEZ-4129.01.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman updated TEZ-4129:
---
Labels:   (was: ShuffleHandler)

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
> Attachments: TEZ-4129.01.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (TEZ-4129) Delete intermediate attempt data for failed attempts for Shuffle Handler

2020-03-16 Thread Syed Shameerur Rahman (Jira)


 [ 
https://issues.apache.org/jira/browse/TEZ-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Syed Shameerur Rahman reassigned TEZ-4129:
--

Assignee: Syed Shameerur Rahman

> Delete intermediate attempt data for failed attempts for Shuffle Handler
> 
>
> Key: TEZ-4129
> URL: https://issues.apache.org/jira/browse/TEZ-4129
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Jonathan Turner Eagles
>Assignee: Syed Shameerur Rahman
>Priority: Major
> Attachments: TEZ-4129.01.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)