[
https://issues.apache.org/jira/browse/TEZ-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738287#comment-14738287
]
Sreenath Somarajapuram commented on TEZ-2776:
-
Once task part of TEZ-2760 get complete following
[
https://issues.apache.org/jira/browse/TEZ-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738508#comment-14738508
]
Rajesh Balamohan commented on TEZ-2775:
---
Fetcher/FetcherOrderedGrouped - should we retain the decomp,
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738556#comment-14738556
]
Prakash Ramachandran commented on TEZ-2792:
---
+1 LGTM pending precommit build.
also can you raise
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738221#comment-14738221
]
Sreenath Somarajapuram edited comment on TEZ-2792 at 9/10/15 6:48 AM:
--
[
https://issues.apache.org/jira/browse/TEZ-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2803:
Description:
- Field to be sorted on
- Format: [:], []-optional
- By default asc.
[
https://issues.apache.org/jira/browse/TEZ-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Zhang updated TEZ-2804:
Assignee: (was: Jeff Zhang)
> Support Node labels scheduling
> --
>
>
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2780:
Attachment: TEZ-2780.3.patch
Making the patch compatible with TEZ-2792.
> Tez UI:
Jeff Zhang created TEZ-2804:
---
Summary: Support Node labels scheduling
Key: TEZ-2804
URL: https://issues.apache.org/jira/browse/TEZ-2804
Project: Apache Tez
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2792:
Attachment: TEZ-2792.2.patch
Thanks [~hitesh]
Please find the patch with the comments
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738581#comment-14738581
]
TezQA commented on TEZ-2792:
{color:green}+1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2792
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1103/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2784:
--
Target Version/s: 0.7.1 (was: 0.8.1)
> optimize TaskImpl.isFinished()
>
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738592#comment-14738592
]
TezQA commented on TEZ-2780:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2780
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1104/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738582#comment-14738582
]
Prakash Ramachandran commented on TEZ-2792:
---
trying out the patch I am getting some errors with
liuchuanqi created TEZ-2805:
---
Summary: run task with lzo files sometimes fail
Key: TEZ-2805
URL: https://issues.apache.org/jira/browse/TEZ-2805
Project: Apache Tez
Issue Type: Bug
Affects
[
https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738843#comment-14738843
]
TezQA commented on TEZ-2799:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2799
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1105/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2792:
Description:
Add AM API for fetching realtime tasks info:
- API endpoint :
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2792:
Description:
Add AM API for fetching realtime tasks info:
- API endpoint :
[
https://issues.apache.org/jira/browse/TEZ-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739179#comment-14739179
]
Siddharth Seth commented on TEZ-2775:
-
bq. Fetcher/FetcherOrderedGrouped - should we retain the decomp,
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738990#comment-14738990
]
Hitesh Shah commented on TEZ-2792:
--
bq. As MinID was confusing, all were changed to just ID
Please add
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739131#comment-14739131
]
Sreenath Somarajapuram commented on TEZ-2792:
-
bq. Please add comments to describe the format so
[
https://issues.apache.org/jira/browse/TEZ-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738985#comment-14738985
]
Hitesh Shah commented on TEZ-2800:
--
Would the above work?
> AM web service API V2: Add fromMinID
>
[
https://issues.apache.org/jira/browse/TEZ-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739045#comment-14739045
]
Siddharth Seth commented on TEZ-2776:
-
[~Sreenath] - if you plan on taking this up after TEZ-2670,
[
https://issues.apache.org/jira/browse/TEZ-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738984#comment-14738984
]
Hitesh Shah commented on TEZ-2800:
--
You dont need to use a map.
Consider vertex v1 (idx=0) having 100
Siddharth Seth created TEZ-2806:
---
Summary: TestContainerReuse flaky
Key: TEZ-2806
URL: https://issues.apache.org/jira/browse/TEZ-2806
Project: Apache Tez
Issue Type: Bug
Affects Versions:
[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739196#comment-14739196
]
Hitesh Shah commented on TEZ-2792:
--
Please add comments into the actual patch too as the source of truth is
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739338#comment-14739338
]
Siddharth Seth commented on TEZ-2774:
-
Some statistics on log sizes, on a 20 node cluster
h6.
[
https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739344#comment-14739344
]
Siddharth Seth commented on TEZ-2164:
-
The one time publish sounds good. I don't think we want to make
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2810:
Attachment: cp5-no-launch.png
cp4-preempt-3.png
cp4-preempt-2.png
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740005#comment-14740005
]
Bikas Saha edited comment on TEZ-2810 at 9/11/15 1:47 AM:
--
[~rajesh.balamohan]
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739676#comment-14739676
]
Bikas Saha commented on TEZ-2808:
-
Both assignment logic and preemption logic take the scheduler lock to be
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739961#comment-14739961
]
Bikas Saha commented on TEZ-2807:
-
0.7
commit 241e73eeb4c9b596b92fddaa62b197ea23b97172
Author: Bikas Saha
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2807:
Fix Version/s: 0.7.1
> Log data in the finish event instead of the start event
>
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2808:
Description:
New container allocated. Put in delayed container manager queue. Triggers
assignment run on
Jira: https://issues.apache.org/jira/browse/TEZ-2808
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1107/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739942#comment-14739942
]
TezQA commented on TEZ-2808:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2808:
Description:
New container allocated. Put in delayed container manager queue. Triggers
assignment run on
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2810:
Attachment: TEZ-2810.1.patch
> Support for showing allocation delays due to internal preemption
>
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-2809:
-
Attachment: TEZ-2809.1.patch
> Minimal distribution compiled on 2.6 fails to run on 2.7
>
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739839#comment-14739839
]
Rajesh Balamohan commented on TEZ-2807:
---
lgtm. +1.
> Log data in the finish event instead of the
Bikas Saha created TEZ-2810:
---
Summary: Support for showing allocation delays due to internal
preemption
Key: TEZ-2810
URL: https://issues.apache.org/jira/browse/TEZ-2810
Project: Apache Tez
Issue
Jira: https://issues.apache.org/jira/browse/TEZ-2807
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1106/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739662#comment-14739662
]
TezQA commented on TEZ-2807:
{color:green}+1 overall{color}. Here are the results of testing the latest
Bikas Saha created TEZ-2808:
---
Summary: Race condition between preemption and container assignment
Key: TEZ-2808
URL: https://issues.apache.org/jira/browse/TEZ-2808
Project: Apache Tez
Issue Type:
Jonathan Eagles created TEZ-2809:
Summary: Minimal distribution compiled on 2.6 fails to run on 2.7
Key: TEZ-2809
URL: https://issues.apache.org/jira/browse/TEZ-2809
Project: Apache Tez
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739758#comment-14739758
]
Jonathan Eagles commented on TEZ-2809:
--
Looks like when we added the Tez AM WebServices we pulled in
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739848#comment-14739848
]
Hitesh Shah commented on TEZ-2808:
--
+1 pending pre-commit and findbugs warnings if any.
> Race condition
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739913#comment-14739913
]
Bikas Saha edited comment on TEZ-2807 at 9/11/15 12:29 AM:
---
Thanks!
commit
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1474#comment-1474
]
Jonathan Eagles commented on TEZ-2809:
--
Thanks, [~hitesh], [~jlowe]. committed to master, branch-0.7,
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-2809:
-
Target Version/s: 0.6.3 (was: 0.7.1)
> Minimal distribution compiled on 2.6 fails to run on 2.7
>
[
https://issues.apache.org/jira/browse/TEZ-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Zhang updated TEZ-2724:
Attachment: TEZ-2724-2.patch
> Tez Client keeps on showing old status when application is finished but RM is
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740004#comment-14740004
]
Bikas Saha commented on TEZ-2810:
-
AnalyseDAG split into straggler analysis and allocation analysis.
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2810:
Attachment: (was: TEZ-2810.1.patch)
> Support for showing allocation delays due to internal preemption
>
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2810:
Attachment: TEZ-2810.1.patch
> Support for showing allocation delays due to internal preemption
>
Jira: https://issues.apache.org/jira/browse/TEZ-2809
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1108/
###
## LAST 60 LINES OF THE CONSOLE
###
Started by
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740005#comment-14740005
]
Bikas Saha commented on TEZ-2810:
-
[~rajesh.balamohan] Please review. Thanks!
> Support for showing
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739772#comment-14739772
]
Hitesh Shah commented on TEZ-2809:
--
+1. Though would be better if there is a way to future proof this.
>
[
https://issues.apache.org/jira/browse/TEZ-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739980#comment-14739980
]
Jonathan Eagles commented on TEZ-2809:
--
Specifically, the issue in this case is that hadoop common
[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739981#comment-14739981
]
Bikas Saha commented on TEZ-2808:
-
Thanks for the review. Committing. Race condition. No tests. Manually
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739961#comment-14739961
]
Bikas Saha edited comment on TEZ-2807 at 9/11/15 2:11 AM:
--
0.7
commit
[
https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740117#comment-14740117
]
TezQA commented on TEZ-2810:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740023#comment-14740023
]
Bikas Saha commented on TEZ-2798:
-
Do you have a fix for this?
> NPE when executing
[
https://issues.apache.org/jira/browse/TEZ-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740065#comment-14740065
]
liuchuanqi commented on TEZ-2805:
-
Is there a relationship with thread safety ??
> run task with lzo
[
https://issues.apache.org/jira/browse/TEZ-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-2787:
-
Attachment: TEZ-2787.2.patch
Added the tmpdir as part of constructAMLaunchOpts at the beginning so
Jira: https://issues.apache.org/jira/browse/TEZ-2810
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1109/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740183#comment-14740183
]
Jeff Zhang commented on TEZ-2724:
-
Upload another patch. [~hitesh] [~pramachandran] Please help review.
Jira: https://issues.apache.org/jira/browse/TEZ-2724
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1110/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740168#comment-14740168
]
TezQA commented on TEZ-2724:
{color:red}-1 overall{color}. Here are the results of testing the latest
Bikas Saha created TEZ-2807:
---
Summary: Log data in the finish event instead of the start event
Key: TEZ-2807
URL: https://issues.apache.org/jira/browse/TEZ-2807
Project: Apache Tez
Issue Type:
[
https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2807:
Attachment: TEZ-2807.1.patch
[~rajesh.balamohan] Please review. This is related to similar root cause at
72 matches
Mail list logo