[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2784:
--
Attachment: TEZ-2784.1.patch
AM_Profiler_snapshot.jpg
> micro optimization:
Rajesh Balamohan created TEZ-2784:
-
Summary: micro optimization: optimize TaskImpl.isFinished()
Key: TEZ-2784
URL: https://issues.apache.org/jira/browse/TEZ-2784
Project: Apache Tez
Issue
[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2784:
--
Attachment: (was: TEZ-2784.1.patch)
> micro optimization: optimize TaskImpl.isFinished()
>
[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2784:
--
Attachment: TEZ-2784.1.patch
> micro optimization: optimize TaskImpl.isFinished()
>
[
https://issues.apache.org/jira/browse/TEZ-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734394#comment-14734394
]
Jeff Zhang commented on TEZ-2769:
-
+1, patch verified.
> TEZ-UI Hive SQL is only displayed to line 11
>
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735434#comment-14735434
]
Siddharth Seth commented on TEZ-2774:
-
Kept the following.
{code}
-LOG.info("Comparing client
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735412#comment-14735412
]
Siddharth Seth commented on TEZ-2774:
-
bq. this has been useful at times when debugging rolling upgrade
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735417#comment-14735417
]
Siddharth Seth commented on TEZ-2774:
-
bq. YarnTaskSchedulerService - Changes related to "Releasing
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735438#comment-14735438
]
Siddharth Seth commented on TEZ-2774:
-
Also for events being sent to tasks - either in the next
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735536#comment-14735536
]
Bikas Saha commented on TEZ-2774:
-
the logs I had mentioned in my comment were the ones I remember using for
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735418#comment-14735418
]
Siddharth Seth commented on TEZ-2774:
-
bq. If I run standalone tez app (like wordcount), I can see the
Jason Lowe created TEZ-2787:
---
Summary: Tez AM should have java.io.tmpdir=./tmp to be consistent
with tasks
Key: TEZ-2787
URL: https://issues.apache.org/jira/browse/TEZ-2787
Project: Apache Tez
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saikat updated TEZ-2643:
Attachment: TEZ-2643.1.patch
> Minimize number of empty spills in Pipelined Sorter
>
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-2097:
-
Attachment: TEZ-2097.3.patch
[~hitesh], reworked the patch so that 1) inprogressurl is now per
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735571#comment-14735571
]
Saikat commented on TEZ-2643:
-
Thanks [~rajesh.balamohan] for the review comments.
Made the following changes in
Jira: https://issues.apache.org/jira/browse/TEZ-2643
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1087/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735617#comment-14735617
]
TezQA commented on TEZ-2643:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saikat updated TEZ-2643:
Attachment: TEZ-2643.2.patch
> Minimize number of empty spills in Pipelined Sorter
>
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735571#comment-14735571
]
Saikat edited comment on TEZ-2643 at 9/8/15 8:42 PM:
-
Thanks [~rajesh.balamohan] for the
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735571#comment-14735571
]
Saikat edited comment on TEZ-2643 at 9/8/15 8:41 PM:
-
Thanks [~rajesh.balamohan] for the
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735675#comment-14735675
]
Bikas Saha commented on TEZ-2788:
-
[~rajesh.balamohan] Straightforward patch. Please review.
> Allow
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735684#comment-14735684
]
Bikas Saha commented on TEZ-2783:
-
lgtm.
> Refactor analyzers to extend TezAnalyzerBase
>
Bikas Saha created TEZ-2789:
---
Summary: Backport events added in TEZ-2612 to branch-0.7
Key: TEZ-2789
URL: https://issues.apache.org/jira/browse/TEZ-2789
Project: Apache Tez
Issue Type: Task
[
https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2789:
Attachment: TEZ-2789.1.patch
> Backport events added in TEZ-2612 to branch-0.7
>
[
https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735659#comment-14735659
]
Bikas Saha commented on TEZ-2789:
-
[~rajesh.balamohan] could you please take a quick look in case I have
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735671#comment-14735671
]
Siddharth Seth commented on TEZ-2774:
-
All of these are still available at DEBUG level. A bunch of the
Jira: https://issues.apache.org/jira/browse/TEZ-2643
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1088/
###
## LAST 60 LINES OF THE CONSOLE
###
Bikas Saha created TEZ-2788:
---
Summary: Allow TezAnalyzerBase to parse SimpleHistory logs
Key: TEZ-2788
URL: https://issues.apache.org/jira/browse/TEZ-2788
Project: Apache Tez
Issue Type: Bug
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735571#comment-14735571
]
Saikat edited comment on TEZ-2643 at 9/8/15 9:18 PM:
-
Thanks [~rajesh.balamohan] for the
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2788:
Attachment: TEZ-2788.1.patch
> Allow TezAnalyzerBase to parse SimpleHistory logs
>
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735762#comment-14735762
]
Rajesh Balamohan commented on TEZ-2788:
---
lgtm. +1
> Allow TezAnalyzerBase to parse SimpleHistory logs
[
https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735765#comment-14735765
]
TezQA commented on TEZ-2643:
{color:green}+1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2774
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1091/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735828#comment-14735828
]
TezQA commented on TEZ-2774:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735797#comment-14735797
]
Hitesh Shah commented on TEZ-2097:
--
[~jeagles] Maybe we can split this jira into 2. One for the ATS publish
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-2774:
Attachment: TEZ-2774.2.txt
Updated patch with comments addressed as indicated in replies. Small
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735802#comment-14735802
]
Hitesh Shah commented on TEZ-2097:
--
Minor nit:
{code}
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2788:
Attachment: TEZ-2788.2.patch
[~rajesh.balamohan] Could you please take another look? I have added support to
Jira: https://issues.apache.org/jira/browse/TEZ-2097
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1090/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735780#comment-14735780
]
TezQA commented on TEZ-2788:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735781#comment-14735781
]
TezQA commented on TEZ-2097:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2788
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1089/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735797#comment-14735797
]
Hitesh Shah edited comment on TEZ-2097 at 9/8/15 11:09 PM:
---
[~jeagles] If needed,
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-2774:
Summary: Reduce logging in the AM, and parts of the runtime (was: Reduce
logging in the AM)
>
[
https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735829#comment-14735829
]
Bikas Saha commented on TEZ-2774:
-
I will reiterate my initial comments about the logs I have mentioned. Let
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735968#comment-14735968
]
Rajesh Balamohan commented on TEZ-2788:
---
>> (user running an analyzer for a dag on a gateway box)
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2783:
--
Attachment: TEZ-2783.2.rebased.patch
Attaching rebased patch.
> Refactor analyzers to extend
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2783:
--
Target Version/s: 0.8.1
> Refactor analyzers to extend TezAnalyzerBase
>
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735871#comment-14735871
]
TezQA commented on TEZ-2788:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2788
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1092/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735928#comment-14735928
]
Rajesh Balamohan commented on TEZ-2788:
---
>> added support to download the ATS data to reduce the
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735943#comment-14735943
]
Bikas Saha commented on TEZ-2788:
-
The analysers can still be used separately with the ATSImportTool. So the
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-2097:
-
Attachment: TEZ-2097.4.patch
[~hitesh], here is the patch with the getAttemptId int replacing the
[
https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735927#comment-14735927
]
Bikas Saha commented on TEZ-2788:
-
Tests not added. I have verified on a real cluster that the new command
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736050#comment-14736050
]
TezQA commented on TEZ-2783:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736115#comment-14736115
]
Jonathan Eagles commented on TEZ-2097:
--
Looks like the test failure is from TEZ-2686.
> TEZ-UI Add dag
[
https://issues.apache.org/jira/browse/TEZ-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736033#comment-14736033
]
TezQA commented on TEZ-2097:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2097
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1093/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736060#comment-14736060
]
TezQA commented on TEZ-2784:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2784
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1095/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2785:
Description: Move setup, reset is Active from TablePageController to this
abstract
Sreenath Somarajapuram created TEZ-2785:
---
Summary: Tez UI: Implement an abstract controller to enclose basic
generic functionalities.
Key: TEZ-2785
URL: https://issues.apache.org/jira/browse/TEZ-2785
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735223#comment-14735223
]
Prakash Ramachandran commented on TEZ-2780:
---
[~Sreenath] still reviewing the changes, one quick
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2780:
Summary: Tez UI: Update All Tasks page while in progress. (was: Tez UI:
Update tasks
[
https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735149#comment-14735149
]
Bikas Saha commented on TEZ-2784:
-
lgtm.
> micro optimization: optimize TaskImpl.isFinished()
>
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2780:
Attachment: TEZ-2780.1.patch
1. Added AM API for fetching realtime tasks info.
2.
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2780:
Description:
Add AM API for fetching realtime tasks info:
- API endpoint :
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735161#comment-14735161
]
Sreenath Somarajapuram edited comment on TEZ-2780 at 9/8/15 5:04 PM:
-
1.
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreenath Somarajapuram updated TEZ-2780:
Description:
Add AM API for fetching realtime tasks info:
- API endpoint :
Sreenath Somarajapuram created TEZ-2786:
---
Summary: Tez UI: Update task details page while in progress.
Key: TEZ-2786
URL: https://issues.apache.org/jira/browse/TEZ-2786
Project: Apache Tez
[
https://issues.apache.org/jira/browse/TEZ-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bikas Saha updated TEZ-2633:
Issue Type: Task (was: Sub-task)
Parent: (was: TEZ-2612)
> Allow VertexManagerPlugins to receive
[
https://issues.apache.org/jira/browse/TEZ-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735299#comment-14735299
]
Siddharth Seth commented on TEZ-2744:
-
In terms of the history events - they provide a good amount of
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735303#comment-14735303
]
TezQA commented on TEZ-2780:
{color:red}-1 overall{color}. Here are the results of testing the latest
Jira: https://issues.apache.org/jira/browse/TEZ-2780
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1086/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735305#comment-14735305
]
Hitesh Shah commented on TEZ-2780:
--
It would be good if the AM webservices and the UI changes could be
Jira: https://issues.apache.org/jira/browse/TEZ-2783
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1096/
###
## LAST 60 LINES OF THE CONSOLE
###
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736228#comment-14736228
]
TezQA commented on TEZ-2783:
{color:red}-1 overall{color}. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2783:
--
Attachment: TEZ-2783.3.patch
Fixing findbug warning (related to string concat)
> Refactor
78 matches
Mail list logo
