[jira] [Created] (TEZ-2807) Log data in the finish event instead of the start event

2015-09-10 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2807: --- Summary: Log data in the finish event instead of the start event Key: TEZ-2807 URL: https://issues.apache.org/jira/browse/TEZ-2807 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-2807) Log data in the finish event instead of the start event

2015-09-10 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2807: Attachment: TEZ-2807.1.patch [~rajesh.balamohan] Please review. This is related to similar root cause at

[jira] [Updated] (TEZ-2799) SimpleHistoryParser NPE

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2799: Attachment: history.txt.appattempt_1441839730184_0001_01 > SimpleHistoryParser NPE >

[jira] [Commented] (TEZ-2799) SimpleHistoryParser NPE

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737828#comment-14737828 ] Bikas Saha commented on TEZ-2799: - java.lang.NullPointerException at

[jira] [Commented] (TEZ-2799) SimpleHistoryParser NPE

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737830#comment-14737830 ] Bikas Saha commented on TEZ-2799: - Looks like a simple null check is missing, but I could be wrong. There

[jira] [Commented] (TEZ-2799) SimpleHistoryParser NPE

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737829#comment-14737829 ] Bikas Saha commented on TEZ-2799: - hadoop jar tez-0.8.1-SNAPSHOT/tez-job-analyzer-0.8.1-SNAPSHOT.jar

[jira] [Commented] (TEZ-2799) SimpleHistoryParser NPE

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737995#comment-14737995 ] Bikas Saha commented on TEZ-2799: - lgtm. minor. if {==null} else {} may be better than if {==null} if

[jira] [Resolved] (TEZ-2789) Backport events added in TEZ-2612 to branch-0.7

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-2789. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.7.1 Thanks! commit

[jira] [Commented] (TEZ-2784) optimize TaskImpl.isFinished()

2015-09-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737250#comment-14737250 ] Bikas Saha commented on TEZ-2784: - does this need a backport to branch 7? > optimize TaskImpl.isFinished()

[jira] [Commented] (TEZ-2774) Reduce logging in the AM

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735536#comment-14735536 ] Bikas Saha commented on TEZ-2774: - the logs I had mentioned in my comment were the ones I remember using for

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735675#comment-14735675 ] Bikas Saha commented on TEZ-2788: - [~rajesh.balamohan] Straightforward patch. Please review. > Allow

[jira] [Commented] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735684#comment-14735684 ] Bikas Saha commented on TEZ-2783: - lgtm. > Refactor analyzers to extend TezAnalyzerBase >

[jira] [Created] (TEZ-2789) Backport events added in TEZ-2612 to branch-0.7

2015-09-08 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2789: --- Summary: Backport events added in TEZ-2612 to branch-0.7 Key: TEZ-2789 URL: https://issues.apache.org/jira/browse/TEZ-2789 Project: Apache Tez Issue Type: Task

[jira] [Updated] (TEZ-2789) Backport events added in TEZ-2612 to branch-0.7

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2789: Attachment: TEZ-2789.1.patch > Backport events added in TEZ-2612 to branch-0.7 >

[jira] [Commented] (TEZ-2789) Backport events added in TEZ-2612 to branch-0.7

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735659#comment-14735659 ] Bikas Saha commented on TEZ-2789: - [~rajesh.balamohan] could you please take a quick look in case I have

[jira] [Created] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2788: --- Summary: Allow TezAnalyzerBase to parse SimpleHistory logs Key: TEZ-2788 URL: https://issues.apache.org/jira/browse/TEZ-2788 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2788: Attachment: TEZ-2788.1.patch > Allow TezAnalyzerBase to parse SimpleHistory logs >

[jira] [Updated] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2788: Attachment: TEZ-2788.2.patch [~rajesh.balamohan] Could you please take another look? I have added support to

[jira] [Commented] (TEZ-2774) Reduce logging in the AM, and parts of the runtime

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735829#comment-14735829 ] Bikas Saha commented on TEZ-2774: - I will reiterate my initial comments about the logs I have mentioned. Let

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735943#comment-14735943 ] Bikas Saha commented on TEZ-2788: - The analysers can still be used separately with the ATSImportTool. So the

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735927#comment-14735927 ] Bikas Saha commented on TEZ-2788: - Tests not added. I have verified on a real cluster that the new command

[jira] [Commented] (TEZ-2784) micro optimization: optimize TaskImpl.isFinished()

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735149#comment-14735149 ] Bikas Saha commented on TEZ-2784: - lgtm. > micro optimization: optimize TaskImpl.isFinished() >

[jira] [Updated] (TEZ-2633) Allow VertexManagerPlugins to receive and report based on attempts instead of tasks

2015-09-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2633: Issue Type: Task (was: Sub-task) Parent: (was: TEZ-2612) > Allow VertexManagerPlugins to receive

[jira] [Updated] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2778: Attachment: TEZ-2778.4.patch Thanks for the review. Attaching commit patch with review comment addressed. >

[jira] [Commented] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734131#comment-14734131 ] Bikas Saha commented on TEZ-2782: - Planning to backport the sub-tasks to branch-0.7 shortly. To reduce 1

[jira] [Updated] (TEZ-2778) Improvements to handle multiple read errors with complex DAGs

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2778: Summary: Improvements to handle multiple read errors with complex DAGs (was: Improvements to handle read

[jira] [Updated] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2782: Attachment: TEZ-2782.2.patch > VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any

[jira] [Updated] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2782: Attachment: (was: TEZ-2782.2.patch) > VertexInfo.getAvgExecutionTimeInterval throws NPE when task does

[jira] [Updated] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2782: Attachment: TEZ-2782.2.patch > VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any

[jira] [Commented] (TEZ-2774) Reduce logging in the AM

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734097#comment-14734097 ] Bikas Saha commented on TEZ-2774: - To keep {code} -LOG.info("Registering " + eventType + " for

[jira] [Updated] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2782: Issue Type: Sub-task (was: Bug) Parent: TEZ-2612 > VertexInfo.getAvgExecutionTimeInterval throws NPE

[jira] [Commented] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

2015-09-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734068#comment-14734068 ] Bikas Saha commented on TEZ-2782: - lgtm. Converting jira to a sub-task of TEZ-2612 for tracking. >

[jira] [Updated] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2778: Attachment: TEZ-2778.2.patch > Improvements to handle read errors - part 2 >

[jira] [Updated] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2778: Attachment: cp-complex.JPG Adding new critical path which tracks reads error dependencies more accurately.

[jira] [Comment Edited] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731625#comment-14731625 ] Bikas Saha edited comment on TEZ-2778 at 9/4/15 11:50 PM: -- Adding new critical path

[jira] [Assigned] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-2778: --- Assignee: Bikas Saha > Improvements to handle read errors - part 2 >

[jira] [Created] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2778: --- Summary: Improvements to handle read errors - part 2 Key: TEZ-2778 URL: https://issues.apache.org/jira/browse/TEZ-2778 Project: Apache Tez Issue Type: Sub-task

[jira] [Commented] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730405#comment-14730405 ] Bikas Saha commented on TEZ-2778: - The approach is evolved to do the following After every read error

[jira] [Updated] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2778: Attachment: TEZ-2778.1.patch > Improvements to handle read errors - part 2 >

[jira] [Commented] (TEZ-2778) Improvements to handle read errors - part 2

2015-09-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730414#comment-14730414 ] Bikas Saha commented on TEZ-2778: - [~rajesh.balamohan] Please review. This should take care of read errors

[jira] [Commented] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-09-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726833#comment-14726833 ] Bikas Saha commented on TEZ-2752: - That is precisely the reason for the change. The UI or anything else that

[jira] [Commented] (TEZ-2755) Fix findbugs warning in TezClient

2015-09-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726831#comment-14726831 ] Bikas Saha commented on TEZ-2755: - lgtm > Fix findbugs warning in TezClient >

[jira] [Commented] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-09-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728230#comment-14728230 ] Bikas Saha commented on TEZ-2752: - Thanks for the reviews. Committing in a bit. > logUnsuccessful

[jira] [Commented] (TEZ-2690) Add critical path analyser

2015-09-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728202#comment-14728202 ] Bikas Saha commented on TEZ-2690: - [~zxzxy1988] Thanks for your interest. We would appreciate people trying

[jira] [Commented] (TEZ-2726) Handle invalid number of partitions for SCATTER-GATHER edge

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723758#comment-14723758 ] Bikas Saha commented on TEZ-2726: - The logs from the output and input would be a good start. The question

[jira] [Commented] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723759#comment-14723759 ] Bikas Saha commented on TEZ-2739: - I will add some comments about this being a regex. Thanks for the review.

[jira] [Updated] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2739: Attachment: TEZ-2739.3.patch > Improve handling of read errors in critical path analyzer >

[jira] [Resolved] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-2739. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.8.1 commit

[jira] [Assigned] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-2752: --- Assignee: Bikas Saha > logUnsuccessful completion in Attempt should write original finish time to ATS

[jira] [Updated] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2752: Attachment: TEZ-2752.1.patch Trivial patch + test. [~hitesh] [~zjffdu] Please review. > logUnsuccessful

[jira] [Commented] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724352#comment-14724352 ] Bikas Saha commented on TEZ-2752: - Findbugs is unrelated. > logUnsuccessful completion in Attempt should

[jira] [Updated] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2739: Attachment: TEZ-2739.1.patch Improve handling of read errors in critical path analyzer

[jira] [Commented] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721265#comment-14721265 ] Bikas Saha commented on TEZ-2739: - Its costly to record all data events that were sent to a

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721280#comment-14721280 ] Bikas Saha commented on TEZ-2300: - This looks like it introduced a findbugs warning that is

[jira] [Updated] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2739: Attachment: TEZ-2739.2.patch Patch with some more tests Improve handling of read errors in critical path

[jira] [Commented] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721398#comment-14721398 ] Bikas Saha commented on TEZ-2739: - Findbugs is unrelated Improve handling of read errors

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720337#comment-14720337 ] Bikas Saha commented on TEZ-2300: - The first config setting probably needs to be removed

[jira] [Updated] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-08-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2752: Assignee: (was: Bikas Saha) logUnsuccessful completion in Attempt should write original finish time to

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717491#comment-14717491 ] Bikas Saha commented on TEZ-2300: - Patch looks good to me. The only item missing is the

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717682#comment-14717682 ] Bikas Saha commented on TEZ-2300: - Patch looks good to me. +1. some minor comments that

[jira] [Created] (TEZ-2752) logUnsuccessful completion in Attempt should write original finish time to ATS

2015-08-27 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2752: --- Summary: logUnsuccessful completion in Attempt should write original finish time to ATS Key: TEZ-2752 URL: https://issues.apache.org/jira/browse/TEZ-2752 Project: Apache Tez

[jira] [Commented] (TEZ-2745) ClassNotFoundException of user code should fail dag

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712386#comment-14712386 ] Bikas Saha commented on TEZ-2745: - Should we just set max attempts to 1. Any crash will stop

[jira] [Commented] (TEZ-2745) ClassNotFoundException of user code should fail dag

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712388#comment-14712388 ] Bikas Saha commented on TEZ-2745: - Or is the suggestion to convert ClassNotFoundException to

[jira] [Created] (TEZ-2740) Create a reconfigureVertex alias for deprecated setVertexParallelism API

2015-08-25 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2740: --- Summary: Create a reconfigureVertex alias for deprecated setVertexParallelism API Key: TEZ-2740 URL: https://issues.apache.org/jira/browse/TEZ-2740 Project: Apache Tez

[jira] [Commented] (TEZ-2740) Create a reconfigureVertex alias for deprecated setVertexParallelism API

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711798#comment-14711798 ] Bikas Saha commented on TEZ-2740: - Trivial update. [~sseth] Please review before 0.8.0.

[jira] [Updated] (TEZ-2740) Create a reconfigureVertex alias for deprecated setVertexParallelism API

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2740: Attachment: TEZ-2740.1.patch Create a reconfigureVertex alias for deprecated setVertexParallelism API

[jira] [Updated] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2739: Issue Type: Sub-task (was: Bug) Parent: TEZ-2612 Improve handling of read errors in critical path

[jira] [Created] (TEZ-2739) Improve handling of read errors in critical path analyzer

2015-08-25 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2739: --- Summary: Improve handling of read errors in critical path analyzer Key: TEZ-2739 URL: https://issues.apache.org/jira/browse/TEZ-2739 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712064#comment-14712064 ] Bikas Saha commented on TEZ-2300: - I apologize. Looks like I misread the code. My bad. If we

[jira] [Created] (TEZ-2742) VertexImpl.finished() terminationCause hides member var of the same name

2015-08-25 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2742: --- Summary: VertexImpl.finished() terminationCause hides member var of the same name Key: TEZ-2742 URL: https://issues.apache.org/jira/browse/TEZ-2742 Project: Apache Tez

[jira] [Updated] (TEZ-2742) VertexImpl.finished() terminationCause hides member var of the same name

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2742: Attachment: TEZ-2742.1.patch VertexImpl.finished() terminationCause hides member var of the same name

[jira] [Commented] (TEZ-2740) Create a reconfigureVertex alias for deprecated setVertexParallelism API

2015-08-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711996#comment-14711996 ] Bikas Saha commented on TEZ-2740: - A simple rename. Test not included for that. Thanks!

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.6.patch Attaching rebased patch. Add critical path analyser

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.5.patch Add critical path analyser -- Key:

[jira] [Commented] (TEZ-2690) Add critical path analyser

2015-08-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707125#comment-14707125 ] Bikas Saha commented on TEZ-2690: - Thanks for the review! Attaching commit patch with

[jira] [Commented] (TEZ-2687) ATS History shutdown happens before the min-held containers are released

2015-08-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705970#comment-14705970 ] Bikas Saha commented on TEZ-2687: - Minor typo - +LOG.info(Realease held containers);

[jira] [Created] (TEZ-2733) Add information about container assignment to attempts

2015-08-20 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2733: --- Summary: Add information about container assignment to attempts Key: TEZ-2733 URL: https://issues.apache.org/jira/browse/TEZ-2733 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.3.patch Add critical path analyser -- Key:

[jira] [Commented] (TEZ-2687) ATS History shutdown happens before the min-held containers are released

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703535#comment-14703535 ] Bikas Saha commented on TEZ-2687: - Looks like the approach in the patch is to have the

[jira] [Commented] (TEZ-2690) Add critical path analyser

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703949#comment-14703949 ] Bikas Saha commented on TEZ-2690: - bq. Since the analyzer is not going to download the data,

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.1.patch Add critical path analyser -- Key:

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.2.patch Add critical path analyser -- Key:

[jira] [Comment Edited] (TEZ-2690) Add critical path analyser

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703949#comment-14703949 ] Bikas Saha edited comment on TEZ-2690 at 8/19/15 11:31 PM: --- bq.

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: (was: TEZ-2690.1.patch) Add critical path analyser --

[jira] [Commented] (TEZ-2687) ATS History shutdown happens before the min-held containers are released

2015-08-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704141#comment-14704141 ] Bikas Saha commented on TEZ-2687: - Typo. And log message should probably now be initiating

[jira] [Commented] (TEZ-2726) Handle invalid number of partitions for SCATTER-GATHER edge

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701684#comment-14701684 ] Bikas Saha commented on TEZ-2726: - Ah. so the producer task wrote data and that generated a

[jira] [Issue Comment Deleted] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Comment: was deleted (was: Adds a task attempt level critical path analyzer. Uses the scheduling and data

[jira] [Commented] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702290#comment-14702290 ] Bikas Saha commented on TEZ-2690: - Adds a task attempt level critical path analyzer. Uses

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.1.patch Add critical path analyser -- Key:

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: TEZ-2690.1.patch Add critical path analyser -- Key:

[jira] [Commented] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702282#comment-14702282 ] Bikas Saha commented on TEZ-2690: - Adds a task attempt level critical path analyzer. Uses

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: criticalPath.png Add critical path analyser -- Key:

[jira] [Comment Edited] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702282#comment-14702282 ] Bikas Saha edited comment on TEZ-2690 at 8/19/15 1:39 AM: -- Adds a

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702216#comment-14702216 ] Bikas Saha commented on TEZ-2300: - The current patch is useful because it ensures that the

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: criticalPath.jpg Add critical path analyser -- Key:

[jira] [Comment Edited] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702282#comment-14702282 ] Bikas Saha edited comment on TEZ-2690 at 8/19/15 1:41 AM: -- Adds a

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: (was: TEZ-2690.1.patch) Add critical path analyser --

[jira] [Updated] (TEZ-2690) Add critical path analyser

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2690: Attachment: (was: criticalPath.png) Add critical path analyser --

[jira] [Commented] (TEZ-2730) tez-api missing dependency on org.codehaus.jettison for json

2015-08-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702037#comment-14702037 ] Bikas Saha commented on TEZ-2730: - lgtm tez-api missing dependency on

[jira] [Commented] (TEZ-2300) TezClient.stop() takes a lot of time or does not work sometimes

2015-08-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700278#comment-14700278 ] Bikas Saha commented on TEZ-2300: - Then perhaps the patch could killDAG() and send a (new)

<    1   2   3   4   5   6   7   8   9   10   >