[jira] [Commented] (TEZ-587) Race condition between delayed assignment thread and onContainerCompleted

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254909#comment-14254909 ] Hitesh Shah commented on TEZ-587: - [~bikassaha] still valid? > Race condition between delay

[jira] [Commented] (TEZ-604) Revert temporary changes made in TEZ-603

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254910#comment-14254910 ] Hitesh Shah commented on TEZ-604: - [~sseth] is this still valid? > Revert temporary changes

[jira] [Resolved] (TEZ-579) Change TestDAGImpl and TestVertexImpl to use a drain dispatcher

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-579. - Resolution: Invalid > Change TestDAGImpl and TestVertexImpl to use a drain dispatcher > -

[jira] [Commented] (TEZ-586) New task that is rack-local does not immediately get assigned rack local container

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254908#comment-14254908 ] Hitesh Shah commented on TEZ-586: - [~bikassaha] Is this still valid? > New task that is rac

[jira] [Commented] (TEZ-564) Add history messages for Containers

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254906#comment-14254906 ] Hitesh Shah commented on TEZ-564: - [~sseth] [~pramachandran] Could you list out all missing d

[jira] [Updated] (TEZ-568) Allow I/P/Os to report spescific time information to the AM

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-568: Priority: Critical (was: Major) Target Version/s: 0.7.0 > Allow I/P/Os to report spescific time in

[jira] [Updated] (TEZ-557) Documentation for configuring the Tez AM

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-557: Priority: Blocker (was: Major) > Documentation for configuring the Tez AM > --

[jira] [Updated] (TEZ-557) Documentation for configuring Tez

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-557: Target Version/s: 0.6.0 > Documentation for configuring Tez > - > >

[jira] [Updated] (TEZ-557) Documentation for configuring Tez

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-557: Summary: Documentation for configuring Tez (was: Documentation for configuring the Tez AM) > Documentation fo

[jira] [Commented] (TEZ-550) Allow re-launching the child JVM in between dags

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254904#comment-14254904 ] Hitesh Shah commented on TEZ-550: - [~bikassaha] Is this still valid? Are we looking for re-la

[jira] [Commented] (TEZ-529) Hive communicates state from RecordReader to Processor via JobConf

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254902#comment-14254902 ] Hitesh Shah commented on TEZ-529: - [~sseth] [~hagleitn] Is this still a valid issue? > Hive

[jira] [Updated] (TEZ-528) In case of failure, RM unregister loops on an exception

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-528: Priority: Critical (was: Major) > In case of failure, RM unregister loops on an exception > --

[jira] [Updated] (TEZ-528) In case of failure, RM unregister loops on an exception

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-528: Target Version/s: 0.6.0 > In case of failure, RM unregister loops on an exception > ---

[jira] [Resolved] (TEZ-530) YARNTezDAGChild still not exiting correctly

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-530. - Resolution: Invalid No longer valid due to TezChild refactor. > YARNTezDAGChild still not exiting correctly

[jira] [Commented] (TEZ-505) Rename version in Events to attemptNumber

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254897#comment-14254897 ] Hitesh Shah commented on TEZ-505: - [~sseth] still valid? > Rename version in Events to atte

[jira] [Commented] (TEZ-527) Exception while serialziing heartbeat response

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254898#comment-14254898 ] Hitesh Shah commented on TEZ-527: - [~sseth] Was this addressed in the TezChild refactor? >

[jira] [Commented] (TEZ-504) DataMovementEvent should not expose a constructor with targetIndex

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254896#comment-14254896 ] Hitesh Shah commented on TEZ-504: - [~sseth] is this still valid? Would likely be an incompati

[jira] [Commented] (TEZ-501) Shutdown service, sleep 5s and then shutdown DAGClientServer to handle RM restart related race conditions YARN-540/MAPREDUCE-5505

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254895#comment-14254895 ] Hitesh Shah commented on TEZ-501: - Seems like this should be a higher priority? [~bikassaha]

[jira] [Commented] (TEZ-495) When current attempt fails/killed and new attempt launched then Task should go back to SCHEDULED state

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254894#comment-14254894 ] Hitesh Shah commented on TEZ-495: - [~bikassaha] Could you add more details on this? If no lon

[jira] [Resolved] (TEZ-491) Add helpers to configure the generic Inputs/Outputs provided by tez-engine

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-491. - Resolution: Duplicate Fixed in various jiras as part of TEZ-690 > Add helpers to configure the generic Input

[jira] [Resolved] (TEZ-494) Investigate: Exception while submitting a dag to a TezSession

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-494. - Resolution: Cannot Reproduce > Investigate: Exception while submitting a dag to a TezSession > --

[jira] [Commented] (TEZ-478) Remove the OUTPUT_CONSUMABLE state from TaskAttemptImpl

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254891#comment-14254891 ] Hitesh Shah commented on TEZ-478: - [~sseth] [~zjffdu] Is this still valid? > Remove the OUT

[jira] [Commented] (TEZ-487) Setup additional MR parameters in SimpleInput/SimpleOutput

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254892#comment-14254892 ] Hitesh Shah commented on TEZ-487: - [~sseth] is this still valid? > Setup additional MR para

[jira] [Commented] (TEZ-475) Descriptors in the API should take class which extend from the base required types and not stringified class names

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254890#comment-14254890 ] Hitesh Shah commented on TEZ-475: - [~bikassaha] [~sseth] comments? > Descriptors in the API

[jira] [Commented] (TEZ-390) Support a Vertex Initializer and Committer

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254889#comment-14254889 ] Hitesh Shah commented on TEZ-390: - [~rohini] Can we close this out or are there some aspects

[jira] [Commented] (TEZ-316) Address findbugs warnings in tez codebase

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254888#comment-14254888 ] Hitesh Shah commented on TEZ-316: - As per TEZ-1313, looks like we have 477 warnings. Might ne

[jira] [Updated] (TEZ-316) Address findbugs warnings in tez codebase

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-316: Priority: Blocker (was: Major) > Address findbugs warnings in tez codebase > -

[jira] [Commented] (TEZ-1839) TestTezClientUtils and TestTezCommonUtils leave files under the target directory after completing

2014-12-20 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254884#comment-14254884 ] Vasanth kumar RJ commented on TEZ-1839: --- Yes. TestTezClientUtils and TestTezCommonUtil

[jira] [Commented] (TEZ-116) Add unit test for the runtime

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254882#comment-14254882 ] Hitesh Shah commented on TEZ-116: - [~sseth] Is this jira still valid? > Add unit test for t

[jira] [Updated] (TEZ-1883) Change findbugs version to 3.x

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1883: - Target Version/s: 0.7.0 > Change findbugs version to 3.x > --- > >

[jira] [Updated] (TEZ-1839) TestTezClientUtils and TestTezCommonUtils leave files under the target directory after completing

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1839: - Target Version/s: 0.6.0 > TestTezClientUtils and TestTezCommonUtils leave files under the target > director

[jira] [Updated] (TEZ-1827) MiniTezCluster takes 10 minutes to shut down

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1827: - Target Version/s: 0.7.0 > MiniTezCluster takes 10 minutes to shut down > ---

[jira] [Updated] (TEZ-1826) Add option to disable grouping in some of the examples

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1826: - Target Version/s: 0.7.0 > Add option to disable grouping in some of the examples > -

[jira] [Updated] (TEZ-1671) Add tests for all converter functions in HistoryEventJsonConversion

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1671: - Target Version/s: 0.7.0 > Add tests for all converter functions in HistoryEventJsonConversion >

[jira] [Updated] (TEZ-1754) Deviant directory structure in tez-dist.

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1754: - Target Version/s: 0.6.0 > Deviant directory structure in tez-dist. > ---

[jira] [Updated] (TEZ-1670) Add tests for all converter functions in HistoryEventTimelineConversion

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1670: - Target Version/s: 0.6.0 > Add tests for all converter functions in HistoryEventTimelineConversion >

[jira] [Resolved] (TEZ-1705) UI-TODOs

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1705. -- Resolution: Invalid Removing umbrella jira for TODOs. Each issue can be tracked separately. > UI-TODOs >

[jira] [Updated] (TEZ-1706) Generic controller

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1706: - Issue Type: Bug (was: Sub-task) Parent: (was: TEZ-1705) > Generic controller >

[jira] [Updated] (TEZ-1467) Tez job "actual" status is miss-reported between RM UI and Console

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1467: - Priority: Major (was: Minor) Target Version/s: 0.7.0 > Tez job "actual" status is miss-reported

[jira] [Commented] (TEZ-1467) Tez job "actual" status is miss-reported between RM UI and Console

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254880#comment-14254880 ] Hitesh Shah commented on TEZ-1467: -- [~pramachandran] [~jeagles] does the same problem hold

[jira] [Updated] (TEZ-1467) Tez job "actual" status is miss-reported between RM UI and Console

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1467: - Target Version/s: 0.6.0 (was: 0.7.0) > Tez job "actual" status is miss-reported between RM UI and Console

[jira] [Commented] (TEZ-1730) Add Auto-reducer-parallelism information to the DAG .dot file

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254879#comment-14254879 ] Hitesh Shah commented on TEZ-1730: -- Is this still needed in lieu of the UI? > Add Auto-re

[jira] [Resolved] (TEZ-1873) TestTezAMRMClient fails due to host resolution timing out

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1873. -- Resolution: Fixed > TestTezAMRMClient fails due to host resolution timing out > --

[jira] [Reopened] (TEZ-1873) TestTezAMRMClient fails due to host resolution timing out

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reopened TEZ-1873: -- Re-opening to test TEZ-1313. > TestTezAMRMClient fails due to host resolution timing out > -

[jira] [Issue Comment Deleted] (TEZ-1873) TestTezAMRMClient fails due to host resolution timing out

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1873: - Comment: was deleted (was: Re-opening to test TEZ-1313. ) > TestTezAMRMClient fails due to host resolution

[jira] [Commented] (TEZ-1883) Change findbugs version to 3.x

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254868#comment-14254868 ] Hitesh Shah commented on TEZ-1883: -- Requires java 1.7 as a minimum dependency. > Change f

[jira] [Updated] (TEZ-1883) Change findbugs version to 3.x

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1883: - Attachment: TEZ-1883.1.patch > Change findbugs version to 3.x > --- > >

[jira] [Created] (TEZ-1883) Change findbugs version to 3.x

2014-12-20 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1883: Summary: Change findbugs version to 3.x Key: TEZ-1883 URL: https://issues.apache.org/jira/browse/TEZ-1883 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Commented] (TEZ-1839) TestTezClientUtils and TestTezCommonUtils leave files under the target directory after completing

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254867#comment-14254867 ] Hitesh Shah commented on TEZ-1839: -- [~vasanthkumar] Agreed that MiniCluster works correctly

[jira] [Commented] (TEZ-1865) UI for configuring host urls from browser.

2014-12-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254854#comment-14254854 ] Hitesh Shah commented on TEZ-1865: -- [~Sreenath] To be clear, this feature is good to have a

[jira] [Resolved] (TEZ-1865) UI for configuring host urls from browser.

2014-12-20 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram resolved TEZ-1865. - Resolution: Invalid > UI for configuring host urls from browser. > -

[jira] [Commented] (TEZ-1865) UI for configuring host urls from browser.

2014-12-20 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254658#comment-14254658 ] Sreenath Somarajapuram commented on TEZ-1865: - Ok. Closing this ticket as invali

[jira] [Commented] (TEZ-1839) TestTezClientUtils and TestTezCommonUtils leave files under the target directory after completing

2014-12-20 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254636#comment-14254636 ] Vasanth kumar RJ commented on TEZ-1839: --- [~hitesh], MiniTezCluster creates tmp directo

[jira] [Commented] (TEZ-1875) dropdown filters do not work on vertices and task attempts page

2014-12-20 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254581#comment-14254581 ] Sreenath Somarajapuram commented on TEZ-1875: - +1 lgtm > dropdown filters do no