[jira] [Commented] (YARN-660) Improve AMRMClient with matching requests

2013-05-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13668714#comment-13668714 ] Hitesh Shah commented on YARN-660: -- +1. Mostly looks good. Minor nit: Should we be

[jira] [Commented] (YARN-734) Error in ContainerLaunchContextPBImpl when trying to launch a container

2013-05-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13670602#comment-13670602 ] Hitesh Shah commented on YARN-734: -- 2013-05-30 10:54:38,265 ERROR [ContainerLauncher #3]

[jira] [Commented] (YARN-734) Error in ContainerLaunchContextPBImpl when trying to launch a container

2013-05-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13670676#comment-13670676 ] Hitesh Shah commented on YARN-734: -- Solved by passing a copy of the container tokens when

[jira] [Commented] (YARN-749) Rename ResourceRequest (get,set)HostName to (get,set)ResourceName

2013-06-02 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672679#comment-13672679 ] Hitesh Shah commented on YARN-749: -- Looks good to me. +1. Rename

[jira] [Updated] (YARN-766) TestNodeManagerShutdown should use Shell to form the output path

2013-06-05 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-766: - Summary: TestNodeManagerShutdown should use Shell to form the output path (was: TestNodeManagerShutdown

[jira] [Commented] (YARN-769) Add metrics for number of containers

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677086#comment-13677086 ] Hitesh Shah commented on YARN-769: -- [~acmurthy], given DRF, it would make more sense to

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677181#comment-13677181 ] Hitesh Shah commented on YARN-689: -- [~tucu00] [~bikassaha] Should we just remove min

[jira] [Commented] (YARN-759) Create Command enum in AllocateResponse

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677526#comment-13677526 ] Hitesh Shah commented on YARN-759: -- Very minor comments. Looks good overall. typo in

[jira] [Created] (YARN-778) Failures in container launches due to issues like disk failure are difficult to diagnose

2013-06-06 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-778: Summary: Failures in container launches due to issues like disk failure are difficult to diagnose Key: YARN-778 URL: https://issues.apache.org/jira/browse/YARN-778 Project:

[jira] [Commented] (YARN-778) Failures in container launches due to issues like disk failure are difficult to diagnose

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677634#comment-13677634 ] Hitesh Shah commented on YARN-778: -- There were no container logs in the above scenario. The

[jira] [Commented] (YARN-759) Create Command enum in AllocateResponse

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677649#comment-13677649 ] Hitesh Shah commented on YARN-759: -- Looks good. +1. Create Command enum

[jira] [Moved] (YARN-813) Document and likewise implement relevant checks/escape functions for what form of input is acceptable for setting up a container launch context i.e. special chars in resource

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah moved MAPREDUCE-3155 to YARN-813: - Tags: (was: mr2,mapreduce-2.0) Component/s:

[jira] [Updated] (YARN-522) [Umbrella] Better reporting for crashed/Killed AMs and Containers

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-522: - Summary: [Umbrella] Better reporting for crashed/Killed AMs and Containers (was: [Umbrella] Better

[jira] [Created] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

2013-06-13 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-814: Summary: Difficult to diagnose a failed container launch when error due to invalid environment variable Key: YARN-814 URL: https://issues.apache.org/jira/browse/YARN-814

[jira] [Updated] (YARN-522) [Umbrella] Better reporting for crashed/Killed AMs/Containers

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-522: - Summary: [Umbrella] Better reporting for crashed/Killed AMs/Containers (was: [Umbrella] Better reporting

[jira] [Commented] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682980#comment-13682980 ] Hitesh Shah commented on YARN-812: -- +1. Explanation seems fine to me.

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684539#comment-13684539 ] Hitesh Shah commented on YARN-727: -- @Xuan, shouldn't the absence of application type ( i.e.

[jira] [Commented] (YARN-387) Fix inconsistent protocol naming

2013-06-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684881#comment-13684881 ] Hitesh Shah commented on YARN-387: -- @Vinod, maybe ContainerManagementProtocol and

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684887#comment-13684887 ] Hitesh Shah commented on YARN-791: -- [~sandyr] I put in a similar comment on YARN-727. In my

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13685651#comment-13685651 ] Hitesh Shah commented on YARN-727: -- Comments: - Usage/helper documentation for

[jira] [Commented] (YARN-841) Annotate and document AuxService APIs

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686048#comment-13686048 ] Hitesh Shah commented on YARN-841: -- [~vinodkv] any chance of also documenting service data

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686106#comment-13686106 ] Hitesh Shah commented on YARN-727: -- @Xuan, why should calling -help return an exit code of

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686110#comment-13686110 ] Hitesh Shah commented on YARN-727: -- More comments: - Any reason why we are using

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686123#comment-13686123 ] Hitesh Shah commented on YARN-727: -- That seems wrong. Either treat the input as invalid and

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686125#comment-13686125 ] Hitesh Shah commented on YARN-727: -- @Xuan, given that above, are you suggesting changing

[jira] [Commented] (YARN-841) Annotate and document AuxService APIs

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686256#comment-13686256 ] Hitesh Shah commented on YARN-841: -- Definitely more helpful to application developers now.

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686287#comment-13686287 ] Hitesh Shah commented on YARN-791: -- More thoughts from YARN-727, how about supporting a set

[jira] [Created] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-848: Summary: Nodemanager does not register with RM using the fully qualified hostname Key: YARN-848 URL: https://issues.apache.org/jira/browse/YARN-848 Project: Hadoop YARN

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Description: If the hostname is misconfigured to not be fully qualified ( i.e. hostname returns foo and

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Description: If the hostname is misconfigured to not be fully qualified ( i.e. hostname returns foo and

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Attachment: YARN-848.1.patch Nodemanager does not register with RM using the fully qualified hostname

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Attachment: YARN-848.2.patch Rebased against YARN-694. Nodemanager does not register

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Attachment: YARN-848.3.patch Correct patch rebased on YARN-649 Nodemanager does not

[jira] [Updated] (YARN-848) Nodemanager does not register with RM using the fully qualified hostname

2013-06-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-848: - Attachment: (was: YARN-848.2.patch) Nodemanager does not register with RM using the fully

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688446#comment-13688446 ] Hitesh Shah commented on YARN-727: -- Comments: ResourceMgrDelegate.java: - In

[jira] [Created] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

2013-06-19 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-857: Summary: Errors when localizing end up with the localization failure not being seen by the NM Key: YARN-857 URL: https://issues.apache.org/jira/browse/YARN-857 Project:

[jira] [Updated] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

2013-06-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-857: - Description: at

[jira] [Assigned] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

2013-06-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned YARN-857: Assignee: Hitesh Shah Errors when localizing end up with the localization failure not being

[jira] [Updated] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

2013-06-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-857: - Attachment: YARN-857.1.patch Unfortunately could not come up with a unit test which tests that exact bit

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689322#comment-13689322 ] Hitesh Shah commented on YARN-727: -- @Xuan, the webservices aspects can be handled in a

[jira] [Moved] (YARN-865) RM webservices can't query on application Types

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah moved MAPREDUCE-5337 to YARN-865: - Key: YARN-865 (was: MAPREDUCE-5337) Project: Hadoop YARN (was:

[jira] [Commented] (YARN-861) TestContainerManager is failing

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689568#comment-13689568 ] Hitesh Shah commented on YARN-861: -- +1. Committing shortly.

[jira] [Commented] (YARN-861) TestContainerManager is failing

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689609#comment-13689609 ] Hitesh Shah commented on YARN-861: -- Thanks Vinod. TestContainerManager is

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689645#comment-13689645 ] Hitesh Shah commented on YARN-727: -- Comments: ResourceMgrDelegate.java: - SetString

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689849#comment-13689849 ] Hitesh Shah commented on YARN-791: -- [~sandyr], [~tucu00], [~vinodkv] - sorry for the late

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689852#comment-13689852 ] Hitesh Shah commented on YARN-791: -- Looks like the {noformat}*{noformat} converted text to

[jira] [Created] (YARN-867) Isolation of failures in aux services

2013-06-20 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-867: Summary: Isolation of failures in aux services Key: YARN-867 URL: https://issues.apache.org/jira/browse/YARN-867 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2013-06-20 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-868: Summary: YarnClient should set the service address in tokens returned by getRMDelegationToken() Key: YARN-868 URL: https://issues.apache.org/jira/browse/YARN-868 Project:

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689994#comment-13689994 ] Hitesh Shah commented on YARN-727: -- [~xgong] Thanks for being patient with the reviews.

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-06-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689995#comment-13689995 ] Hitesh Shah commented on YARN-727: -- To clarify on my previous comment, we need @vinodkv to

[jira] [Commented] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

2013-06-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696174#comment-13696174 ] Hitesh Shah commented on YARN-814: -- A quick minor comment ( for now ): LOG.error(Exit code

[jira] [Commented] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

2013-07-01 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697240#comment-13697240 ] Hitesh Shah commented on YARN-814: -- Comments: Why is shExec.getOutput() being ignored (

[jira] [Commented] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

2013-07-01 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697377#comment-13697377 ] Hitesh Shah commented on YARN-814: -- There is no guarantee that shExec.getOutput() will

[jira] [Created] (YARN-900) YarnClientApplication uses composition to hold GetNewApplicationResponse instead of having a simpler flattened structure

2013-07-03 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-900: Summary: YarnClientApplication uses composition to hold GetNewApplicationResponse instead of having a simpler flattened structure Key: YARN-900 URL:

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702543#comment-13702543 ] Hitesh Shah commented on YARN-727: -- - Use MRJobConfig.MR_APPLICATION_TYPE instead of

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703383#comment-13703383 ] Hitesh Shah commented on YARN-727: -- {code} - * pThe interface used by clients to get a

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703640#comment-13703640 ] Hitesh Shah commented on YARN-727: -- {code} +return getApplications(new

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703857#comment-13703857 ] Hitesh Shah commented on YARN-727: -- [~xgong] Thanks for the patience. Looks good. Will wait

[jira] [Updated] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-909: - Assignee: Chuan Liu (was: Hitesh Shah) Disable TestLinuxContainerExecutorWithMocks on Windows

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703971#comment-13703971 ] Hitesh Shah commented on YARN-727: -- Thanks [~xgong]

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-10 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13705477#comment-13705477 ] Hitesh Shah commented on YARN-865: -- [~xgong] why is the following done for each rm app (

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706251#comment-13706251 ] Hitesh Shah commented on YARN-865: -- [~xgong] Documentation is still not clear. How are

[jira] [Reopened] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reopened YARN-541: -- [~ojoshi] [~write2kishore] I think [~bikassaha] discovered a race condition in the AMRMClient that may be

[jira] [Commented] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706601#comment-13706601 ] Hitesh Shah commented on YARN-541: -- [~write2kishore] if you plan to re-run this to get new

[jira] [Commented] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706602#comment-13706602 ] Hitesh Shah commented on YARN-541: -- Likewise have the AM also run with the debug log level

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706645#comment-13706645 ] Hitesh Shah commented on YARN-321: -- {quote} To start with, we will have an implementation

[jira] [Commented] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706650#comment-13706650 ] Hitesh Shah commented on YARN-541: -- export HADOOP_ROOT_LOGGER=DEBUG,RFA export

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706982#comment-13706982 ] Hitesh Shah commented on YARN-865: -- Given that the /nodes api has used comma-separated ( as

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707175#comment-13707175 ] Hitesh Shah commented on YARN-865: -- [~xgong] We can do both - map QueryParam appTypes to a

[jira] [Updated] (YARN-865) RM webservices can't query based on application Types

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-865: - Summary: RM webservices can't query based on application Types (was: RM webservices can't query on

[jira] [Commented] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707328#comment-13707328 ] Hitesh Shah commented on YARN-541: -- +1. Looks fine. We should ideally look at creating a

[jira] [Updated] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-541: - Target Version/s: 2.1.0-beta getAllocatedContainers() is not returning all the allocated containers

[jira] [Updated] (YARN-541) getAllocatedContainers() is not returning all the allocated containers

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-541: - Priority: Blocker (was: Major) getAllocatedContainers() is not returning all the allocated

[jira] [Commented] (YARN-919) Setting default heap sizes in yarn env

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707399#comment-13707399 ] Hitesh Shah commented on YARN-919: -- [~mayank_bansal] Is this just a question of adding

[jira] [Commented] (YARN-865) RM webservices can't query based on application Types

2013-07-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707548#comment-13707548 ] Hitesh Shah commented on YARN-865: -- {code} if (!applicationTypes.isEmpty()

[jira] [Commented] (YARN-919) Setting default heap sizes in yarn env

2013-07-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709088#comment-13709088 ] Hitesh Shah commented on YARN-919: -- [~mayank_bansal] Yes, that sounds good. Something

[jira] [Created] (YARN-931) Overlapping classes across hadoop-yarn-api and hadoop-yarn-common

2013-07-16 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-931: Summary: Overlapping classes across hadoop-yarn-api and hadoop-yarn-common Key: YARN-931 URL: https://issues.apache.org/jira/browse/YARN-931 Project: Hadoop YARN

[jira] [Commented] (YARN-919) Setting default heap sizes in yarn env

2013-07-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710315#comment-13710315 ] Hitesh Shah commented on YARN-919: -- [~mayank_bansal] I was actually recommending replacing

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710449#comment-13710449 ] Hitesh Shah commented on YARN-927: -- +1. Change ContainerRequest to not

[jira] [Commented] (YARN-865) RM webservices can't query based on application Types

2013-07-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711659#comment-13711659 ] Hitesh Shah commented on YARN-865: -- +1. Looks fine to me. Will commit shortly.

[jira] [Commented] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-07-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13712507#comment-13712507 ] Hitesh Shah commented on YARN-873: -- [~xgong] Requiring to parse a string message to

[jira] [Commented] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-07-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13712994#comment-13712994 ] Hitesh Shah commented on YARN-873: -- [~xgong] When you say different errors, are you

[jira] [Updated] (YARN-919) Setting default heap sizes in yarn env

2013-07-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-919: - Attachment: YARN.919.4.patch [~mayank_bansal] Thanks for addressing the review comments. Looking at

[jira] [Updated] (YARN-919) Document setting default heap sizes in yarn env

2013-07-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-919: - Summary: Document setting default heap sizes in yarn env (was: Setting default heap sizes in yarn env)

[jira] [Commented] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-07-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13714224#comment-13714224 ] Hitesh Shah commented on YARN-873: -- I dont think it is that trivial to set -1/-2/-3 ...

[jira] [Commented] (YARN-945) AM register failing after AMRMToken

2013-07-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13714266#comment-13714266 ] Hitesh Shah commented on YARN-945: -- am log has: {code} 2013-07-19 17:26:28,837 DEBUG

[jira] [Commented] (YARN-944) App failed with container launch failed even though container started

2013-07-23 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13717481#comment-13717481 ] Hitesh Shah commented on YARN-944: -- There are 2 different issues being reported in this

[jira] [Commented] (YARN-389) Infinitely assigning containers when the required resource exceeds the cluster's absolute capacity

2013-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13718673#comment-13718673 ] Hitesh Shah commented on YARN-389: -- The static limit is there for a reason. No application

[jira] [Commented] (YARN-948) CapacityScheduler should validate the release container list before actually releasing them

2013-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13718770#comment-13718770 ] Hitesh Shah commented on YARN-948: -- +1 to [~tucu00]'s comment on this check being done in

[jira] [Created] (YARN-971) hadoop-yarn-api pom does not define a dependencies tag

2013-07-24 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-971: Summary: hadoop-yarn-api pom does not define a dependencies tag Key: YARN-971 URL: https://issues.apache.org/jira/browse/YARN-971 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-971) hadoop-yarn-api pom does not define a dependencies tag

2013-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13719801#comment-13719801 ] Hitesh Shah commented on YARN-971: -- [~yuzhih...@gmail.com] I believe yarn-api has code that

[jira] [Commented] (YARN-988) RM /proxy/app always gives HTML response

2013-07-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723170#comment-13723170 ] Hitesh Shah commented on YARN-988: -- [~srimanth.gunturi] The tracker url is served by the

[jira] [Commented] (YARN-988) RM /proxy/app always gives HTML response

2013-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724403#comment-13724403 ] Hitesh Shah commented on YARN-988: -- The AM is only up while the job is running. Once the

[jira] [Commented] (YARN-989) MR2 specific metrics should be collected

2013-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724437#comment-13724437 ] Hitesh Shah commented on YARN-989: -- What is the use-case that you are trying to solve that

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725299#comment-13725299 ] Hitesh Shah commented on YARN-1004: --- Is there a reason why maximum-allocation is also

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725517#comment-13725517 ] Hitesh Shah commented on YARN-1004: --- [~sandyr] Scheduler-specific configs are fine as

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725556#comment-13725556 ] Hitesh Shah commented on YARN-1004: --- [~vinodkv] min allocation is no longer visible to an

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-08-02 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13727391#comment-13727391 ] Hitesh Shah commented on YARN-353: -- [~jianhe] Could you please look at the findbug warnings

[jira] [Commented] (YARN-1020) Resource Localization using Groups as a new Localization Type

2013-08-02 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728074#comment-13728074 ] Hitesh Shah commented on YARN-1020: --- [~ojoshi] Could you explain how a container can

[jira] [Created] (YARN-1037) Create a helper function to create a local resource object given a path to file

2013-08-06 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-1037: - Summary: Create a helper function to create a local resource object given a path to file Key: YARN-1037 URL: https://issues.apache.org/jira/browse/YARN-1037 Project:

  1   2   3   4   5   6   >