[jira] [Updated] (YARN-723) Yarn default value of physical cpu cores to virtual core is 2

2013-05-23 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-723: Affects Version/s: 2.0.4-alpha Yarn default value of physical cpu cores to virtual core is 2

[jira] [Commented] (YARN-392) Make it possible to specify hard locality constraints in resource requests

2013-05-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13668677#comment-13668677 ] Bikas Saha commented on YARN-392: - Sorry got caught up with other stuff. I was waiting for

[jira] [Updated] (YARN-660) Improve AMRMClient with matching requests

2013-05-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-660: Attachment: YARN-660.6.patch Minor update to add a setHeartbeatInterval method to the async client. This

[jira] [Moved] (YARN-744) Locking not correct in org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.allocate(AllocateRequest request)

2013-05-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha moved MAPREDUCE-3899 to YARN-744: Component/s: (was: resourcemanager)

[jira] [Created] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2013-06-01 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-745: --- Summary: Move UnmanagedAMLauncher to yarn client package Key: YARN-745 URL: https://issues.apache.org/jira/browse/YARN-745 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-747) Improve CapacityScheduler to support allocation to specific locations

2013-06-01 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-747: --- Summary: Improve CapacityScheduler to support allocation to specific locations Key: YARN-747 URL: https://issues.apache.org/jira/browse/YARN-747 Project: Hadoop YARN

[jira] [Commented] (YARN-635) Rename YarnRemoteException to YarnException

2013-06-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672169#comment-13672169 ] Bikas Saha commented on YARN-635: - +1 for changing YARNException to YARNRuntimeException.

[jira] [Commented] (YARN-398) Enhance CS to allow for white-list of resources

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673384#comment-13673384 ] Bikas Saha commented on YARN-398: - +1. Looks good overall. Enhance CS to

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673496#comment-13673496 ] Bikas Saha commented on YARN-750: - Probably dont need the iterator {code} + private void

[jira] [Commented] (YARN-752) Throw exception if AMRMClient.ContainerRequest is given invalid locations

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673512#comment-13673512 ] Bikas Saha commented on YARN-752: - I was going to open a jira for the second option

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673733#comment-13673733 ] Bikas Saha commented on YARN-750: - Dont we need to clear the local cache of the list also?

[jira] [Created] (YARN-755) Rename AllocateResponse.reboot to AllocateResponse.resync

2013-06-03 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-755: --- Summary: Rename AllocateResponse.reboot to AllocateResponse.resync Key: YARN-755 URL: https://issues.apache.org/jira/browse/YARN-755 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-755) Rename AllocateResponse.reboot to AllocateResponse.resync

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-755: Affects Version/s: 2.1.0-beta Rename AllocateResponse.reboot to AllocateResponse.resync

[jira] [Updated] (YARN-755) Rename AllocateResponse.reboot to AllocateResponse.resync

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-755: Attachment: YARN-755.1.patch Refactor using Eclipse. Changed the proto field also. Rename

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673836#comment-13673836 ] Bikas Saha commented on YARN-750: - The javadoc on the 2 exceptions are still mixed with each

[jira] [Created] (YARN-757) TestRMRestart failing/stuck on trunk

2013-06-03 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-757: --- Summary: TestRMRestart failing/stuck on trunk Key: YARN-757 URL: https://issues.apache.org/jira/browse/YARN-757 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673921#comment-13673921 ] Bikas Saha commented on YARN-750: - Need a jira for Fifo scheduler. Thanks Sandy for the Fair

[jira] [Resolved] (YARN-185) Add preemption to CS

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-185. - Resolution: Duplicate Duplicated and patch available on YARN-569 Add preemption to CS

[jira] [Created] (YARN-759) Create Command enum in AllocateResponse

2013-06-03 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-759: --- Summary: Create Command enum in AllocateResponse Key: YARN-759 URL: https://issues.apache.org/jira/browse/YARN-759 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-755) Rename AllocateResponse.reboot to AllocateResponse.resync

2013-06-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13674078#comment-13674078 ] Bikas Saha commented on YARN-755: - TestNMClientAsync does not look related to this patch.

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13674582#comment-13674582 ] Bikas Saha commented on YARN-750: - +1. Looks good overall. Need a jira for FIFO scheduler

[jira] [Created] (YARN-763) AMRMClientAsync should stop heartbeating after receiving shutdown from RM

2013-06-04 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-763: --- Summary: AMRMClientAsync should stop heartbeating after receiving shutdown from RM Key: YARN-763 URL: https://issues.apache.org/jira/browse/YARN-763 Project: Hadoop YARN

[jira] [Updated] (YARN-759) Create Command enum in AllocateResponse

2013-06-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-759: Assignee: Bikas Saha Create Command enum in AllocateResponse ---

[jira] [Updated] (YARN-759) Create Command enum in AllocateResponse

2013-06-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-759: Attachment: YARN-759.1.patch Also renames the callback in AMRMClientAsync appropriately.

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677247#comment-13677247 ] Bikas Saha commented on YARN-689: - bq. the MRAppMaster obtains the MIN/MAX values from the

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677287#comment-13677287 ] Bikas Saha commented on YARN-752: - First of all I think I made a mistake in putting

[jira] [Updated] (YARN-759) Create Command enum in AllocateResponse

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-759: Attachment: YARN-759.2.patch Minor change in API to return List instead of specific ImmutableList.

[jira] [Commented] (YARN-750) Allow for black-listing resources in CS

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677358#comment-13677358 ] Bikas Saha commented on YARN-750: - There were some extra diff artifacts in the patch that I

[jira] [Created] (YARN-771) AMRMClient support for resource blacklisting

2013-06-06 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-771: --- Summary: AMRMClient support for resource blacklisting Key: YARN-771 URL: https://issues.apache.org/jira/browse/YARN-771 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-750) Allow for black-listing resources in YARN API and Impl in CS

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-750: Summary: Allow for black-listing resources in YARN API and Impl in CS (was: Allow for black-listing

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677373#comment-13677373 ] Bikas Saha commented on YARN-752: - bq. Wrapping the test in a MiniYARNCluster and other

[jira] [Resolved] (YARN-750) Allow for black-listing resources in YARN API and Impl in CS

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-750. - Resolution: Fixed Fix Version/s: 2.1.0-beta Allow for black-listing resources in YARN API and

[jira] [Commented] (YARN-750) Allow for black-listing resources in YARN API and Impl in CS

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677452#comment-13677452 ] Bikas Saha commented on YARN-750: - Committed to trunk, branch-2 and branch-2.1-beta

[jira] [Created] (YARN-774) Review CapacityScheduler limit/headroom calculations after whitelisting and blacklisting changes

2013-06-06 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-774: --- Summary: Review CapacityScheduler limit/headroom calculations after whitelisting and blacklisting changes Key: YARN-774 URL: https://issues.apache.org/jira/browse/YARN-774

[jira] [Commented] (YARN-761) TestNMClientAsync fails sometimes

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677484#comment-13677484 ] Bikas Saha commented on YARN-761: - +1. Looks good. Committing this as its causing noise in

[jira] [Updated] (YARN-759) Create Command enum in AllocateResponse

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-759: Attachment: YARN-759.3.patch Create Command enum in AllocateResponse

[jira] [Updated] (YARN-759) Create Command enum in AllocateResponse

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-759: Affects Version/s: 2.1.0-beta Create Command enum in AllocateResponse

[jira] [Commented] (YARN-737) Some Exceptions no longer need to be wrapped by YarnException and can be directly thrown out after YARN-142

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677710#comment-13677710 ] Bikas Saha commented on YARN-737: - Redundant code in the first line? {code} + tokenId =

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678273#comment-13678273 ] Bikas Saha commented on YARN-752: - YARN's default and most efficient scheduling behavior

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678275#comment-13678275 ] Bikas Saha commented on YARN-752: - The patch looks good to me as is. Need to do a final

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678405#comment-13678405 ] Bikas Saha commented on YARN-752: - User cannot provide a wrong rack for a node. User can

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678470#comment-13678470 ] Bikas Saha commented on YARN-752: - The user needs to only specify a node (and may end up

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678472#comment-13678472 ] Bikas Saha commented on YARN-752: - Would be great if the next patch added documentation

[jira] [Created] (YARN-790) Use ApplicationSubmissionContext to send tokens instead of file

2013-06-07 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-790: --- Summary: Use ApplicationSubmissionContext to send tokens instead of file Key: YARN-790 URL: https://issues.apache.org/jira/browse/YARN-790 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-785) Every startContainer request send a set of information (auxiliary service related information) which is redundant. Can be replaced with single NodeManager API.

2013-06-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678876#comment-13678876 ] Bikas Saha commented on YARN-785: - How is the NMToken going to be obtained by the AM unless

[jira] [Commented] (YARN-794) YarnClientImpl.submitApplication() to add a timeout

2013-06-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13679206#comment-13679206 ] Bikas Saha commented on YARN-794: - The client will not spin indefinitely (or at least be

[jira] [Updated] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-752: Attachment: YARN-752.3.patch In AMRMClient, automatically add corresponding rack requests for requested

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13679235#comment-13679235 ] Bikas Saha commented on YARN-752: - Its not 100% clear what the API should be on the

[jira] [Updated] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-752: Attachment: YARN-752.4.patch In AMRMClient, automatically add corresponding rack requests for requested

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-10 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13680176#comment-13680176 ] Bikas Saha commented on YARN-569: - Sorry for the delayed response. This doesnt seem to

[jira] [Commented] (YARN-369) Handle ( or throw a proper error when receiving) status updates from application masters that have not registered

2013-06-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13681385#comment-13681385 ] Bikas Saha commented on YARN-369: - Typo {code} + // increment the response id to

[jira] [Commented] (YARN-789) Enable zero capabilities resource requests in fair scheduler

2013-06-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682424#comment-13682424 ] Bikas Saha commented on YARN-789: - Do the resource calculator changes need to be considered

[jira] [Created] (YARN-808) ApplicationReport does not clearly tell that the attempt is running or not

2013-06-13 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-808: --- Summary: ApplicationReport does not clearly tell that the attempt is running or not Key: YARN-808 URL: https://issues.apache.org/jira/browse/YARN-808 Project: Hadoop YARN

[jira] [Created] (YARN-820) NodeManager has invalid state transition after error in resource localization

2013-06-14 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-820: --- Summary: NodeManager has invalid state transition after error in resource localization Key: YARN-820 URL: https://issues.apache.org/jira/browse/YARN-820 Project: Hadoop YARN

[jira] [Updated] (YARN-820) NodeManager has invalid state transition after error in resource localization

2013-06-14 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-820: Attachment: yarn-user-nodemanager-localhost.localdomain.log Attaching NM log. NodeManager

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-14 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683817#comment-13683817 ] Bikas Saha commented on YARN-752: - Probably just refer to the javadoc for

[jira] [Commented] (YARN-779) AMRMClient should clean up dangling unsatisfied request

2013-06-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684548#comment-13684548 ] Bikas Saha commented on YARN-779: - That API is AMRMClient.removeContainerRequest().

[jira] [Created] (YARN-827) Need to make Resource arithmetic methods public

2013-06-16 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-827: --- Summary: Need to make Resource arithmetic methods public Key: YARN-827 URL: https://issues.apache.org/jira/browse/YARN-827 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-827) Need to make Resource arithmetic methods public

2013-06-16 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-827: Assignee: Zhijie Shen Need to make Resource arithmetic methods public

[jira] [Commented] (YARN-787) Remove resource min from Yarn client API

2013-06-16 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684827#comment-13684827 ] Bikas Saha commented on YARN-787: - This also need to be removed from yarn-common. {code}

[jira] [Created] (YARN-832) Update Resource javadoc to clarify units for memory

2013-06-16 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-832: --- Summary: Update Resource javadoc to clarify units for memory Key: YARN-832 URL: https://issues.apache.org/jira/browse/YARN-832 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-787) Remove resource min from Yarn client API

2013-06-16 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684958#comment-13684958 ] Bikas Saha commented on YARN-787: - My bad. Eclipse refresh got messed up.

[jira] [Created] (YARN-838) Give apps an idea of totalAppResource

2013-06-16 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-838: --- Summary: Give apps an idea of totalAppResource Key: YARN-838 URL: https://issues.apache.org/jira/browse/YARN-838 Project: Hadoop YARN Issue Type: Sub-task Affects

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686136#comment-13686136 ] Bikas Saha commented on YARN-569: - bq. so we would prefer to have the mechanism to remain

[jira] [Created] (YARN-847) Fix loss of size information in capacity scheduler

2013-06-17 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-847: --- Summary: Fix loss of size information in capacity scheduler Key: YARN-847 URL: https://issues.apache.org/jira/browse/YARN-847 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-369) Handle ( or throw a proper error when receiving) status updates from application masters that have not registered

2013-06-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13686410#comment-13686410 ] Bikas Saha commented on YARN-369: - We should probably set the value to 0 instead of

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13687052#comment-13687052 ] Bikas Saha commented on YARN-569: - The correct place for the configs would depend on which

[jira] [Commented] (YARN-850) Rename AMRMClient#getClusterAvailableResources, AMRMClientAsync#getClusterAvailableResources to getAvailableResources

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13687174#comment-13687174 ] Bikas Saha commented on YARN-850: - Will commit when tests pass. Rename

[jira] [Commented] (YARN-850) Rename AMRMClient#getClusterAvailableResources, AMRMClientAsync#getClusterAvailableResources to getAvailableResources

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13687172#comment-13687172 ] Bikas Saha commented on YARN-850: - Thanks Jian. This matches the method name with the method

[jira] [Updated] (YARN-850) Rename AMRMClient#getClusterAvailableResources, AMRMClientAsync#getClusterAvailableResources to getAvailableResources

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-850: Affects Version/s: 2.1.0-beta Rename AMRMClient#getClusterAvailableResources,

[jira] [Updated] (YARN-850) Rename getClusterAvailableResources to getAvailableResources in AMRMClients

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-850: Summary: Rename getClusterAvailableResources to getAvailableResources in AMRMClients (was: Rename

[jira] [Updated] (YARN-850) Rename AMRMClient*#getClusterAvailableResources to getAvailableResources

2013-06-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-850: Summary: Rename AMRMClient*#getClusterAvailableResources to getAvailableResources (was: Rename

[jira] [Commented] (YARN-851) Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.

2013-06-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688200#comment-13688200 ] Bikas Saha commented on YARN-851: - If an interface method is not going to be used then we

[jira] [Commented] (YARN-851) Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.

2013-06-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688199#comment-13688199 ] Bikas Saha commented on YARN-851: - This loop changes doesnt quite look the same as earlier.

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688233#comment-13688233 ] Bikas Saha commented on YARN-569: - bq. You're saying the block updating the responseMap

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688237#comment-13688237 ] Bikas Saha commented on YARN-569: - Since configuring this involves more than 1 config file,

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13688272#comment-13688272 ] Bikas Saha commented on YARN-569: - One other thing to check would be if the preemption

[jira] [Updated] (YARN-860) JobHistory UI shows -ve times for reducer

2013-06-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-860: Attachment: MR.png JobHistory UI shows -ve times for reducer -

[jira] [Created] (YARN-863) Crash in YARNRunner because of NULL dagClient

2013-06-20 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-863: --- Summary: Crash in YARNRunner because of NULL dagClient Key: YARN-863 URL: https://issues.apache.org/jira/browse/YARN-863 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods public

2013-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690533#comment-13690533 ] Bikas Saha commented on YARN-827: - +1. Straightforward refactor. Need to

[jira] [Updated] (YARN-827) Need to make Resource arithmetic methods accessible

2013-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-827: Summary: Need to make Resource arithmetic methods accessible (was: Need to make Resource arithmetic methods

[jira] [Updated] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns an empty application report

2013-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-873: Affects Version/s: 2.1.0-beta YARNClient.getApplicationReport(unknownAppId) returns an empty

[jira] [Created] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns an empty application report

2013-06-21 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-873: --- Summary: YARNClient.getApplicationReport(unknownAppId) returns an empty application report Key: YARN-873 URL: https://issues.apache.org/jira/browse/YARN-873 Project: Hadoop

[jira] [Updated] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-873: Summary: YARNClient.getApplicationReport(unknownAppId) returns a null report (was:

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

2013-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690926#comment-13690926 ] Bikas Saha commented on YARN-827: - Thanks! Need to make Resource

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691072#comment-13691072 ] Bikas Saha commented on YARN-569: - Changes look good overall. Didnt look deeply at the

[jira] [Updated] (YARN-827) Need to make Resource arithmetic methods accessible

2013-06-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-827: Attachment: YARN-827.MiniYARNFix.patch Committing minor fix in config file that was missed in the original

[jira] [Updated] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-06-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-873: Assignee: Xuan Gong YARNClient.getApplicationReport(unknownAppId) returns a null report

[jira] [Updated] (YARN-654) AMRMClient: Perform sanity checks for parameters of public methods

2013-06-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-654: Assignee: Xuan Gong AMRMClient: Perform sanity checks for parameters of public methods

[jira] [Updated] (YARN-763) AMRMClientAsync should stop heartbeating after receiving shutdown from RM

2013-06-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-763: Assignee: Xuan Gong AMRMClientAsync should stop heartbeating after receiving shutdown from RM

[jira] [Created] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-06-23 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-875: --- Summary: Application can hang if AMRMClientAsync callback thread has exception Key: YARN-875 URL: https://issues.apache.org/jira/browse/YARN-875 Project: Hadoop YARN

[jira] [Updated] (YARN-876) Node resource is added twice when node comes back from unhealthy to healthy

2013-06-23 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-876: Assignee: PengZhang Node resource is added twice when node comes back from unhealthy to healthy

[jira] [Commented] (YARN-610) ClientToken (ClientToAMToken) should not be set in the environment

2013-06-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696367#comment-13696367 ] Bikas Saha commented on YARN-610: - Since its a secret key. It should probably have been

[jira] [Commented] (YARN-610) ClientToken (ClientToAMToken) should not be set in the environment

2013-06-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696369#comment-13696369 ] Bikas Saha commented on YARN-610: - Looks like its called ClientToAMTokenMasterKey.

[jira] [Created] (YARN-891) Store completed application information in

2013-06-30 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-891: --- Summary: Store completed application information in Key: YARN-891 URL: https://issues.apache.org/jira/browse/YARN-891 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-891) Store completed application information in RM state store

2013-06-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-891: Description: Add information like exit status etc for the completed attempt. Store completed

[jira] [Commented] (YARN-891) Store completed application information in RM state store

2013-06-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696434#comment-13696434 ] Bikas Saha commented on YARN-891: - This was not required when RM restart work started since

[jira] [Commented] (YARN-430) Add HDFS based store for RM which manages the store using directories

2013-06-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696436#comment-13696436 ] Bikas Saha commented on YARN-430: - We should probably change the FileSystem store to use

[jira] [Updated] (YARN-556) RM Restart phase 2 - Work preserving restart

2013-07-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-556: Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-128) RM Restart phase 2 - Work

[jira] [Commented] (YARN-149) ResourceManager (RM) High-Availability (HA)

2013-07-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697005#comment-13697005 ] Bikas Saha commented on YARN-149: - I will be posting a short design/road-map document

  1   2   3   4   5   6   7   8   9   10   >