[jira] [Commented] (YARN-1474) Make schedulers services

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994837#comment-13994837 ] Karthik Kambatla commented on YARN-1474: # Correct me if I am wrong, but changes to

[jira] [Resolved] (YARN-2044) thrift interface for YARN?

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-2044. --- Resolution: Not a Problem We have protocol buffer based interfaces that you

[jira] [Commented] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994865#comment-13994865 ] Vinod Kumar Vavilapalli commented on YARN-1515: --- bq. Vinod Kumar Vavilapalli,

[jira] [Updated] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1515: -- Issue Type: Sub-task (was: New Feature) Parent: YARN-445 Ability to

[jira] [Commented] (YARN-445) Ability to signal containers

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994878#comment-13994878 ] Vinod Kumar Vavilapalli commented on YARN-445: -- Folks, I just made YARN-1515 a

[jira] [Updated] (YARN-2017) Merge some of the common lib code in schedulers

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2017: -- Summary: Merge some of the common lib code in schedulers (was: Merge common

[jira] [Commented] (YARN-1803) Signal container support in nodemanager

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994879#comment-13994879 ] Vinod Kumar Vavilapalli commented on YARN-1803: --- Tx for working on this Ming.

[jira] [Assigned] (YARN-1368) Common work to re-populateĀ containersā€™ state into scheduler

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-1368: - Assignee: Jian He (was: Anubhav Dhoot) Assigning to Jian as he started

[jira] [Assigned] (YARN-1366) ApplicationMasterService should Resync with the AM upon allocate call after restart

2014-05-12 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-1366: Assignee: Rohith ApplicationMasterService should Resync with the AM upon allocate call after restart

[jira] [Commented] (YARN-1366) ApplicationMasterService should Resync with the AM upon allocate call after restart

2014-05-12 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994920#comment-13994920 ] Rohith commented on YARN-1366: -- Thank you for offering! It was just wait to finsih prototype

[jira] [Assigned] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-05-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-796: --- Assignee: Wangda Tan (was: Arun C Murthy) Working on this JIRA, assigned it to myself. And will post

[jira] [Commented] (YARN-1366) ApplicationMasterService should Resync with the AM upon allocate call after restart

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994891#comment-13994891 ] Vinod Kumar Vavilapalli commented on YARN-1366: --- [~rohithsharma], are you

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994893#comment-13994893 ] Vinod Kumar Vavilapalli commented on YARN-556: -- Also, if there is a general

[jira] [Assigned] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-05-12 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned YARN-2026: Assignee: Ashwin Shankar Fair scheduler : Fair share for inactive queues causes unfair

[jira] [Updated] (YARN-1989) Adding shell scripts to launch multiple servers on localhost

2014-05-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-1989: --- Attachment: YARN-1989-0.patch attaching patch. local-resourcemanagers-ha.sh starts multiple

[jira] [Commented] (YARN-1986) After upgrade from 2.2.0 to 2.4.0, NPE on first job start.

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992950#comment-13992950 ] Tsuyoshi OZAWA commented on YARN-1986: -- +1(non-binding). Let's wait for [~sandyr]'s

[jira] [Updated] (YARN-667) Data persisted in RM should be versioned

2014-05-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-667: Summary: Data persisted in RM should be versioned (was: Data persisted by YARN daemons should be versioned)

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994886#comment-13994886 ] Vinod Kumar Vavilapalli commented on YARN-556: -- Tx for the community update,

[jira] [Created] (YARN-2045) Data persisted in NM should be versioned

2014-05-12 Thread Junping Du (JIRA)
Junping Du created YARN-2045: Summary: Data persisted in NM should be versioned Key: YARN-2045 URL: https://issues.apache.org/jira/browse/YARN-2045 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-667) Data persisted in RM should be versioned

2014-05-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994984#comment-13994984 ] Junping Du commented on YARN-667: - Filed YARN-2045 to address NM part data. Data persisted

[jira] [Commented] (YARN-182) Unnecessary Container killed by the ApplicationMaster message for successful containers

2014-05-12 Thread Deepak Kumar V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994967#comment-13994967 ] Deepak Kumar V commented on YARN-182: - Hello, I am seeing this in Note section of each

[jira] [Commented] (YARN-667) Data persisted in RM should be versioned

2014-05-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994975#comment-13994975 ] Junping Du commented on YARN-667: - Limit the scope of this JIRA to persistent data in RM -

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-05-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994957#comment-13994957 ] Carlo Curino commented on YARN-2022: Sunil, I am travelling abroad till 26th (please

[jira] [Commented] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994877#comment-13994877 ] Vinod Kumar Vavilapalli commented on YARN-1515: --- YARN-445 BTW is today

[jira] [Commented] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994866#comment-13994866 ] Vinod Kumar Vavilapalli commented on YARN-1515: --- We can still implement the

[jira] [Updated] (YARN-2010) RM can't transition to active if it can't recover an app attempt

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-2.patch New patch with following changes - # Noticed that

[jira] [Created] (YARN-2042) String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp()

2014-05-12 Thread Ted Yu (JIRA)
Ted Yu created YARN-2042: Summary: String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp() Key: YARN-2042 URL: https://issues.apache.org/jira/browse/YARN-2042 Project:

[jira] [Updated] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1515: -- Target Version/s: 2.5.0 (was: 2.4.0) Ability to dump the container threads

[jira] [Created] (YARN-2046) Out of band heartbeats are sent only on container kill and possibly too early

2014-05-12 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-2046: Summary: Out of band heartbeats are sent only on container kill and possibly too early Key: YARN-2046 URL: https://issues.apache.org/jira/browse/YARN-2046 Project: Hadoop

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995165#comment-13995165 ] Karthik Kambatla commented on YARN-556: --- Oh. Forgot to mention that. [~adhoot] offered

[jira] [Commented] (YARN-1918) Typo in description and error message for 'yarn.resourcemanager.cluster-id'

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995173#comment-13995173 ] Tsuyoshi OZAWA commented on YARN-1918: -- Thanks for your contribution, [~analog.sony].

[jira] [Commented] (YARN-1701) Improve default paths of timeline store and generic history store

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994348#comment-13994348 ] Hudson commented on YARN-1701: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #560 (See

[jira] [Updated] (YARN-1474) Make schedulers services

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1474: - Attachment: YARN-1474.11.patch Added missing file to pass compile. Make schedulers services

[jira] [Commented] (YARN-2027) YARN ignores host-specific resource requests

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995262#comment-13995262 ] Bikas Saha commented on YARN-2027: -- Was the relaxLocality flag set to false in order to

[jira] [Created] (YARN-2036) Document yarn.resourcemanager.hostname in ClusterSetup

2014-05-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2036: -- Summary: Document yarn.resourcemanager.hostname in ClusterSetup Key: YARN-2036 URL: https://issues.apache.org/jira/browse/YARN-2036 Project: Hadoop YARN

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995290#comment-13995290 ] Anubhav Dhoot commented on YARN-2001: - Won't killing the containers on RM restart/fail

[jira] [Commented] (YARN-2046) Out of band heartbeats are sent only on container kill and possibly too early

2014-05-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995147#comment-13995147 ] Jason Lowe commented on YARN-2046: -- We should consider sending out of band heartbeats

[jira] [Resolved] (YARN-2039) Better reporting of finished containers to AMs

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2039. Resolution: Duplicate Thanks for pointing that out, Bikas. Resolving as duplicate. Better

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

2014-05-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995361#comment-13995361 ] Jian He commented on YARN-2016: --- Adding unit tests for all records would be another big

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995316#comment-13995316 ] Bikas Saha commented on YARN-2001: -- I think the offline discussion agreement was that

[jira] [Commented] (YARN-1982) Rename the daemon name to timelineserver

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995404#comment-13995404 ] Hudson commented on YARN-1982: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-1962) Timeline server is enabled by default

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995407#comment-13995407 ] Hudson commented on YARN-1962: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-2036) Document yarn.resourcemanager.hostname in ClusterSetup

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995405#comment-13995405 ] Hudson commented on YARN-2036: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-1975) Used resources shows escaped html in CapacityScheduler and FairScheduler page

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995408#comment-13995408 ] Hudson commented on YARN-1975: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Updated] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-05-12 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2032: Attachment: YARN-2032-branch-2-1.patch Updating patch for branch-2 Thanks, Mayank Implement a

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995438#comment-13995438 ] Karthik Kambatla commented on YARN-2033: Thanks Vinod. Would like to hear your

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995326#comment-13995326 ] Tsuyoshi OZAWA commented on YARN-2001: -- [~adhoot], you're correct basically. I meant

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995328#comment-13995328 ] Anubhav Dhoot commented on YARN-556: bq. clustertimestamp is added to containerId so

[jira] [Assigned] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-1913: -- Assignee: Karthik Kambatla With Fair Scheduler, cluster can logjam when all resources

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-05-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995354#comment-13995354 ] Jian He commented on YARN-1372: --- An alternative would be to make NM remember the current

[jira] [Commented] (YARN-2042) String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp()

2014-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995485#comment-13995485 ] Hadoop QA commented on YARN-2042: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995213#comment-13995213 ] Tsuyoshi OZAWA commented on YARN-2001: -- [~leftnoteasy] , my idea is creating

[jira] [Commented] (YARN-1969) Fair Scheduler: Add policy for Earliest Deadline First

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995153#comment-13995153 ] Karthik Kambatla commented on YARN-1969: Just stating the obvious: we need to add a

[jira] [Commented] (YARN-2011) Fix typo and warning in TestLeafQueue

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995403#comment-13995403 ] Hudson commented on YARN-2011: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995516#comment-13995516 ] Bikas Saha commented on YARN-1372: -- what happens when they are 100's of long jobs running

[jira] [Commented] (YARN-1987) Wrapper for leveldb DBIterator to aid in handling database exceptions

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995398#comment-13995398 ] Hudson commented on YARN-1987: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

2014-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995498#comment-13995498 ] Hadoop QA commented on YARN-2016: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2048) List all of the containers of an application from the yarn web

2014-05-12 Thread Min Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated YARN-2048: --- Attachment: YARN-2048-trunk-v1.patch Submit a patch on trunk List all of the containers of an application

[jira] [Created] (YARN-2048) List all of the containers of an application from the yarn web

2014-05-12 Thread Min Zhou (JIRA)
Min Zhou created YARN-2048: -- Summary: List all of the containers of an application from the yarn web Key: YARN-2048 URL: https://issues.apache.org/jira/browse/YARN-2048 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-2040) Recover information about finished containers

2014-05-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-2040. -- Resolution: Duplicate This will be covered by YARN-1337. Recover information about finished

[jira] [Commented] (YARN-2042) String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp()

2014-05-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995505#comment-13995505 ] Chen He commented on YARN-2042: --- The change in this patch does not need to include test.

[jira] [Updated] (YARN-1702) Expose kill app functionality as part of RM web services

2014-05-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1702: Attachment: apache-yarn-1702.9.patch New patch with the following fixes - 1. Use right call to get

[jira] [Updated] (YARN-1938) Kerberos authentication for the timeline server

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1938: -- Attachment: YARN-1938.2.patch Made some minor touch on the last patch. Kerberos authentication for

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992962#comment-13992962 ] Tsuyoshi OZAWA commented on YARN-2001: -- {quote} If possible, I think we should avoid

[jira] [Commented] (YARN-1457) YARN single node install issues on mvn clean install assembly:assembly on mapreduce project

2014-05-12 Thread Shaun Gittens (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992948#comment-13992948 ] Shaun Gittens commented on YARN-1457: - I get virtually the same error when executing :

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995511#comment-13995511 ] Tsuyoshi OZAWA commented on YARN-556: - If we can break the compatibility about the

[jira] [Updated] (YARN-2050) Fix LogCLIHelpers to create the correct FileContext

2014-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-2050: -- Attachment: YARN-2050.patch Papreduce CLI and yarn CLI pass the configuration to LogCLIHelpers. LogCLIHelpers

[jira] [Commented] (YARN-2039) Better reporting of finished containers to AMs

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995241#comment-13995241 ] Bikas Saha commented on YARN-2039: -- Dupe of YARN-1372? Better reporting of finished

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995243#comment-13995243 ] Karthik Kambatla commented on YARN-2001: I think the epoch idea might work very

[jira] [Commented] (YARN-766) TestNodeManagerShutdown in branch-2 should use Shell to form the output path and a format issue in trunk

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995402#comment-13995402 ] Hudson commented on YARN-766: - SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995247#comment-13995247 ] Karthik Kambatla commented on YARN-1372: Based on offline discussion with Anubhav,

[jira] [Commented] (YARN-1412) Allocating Containers on a particular Node in Yarn

2014-05-12 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993616#comment-13993616 ] Chris Riccomini commented on YARN-1412: --- Seeing this as well (YARN-2027).

[jira] [Updated] (YARN-1936) Secured timeline client

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1936: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) Secured timeline client

[jira] [Updated] (YARN-1936) Secured timeline client

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1936: -- Description: TimelineClient should be able to talk to the timeline server with kerberos authentication

[jira] [Commented] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995381#comment-13995381 ] Ted Yu commented on YARN-2032: -- {code} + version0.98.0-hadoop2/version {code} 0.98.2 is

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995812#comment-13995812 ] Xuan Gong commented on YARN-1861: - Uploaded a new patch, Explicitly throwing the exception,

[jira] [Updated] (YARN-1751) Improve MiniYarnCluster for log aggregation testing

2014-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-1751: -- Attachment: YARN-1751.patch Thanks, Jason. Here is the patch for MiniYarnCluster. I have opened

[jira] [Commented] (YARN-1936) Secured timeline client

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995851#comment-13995851 ] Zhijie Shen commented on YARN-1936: --- BTW, the patch depends on YARN-2049 for compiling

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995878#comment-13995878 ] Bikas Saha commented on YARN-556: - Folks please take the discussion for container id to its

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-05-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995829#comment-13995829 ] Bikas Saha commented on YARN-556: - bq. After the configurable wait-time, the RM starts

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995536#comment-13995536 ] Tsuyoshi OZAWA commented on YARN-2001: -- Bikas and Karthik, thanks for the sharing.

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995796#comment-13995796 ] Xuan Gong commented on YARN-1861: - bq. Can we make this explicit, instead of being an NPE?

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995743#comment-13995743 ] Karthik Kambatla commented on YARN-1861: bq. Also, we need to make sure that when

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995760#comment-13995760 ] Vinod Kumar Vavilapalli commented on YARN-1861: --- bq. Without the core code

[jira] [Resolved] (YARN-1227) Update Single Cluster doc to use yarn.resourcemanager.hostname

2014-05-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved YARN-1227. - Resolution: Invalid Closing this issue. Feel free to reopen if you disagree. Update Single

[jira] [Updated] (YARN-1936) Secured timeline client

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1936: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1935 Secured timeline client

[jira] [Assigned] (YARN-2012) Fair Scheduler : Default rule in queue placement policy can take a queue as an optional attribute

2014-05-12 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned YARN-2012: Assignee: Ashwin Shankar Fair Scheduler : Default rule in queue placement policy can take

[jira] [Created] (YARN-2050) Fix LogCLIHelpers to create the correct FileContext

2014-05-12 Thread Ming Ma (JIRA)
Ming Ma created YARN-2050: - Summary: Fix LogCLIHelpers to create the correct FileContext Key: YARN-2050 URL: https://issues.apache.org/jira/browse/YARN-2050 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2050) Fix LogCLIHelpers to create the correct FileContext

2014-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995780#comment-13995780 ] Hadoop QA commented on YARN-2050: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995781#comment-13995781 ] Karthik Kambatla commented on YARN-1861: bq. That is what I was thinking, but I am

[jira] [Commented] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

2014-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995569#comment-13995569 ] Hadoop QA commented on YARN-1515: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-05-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995782#comment-13995782 ] Wangda Tan commented on YARN-2001: -- [~ozawa], as Bikas said, we should keep at least some

[jira] [Commented] (YARN-1969) Fair Scheduler: Add policy for Earliest Deadline First

2014-05-12 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995993#comment-13995993 ] Maysam Yabandeh commented on YARN-1969: --- Thanks for the comment [~kasha]. I think

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

2014-05-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995925#comment-13995925 ] Junping Du commented on YARN-2016: -- Thanks [~jianhe] for review and comments! Filed

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

2014-05-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995981#comment-13995981 ] Hudson commented on YARN-2016: -- FAILURE: Integrated in Hadoop-trunk-Commit #5604 (See

[jira] [Updated] (YARN-2049) Delegation token stuff for the timeline sever

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2049: -- Attachment: YARN-2049.1.patch In this patch, I implemented the delegation token service via HTTP

[jira] [Updated] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

2014-05-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1861: Attachment: YARN-1861.7.patch Both RM stuck in standby mode when automatic failover is enabled

[jira] [Commented] (YARN-1936) Secured timeline client

2014-05-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995919#comment-13995919 ] Hadoop QA commented on YARN-1936: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1751) Improve MiniYarnCluster for log aggregation testing

2014-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-1751: -- Summary: Improve MiniYarnCluster for log aggregation testing (was: Improve MiniYarnCluster and LogCLIHelpers

[jira] [Updated] (YARN-1937) Access control of per-framework data

2014-05-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1937: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) Access control of per-framework

  1   2   >