[jira] [Assigned] (YARN-715) TestDistributedShell and TestUnmanagedAMLauncher are failing

2013-05-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-715: Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) TestDistributedShell and

[jira] [Assigned] (YARN-715) TestDistributedShell and TestUnmanagedAMLauncher are failing

2013-05-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-715: Assignee: Vinod Kumar Vavilapalli (was: Zhijie Shen) Press the wrong button, sorry. Return to Vinod

[jira] [Updated] (YARN-422) Add NM client library

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.10.patch Thanks, Vinod! Addressed most of your comments except the following: bq.

[jira] [Updated] (YARN-422) Add NM client library

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.11.patch Fix the findbug problem Add NM client library

[jira] [Updated] (YARN-422) Add NM client library

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.12.patch Thanks, Vinod! Addressed your comments. One minor thing is that I still

[jira] [Updated] (YARN-422) Add NM client library

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.13.patch Fix the findbug Add NM client library

[jira] [Updated] (YARN-422) Add NM client library

2013-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.14.patch Addressed Vinod's comments. One notable change is that now all the errors go

[jira] [Updated] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-05-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-639: - Attachment: YARN-639.1.patch Now change AM of distributed shell to use NMClient, and update the tests.

[jira] [Created] (YARN-730) NMClientAsync needs to remove completed container

2013-05-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-730: Summary: NMClientAsync needs to remove completed container Key: YARN-730 URL: https://issues.apache.org/jira/browse/YARN-730 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-730) NMClientAsync needs to remove completed container

2013-05-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-730: - Attachment: YARN-730.1.patch If the container is failed or done, it should be removed from the

[jira] [Updated] (YARN-733) TestNMClient fails occasionally

2013-05-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-733: - Attachment: YARN-733.1.patch In the patch: 1. Update the tests to wait until the expected container status

[jira] [Assigned] (YARN-720) container-log4j.properties should not refer to mapreduce properties

2013-05-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-720: Assignee: Zhijie Shen container-log4j.properties should not refer to mapreduce properties

[jira] [Updated] (YARN-733) TestNMClient fails occasionally

2013-05-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-733: - Attachment: YARN-733.2.patch Fix the javadoc and refactor the test. Thank Omkar and Vinod for your review.

[jira] [Updated] (YARN-761) TestNMClientAsync fails sometimes

2013-06-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-761: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) TestNMClientAsync fails sometimes

[jira] [Updated] (YARN-761) TestNMClientAsync fails sometimes

2013-06-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-761: - Attachment: YARN-761.1.patch It's the race condition problem, but is restricted with the test. It happens

[jira] [Commented] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677368#comment-13677368 ] Zhijie Shen commented on YARN-641: -- One blocking issue here is that if AMLauncher want to

[jira] [Assigned] (YARN-731) RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

2013-06-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-731: Assignee: Zhijie Shen RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

[jira] [Commented] (YARN-777) Remove unreferenced objects from proto

2013-06-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678448#comment-13678448 ] Zhijie Shen commented on YARN-777: -- +1. Checked the code base, StringURLMapProto is

[jira] [Commented] (YARN-737) Some Exceptions no longer need to be wrapped by YarnException and can be directly thrown out after YARN-142

2013-06-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678789#comment-13678789 ] Zhijie Shen commented on YARN-737: -- Search around the source code. It seems that the

[jira] [Updated] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-641: - Attachment: YARN-641.1.patch In the patch, ApplicationMasterLauncher is changed to extends NMClientAsync,

[jira] [Updated] (YARN-731) RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

2013-06-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-731: - Attachment: YARN-731.1.patch Added the block in RPCUtil#unwrapAndThrowException to handle the runtime

[jira] [Updated] (YARN-731) RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

2013-06-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-731: - Attachment: YARN-731.2.patch Fixed the minor nits. Thanks, Sid!

[jira] [Updated] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-641: - Attachment: YARN-641.2.patch Update the patch to make using NMClient configurable. Make

[jira] [Updated] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-641: - Attachment: YARN-641.3.patch Fix the test failure. Make AMLauncher in RM Use NMClient

[jira] [Commented] (YARN-800) Clicking on an AM link for a running app leads to a HTTP 500

2013-06-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13681838#comment-13681838 ] Zhijie Shen commented on YARN-800: -- Did a quick local test, and found the link was not

[jira] [Commented] (YARN-803) factor out scheduler config validation from the ResourceManager to each scheduler implementation

2013-06-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682444#comment-13682444 ] Zhijie Shen commented on YARN-803: -- It sounds a good idea to support polymorphy of config

[jira] [Commented] (YARN-803) factor out scheduler config validation from the ResourceManager to each scheduler implementation

2013-06-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682652#comment-13682652 ] Zhijie Shen commented on YARN-803: -- looks good. +1 factor out scheduler

[jira] [Commented] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683087#comment-13683087 ] Zhijie Shen commented on YARN-812: -- +1 for the patch. One related question. Does

[jira] [Commented] (YARN-662) Enforce required parameters for all the protocols

2013-06-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683504#comment-13683504 ] Zhijie Shen commented on YARN-662: -- Bellow is the strategy to enforce the required

[jira] [Commented] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-06-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683781#comment-13683781 ] Zhijie Shen commented on YARN-639: -- bq. why do we need to do getContainerStatus after

[jira] [Updated] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-06-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-639: - Attachment: YARN-639.2.patch Jenkins test seemed to be killed. Resubmit the same patch and kick out the

[jira] [Created] (YARN-826) Move Clock/SystemClock to util package

2013-06-15 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-826: Summary: Move Clock/SystemClock to util package Key: YARN-826 URL: https://issues.apache.org/jira/browse/YARN-826 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-826) Move Clock/SystemClock to util package

2013-06-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-826: - Attachment: YARN-826.1.patch Move Clock/SystemClock, patch needs to rebase when YARN-825 is checked in

[jira] [Created] (YARN-828) Remove YarnVersionAnnotation

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-828: Summary: Remove YarnVersionAnnotation Key: YARN-828 URL: https://issues.apache.org/jira/browse/YARN-828 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Updated] (YARN-828) Remove YarnVersionAnnotation

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-828: - Attachment: YARN-828.1.patch The patch removes YarnVersionAnnotation. Remove

[jira] [Created] (YARN-829) Rename RMTokenSelector to be RMDelegationTokenSelector

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-829: Summary: Rename RMTokenSelector to be RMDelegationTokenSelector Key: YARN-829 URL: https://issues.apache.org/jira/browse/YARN-829 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-829) Rename RMTokenSelector to be RMDelegationTokenSelector

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-829: - Attachment: YARN-829.1.patch Rename RMTokenSelector, and modify its reference. Rename

[jira] [Commented] (YARN-828) Remove YarnVersionAnnotation

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684597#comment-13684597 ] Zhijie Shen commented on YARN-828: -- Simple class removal, it should be fine without

[jira] [Commented] (YARN-829) Rename RMTokenSelector to be RMDelegationTokenSelector

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684598#comment-13684598 ] Zhijie Shen commented on YARN-829: -- Need to rebase after YARN-825 is committed.

[jira] [Created] (YARN-830) Refactor yarn.service and yarn.state in hadoop-yarn-common

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-830: Summary: Refactor yarn.service and yarn.state in hadoop-yarn-common Key: YARN-830 URL: https://issues.apache.org/jira/browse/YARN-830 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-830) Refactor yarn.service and yarn.state in hadoop-yarn-common

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-830: - Attachment: YARN-830.1.patch In addition to moving classes, ServiceStateException and

[jira] [Commented] (YARN-830) Refactor yarn.service and yarn.state in hadoop-yarn-common

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13684729#comment-13684729 ] Zhijie Shen commented on YARN-830: -- The test failure is not related, and is filed in

[jira] [Created] (YARN-833) Move Graph and VisualizeStateMachine into yarn.state package

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-833: Summary: Move Graph and VisualizeStateMachine into yarn.state package Key: YARN-833 URL: https://issues.apache.org/jira/browse/YARN-833 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-826) Move Clock/SystemClock to util package

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-826: - Attachment: YARN-826.2.patch Rebase the patch, as YARN-825 has been checked in Move

[jira] [Updated] (YARN-833) Move Graph and VisualizeStateMachine into yarn.state package

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-833: - Attachment: YARN-833.1.patch Move graph and visualizestatemachine, and update pom.xml accordingly.

[jira] [Created] (YARN-836) Cleanup Apps ConverterUtils StringHelper Times to avoid duplicate APIs

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-836: Summary: Cleanup Apps ConverterUtils StringHelper Times to avoid duplicate APIs Key: YARN-836 URL: https://issues.apache.org/jira/browse/YARN-836 Project: Hadoop YARN

[jira] [Created] (YARN-837) ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn

2013-06-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-837: Summary: ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn Key: YARN-837 URL: https://issues.apache.org/jira/browse/YARN-837 Project: Hadoop YARN

[jira] [Updated] (YARN-837) ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn

2013-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-837: - Attachment: YARN-837.1.patch ClusterInfo is used by MR only, it should be moved to MR project.

[jira] [Commented] (YARN-836) Cleanup Apps ConverterUtils StringHelper Times to avoid duplicate APIs

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13685020#comment-13685020 ] Zhijie Shen commented on YARN-836: -- Did some investigation. Bellow is the summary: 1.

[jira] [Updated] (YARN-837) ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-837: - Attachment: YARN-837.2.patch Rebase the patch ClusterInfo.java doesn't seem to belong to

[jira] [Updated] (YARN-836) Cleanup Apps ConverterUtils StringHelper Times to avoid duplicate APIs

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-836: - Attachment: YARN-836.1.patch The patch merge Times and StringHelpers to the corresponding classes in

[jira] [Updated] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-834: - Attachment: YARN-834.2.patch Fix TestNMClientAsync and test it locally. Will review the patch afterwards.

[jira] [Updated] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-834: - Attachment: YARN-834.2.patch Resubmit the patch, the previous one is wrong Review/fix

[jira] [Assigned] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-834: Assignee: Zhijie Shen (was: Arun C Murthy) Review/fix annotations for yarn-client module and

[jira] [Commented] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13685926#comment-13685926 ] Zhijie Shen commented on YARN-834: -- Thanks, [~acmurthy] for the initial patch. I'll

[jira] [Updated] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-834: - Attachment: YARN-834.3.patch In the patch: 1. ResourceMgrDelegate is changed to implement YarnClient

[jira] [Updated] (YARN-834) Review/fix annotations for yarn-client module and clearly differentiate *Async apis

2013-06-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-834: - Attachment: YARN-834.4.patch Fix the test failure Review/fix annotations for yarn-client

[jira] [Created] (YARN-871) Failed to run MR example against latest trunk

2013-06-21 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-871: Summary: Failed to run MR example against latest trunk Key: YARN-871 URL: https://issues.apache.org/jira/browse/YARN-871 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-871) Failed to run MR example against latest trunk

2013-06-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-871: - Attachment: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log Attach the RM log for diagnostic

[jira] [Created] (YARN-872) BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF

2013-06-21 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-872: Summary: BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF Key: YARN-872 URL: https://issues.apache.org/jira/browse/YARN-872 Project:

[jira] [Commented] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

2013-06-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690904#comment-13690904 ] Zhijie Shen commented on YARN-874: -- Ran MR example on latest trunk, and saw. Not sure it is

[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk

2013-06-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13692108#comment-13692108 ] Zhijie Shen commented on YARN-871: -- [~devaraj.k], the posted exception seems to be related

[jira] [Commented] (YARN-853) maximum-am-resource-percent doesn't work after refreshQueues command

2013-06-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13693277#comment-13693277 ] Zhijie Shen commented on YARN-853: -- The patch looks almost good, just one small nit: In

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697185#comment-13697185 ] Zhijie Shen commented on YARN-675: -- [~sandyr], would you mind my taking this ticket over?

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697493#comment-13697493 ] Zhijie Shen commented on YARN-675: -- Take it over. Thanks! In YarnClient,

[jira] [Assigned] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-675: Assignee: Zhijie Shen In YarnClient, pull AM logs on AM container failure

[jira] [Resolved] (YARN-871) Failed to run MR example against latest trunk

2013-07-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-871. -- Resolution: Cannot Reproduce Thanks, [~djp]! Close it as cannot reproduce Failed to

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-07-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13698415#comment-13698415 ] Zhijie Shen commented on YARN-649: -- Read the patch quickly. It looks almost fine to me. One

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699270#comment-13699270 ] Zhijie Shen commented on YARN-649: -- bq. Oops, leaving in MediaType.APPLICATION_JSON was a

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699488#comment-13699488 ] Zhijie Shen commented on YARN-675: -- Checked YarnClient and found one issue: ContainerId is

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699538#comment-13699538 ] Zhijie Shen commented on YARN-675: -- It's feasible to pass ContainerId through

[jira] [Commented] (YARN-502) RM crash with NPE on NODE_REMOVED event with FairScheduler

2013-07-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702177#comment-13702177 ] Zhijie Shen commented on YARN-502: -- +1, the patch looks good to me RM

[jira] [Commented] (YARN-295) Resource Manager throws InvalidStateTransitonException: Invalid event: CONTAINER_FINISHED at ALLOCATED for RMAppAttemptImpl

2013-07-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702245#comment-13702245 ] Zhijie Shen commented on YARN-295: -- I agree with moving RMAppAttempt from ALLOCATED to

[jira] [Commented] (YARN-296) Resource Manager throws InvalidStateTransitonException: Invalid event: APP_ACCEPTED at RUNNING for RMAppImpl

2013-07-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702464#comment-13702464 ] Zhijie Shen commented on YARN-296: -- The patch should work, but IMHO, the essential problem

[jira] [Commented] (YARN-296) Resource Manager throws InvalidStateTransitonException: Invalid event: APP_ACCEPTED at RUNNING for RMAppImpl

2013-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702979#comment-13702979 ] Zhijie Shen commented on YARN-296: -- I'm afraid it is different case wrt YARN-295. In

[jira] [Commented] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

2013-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702987#comment-13702987 ] Zhijie Shen commented on YARN-873: -- bq. Null report can be unclear as to what happened.

[jira] [Created] (YARN-906) TestNMClient.testNMClientNoCleanupOnStop fails occasionally

2013-07-09 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-906: Summary: TestNMClient.testNMClientNoCleanupOnStop fails occasionally Key: YARN-906 URL: https://issues.apache.org/jira/browse/YARN-906 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

2013-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703018#comment-13703018 ] Zhijie Shen commented on YARN-347: -- +1, the patch looks good to me, and the test failure

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703508#comment-13703508 ] Zhijie Shen commented on YARN-649: -- bq. if support JSON/XML, how will you wrap up the logs

[jira] [Commented] (YARN-853) maximum-am-resource-percent doesn't work after refreshQueues command

2013-07-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704264#comment-13704264 ] Zhijie Shen commented on YARN-853: -- +1. looks good to me

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704773#comment-13704773 ] Zhijie Shen commented on YARN-865: -- The patch looks good to me, but I have two minor

[jira] [Commented] (YARN-661) NM fails to cleanup local directories for users

2013-07-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13705285#comment-13705285 ] Zhijie Shen commented on YARN-661: -- I agree with the idea, and the patch looks generally

[jira] [Assigned] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-292: Assignee: Zhijie Shen ResourceManager throws ArrayIndexOutOfBoundsException while handling

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706108#comment-13706108 ] Zhijie Shen commented on YARN-292: -- Will look into this problem

[jira] [Commented] (YARN-865) RM webservices can't query on application Types

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706126#comment-13706126 ] Zhijie Shen commented on YARN-865: -- +1 for the latest patch RM

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706432#comment-13706432 ] Zhijie Shen commented on YARN-292: -- {code} // Acquire the AM container from the

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706673#comment-13706673 ] Zhijie Shen commented on YARN-321: -- bq. To start with, we will have an implementation with

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706686#comment-13706686 ] Zhijie Shen commented on YARN-321: -- bq. ResoureManager will write per-application data to a

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706773#comment-13706773 ] Zhijie Shen commented on YARN-321: -- bq. Are we moving aggregated log management(i.e

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708761#comment-13708761 ] Zhijie Shen commented on YARN-744: -- The passed in appAttemptId for an app currently seems

[jira] [Resolved] (YARN-924) TestNMClient.testNMClientNoCleanupOnStop frequently failing due to timeout

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-924. -- Resolution: Duplicate It is duplicate with YARN-906.

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709072#comment-13709072 ] Zhijie Shen commented on YARN-744: -- bq. locking on appAttemptId in case of allocate /

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709098#comment-13709098 ] Zhijie Shen commented on YARN-321: -- bq. Is it per application or only one thread in RM? I

[jira] [Commented] (YARN-906) TestNMClient.testNMClientNoCleanupOnStop fails occasionally

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709195#comment-13709195 ] Zhijie Shen commented on YARN-906: -- Did some investigation in this test failure. The test

[jira] [Updated] (YARN-321) Generic application history service

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-321: - Attachment: HistoryStorageDemo.java bq. However, during the design, it would be nice to outline (at least

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710132#comment-13710132 ] Zhijie Shen commented on YARN-875: -- +1 onError(Throwable). However, does it belong to the

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710207#comment-13710207 ] Zhijie Shen commented on YARN-875: -- IMHO, users know best about the implementations of

[jira] [Commented] (YARN-931) Overlapping classes across hadoop-yarn-api and hadoop-yarn-common

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710280#comment-13710280 ] Zhijie Shen commented on YARN-931: -- hm... the packages have been defined in both

[jira] [Commented] (YARN-930) Bootstrap ApplicationHistoryService module

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710351#comment-13710351 ] Zhijie Shen commented on YARN-930: -- Thanks, Vinod. Overall the patch looks nice. There're

[jira] [Commented] (YARN-906) TestNMClient.testNMClientNoCleanupOnStop fails occasionally

2013-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710475#comment-13710475 ] Zhijie Shen commented on YARN-906: -- Did some further investigation, and found Container

  1   2   3   4   5   6   7   8   9   10   >