Junping Du created YARN-291:
---
Summary: Dynamic resource configuration on NM
Key: YARN-291
URL: https://issues.apache.org/jira/browse/YARN-291
Project: Hadoop YARN
Issue Type: New Feature
Junping Du created YARN-312:
---
Summary: Add RPC (ClientRMProtocol) to support node's resource
change
Key: YARN-312
URL: https://issues.apache.org/jira/browse/YARN-312
Project: Hadoop YARN
Issue
Junping Du created YARN-313:
---
Summary: Add CLI (NodeCLI) for supporting node resource
configuration through client
Key: YARN-313
URL: https://issues.apache.org/jira/browse/YARN-313
Project: Hadoop YARN
Junping Du created YARN-877:
---
Summary: Allow for black-listing resources in FifoScheduler
Key: YARN-877
URL: https://issues.apache.org/jira/browse/YARN-877
Project: Hadoop YARN
Issue Type:
Junping Du created YARN-878:
---
Summary: Test failed on trunk for
TestAMAuthorization.testUnauthorizedAccess
Key: YARN-878
URL: https://issues.apache.org/jira/browse/YARN-878
Project: Hadoop YARN
Junping Du created YARN-879:
---
Summary: Fix NPE in Application.getResources()
Key: YARN-879
URL: https://issues.apache.org/jira/browse/YARN-879
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-878.
-
Resolution: Duplicate
Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess
Junping Du created YARN-999:
---
Summary: In case of long running tasks, reduce node resource
should balloon out resource quickly by calling preemption API and suspending
running task.
Key: YARN-999
URL:
Junping Du created YARN-1000:
Summary: Dynamic resource configuration feature can be configured
to enable or disable and persistent on setting or not
Key: YARN-1000
URL:
Junping Du created YARN-1163:
Summary: Cleanup code for AssignMapsWithLocality() in
RMContainerAllocator
Key: YARN-1163
URL: https://issues.apache.org/jira/browse/YARN-1163
Project: Hadoop YARN
Junping Du created YARN-1251:
Summary: TestDistributedShell#TestDSShell failed with timeout
Key: YARN-1251
URL: https://issues.apache.org/jira/browse/YARN-1251
Project: Hadoop YARN
Issue Type:
Junping Du created YARN-1310:
Summary: Get rid of MR settings in YARN configuration
Key: YARN-1310
URL: https://issues.apache.org/jira/browse/YARN-1310
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-1289.
--
Resolution: Invalid
Configuration yarn.nodemanager.aux-services should have default value for
Junping Du created YARN-1468:
Summary: TestRMRestart.testRMRestartWaitForPreviousAMToFinish get
failed.
Key: YARN-1468
URL: https://issues.apache.org/jira/browse/YARN-1468
Project: Hadoop YARN
Junping Du created YARN-1506:
Summary: Replace set resource change on RMNode directly with event
notification.
Key: YARN-1506
URL: https://issues.apache.org/jira/browse/YARN-1506
Project: Hadoop YARN
Junping Du created YARN-1508:
Summary: Rename ResourceOption and document resource
over-commitment cases
Key: YARN-1508
URL: https://issues.apache.org/jira/browse/YARN-1508
Project: Hadoop YARN
Junping Du created YARN-1561:
Summary: Fix a generic type warning in FairScheduler
Key: YARN-1561
URL: https://issues.apache.org/jira/browse/YARN-1561
Project: Hadoop YARN
Issue Type:
Junping Du created YARN-1569:
Summary: For handl(SchedulerEvent) in FifoScheduler and
CapacityScheduler, SchedulerEvent should get checked (instanceof) for
appropriate type before casting
Key: YARN-1569
URL:
Junping Du created YARN-1604:
Summary: Remove unnecessary files TestFifoScheduler.java.orig and
FairScheduler.java.orig
Key: YARN-1604
URL: https://issues.apache.org/jira/browse/YARN-1604
Project: Hadoop
Junping Du created YARN-1733:
Summary: Intermittent failed for TestRMWebServicesApps
Key: YARN-1733
URL: https://issues.apache.org/jira/browse/YARN-1733
Project: Hadoop YARN
Issue Type: Bug
Junping Du created YARN-1968:
Summary: YARN Admin service should have more fine-grained ACL
which is based on mapping of users with methods/operations.
Key: YARN-1968
URL:
Junping Du created YARN-1977:
Summary: Add tests on getApplicationRequest with filtering start
time range
Key: YARN-1977
URL: https://issues.apache.org/jira/browse/YARN-1977
Project: Hadoop YARN
Junping Du created YARN-1983:
Summary: Support heterogeneous container types at runtime on YARN
Key: YARN-1983
URL: https://issues.apache.org/jira/browse/YARN-1983
Project: Hadoop YARN
Issue
Junping Du created YARN-2019:
Summary: Retrospect on decision of making RM crashed if any
exception throw in ZKRMStateStore
Key: YARN-2019
URL: https://issues.apache.org/jira/browse/YARN-2019
Project:
Junping Du created YARN-2051:
Summary: Add more unit tests for PBImpl that didn't get covered
Key: YARN-2051
URL: https://issues.apache.org/jira/browse/YARN-2051
Project: Hadoop YARN
Issue Type:
Junping Du created YARN-2030:
Summary: Use StateMachine to simplify handleStoreEvent() in
RMStateStore
Key: YARN-2030
URL: https://issues.apache.org/jira/browse/YARN-2030
Project: Hadoop YARN
Junping Du created YARN-2167:
Summary: LeveldbIterator should get closed in
NMLeveldbStateStoreService#loadLocalizationState() within finally block
Key: YARN-2167
URL: https://issues.apache.org/jira/browse/YARN-2167
Junping Du created YARN-2227:
Summary: Move containerMgrProxy from RM's AMLaunch to get rid of
issues that new client talking with old server
Key: YARN-2227
URL: https://issues.apache.org/jira/browse/YARN-2227
Junping Du created YARN-2278:
Summary: YARN RPC should support Protocol Version in client/server
Key: YARN-2278
URL: https://issues.apache.org/jira/browse/YARN-2278
Project: Hadoop YARN
Issue
Junping Du created YARN-2289:
Summary: ApplicationHistoryStore should be versioned
Key: YARN-2289
URL: https://issues.apache.org/jira/browse/YARN-2289
Project: Hadoop YARN
Issue Type: Sub-task
Junping Du created YARN-2316:
Summary: TestNMWebServices* get failed on trunk
Key: YARN-2316
URL: https://issues.apache.org/jira/browse/YARN-2316
Project: Hadoop YARN
Issue Type: Bug
Junping Du created YARN-2347:
Summary: Consolidate RMStateVersion and NMDBSchemaVersion into
StateVersion in yarn-server-common
Key: YARN-2347
URL: https://issues.apache.org/jira/browse/YARN-2347
[
https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-667.
-
Resolution: Duplicate
Data persisted in RM should be versioned
Junping Du created YARN-2469:
Summary: Merge duplicated tests in Fifo/Capacity/Fair Scheduler
into some common test
Key: YARN-2469
URL: https://issues.apache.org/jira/browse/YARN-2469
Project: Hadoop
Junping Du created YARN-2489:
Summary: ResouceOption's overcommitTimeout should be respected
during resource update on NM
Key: YARN-2489
URL: https://issues.apache.org/jira/browse/YARN-2489
Project:
[
https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2298.
--
Resolution: Fixed
Move TimelineClient to yarn-common project
Junping Du created YARN-2585:
Summary: TestContainerManagerSecurity failed on trunk
Key: YARN-2585
URL: https://issues.apache.org/jira/browse/YARN-2585
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2585.
--
Resolution: Duplicate
TestContainerManagerSecurity failed on trunk
Junping Du created YARN-2593:
Summary: Many tests get failed on trunk
Key: YARN-2593
URL: https://issues.apache.org/jira/browse/YARN-2593
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2593.
--
Resolution: Fixed
Many tests get failed on trunk
--
Key:
Junping Du created YARN-2596:
Summary: TestWorkPreservingRMRestart failed on trunk
Key: YARN-2596
URL: https://issues.apache.org/jira/browse/YARN-2596
Project: Hadoop YARN
Issue Type: Test
Junping Du created YARN-2615:
Summary: ClientToAMTokenIdentifier and DelegationTokenIdentifier
should allow extended fields
Key: YARN-2615
URL: https://issues.apache.org/jira/browse/YARN-2615
Project:
Junping Du created YARN-2632:
Summary: Document NM Restart feature
Key: YARN-2632
URL: https://issues.apache.org/jira/browse/YARN-2632
Project: Hadoop YARN
Issue Type: Sub-task
Junping Du created YARN-2634:
Summary: Test failure for TestClientRMTokens
Key: YARN-2634
URL: https://issues.apache.org/jira/browse/YARN-2634
Project: Hadoop YARN
Issue Type: Test
[
https://issues.apache.org/jira/browse/YARN-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2550.
--
Resolution: Duplicate
Yes. Resolve it as duplicated. Let's move the discussion to YARN-2483.
[
https://issues.apache.org/jira/browse/YARN-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2645.
--
Resolution: Duplicate
TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails in trunk
Junping Du created YARN-2680:
Summary: Node shouldn't be listed as RUNNING when NM daemon is
stop even when recovery work is enabled.
Key: YARN-2680
URL: https://issues.apache.org/jira/browse/YARN-2680
Junping Du created YARN-2846:
Summary: Incorrect persist exit code for running containers in
reacquireContainer() that interrupted by NodeManager restart.
Key: YARN-2846
URL:
Junping Du created YARN-2970:
Summary: NodeLabel operations in RMAdmin CLI get missing in help
command.
Key: YARN-2970
URL: https://issues.apache.org/jira/browse/YARN-2970
Project: Hadoop YARN
Junping Du created YARN-2977:
Summary: TestNMClient get failed intermittently
Key: YARN-2977
URL: https://issues.apache.org/jira/browse/YARN-2977
Project: Hadoop YARN
Issue Type: Bug
Junping Du created YARN-3212:
Summary: RMNode State Transition Update with DECOMMISSIONING state
Key: YARN-3212
URL: https://issues.apache.org/jira/browse/YARN-3212
Project: Hadoop YARN
Issue
Junping Du created YARN-3224:
Summary: Notify AM with containers (on decommissioning node) could
be preempted after timeout.
Key: YARN-3224
URL: https://issues.apache.org/jira/browse/YARN-3224
Project:
Junping Du created YARN-3223:
Summary: Resource update during NM graceful decommission
Key: YARN-3223
URL: https://issues.apache.org/jira/browse/YARN-3223
Project: Hadoop YARN
Issue Type:
Junping Du created YARN-3225:
Summary: New parameter or CLI for decommissioning node gracefully
in RMAdmin CLI
Key: YARN-3225
URL: https://issues.apache.org/jira/browse/YARN-3225
Project: Hadoop YARN
Junping Du created YARN-3226:
Summary: UI changes for decommissioning node
Key: YARN-3226
URL: https://issues.apache.org/jira/browse/YARN-3226
Project: Hadoop YARN
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/YARN-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2680.
--
Resolution: Duplicate
Node shouldn't be listed as RUNNING when NM daemon is stop even when recovery
[
https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-.
--
Resolution: Fixed
Hadoop Flags: Reviewed
rename TimelineAggregator etc. to TimelineCollector
Junping Du created YARN-3359:
Summary: Recover aggregator (collector) list in RM failed over
Key: YARN-3359
URL: https://issues.apache.org/jira/browse/YARN-3359
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3035.
--
Resolution: Duplicate
Close it as duplicated as we already have a local file based storage
Junping Du created YARN-3304:
Summary: Default return values for resources in
ResourceCalculatorProcessTree are inconsistent in case where functionality is
not available.
Key: YARN-3304
URL:
Junping Du created YARN-3408:
Summary: TestDistributedShell get failed due to RM start failure.
Key: YARN-3408
URL: https://issues.apache.org/jira/browse/YARN-3408
Project: Hadoop YARN
Issue
Junping Du created YARN-3276:
Summary: Fix NPE and refactor in some map cast for TimelineEntity
Key: YARN-3276
URL: https://issues.apache.org/jira/browse/YARN-3276
Project: Hadoop YARN
Issue
Junping Du created YARN-3274:
Summary: FIFOScheduler should assign the same container number
equal to ResourceRequest ask for ANY
Key: YARN-3274
URL: https://issues.apache.org/jira/browse/YARN-3274
[
https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3240.
--
Resolution: Fixed
Fix Version/s: YARN-2928
Hadoop Flags: Reviewed
I have commit v3 patch to
Junping Du created YARN-3402:
Summary: Security support for new timeline service.
Key: YARN-3402
URL: https://issues.apache.org/jira/browse/YARN-3402
Project: Hadoop YARN
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/YARN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3040.
--
Resolution: Fixed
Fix Version/s: YARN-2928
Hadoop Flags: Reviewed
[Data Model] Make
Junping Du created YARN-3367:
Summary: Replace starting a separate thread for post entity with
event loop in TimelineClient
Key: YARN-3367
URL: https://issues.apache.org/jira/browse/YARN-3367
Project:
Junping Du created YARN-3445:
Summary: NM notify RM on running Apps in NM-RM heartbeat
Key: YARN-3445
URL: https://issues.apache.org/jira/browse/YARN-3445
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2470.
--
Resolution: Won't Fix
A high value for yarn.nodemanager.delete.debug-delay-sec causes Nodemanager
to
[
https://issues.apache.org/jira/browse/YARN-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2483.
--
Resolution: Duplicate
Target Version/s: (was: 2.6.0)
Resolve this JIRA as duplicated.
[
https://issues.apache.org/jira/browse/YARN-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2445.
--
Resolution: Won't Fix
Agree with [~billie.rinaldi]'s comments above, this is expected behavior.
ATS
[
https://issues.apache.org/jira/browse/YARN-670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-670.
-
Resolution: Won't Fix
Add an Exception to indicate 'Maintenance' for NMs and add this to the
JavaDoc for
[
https://issues.apache.org/jira/browse/YARN-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-964.
-
Resolution: Won't Fix
Agree with [~vinodkv]. Resolve this as won't fix.
Give a parameter that can set AM
[
https://issues.apache.org/jira/browse/YARN-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2365.
--
Resolution: Cannot Reproduce
TestAMRestart.testShouldNotCountFailureToMaxAttemptRetry fails on branch-2
Junping Du created YARN-3567:
Summary: Document exit codes and their meanings used by
LinuxContainerExecutor.
Key: YARN-3567
URL: https://issues.apache.org/jira/browse/YARN-3567
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2334.
--
Resolution: Not A Problem
Document exit codes and their meanings used by linux task controller.
[
https://issues.apache.org/jira/browse/YARN-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2364.
--
Resolution: Duplicate
Duplicated with YARN-1468
TestRMRestart#testRMRestartWaitForPreviousAMToFinish
[
https://issues.apache.org/jira/browse/YARN-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2390.
--
Resolution: Won't Fix
Investigating whether generic history service needs to support queue-acls
[
https://issues.apache.org/jira/browse/YARN-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2401.
--
Resolution: Won't Fix
Rethinking of the HTTP method of TimelineWebServices#postEntities
[
https://issues.apache.org/jira/browse/YARN-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2398.
--
Resolution: Cannot Reproduce
TestResourceTrackerOnHA crashes
---
[
https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3431.
--
Resolution: Fixed
Fix Version/s: YARN-2928
Hadoop Flags: Reviewed
I have commit this to
[
https://issues.apache.org/jira/browse/YARN-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-880.
-
Resolution: Not A Problem
Assignee: (was: Omkar Vinit Joshi)
Configuring map/reduce memory equal
[
https://issues.apache.org/jira/browse/YARN-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-943.
-
Resolution: Not A Problem
Assignee: (was: Zhijie Shen)
RM starts 2 attempts of failed app even
Junping Du created YARN-3586:
Summary: RM only get back addresses of Collectors that NM needs to
know.
Key: YARN-3586
URL: https://issues.apache.org/jira/browse/YARN-3586
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3599.
--
Resolution: Duplicate
Fix the javadoc of DelegationTokenSecretManager in hadoop-yarn
[
https://issues.apache.org/jira/browse/YARN-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3596.
--
Resolution: Duplicate
Fix the javadoc of DelegationTokenSecretManager in hadoop-common
[
https://issues.apache.org/jira/browse/YARN-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3597.
--
Resolution: Duplicate
Fix the javadoc of DelegationTokenSecretManager in hadoop-hdfs
[
https://issues.apache.org/jira/browse/YARN-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3598.
--
Resolution: Duplicate
Fix the javadoc of DelegationTokenSecretManager in hadoop-mapreduce
Junping Du created YARN-3592:
Summary: Fix typos in RMNodeLabelsManager
Key: YARN-3592
URL: https://issues.apache.org/jira/browse/YARN-3592
Project: Hadoop YARN
Issue Type: Bug
Junping Du created YARN-3641:
Summary: stopRecoveryStore() shouldn't be skipped when exceptions
happen in stopping NM's sub-services.
Key: YARN-3641
URL: https://issues.apache.org/jira/browse/YARN-3641
Junping Du created YARN-3505:
Summary: Node's Log Aggregation Report with SUCCEED should not
cached in RMApps
Key: YARN-3505
URL: https://issues.apache.org/jira/browse/YARN-3505
Project: Hadoop YARN
Junping Du created YARN-3488:
Summary: AM get timeline service info from RM rather than
Application specific configuration.
Key: YARN-3488
URL: https://issues.apache.org/jira/browse/YARN-3488
Project:
[
https://issues.apache.org/jira/browse/YARN-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-3449.
--
Resolution: Invalid
Assignee: (was: Junping Du)
Recover appTokenKeepAliveMap upon nodemanager
[
https://issues.apache.org/jira/browse/YARN-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-329.
-
Resolution: Fixed
Fix Version/s: 2.6.0
This get fixed since 2.6.0 release. Mark it as resolved.
[
https://issues.apache.org/jira/browse/YARN-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-374.
-
Resolution: Not a Problem
Job History Server doesn't show jobs which killed by
[
https://issues.apache.org/jira/browse/YARN-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-2969.
--
Resolution: Duplicate
allocate resource on different nodes for task
[
https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-463.
-
Resolution: Implemented
We already have decommission nodes in UI page, so resolve this JIRA.
Show
[
https://issues.apache.org/jira/browse/YARN-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-551.
-
Resolution: Not a Problem
The option shell_command of DistributedShell had better support compound
[
https://issues.apache.org/jira/browse/YARN-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-375.
-
Resolution: Not a Problem
FIFO scheduler may crash due to bugg app
[
https://issues.apache.org/jira/browse/YARN-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junping Du resolved YARN-800.
-
Resolution: Duplicate
Clicking on an AM link for a running app leads to a HTTP 500
1 - 100 of 162 matches
Mail list logo
