[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-31 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757815#comment-16757815 ] Wilfred Spiegelenburg commented on YARN-8967: - [~sunilg] can you please have a review of this

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743604#comment-16743604 ] Wilfred Spiegelenburg commented on YARN-9198: - Not restoring an application is irreversible.

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED, and NullPointerException happens in RM while shutdown a NM

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743598#comment-16743598 ] Wilfred Spiegelenburg commented on YARN-9194: - Yes that looks better. > Invalid event:

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED, and NullPointerException happens in RM while shutdown a NM

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743551#comment-16743551 ] Wilfred Spiegelenburg commented on YARN-9194: - Changing it back to SCHEDULED looks much

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742077#comment-16742077 ] Wilfred Spiegelenburg commented on YARN-9198: - As I [commented in the previous

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742061#comment-16742061 ] Wilfred Spiegelenburg commented on YARN-9194: - Thank you for logging this jira

[jira] [Commented] (YARN-9193) NullPointerException happens in RM while shutdown a NM

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742063#comment-16742063 ] Wilfred Spiegelenburg commented on YARN-9193: - [~xiaoheipangzi] if this is really the same

[jira] [Assigned] (YARN-7913) Improve error handling when application recovery fails with exception

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-7913: --- Assignee: Wilfred Spiegelenburg (was: Gergo Repas) > Improve error handling

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742031#comment-16742031 ] Wilfred Spiegelenburg commented on YARN-9198: - [~dapengsun] can you explain a bit more about

[jira] [Resolved] (YARN-1122) FairScheduler user-as-default-queue always defaults to 'default'

2019-01-12 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-1122. - Resolution: Duplicate closing old jira as duplicate per comment > FairScheduler

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737851#comment-16737851 ] Wilfred Spiegelenburg commented on YARN-8833: - The patch looks good +1. The check implemented

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736780#comment-16736780 ] Wilfred Spiegelenburg commented on YARN-9173: - Sorry for the typo in the patch name, I did not

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736490#comment-16736490 ] Wilfred Spiegelenburg commented on YARN-9173: - [~cheersyang] I have added a patch for branch

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: YARN-9137-branch3.1.001.patch > FairShare calculation broken for large

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: (was: stash@{1}.textClipping) > FairShare calculation broken for

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: stash@{1}.textClipping > FairShare calculation broken for large values

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: YARN-9173.002.patch > FairShare calculation broken for large values

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735398#comment-16735398 ] Wilfred Spiegelenburg commented on YARN-9173: - Thank you [~cheersyang] for the review. Updated

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-05 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734881#comment-16734881 ] Wilfred Spiegelenburg commented on YARN-8967: - Updated the patch with fixes for the tests and

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-05 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.004.patch > Change FairScheduler to use PlacementRule

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734240#comment-16734240 ] Wilfred Spiegelenburg commented on YARN-9173: - Test failure is not related to the change. I

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733723#comment-16733723 ] Wilfred Spiegelenburg commented on YARN-8967: - Thank you [~leftnoteasy] It has been a long

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.003.patch > Change FairScheduler to use PlacementRule

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733094#comment-16733094 ] Wilfred Spiegelenburg commented on YARN-8967: - Update to fix the tests and the checkstyle

[jira] [Created] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9173: --- Summary: FairShare calculation broken for large values after YARN-8833 Key: YARN-9173 URL: https://issues.apache.org/jira/browse/YARN-9173 Project:

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.002.patch > Change FairScheduler to use PlacementRule

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732656#comment-16732656 ] Wilfred Spiegelenburg commented on YARN-8967: - new patch rebased to the latest trunk: fixed

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.001.patch > Change FairScheduler to use PlacementRule

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-12-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709605#comment-16709605 ] Wilfred Spiegelenburg commented on YARN-8789: - First: I would expect that the change would be

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-12-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706529#comment-16706529 ] Wilfred Spiegelenburg commented on YARN-8789: - Hi [~belugabehr] can you explain a bit more

[jira] [Assigned] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9066: --- Assignee: Wilfred Spiegelenburg > Deprecate Fair Scheduler min share >

[jira] [Commented] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704225#comment-16704225 ] Wilfred Spiegelenburg commented on YARN-9066: - [~haibochen] do you mind if I take this one up?

[jira] [Commented] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696698#comment-16696698 ] Wilfred Spiegelenburg commented on YARN-9047: - Even before the build shows up: the code change

[jira] [Assigned] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9047: --- Assignee: Szilard Nemeth > FairScheduler: default resource calculator is not

[jira] [Created] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9047: --- Summary: FairScheduler: default resource calculator is not resource type aware Key: YARN-9047 URL: https://issues.apache.org/jira/browse/YARN-9047

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695727#comment-16695727 ] Wilfred Spiegelenburg commented on YARN-8948: - Thank you [~bibinchundatt] for the updated

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693316#comment-16693316 ] Wilfred Spiegelenburg commented on YARN-8738: - Thank you for the patch [~snemeth]. The build

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693298#comment-16693298 ] Wilfred Spiegelenburg commented on YARN-9025: - Change looks good, we discussed the test

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693290#comment-16693290 ] Wilfred Spiegelenburg commented on YARN-9019: - Change looks good +1 (non binding) > Ratio

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693120#comment-16693120 ] Wilfred Spiegelenburg commented on YARN-8992: - junit test failure is not related to the change

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-19 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691681#comment-16691681 ] Wilfred Spiegelenburg commented on YARN-8992: - Updated patch with a fix for the checkstyle

[jira] [Updated] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-19 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8992: Attachment: YARN-8992.002.patch > Fair scheduler can delete a dynamic queue while

[jira] [Commented] (YARN-9024) ClusterNodeTracker maximum allocation does not respect resource units

2018-11-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688214#comment-16688214 ] Wilfred Spiegelenburg commented on YARN-9024: - Thank you for logging this issue and providing

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686547#comment-16686547 ] Wilfred Spiegelenburg commented on YARN-9007: - [~sunilg] OPPORTUNISTIC containers should not

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-13 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684892#comment-16684892 ] Wilfred Spiegelenburg commented on YARN-8948: - Hi [~bibinchundatt], thank you for the patch.

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680955#comment-16680955 ] Wilfred Spiegelenburg commented on YARN-8992: - [~haibochen] thank you for logging this. I'll

[jira] [Assigned] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-8992: --- Assignee: Wilfred Spiegelenburg > Fair scheduler can delete a dynamic queue

[jira] [Created] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8994: --- Summary: Fix for race condition in move app and queue cleanup in FS Key: YARN-8994 URL: https://issues.apache.org/jira/browse/YARN-8994 Project: Hadoop

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680725#comment-16680725 ] Wilfred Spiegelenburg commented on YARN-8990: - thank you [~haibochen] for the quick review and

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680623#comment-16680623 ] Wilfred Spiegelenburg commented on YARN-8990: - I think that is a good idea, I have been

[jira] [Updated] (YARN-8990) FS: race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8990: Summary: FS: race condition in app submit and queue cleanup (was: FS" race

[jira] [Updated] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8985: Attachment: YARN-8985.002.patch > FSParentQueue: debug log missing when assigning

[jira] [Created] (YARN-8990) FS" race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8990: --- Summary: FS" race condition in app submit and queue cleanup Key: YARN-8990 URL: https://issues.apache.org/jira/browse/YARN-8990 Project: Hadoop YARN

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679313#comment-16679313 ] Wilfred Spiegelenburg commented on YARN-8985: - [~templedf] could you have a look at this one

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679535#comment-16679535 ] Wilfred Spiegelenburg commented on YARN-8985: - Patch to fix the findbugs warning

[jira] [Created] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8985: --- Summary: FSParentQueue: debug log missing when assigning container Key: YARN-8985 URL: https://issues.apache.org/jira/browse/YARN-8985 Project: Hadoop

[jira] [Commented] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2018-11-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674614#comment-16674614 ] Wilfred Spiegelenburg commented on YARN-7560: - [~zhengchenyu] do you mind if I take over to

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-11-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674592#comment-16674592 ] Wilfred Spiegelenburg commented on YARN-8865: - [~daryn] or [~jlowe] Could you please check the

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673027#comment-16673027 ] Wilfred Spiegelenburg commented on YARN-8948: - [~bibinchundatt] Thank you for picking this up.

[jira] [Created] (YARN-8967) Change FairScheduler to use PlacementRule interface

2018-11-02 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8967: --- Summary: Change FairScheduler to use PlacementRule interface Key: YARN-8967 URL: https://issues.apache.org/jira/browse/YARN-8967 Project: Hadoop YARN

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667328#comment-16667328 ] Wilfred Spiegelenburg commented on YARN-8951: - You should not be able to pass the last rule

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1601#comment-1601 ] Wilfred Spiegelenburg commented on YARN-8944: - The two new failures in this junit test are

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-25 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663617#comment-16663617 ] Wilfred Spiegelenburg commented on YARN-8944: - Failure stack trace from the junit test:

[jira] [Created] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-25 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8944: --- Summary: TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896 Key: YARN-8944 URL:

[jira] [Commented] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2018-10-24 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662293#comment-16662293 ] Wilfred Spiegelenburg commented on YARN-7721: - Neither of the junit tests failures are

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661608#comment-16661608 ] Wilfred Spiegelenburg commented on YARN-8904: - Thank you [~jlowe] for the checkin. The pointer

[jira] [Commented] (YARN-8436) FSParentQueue: Comparison method violates its general contract

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661579#comment-16661579 ] Wilfred Spiegelenburg commented on YARN-8436: - Sorry [~imstefanlee] I did not see your comment

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661462#comment-16661462 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you for catching that [~daryn]. The max

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.006.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659902#comment-16659902 ] Wilfred Spiegelenburg commented on YARN-8865: - junit test failures: * TestRMDelegationTokens:

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658768#comment-16658768 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you [~jlowe] for the review, the tests

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.005.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-21 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658447#comment-16658447 ] Wilfred Spiegelenburg commented on YARN-8059: - For the tests: I was expecting that when you

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656136#comment-16656136 ] Wilfred Spiegelenburg commented on YARN-8059: - Tank you [~snemeth] Jenkins has not run but I

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655245#comment-16655245 ] Wilfred Spiegelenburg commented on YARN-8904: - I cannot find any test failure: [WARNING] Tests

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655123#comment-16655123 ] Wilfred Spiegelenburg commented on YARN-8865: - Test failure is covered by YARN-8904. [~daryn]

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655080#comment-16655080 ] Wilfred Spiegelenburg commented on YARN-8864: - The test failure is in the native tests, I have

[jira] [Created] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8904: --- Summary: TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey Key: YARN-8904 URL: https://issues.apache.org/jira/browse/YARN-8904

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.004.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654588#comment-16654588 ] Wilfred Spiegelenburg commented on YARN-8865: - Fix for the check style issue I introduced. The

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654416#comment-16654416 ] Wilfred Spiegelenburg commented on YARN-8864: - Updated the patch to also use the remoteUser

[jira] [Updated] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8864: Attachment: YARN-8864.002.patch > NM incorrectly logs container user as the user

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652986#comment-16652986 ] Wilfred Spiegelenburg commented on YARN-8865: - [~daryn]: I changed the approach to add the

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.003.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647197#comment-16647197 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you for the updated patch. I am OK with

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646622#comment-16646622 ] Wilfred Spiegelenburg commented on YARN-8865: - I am not sure what has happened in the

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646374#comment-16646374 ] Wilfred Spiegelenburg commented on YARN-8865: - junit test failures are not related to the

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646360#comment-16646360 ] Wilfred Spiegelenburg commented on YARN-8864: - [~haibochen] If I understand you correctly we

[jira] [Assigned] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-8864: --- Assignee: Wilfred Spiegelenburg > NM incorrectly logs container user as the

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646003#comment-16646003 ] Wilfred Spiegelenburg commented on YARN-8468: - [~cheersyang] I see the same failure on trunk

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645997#comment-16645997 ] Wilfred Spiegelenburg commented on YARN-8865: - I added a second patch that follows the second

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.002.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645868#comment-16645868 ] Wilfred Spiegelenburg commented on YARN-8842: - The test failure is not related to this change

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645820#comment-16645820 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you for the feedback [~jlowe] and

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.001.patch > RMStateStore contains large number of expired

[jira] [Created] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8865: --- Summary: RMStateStore contains large number of expired RMDelegationToken Key: YARN-8865 URL: https://issues.apache.org/jira/browse/YARN-8865 Project:

[jira] [Comment Edited] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg edited comment on YARN-8842 at 10/10/18 5:29 AM:

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you [~snemeth]. I am glad we gave this

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638294#comment-16638294 ] Wilfred Spiegelenburg commented on YARN-8059: - Thank you for the split [~snemeth]. I added my

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638239#comment-16638239 ] Wilfred Spiegelenburg commented on YARN-8842: - One further remark that showed up while

<    1   2   3   4   5   6   >