[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-31 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757815#comment-16757815 ] Wilfred Spiegelenburg commented on YARN-8967: - [~sunilg] can you please have a

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743604#comment-16743604 ] Wilfred Spiegelenburg commented on YARN-9198: - Not restoring an application is

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED, and NullPointerException happens in RM while shutdown a NM

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743598#comment-16743598 ] Wilfred Spiegelenburg commented on YARN-9194: - Yes that looks better. > Inval

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED, and NullPointerException happens in RM while shutdown a NM

2019-01-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743551#comment-16743551 ] Wilfred Spiegelenburg commented on YARN-9194: - Changing it back to SCHEDULED l

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742077#comment-16742077 ] Wilfred Spiegelenburg commented on YARN-9198: - As I [commented in the previous

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED at FAILED

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742061#comment-16742061 ] Wilfred Spiegelenburg commented on YARN-9194: - Thank you for logging this jira

[jira] [Commented] (YARN-9193) NullPointerException happens in RM while shutdown a NM

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742063#comment-16742063 ] Wilfred Spiegelenburg commented on YARN-9193: - [~xiaoheipangzi] if this is rea

[jira] [Assigned] (YARN-7913) Improve error handling when application recovery fails with exception

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-7913: --- Assignee: Wilfred Spiegelenburg (was: Gergo Repas) > Improve error handling

[jira] [Commented] (YARN-9198) Corrupted state from a previous version can still cause RM to fail with NPE on FairScheduler

2019-01-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742031#comment-16742031 ] Wilfred Spiegelenburg commented on YARN-9198: - [~dapengsun] can you explain a

[jira] [Resolved] (YARN-1122) FairScheduler user-as-default-queue always defaults to 'default'

2019-01-12 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-1122. - Resolution: Duplicate closing old jira as duplicate per comment > FairScheduler u

[jira] [Commented] (YARN-8833) Avoid potential integer overflow when computing fair shares

2019-01-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737851#comment-16737851 ] Wilfred Spiegelenburg commented on YARN-8833: - The patch looks good +1. The ch

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736780#comment-16736780 ] Wilfred Spiegelenburg commented on YARN-9173: - Sorry for the typo in the patch

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736490#comment-16736490 ] Wilfred Spiegelenburg commented on YARN-9173: - [~cheersyang] I have added a pa

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: YARN-9137-branch3.1.001.patch > FairShare calculation broken for large v

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: (was: stash@{1}.textClipping) > FairShare calculation broken for lar

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: stash@{1}.textClipping > FairShare calculation broken for large values a

[jira] [Updated] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-9173: Attachment: YARN-9173.002.patch > FairShare calculation broken for large values afte

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735398#comment-16735398 ] Wilfred Spiegelenburg commented on YARN-9173: - Thank you [~cheersyang] for the

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-05 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734881#comment-16734881 ] Wilfred Spiegelenburg commented on YARN-8967: - Updated the patch with fixes fo

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-05 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.004.patch > Change FairScheduler to use PlacementRule interfac

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734240#comment-16734240 ] Wilfred Spiegelenburg commented on YARN-9173: - Test failure is not related to

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733723#comment-16733723 ] Wilfred Spiegelenburg commented on YARN-8967: - Thank you [~leftnoteasy] It has

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.003.patch > Change FairScheduler to use PlacementRule interfac

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733094#comment-16733094 ] Wilfred Spiegelenburg commented on YARN-8967: - Update to fix the tests and the

[jira] [Created] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-03 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9173: --- Summary: FairShare calculation broken for large values after YARN-8833 Key: YARN-9173 URL: https://issues.apache.org/jira/browse/YARN-9173 Project: Hado

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.002.patch > Change FairScheduler to use PlacementRule interfac

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732656#comment-16732656 ] Wilfred Spiegelenburg commented on YARN-8967: - new patch rebased to the latest

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-01-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.001.patch > Change FairScheduler to use PlacementRule interfac

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-12-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709605#comment-16709605 ] Wilfred Spiegelenburg commented on YARN-8789: - First: I would expect that the

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-12-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16706529#comment-16706529 ] Wilfred Spiegelenburg commented on YARN-8789: - Hi [~belugabehr] can you explai

[jira] [Assigned] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9066: --- Assignee: Wilfred Spiegelenburg > Deprecate Fair Scheduler min share > --

[jira] [Commented] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704225#comment-16704225 ] Wilfred Spiegelenburg commented on YARN-9066: - [~haibochen] do you mind if I t

[jira] [Commented] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16696698#comment-16696698 ] Wilfred Spiegelenburg commented on YARN-9047: - Even before the build shows up:

[jira] [Assigned] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9047: --- Assignee: Szilard Nemeth > FairScheduler: default resource calculator is not

[jira] [Created] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9047: --- Summary: FairScheduler: default resource calculator is not resource type aware Key: YARN-9047 URL: https://issues.apache.org/jira/browse/YARN-9047 Proje

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695727#comment-16695727 ] Wilfred Spiegelenburg commented on YARN-8948: - Thank you [~bibinchundatt] for

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16693316#comment-16693316 ] Wilfred Spiegelenburg commented on YARN-8738: - Thank you for the patch [~sneme

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16693298#comment-16693298 ] Wilfred Spiegelenburg commented on YARN-9025: - Change looks good, we discussed

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16693290#comment-16693290 ] Wilfred Spiegelenburg commented on YARN-9019: - Change looks good +1 (non bindi

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16693120#comment-16693120 ] Wilfred Spiegelenburg commented on YARN-8992: - junit test failure is not relat

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-19 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691681#comment-16691681 ] Wilfred Spiegelenburg commented on YARN-8992: - Updated patch with a fix for th

[jira] [Updated] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-19 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8992: Attachment: YARN-8992.002.patch > Fair scheduler can delete a dynamic queue while an

[jira] [Commented] (YARN-9024) ClusterNodeTracker maximum allocation does not respect resource units

2018-11-15 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16688214#comment-16688214 ] Wilfred Spiegelenburg commented on YARN-9024: - Thank you for logging this issu

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-14 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686547#comment-16686547 ] Wilfred Spiegelenburg commented on YARN-9007: - [~sunilg] OPPORTUNISTIC contain

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-13 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684892#comment-16684892 ] Wilfred Spiegelenburg commented on YARN-8948: - Hi [~bibinchundatt], thank you

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680955#comment-16680955 ] Wilfred Spiegelenburg commented on YARN-8992: - [~haibochen] thank you for logg

[jira] [Assigned] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-8992: --- Assignee: Wilfred Spiegelenburg > Fair scheduler can delete a dynamic queue w

[jira] [Created] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8994: --- Summary: Fix for race condition in move app and queue cleanup in FS Key: YARN-8994 URL: https://issues.apache.org/jira/browse/YARN-8994 Project: Hadoop Y

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680725#comment-16680725 ] Wilfred Spiegelenburg commented on YARN-8990: - thank you [~haibochen] for the

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680623#comment-16680623 ] Wilfred Spiegelenburg commented on YARN-8990: - I think that is a good idea, I

[jira] [Updated] (YARN-8990) FS: race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8990: Summary: FS: race condition in app submit and queue cleanup (was: FS" race conditio

[jira] [Updated] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8985: Attachment: YARN-8985.002.patch > FSParentQueue: debug log missing when assigning co

[jira] [Created] (YARN-8990) FS" race condition in app submit and queue cleanup

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8990: --- Summary: FS" race condition in app submit and queue cleanup Key: YARN-8990 URL: https://issues.apache.org/jira/browse/YARN-8990 Project: Hadoop YARN

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679313#comment-16679313 ] Wilfred Spiegelenburg commented on YARN-8985: - [~templedf] could you have a lo

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679535#comment-16679535 ] Wilfred Spiegelenburg commented on YARN-8985: - Patch to fix the findbugs warni

[jira] [Created] (YARN-8985) FSParentQueue: debug log missing when assigning container

2018-11-08 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8985: --- Summary: FSParentQueue: debug log missing when assigning container Key: YARN-8985 URL: https://issues.apache.org/jira/browse/YARN-8985 Project: Hadoop YA

[jira] [Commented] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2018-11-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674614#comment-16674614 ] Wilfred Spiegelenburg commented on YARN-7560: - [~zhengchenyu] do you mind if I

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-11-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674592#comment-16674592 ] Wilfred Spiegelenburg commented on YARN-8865: - [~daryn] or [~jlowe] Could you

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673027#comment-16673027 ] Wilfred Spiegelenburg commented on YARN-8948: - [~bibinchundatt] Thank you for

[jira] [Created] (YARN-8967) Change FairScheduler to use PlacementRule interface

2018-11-02 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8967: --- Summary: Change FairScheduler to use PlacementRule interface Key: YARN-8967 URL: https://issues.apache.org/jira/browse/YARN-8967 Project: Hadoop YARN

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667328#comment-16667328 ] Wilfred Spiegelenburg commented on YARN-8951: - You should not be able to pass

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1601#comment-1601 ] Wilfred Spiegelenburg commented on YARN-8944: - The two new failures in this ju

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-25 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663617#comment-16663617 ] Wilfred Spiegelenburg commented on YARN-8944: - Failure stack trace from the ju

[jira] [Created] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-25 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8944: --- Summary: TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896 Key: YARN-8944 URL: https://issues.apache.org/jira/browse/YARN-89

[jira] [Commented] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2018-10-24 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662293#comment-16662293 ] Wilfred Spiegelenburg commented on YARN-7721: - Neither of the junit tests fail

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661608#comment-16661608 ] Wilfred Spiegelenburg commented on YARN-8904: - Thank you [~jlowe] for the chec

[jira] [Commented] (YARN-8436) FSParentQueue: Comparison method violates its general contract

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661579#comment-16661579 ] Wilfred Spiegelenburg commented on YARN-8436: - Sorry [~imstefanlee] I did not

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661462#comment-16661462 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you for catching that [~d

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.006.patch > RMStateStore contains large number of expired RMDe

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659902#comment-16659902 ] Wilfred Spiegelenburg commented on YARN-8865: - junit test failures: * TestRMD

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658768#comment-16658768 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you [~jlowe] for the revi

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.005.patch > RMStateStore contains large number of expired RMDe

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-21 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16658447#comment-16658447 ] Wilfred Spiegelenburg commented on YARN-8059: - For the tests: I was expecting

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656136#comment-16656136 ] Wilfred Spiegelenburg commented on YARN-8059: - Tank you [~snemeth] Jenkins ha

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655245#comment-16655245 ] Wilfred Spiegelenburg commented on YARN-8904: - I cannot find any test failure:

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655123#comment-16655123 ] Wilfred Spiegelenburg commented on YARN-8865: - Test failure is covered by YARN

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655080#comment-16655080 ] Wilfred Spiegelenburg commented on YARN-8864: - The test failure is in the nati

[jira] [Created] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8904: --- Summary: TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey Key: YARN-8904 URL: https://issues.apache.org/jira/browse/YARN-8904

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.004.patch > RMStateStore contains large number of expired RMDe

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654588#comment-16654588 ] Wilfred Spiegelenburg commented on YARN-8865: - Fix for the check style issue I

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654416#comment-16654416 ] Wilfred Spiegelenburg commented on YARN-8864: - Updated the patch to also use t

[jira] [Updated] (YARN-8864) NM incorrectly logs container user as the user who sent a start/stop container request in its audit log

2018-10-17 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8864: Attachment: YARN-8864.002.patch > NM incorrectly logs container user as the user who

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652986#comment-16652986 ] Wilfred Spiegelenburg commented on YARN-8865: - [~daryn]: I changed the approac

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.003.patch > RMStateStore contains large number of expired RMDe

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647197#comment-16647197 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you for the updated patch

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646622#comment-16646622 ] Wilfred Spiegelenburg commented on YARN-8865: - I am not sure what has happened

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646374#comment-16646374 ] Wilfred Spiegelenburg commented on YARN-8865: - junit test failures are not rel

[jira] [Commented] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-11 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646360#comment-16646360 ] Wilfred Spiegelenburg commented on YARN-8864: - [~haibochen] If I understand yo

[jira] [Assigned] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-8864: --- Assignee: Wilfred Spiegelenburg > NM incorrectly logs container user as the u

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646003#comment-16646003 ] Wilfred Spiegelenburg commented on YARN-8468: - [~cheersyang] I see the same fa

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645997#comment-16645997 ] Wilfred Spiegelenburg commented on YARN-8865: - I added a second patch that fol

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.002.patch > RMStateStore contains large number of expired RMDe

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645868#comment-16645868 ] Wilfred Spiegelenburg commented on YARN-8842: - The test failure is not related

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645820#comment-16645820 ] Wilfred Spiegelenburg commented on YARN-8865: - Thank you for the feedback [~jl

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.001.patch > RMStateStore contains large number of expired RMDe

[jira] [Created] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-8865: --- Summary: RMStateStore contains large number of expired RMDelegationToken Key: YARN-8865 URL: https://issues.apache.org/jira/browse/YARN-8865 Project: Ha

[jira] [Comment Edited] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644473#comment-16644473 ] Wilfred Spiegelenburg edited comment on YARN-8842 at 10/10/18 5:29 AM: -

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644473#comment-16644473 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you [~snemeth]. I am glad

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638294#comment-16638294 ] Wilfred Spiegelenburg commented on YARN-8059: - Thank you for the split [~sneme

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638239#comment-16638239 ] Wilfred Spiegelenburg commented on YARN-8842: - One further remark that showed

<    1   2   3   4   5   6   >