[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-05 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.003.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-05-31 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853168#comment-16853168 ] Adam Antal commented on YARN-9573: -- I couldn't get any further with this patch, because I couldn't start

[jira] [Comment Edited] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-05-31 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853168#comment-16853168 ] Adam Antal edited comment on YARN-9573 at 5/31/19 4:08 PM: --- I couldn't get any

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-31 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853183#comment-16853183 ] Adam Antal commented on YARN-9525: -- [~pbacsko]: The error with the offset thing pops up with the old code

[jira] [Comment Edited] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-05-28 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847644#comment-16847644 ] Adam Antal edited comment on YARN-9573 at 5/28/19 1:34 PM: --- Thanks for the

[jira] [Commented] (YARN-9452) Fix failing testcases TestDistributedShell and TestTimelineAuthFilterForV2

2019-05-30 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851884#comment-16851884 ] Adam Antal commented on YARN-9452: -- Thanks for taking care the items, +1 (non-binding). > Fix failing

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-30 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852026#comment-16852026 ] Adam Antal commented on YARN-9525: -- Turned out I have problems changing the jars in my cluster. Looks

[jira] [Commented] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-28 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849586#comment-16849586 ] Adam Antal commented on YARN-9581: -- Thanks for the patch [~Prabhu Joseph], indeed a nice catch. Also

[jira] [Commented] (YARN-9452) Fix failing testcases TestDistributedShell and TestTimelineAuthFilterForV2

2019-05-28 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849844#comment-16849844 ] Adam Antal commented on YARN-9452: -- Thanks for the detailed explanation. I looked at the jiras you

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-04 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855416#comment-16855416 ] Adam Antal commented on YARN-9573: -- Strangely jenkins didn't run. Retriggering it by moving this issue

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857460#comment-16857460 ] Adam Antal commented on YARN-9573: -- [~sunilg] all items have been addressed. Could you take a look at it?

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857493#comment-16857493 ] Adam Antal commented on YARN-6875: -- As my understanding the last issue around the new file format is to

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857512#comment-16857512 ] Adam Antal commented on YARN-9573: -- Yes, I uploaded patches to branch-3.2:

[jira] [Updated] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9573: - Attachment: YARN-9573.001.branch-3.1.patch > DistributedShell cannot specify LogAggregationContext >

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Issue Type: Sub-task (was: Bug) Parent: YARN-6875 > IFile format is not working against s3a

[jira] [Created] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-06 Thread Adam Antal (JIRA)
Adam Antal created YARN-9607: Summary: Auto-configuring rollover-size of IFile format for non-appendable filesystems Key: YARN-9607 URL: https://issues.apache.org/jira/browse/YARN-9607 Project: Hadoop

[jira] [Updated] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9573: - Attachment: YARN-9573.001.branch-3.2.patch > DistributedShell cannot specify LogAggregationContext >

[jira] [Commented] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-06-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860628#comment-16860628 ] Adam Antal commented on YARN-9471: -- Thanks for the review [~snemeth], and [~jojochuang] for the commit!

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863169#comment-16863169 ] Adam Antal commented on YARN-9525: -- Sorry for the delayed answer, let me recap my current progress. I

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.004.patch > IFile format is not working against s3a remote folder >

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-12 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Attachment: YARN-9607.001.patch > Auto-configuring rollover-size of IFile format for non-appendable

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863826#comment-16863826 ] Adam Antal commented on YARN-9525: -- Uploaded patch v5 fixing the 2 checkstyle errors. > IFile format is

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.005.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-19 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867716#comment-16867716 ] Adam Antal commented on YARN-9607: -- Uploaded patch v2. There has been changed a lot since the last

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-19 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Attachment: YARN-9607.002.patch > Auto-configuring rollover-size of IFile format for non-appendable

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-20 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868326#comment-16868326 ] Adam Antal commented on YARN-9607: -- Thanks for the comment [~ste...@apache.org]. HADOOP-15691 would be

[jira] [Commented] (YARN-9559) Create AbstractContainersLauncher for pluggable ContainersLauncher logic

2019-06-20 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868490#comment-16868490 ] Adam Antal commented on YARN-9559: -- Hi, Thanks for the patch [~jhung]. Generally I think this logic

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869360#comment-16869360 ] Adam Antal commented on YARN-9629: -- Uploaded patch v1. Implementation comments: - a new config option has

[jira] [Updated] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9629: - Attachment: YARN-9629.001.patch > Support configurable MIN_LOG_ROLLING_INTERVAL >

[jira] [Updated] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9629: - Attachment: YARN-9629.002.patch > Support configurable MIN_LOG_ROLLING_INTERVAL >

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869540#comment-16869540 ] Adam Antal commented on YARN-9629: -- Thanks for the review [~shuzirra]. Renamed the constant

[jira] [Updated] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9629: - Attachment: YARN-9629.003.patch > Support configurable MIN_LOG_ROLLING_INTERVAL >

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871003#comment-16871003 ] Adam Antal commented on YARN-9629: -- Thanks for the review [~snemeth]. Please find your concerns addressed

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871184#comment-16871184 ] Adam Antal commented on YARN-9525: -- An update on this issue: The manual verification of the patch has

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-18 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866574#comment-16866574 ] Adam Antal commented on YARN-9573: -- [~sunilg], did you have a chance to check the patches for the other

[jira] [Created] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-06-17 Thread Adam Antal (JIRA)
Adam Antal created YARN-9629: Summary: Support configurable MIN_LOG_ROLLING_INTERVAL Key: YARN-9629 URL: https://issues.apache.org/jira/browse/YARN-9629 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838532#comment-16838532 ] Adam Antal commented on YARN-9525: -- Thanks for the input [~ste...@apache.org]. When an aggregation cycle

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Summary: IFile format is not working against s3a remote folder (was: TFile format is not working against

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-13 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838609#comment-16838609 ] Adam Antal commented on YARN-9519: -- We're a bit stuck to properly configure file formats without this

[jira] [Commented] (YARN-9519) TFile log aggregation file format is not working for yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840094#comment-16840094 ] Adam Antal commented on YARN-9519: -- Thanks for the reviews and the commit. > TFile log aggregation file

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846797#comment-16846797 ] Adam Antal commented on YARN-9525: -- I want to recreate the test on every config combination, I'll paste

[jira] [Commented] (YARN-9469) Fix typo in YarnConfiguration: physical memory

2019-05-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846903#comment-16846903 ] Adam Antal commented on YARN-9469: -- Thanks for the contribution [~troclosan] and [~jojochuang] for the

[jira] [Updated] (YARN-9573) DistributedShell can't specify LogAggregationContext

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9573: - Attachment: YARN-9573.001.patch > DistributedShell can't specify LogAggregationContext >

[jira] [Commented] (YARN-9573) DistributedShell can't specify LogAggregationContext

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847316#comment-16847316 ] Adam Antal commented on YARN-9573: -- Uploaded patch v1. It supports adding simple pattern to be added to

[jira] [Assigned] (YARN-9512) [JDK11] TestAuxServices#testCustomizedAuxServiceClassPath ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLCl

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9512: Assignee: Adam Antal > [JDK11] TestAuxServices#testCustomizedAuxServiceClassPath

[jira] [Assigned] (YARN-9511) [JDK11] TestAuxServices#testRemoteAuxServiceClassPath YarnRuntimeException: The remote jarfile should not be writable by group or others. The current Permission is 436

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9511: Assignee: Adam Antal > [JDK11] TestAuxServices#testRemoteAuxServiceClassPath YarnRuntimeException:

[jira] [Commented] (YARN-9145) [Umbrella] Dynamically add or remove auxiliary services

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847576#comment-16847576 ] Adam Antal commented on YARN-9145: -- Hi [~billie.rinaldi], is this considered feature-completed? >

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847644#comment-16847644 ] Adam Antal commented on YARN-9573: -- Thanks for the reviews, just to make sure let's wait until YARN-9425

[jira] [Commented] (YARN-9558) Log Aggregation testcases failing

2019-05-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846549#comment-16846549 ] Adam Antal commented on YARN-9558: -- Thanks for the patch [~Prabhu Joseph], +1 (non-binding). Also thanks

[jira] [Commented] (YARN-9512) [JDK11] TestAuxServices#testCustomizedAuxServiceClassPath ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLC

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847689#comment-16847689 ] Adam Antal commented on YARN-9512: -- I made some investigation, but don't have a proposed solutions to

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-24 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847698#comment-16847698 ] Adam Antal commented on YARN-9525: -- It looks like we still have some problems with IFile, I got the

[jira] [Updated] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-05-20 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9471: - Attachment: YARN-9471.002.patch > Cleanup in TestLogAggregationIndexFileController >

[jira] [Commented] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-05-20 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844115#comment-16844115 ] Adam Antal commented on YARN-9471: -- Oh, in the meantime YARN-9470 got committed. Rebased. Thanks for the

[jira] [Created] (YARN-9573) DistributedShell can't specify LogAggregationContext

2019-05-21 Thread Adam Antal (JIRA)
Adam Antal created YARN-9573: Summary: DistributedShell can't specify LogAggregationContext Key: YARN-9573 URL: https://issues.apache.org/jira/browse/YARN-9573 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9558) Log Aggregation testcases failing

2019-05-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844613#comment-16844613 ] Adam Antal commented on YARN-9558: -- Thanks for taking care the failures. It's been annoying people all

[jira] [Commented] (YARN-6272) TestAMRMClient#testAMRMClientWithContainerResourceChange fails intermittently

2019-05-21 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844794#comment-16844794 ] Adam Antal commented on YARN-6272: -- Couldn't we force the container to be allocated in the same node

[jira] [Commented] (YARN-9518) cgroup subsystem in centos7

2019-04-29 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829064#comment-16829064 ] Adam Antal commented on YARN-9518: -- Hi [~shurong.mai], could you please provide a description about the

[jira] [Assigned] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-29 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9519: Assignee: Adam Antal > TFile log aggregation file format is insensitive to the >

[jira] [Created] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-29 Thread Adam Antal (JIRA)
Adam Antal created YARN-9519: Summary: TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config Key: YARN-9519 URL: https://issues.apache.org/jira/browse/YARN-9519

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-29 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829223#comment-16829223 ] Adam Antal commented on YARN-9519: -- It looks like it is also insensitive to the suffix version of this

[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-04-29 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9519: - Attachment: YARN-9519.001.patch > TFile log aggregation file format is insensitive to the >

[jira] [Updated] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-07 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9513: - Attachment: YARN-9513.002.patch > [JDK11] TestMetricsInvariantChecker#testManyRuns

[jira] [Commented] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-07 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834763#comment-16834763 ] Adam Antal commented on YARN-9513: -- Thanks [~giovanni.fumarola], I was trying so hard to find a

[jira] [Commented] (YARN-9513) [JDK11] Fix TestMetricsInvariantChecker#testManyRuns in case of JDK greater than 8

2019-05-08 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835396#comment-16835396 ] Adam Antal commented on YARN-9513: -- I should have added the exclusion to the pom.xml. Thanks for the

[jira] [Updated] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9513: - Attachment: YARN-9513.001.patch > [JDK11] TestMetricsInvariantChecker#testManyRuns

[jira] [Commented] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833711#comment-16833711 ] Adam Antal commented on YARN-9513: -- I got a chance to run this test on multiple JDKs, and it turns out

[jira] [Commented] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833712#comment-16833712 ] Adam Antal commented on YARN-9513: -- [~jojochuang], [~smeng], do you have any thoughts on this/could you

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833779#comment-16833779 ] Adam Antal commented on YARN-9519: -- Forget to address the {{ExpectedException}}, added it in patch v5.

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833769#comment-16833769 ] Adam Antal commented on YARN-9519: -- Thanks for the review [~snemeth]. I answer to your points below: 1.

[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9519: - Attachment: YARN-9519.003.patch > TFile log aggregation file format is insensitive to the >

[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9519: - Attachment: YARN-9519.004.patch > TFile log aggregation file format is insensitive to the >

[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9519: - Attachment: YARN-9519.005.patch > TFile log aggregation file format is insensitive to the >

[jira] [Commented] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833864#comment-16833864 ] Adam Antal commented on YARN-9513: -- 1 ASF License error is due to the invariants.txt file is parsed line

[jira] [Commented] (YARN-9526) NM invariably dies if log aggregation is enabled

2019-05-06 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833867#comment-16833867 ] Adam Antal commented on YARN-9526: -- That does make sense. I encourage you to go ahead and raise a ticket

[jira] [Commented] (YARN-9525) TFile format is not working against s3a remote folder

2019-05-02 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831783#comment-16831783 ] Adam Antal commented on YARN-9525: -- The related code: {code:java} Path aggregatedLogFile = null; if

[jira] [Assigned] (YARN-9525) TFile format is not working against s3a remote folder

2019-05-02 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9525: Assignee: Adam Antal > TFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9526) NM invariably dies if log aggregation is enabled

2019-05-02 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831858#comment-16831858 ] Adam Antal commented on YARN-9526: -- I'm +1 on making a more meaningful message instead of

[jira] [Created] (YARN-9525) TFile format is not working against s3a remote folder

2019-05-02 Thread Adam Antal (JIRA)
Adam Antal created YARN-9525: Summary: TFile format is not working against s3a remote folder Key: YARN-9525 URL: https://issues.apache.org/jira/browse/YARN-9525 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9519: - Attachment: YARN-9519.002.patch > TFile log aggregation file format is insensitive to the >

[jira] [Commented] (YARN-9519) TFile log aggregation file format is insensitive to the yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832469#comment-16832469 ] Adam Antal commented on YARN-9519: -- Uploaded patch v2 with some tests. Unfortunately I couldn't touch

[jira] [Commented] (YARN-9513) [JDK11] TestMetricsInvariantChecker#testManyRuns InvariantViolationException: ReferenceError: "GcCountPS_Scavenge" is not defined in at line number 1

2019-04-26 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826977#comment-16826977 ] Adam Antal commented on YARN-9513: -- I run it on my local and played around a little with the test case.

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-26 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826983#comment-16826983 ] Adam Antal commented on YARN-6929: -- This patch has a very good side-effect. For not-posix compliant

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877668#comment-16877668 ] Adam Antal commented on YARN-9629: -- Thanks for the reply [~sunilg]. Agreed on #2. Removed the plus

[jira] [Updated] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9629: - Attachment: YARN-9629.006.patch > Support configurable MIN_LOG_ROLLING_INTERVAL >

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-02 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877015#comment-16877015 ] Adam Antal commented on YARN-9629: -- Thanks for the review [~sunilg]. 1) Firstly if the user does not

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-04 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878427#comment-16878427 ] Adam Antal commented on YARN-9629: -- Thanks [~snemeth] for uploading the patches. Looks like the two test

[jira] [Updated] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-01 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9629: - Attachment: YARN-9629.005.patch > Support configurable MIN_LOG_ROLLING_INTERVAL >

[jira] [Commented] (YARN-9629) Support configurable MIN_LOG_ROLLING_INTERVAL

2019-07-01 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876128#comment-16876128 ] Adam Antal commented on YARN-9629: -- Ah indeed, thanks for the suggestion [~snemeth]. I must have missed

[jira] [Assigned] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9676: Assignee: Adam Antal > Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected >

[jira] [Created] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

2019-07-15 Thread Adam Antal (JIRA)
Adam Antal created YARN-9676: Summary: Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes Key: YARN-9676 URL: https://issues.apache.org/jira/browse/YARN-9676 Project: Hadoop

[jira] [Assigned] (YARN-9675) Expose log aggregation diagnostic messages through RM API

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9675: Assignee: Adam Antal > Expose log aggregation diagnostic messages through RM API >

[jira] [Created] (YARN-9675) Expose log aggregation diagnostic messages through RM API

2019-07-15 Thread Adam Antal (JIRA)
Adam Antal created YARN-9675: Summary: Expose log aggregation diagnostic messages through RM API Key: YARN-9675 URL: https://issues.apache.org/jira/browse/YARN-9675 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2019-04-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823880#comment-16823880 ] Adam Antal commented on YARN-8551: -- Sorry didn't have the bandwidth to take a look at this. If I found

[jira] [Assigned] (YARN-9469) Fix typo in YarnConfiguration: physical memory

2019-04-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9469: Assignee: Igor Rudenko > Fix typo in YarnConfiguration: physical memory >

[jira] [Commented] (YARN-9469) Fix typo in YarnConfiguration: physical memory

2019-04-23 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823875#comment-16823875 ] Adam Antal commented on YARN-9469: -- Assigned to you. Thanks [~troclosan], LGTM (non-binding). > Fix typo

[jira] [Created] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-04-10 Thread Adam Antal (JIRA)
Adam Antal created YARN-9471: Summary: Cleanup in TestLogAggregationIndexFileController Key: YARN-9471 URL: https://issues.apache.org/jira/browse/YARN-9471 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-04-10 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9471: - Attachment: YARN-9471.001.patch > Cleanup in TestLogAggregationIndexFileController >

[jira] [Assigned] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

2019-04-10 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9471: Assignee: Adam Antal > Cleanup in TestLogAggregationIndexFileController >

[jira] [Assigned] (YARN-6356) Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs

2019-04-09 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-6356: Assignee: Adam Antal > Allow different values of yarn.log-aggregation.retain-seconds for succeeded

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2019-04-09 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813320#comment-16813320 ] Adam Antal commented on YARN-8920: -- Hi [~suma.shivaprasad], Are you still working on this issue? >

<    1   2   3   4   5   6   7   8   9   >