[jira] [Updated] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HADOOP-15449: Description: We observed from several users regarding Namenode flip-over is due

[jira] [Updated] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HADOOP-15449: Attachment: HADOOP-15449.patch > Frequent Namenode Flipover affecting user Jobs.

[jira] [Created] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
Karthik Palanisamy created HADOOP-15449: --- Summary: Frequent Namenode Flipover affecting user Jobs. Key: HADOOP-15449 URL: https://issues.apache.org/jira/browse/HADOOP-15449 Project: Hadoop

[jira] [Commented] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465524#comment-16465524 ] Karthik Palanisamy commented on HADOOP-15449: - Cc: [~arpitagarwal] [~anu] > Frequent

[jira] [Updated] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HADOOP-15449: Description: We observed from several users regarding Namenode flip-over is due

[jira] [Updated] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-13649: Attachment: HADOOP-13649.002.patch > s3guard: implement time-based (TTL) expiry for

[jira] [Commented] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465674#comment-16465674 ] genericqa commented on HADOOP-13649: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465799#comment-16465799 ] Hudson commented on HADOOP-15446: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14132 (See

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465783#comment-16465783 ] Steve Loughran commented on HADOOP-15446: - +1, committed to branch 3.1 & trunk. If you want

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: (was: HADOOP-1.15.patch) > New implementation of ftp and sftp

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: HADOOP-1.15.patch > New implementation of ftp and sftp filesystems >

[jira] [Commented] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465636#comment-16465636 ] Gabor Bota commented on HADOOP-13649: - Thanks for the review. # I've created HADOOP-15423 to merge

[jira] [Comment Edited] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465636#comment-16465636 ] Gabor Bota edited comment on HADOOP-13649 at 5/7/18 8:43 AM: - Thanks for the

[jira] [Comment Edited] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465636#comment-16465636 ] Gabor Bota edited comment on HADOOP-13649 at 5/7/18 8:53 AM: - Thanks for the

[jira] [Commented] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465802#comment-16465802 ] Gabor Bota commented on HADOOP-13649: - Mvn test and verify were successful on eu-west-1 with 

[jira] [Comment Edited] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465802#comment-16465802 ] Gabor Bota edited comment on HADOOP-13649 at 5/7/18 11:23 AM: -- Mvn test and

[jira] [Updated] (HADOOP-15448) Swift auth fails "Expecting to find auth in request body"

2018-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15448: Summary: Swift auth fails "Expecting to find auth in request body" (was: Hadoop-8545

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: HADOOP-1.15.patch > New implementation of ftp and sftp filesystems >

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: (was: HADOOP-1.15.patch) > New implementation of ftp and sftp

[jira] [Commented] (HADOOP-15448) Swift auth fails "Expecting to find auth in request body"

2018-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465812#comment-16465812 ] Steve Loughran commented on HADOOP-15448: - * Well, this isn't a support channel, more for filing

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465825#comment-16465825 ] genericqa commented on HADOOP-1: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-12896) kdiag to add a --DEFAULTREALM option

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465877#comment-16465877 ] SammiChen edited comment on HADOOP-12896 at 5/7/18 12:56 PM: - Remove the fix

[jira] [Updated] (HADOOP-12896) kdiag to add a --DEFAULTREALM option

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-12896: --- Fix Version/s: (was: 2.9.1) > kdiag to add a --DEFAULTREALM option >

[jira] [Commented] (HADOOP-12896) kdiag to add a --DEFAULTREALM option

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465877#comment-16465877 ] SammiChen commented on HADOOP-12896: Remov the fix version field since it's not fixed actually. >

[jira] [Assigned] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HADOOP-15449: -- Assignee: Karthik Palanisamy > Frequent Namenode Flipover affecting user Jobs. >

[jira] [Commented] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465968#comment-16465968 ] Arpit Agarwal commented on HADOOP-15449: Thanks for reporting this [~kpalanisamy]. 5 seconds is

[jira] [Updated] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-15449: --- Status: Patch Available (was: Open) > Frequent Namenode Flipover affecting user Jobs. >

[jira] [Commented] (HADOOP-15420) s3guard ITestS3GuardToolLocal failures in diff tests

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466387#comment-16466387 ] Gabor Bota commented on HADOOP-15420: - Fixed checkstyle issues > s3guard ITestS3GuardToolLocal

[jira] [Updated] (HADOOP-15420) s3guard ITestS3GuardToolLocal failures in diff tests

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15420: Attachment: HADOOP-15420.002.patch > s3guard ITestS3GuardToolLocal failures in diff tests >

[jira] [Assigned] (HADOOP-15416) s3guard diff assert failure if source path not found

2018-05-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15416: --- Assignee: Gabor Bota > s3guard diff assert failure if source path not found >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Fix Version/s: (was: 3.0.3) (was: 2.9.2) (was:

[jira] [Commented] (HADOOP-15441) After HADOOP-14445, encryption zone operations print unnecessary INFO logs

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466486#comment-16466486 ] Xiao Chen commented on HADOOP-15441: Changed links based on Wei-Chiu's comment > After

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-15450: Fix Version/s: 2.8.4 > Avoid fsync storm triggered by DiskChecker and handle disk full situation

[jira] [Commented] (HADOOP-15390) Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466369#comment-16466369 ] Xiao Chen commented on HADOOP-15390: Just found out this was missing from branch-2, cherry-picked

[jira] [Updated] (HADOOP-15390) Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15390: --- Fix Version/s: 2.10.0 > Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens >

[jira] [Comment Edited] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466221#comment-16466221 ] Xiao Chen edited comment on HADOOP-14445 at 5/7/18 7:54 PM: Reopening Jira

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Fix Version/s: (was: 3.2.0) > Delegation tokens are not shared between KMS instances >

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466557#comment-16466557 ] Thomas Marquardt commented on HADOOP-15446: --- Yes, I will submit a branch-2 patch later today.

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HADOOP-15450: Target Version/s: 2.8.4, 3.1.1, 2.9.2, 3.0.3 Fix Version/s: (was: 2.8.4) > Avoid fsync

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466466#comment-16466466 ] Hudson commented on HADOOP-14445: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14133 (See

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: HADOOP-1.15.patch > New implementation of ftp and sftp filesystems >

[jira] [Updated] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Waldmann updated HADOOP-1: Attachment: (was: HADOOP-1.15.patch) > New implementation of ftp and sftp

[jira] [Updated] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15408: --- Resolution: Invalid Status: Resolved (was: Patch Available) With HADOOP-14445 reverted

[jira] [Updated] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15431: --- Resolution: Invalid Status: Resolved (was: Patch Available) With HADOOP-14445 reverted

[jira] [Assigned] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HADOOP-15408: -- Assignee: Rushabh S Shah > HADOOP-14445 broke Spark. > - > >

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466846#comment-16466846 ] Thomas Marquardt commented on HADOOP-15446: --- FYI, the same changes apply to both branch-2 and

[jira] [Comment Edited] (HADOOP-15420) s3guard ITestS3GuardToolLocal failures in diff tests

2018-05-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466764#comment-16466764 ] Aaron Fabbri edited comment on HADOOP-15420 at 5/8/18 2:44 AM: --- Thank you

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Attachment: HADOOP-15446-branch-2.001.patch > WASB: PageBlobInputStream.skip breaks

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466843#comment-16466843 ] Thomas Marquardt commented on HADOOP-15446: --- For branch-2, I've attached

[jira] [Commented] (HADOOP-15420) s3guard ITestS3GuardToolLocal failures in diff tests

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466624#comment-16466624 ] genericqa commented on HADOOP-15420: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13738) DiskChecker should perform some disk IO

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13738: Fix Version/s: (was: 2.8.4) 2.8.5 > DiskChecker should perform some disk

[jira] [Commented] (HADOOP-15420) s3guard ITestS3GuardToolLocal failures in diff tests

2018-05-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466764#comment-16466764 ] Aaron Fabbri commented on HADOOP-15420: --- Thank you for working on this issue [~gabor.bota]. Good

[jira] [Updated] (HADOOP-15399) KMSAcls should read kms-site.xml file.

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-15399: Fix Version/s: (was: 2.8.4) > KMSAcls should read kms-site.xml file. >

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466862#comment-16466862 ] genericqa commented on HADOOP-15446: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-15450: Target Version/s: 3.1.1, 2.9.2, 3.0.3, 2.8.5 (was: 2.8.4, 3.1.1, 2.9.2, 3.0.3) > Avoid fsync

[jira] [Commented] (HADOOP-13738) DiskChecker should perform some disk IO

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466748#comment-16466748 ] Junping Du commented on HADOOP-13738: - Revert it from branch-2.8.4 but keep it on branch-2.8 as I

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466769#comment-16466769 ] genericqa commented on HADOOP-1: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466836#comment-16466836 ] genericqa commented on HADOOP-13649: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13649: -- Attachment: HADOOP-13649.003.patch > s3guard: implement time-based (TTL) expiry for

[jira] [Commented] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466798#comment-16466798 ] Aaron Fabbri commented on HADOOP-13649: --- Nice work [~gabor.bota], this looks good. I hope you

[jira] [Commented] (HADOOP-15449) ZK performance issues causing frequent Namenode failover

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466685#comment-16466685 ] genericqa commented on HADOOP-15449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

2018-05-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466798#comment-16466798 ] Aaron Fabbri edited comment on HADOOP-13649 at 5/8/18 3:07 AM: --- Nice work

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-15450: --- Reporter: Kihwal Lee (was: Arpit Agarwal) > Avoid fsync storm triggered by DiskChecker and

[jira] [Commented] (HADOOP-13738) DiskChecker should perform some disk IO

2018-05-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466106#comment-16466106 ] Daryn Sharp commented on HADOOP-13738: -- This jira was not thought out.  It's causing problems on

[jira] [Commented] (HADOOP-13738) DiskChecker should perform some disk IO

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466159#comment-16466159 ] Arpit Agarwal commented on HADOOP-13738: [~daryn], [~kihwal], we can avoid the fsync storm by

[jira] [Created] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HADOOP-15450: -- Summary: Avoid fsync storm triggered by DiskChecker and handle disk full situation Key: HADOOP-15450 URL: https://issues.apache.org/jira/browse/HADOOP-15450

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-15450: --- Description: Fix disk checker issues reported by [~kihwal] in HADOOP-13738: # When space is

[jira] [Commented] (HADOOP-15449) Frequent Namenode Flipover affecting user Jobs.

2018-05-07 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466119#comment-16466119 ] Karthik Palanisamy commented on HADOOP-15449: - [~arpitagarwal]  Yes, it should re-connect. 

[jira] [Updated] (HADOOP-15449) ZK performance issues causing frequent Namenode failover

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-15449: --- Summary: ZK performance issues causing frequent Namenode failover (was: Frequent Namenode

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466155#comment-16466155 ] genericqa commented on HADOOP-1: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13738) DiskChecker should perform some disk IO

2018-05-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466171#comment-16466171 ] Arpit Agarwal commented on HADOOP-13738: Filed HADOOP-15450. > DiskChecker should perform some

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-15450: Priority: Blocker (was: Major) > Avoid fsync storm triggered by DiskChecker and handle disk full

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Duo Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466250#comment-16466250 ] Duo Xu commented on HADOOP-15446: - [~tmarquardt]  & [~ste...@apache.org]   Could we backport this to

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.revert.patch > Delegation tokens are not shared between KMS instances >

[jira] [Reopened] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HADOOP-14445: Reopening Jira as I'm reverting those changes. Will remove fix versions as I proceed. Some minor

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Status: Patch Available (was: Reopened) > Delegation tokens are not shared between KMS instances >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.branch-2.8.revert.patch > Delegation tokens are not shared between KMS