[jira] [Updated] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12977: Status: Open (was: Patch Available) > s3a ignores delete("/", true) >

[jira] [Commented] (HADOOP-11780) Prevent IPC reader thread death

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530127#comment-15530127 ] Kihwal Lee commented on HADOOP-11780: - The 2.7 commit has been done. The only change is using type

[jira] [Updated] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12977: Attachment: HADOOP-12977-branch-2-002.patch branch-2 for branch-2; the patch tweaks the

[jira] [Commented] (HADOOP-13663) Index out of range in SysInfoWindows

2016-09-28 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530347#comment-15530347 ] Inigo Goiri commented on HADOOP-13663: -- My cleanest Hadoop QA report in a long time :)

[jira] [Comment Edited] (HADOOP-13661) Upgrade HTrace version

2016-09-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530231#comment-15530231 ] Sean Mackrory edited comment on HADOOP-13661 at 9/28/16 5:07 PM: -

[jira] [Updated] (HADOOP-11780) Prevent IPC reader thread death

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-11780: Fix Version/s: (was: 2.8.0) 2.7.4 > Prevent IPC reader thread death >

[jira] [Resolved] (HADOOP-13657) IPC Reader thread could silently die and leave NameNode unresponsive

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13657. - Resolution: Duplicate > IPC Reader thread could silently die and leave NameNode unresponsive >

[jira] [Commented] (HADOOP-13537) Support external calls in the RPC call queue

2016-09-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531094#comment-15531094 ] Rushabh S Shah commented on HADOOP-13537: - {noformat} Failed junit tests:

[jira] [Commented] (HADOOP-13560) S3ABlockOutputStream to support huge (many GB) file writes

2016-09-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530886#comment-15530886 ] Chris Nauroth commented on HADOOP-13560: I just realized that these comments would have been

[jira] [Commented] (HADOOP-13560) S3ABlockOutputStream to support huge (many GB) file writes

2016-09-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530884#comment-15530884 ] Chris Nauroth commented on HADOOP-13560: The documentation changes are looking good too. The

[jira] [Commented] (HADOOP-13560) S3ABlockOutputStream to support huge (many GB) file writes

2016-09-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530520#comment-15530520 ] Chris Nauroth commented on HADOOP-13560: At this point, I've read through all of patch 006

[jira] [Commented] (HADOOP-13661) Upgrade HTrace version

2016-09-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530231#comment-15530231 ] Sean Mackrory commented on HADOOP-13661: They're currently depending on 3.1.0 (both directly and

[jira] [Updated] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12977: Attachment: HADOOP-12977-branch-2-002.patch branch-2 for branch-2; the patch tweaks the

[jira] [Commented] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530390#comment-15530390 ] Mingliang Liu commented on HADOOP-12977: I like this patch, especially the FS spec improvements.

[jira] [Updated] (HADOOP-13599) s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown

2016-09-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13599: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (HADOOP-13599) s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531260#comment-15531260 ] Hudson commented on HADOOP-13599: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10510 (See

[jira] [Commented] (HADOOP-13628) Support to retrieve specific property from configuration via REST API

2016-09-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528534#comment-15528534 ] Weiwei Yang commented on HADOOP-13628: -- Hello [~liuml07] I just uploaded v6 patch according to

[jira] [Updated] (HADOOP-7352) FileSystem#listStatus should throw IOE upon access error

2016-09-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-7352: --- Attachment: HADOOP-7352.004.patch Patch 004: * Rebase * Fix 2 nits > FileSystem#listStatus should

[jira] [Commented] (HADOOP-13420) Hadoop standalone instance exits during starting an MR job with ExpiredTokenRemover error in log (after some time & after few jobs executed successfully)

2016-09-28 Thread Ramu.R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528633#comment-15528633 ] Ramu.R commented on HADOOP-13420: - Had the same problem with Ubuntu 16.04, I have downgraded to 14.04.

[jira] [Updated] (HADOOP-13164) Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13164: Attachment: HADOOP-13164-branch-005.patch # using {{ArrayList<>}} for list; no need to go

[jira] [Commented] (HADOOP-13661) Upgrade HTrace version

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529242#comment-15529242 ] Steve Loughran commented on HADOOP-13661: - As usual: what's at risk here? HBase? What version

[jira] [Commented] (HADOOP-7352) FileSystem#listStatus should throw IOE upon access error

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529250#comment-15529250 ] Hadoop QA commented on HADOOP-7352: --- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13164) Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13164: Status: Patch Available (was: Open) > Optimize

[jira] [Commented] (HADOOP-13164) Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529359#comment-15529359 ] Steve Loughran commented on HADOOP-13164: - One more thing. Seems to me that the cleanup after

[jira] [Commented] (HADOOP-12804) Read Proxy Password from Credential Providers in S3 FileSystem

2016-09-28 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529443#comment-15529443 ] Larry McCay commented on HADOOP-12804: -- Hi [~ste...@apache.org] - I'm sorry - this fell off my

[jira] [Commented] (HADOOP-12804) Read Proxy Password from Credential Providers in S3 FileSystem

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529085#comment-15529085 ] Hadoop QA commented on HADOOP-12804: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528794#comment-15528794 ] Rui Gao commented on HADOOP-13667: -- Hi [~templedf], could you help me review the patch? Thank you very

[jira] [Commented] (HADOOP-12804) Read Proxy Password from Credential Providers in S3 FileSystem

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528977#comment-15528977 ] Steve Loughran commented on HADOOP-12804: - Larry, have you had a chance to look at this? > Read

[jira] [Commented] (HADOOP-13222) s3a.mkdirs() to delete empty fake parent directories

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529053#comment-15529053 ] Steve Loughran commented on HADOOP-13222: - This is slightly more serious than you'd think: it

[jira] [Updated] (HADOOP-13164) Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13164: Assignee: Rajesh Balamohan Target Version/s: 2.9.0 Status: Open

[jira] [Updated] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Gao updated HADOOP-13667: - Status: Patch Available (was: Open) > Fix typing mistake of inline document in

[jira] [Commented] (HADOOP-13655) document object store use with fs shell and distcp

2016-09-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529527#comment-15529527 ] ASF GitHub Bot commented on HADOOP-13655: - Github user steveloughran commented on a diff in the

[jira] [Updated] (HADOOP-13427) Eliminate needless uses of FileSystem.exists, isFile, isDirectory

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13427: Status: Open (was: Patch Available) > Eliminate needless uses of FileSystem.exists,

[jira] [Commented] (HADOOP-12572) Update Hadoop's lz4 to r131

2016-09-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529676#comment-15529676 ] Allen Wittenauer commented on HADOOP-12572: --- Re-submitting to see if Apache Yetus still has a

[jira] [Commented] (HADOOP-13164) Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529511#comment-15529511 ] Hadoop QA commented on HADOOP-13164: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13427) Eliminate needless uses of FileSystem.exists, isFile, isDirectory

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13427: Attachment: HADOOP-13427-002.patch Patch 002: patch 001 rebased to trunk, to see what is

[jira] [Updated] (HADOOP-12572) Update Hadoop's lz4 to r131

2016-09-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-12572: -- Status: Patch Available (was: Reopened) > Update Hadoop's lz4 to r131 >

[jira] [Commented] (HADOOP-13560) S3ABlockOutputStream to support huge (many GB) file writes

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529588#comment-15529588 ] Steve Loughran commented on HADOOP-13560: - bq. so we'll eventually need a different patch for

[jira] [Assigned] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-12977: --- Assignee: Steve Loughran > s3a ignores delete("/", true) >

[jira] [Commented] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528789#comment-15528789 ] Rui Gao commented on HADOOP-13667: -- How nice you are! Thanks! > Fix typing mistake of inline document

[jira] [Comment Edited] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528794#comment-15528794 ] Rui Gao edited comment on HADOOP-13667 at 9/28/16 9:25 AM: --- Hi [~templedf],

[jira] [Commented] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529037#comment-15529037 ] Hadoop QA commented on HADOOP-13667: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13667) Fix typing mistake of inline document in hadoop-metrics2.properties

2016-09-28 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Gao updated HADOOP-13667: - Attachment: HADOOP-13667.patch > Fix typing mistake of inline document in hadoop-metrics2.properties >

[jira] [Commented] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529795#comment-15529795 ] Steve Loughran commented on HADOOP-13231: - * {{ITestS3ADeleteManyFiles.testOpenCreate}] uses

[jira] [Commented] (HADOOP-12572) Update Hadoop's lz4 to r131

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529704#comment-15529704 ] Hadoop QA commented on HADOOP-12572: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12977: Attachment: HADOOP-12977-002.patch Patch 002 # FS spec docs cover what posix does

[jira] [Commented] (HADOOP-13661) Upgrade HTrace version

2016-09-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529782#comment-15529782 ] Wei-Chiu Chuang commented on HADOOP-13661: -- It might be easier if we target it at 3.0. >

[jira] [Commented] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529784#comment-15529784 ] Hadoop QA commented on HADOOP-12977: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-12977) s3a ignores delete("/", true)

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12977: Target Version/s: 2.8.0 Status: Patch Available (was: Open) > s3a ignores

[jira] [Commented] (HADOOP-13516) Listing an empty s3a NON root directory throws FileNotFound.

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529828#comment-15529828 ] Steve Loughran commented on HADOOP-13516: - I'm not seeing this in branch-2 {code} $ ./hadoop fs

[jira] [Comment Edited] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529795#comment-15529795 ] Steve Loughran edited comment on HADOOP-13231 at 9/28/16 2:32 PM: -- *

[jira] [Resolved] (HADOOP-13567) S3AFileSystem to override getStorageStatistics() and so serve up its statistics

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13567. - Resolution: Duplicate Fix Version/s: 2.9.0 This was fixed during HADOOP-13560

[jira] [Commented] (HADOOP-11780) Prevent IPC reader thread death

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529887#comment-15529887 ] Hudson commented on HADOOP-11780: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10507 (See

[jira] [Updated] (HADOOP-11780) Prevent IPC reader thread death

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-11780: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Created] (HADOOP-13668) Make InstrumentedLock require ReentrantLock

2016-09-28 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HADOOP-13668: -- Summary: Make InstrumentedLock require ReentrantLock Key: HADOOP-13668 URL: https://issues.apache.org/jira/browse/HADOOP-13668 Project: Hadoop Common