[jira] [Commented] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035743#comment-16035743 ] Hadoop QA commented on HADOOP-14478: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035724#comment-16035724 ] Rajesh Balamohan commented on HADOOP-14478: --- Thanks [~liuml07] > Optimize

[jira] [Updated] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14478: -- Attachment: HADOOP-14478.003.patch Attaching .3 patch to address checkstyle issue

[jira] [Commented] (HADOOP-14476) make InconsistentAmazonS3Client usable in downstream tests

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035691#comment-16035691 ] Aaron Fabbri commented on HADOOP-14476: --- I started on this but shout if you wanted to work on it

[jira] [Commented] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035677#comment-16035677 ] Hadoop QA commented on HADOOP-14478: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14459) SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined

2017-06-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035678#comment-16035678 ] Daniel Templeton commented on HADOOP-14459: --- I think that works for me. I think the last

[jira] [Commented] (HADOOP-14394) Provide Builder pattern for DistributedFileSystem.create

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035657#comment-16035657 ] Hadoop QA commented on HADOOP-14394: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035644#comment-16035644 ] Mingliang Liu commented on HADOOP-14478: +1 pending on Jenkins. Will commit next Monday if no

[jira] [Assigned] (HADOOP-14476) make InconsistentAmazonS3Client usable in downstream tests

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri reassigned HADOOP-14476: - Assignee: Aaron Fabbri > make InconsistentAmazonS3Client usable in downstream tests >

[jira] [Updated] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14478: --- Status: Patch Available (was: Open) > Optimize NativeAzureFsInputStream for positional

[jira] [Comment Edited] (HADOOP-12360) Create StatsD metrics2 sink

2017-06-02 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035619#comment-16035619 ] Dave Marion edited comment on HADOOP-12360 at 6/2/17 11:27 PM: --- Honestly,

[jira] [Comment Edited] (HADOOP-12360) Create StatsD metrics2 sink

2017-06-02 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035619#comment-16035619 ] Dave Marion edited comment on HADOOP-12360 at 6/2/17 11:26 PM: --- Honestly,

[jira] [Commented] (HADOOP-12360) Create StatsD metrics2 sink

2017-06-02 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035619#comment-16035619 ] Dave Marion commented on HADOOP-12360: -- Honestly, I don't remember, it's been too long. Is this

[jira] [Commented] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035586#comment-16035586 ] Chen Liang commented on HADOOP-14481: - Thanks [~jojochuang] for the catch! v001 patch LGTM. > Print

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035546#comment-16035546 ] Hadoop QA commented on HADOOP-13786: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14394) Provide Builder pattern for DistributedFileSystem.create

2017-06-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14394: --- Attachment: HADOOP-14394.03.patch Attach a new patch to fix test failures. > Provide

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035396#comment-16035396 ] Aaron Fabbri commented on HADOOP-14457: --- If we end up adding an "ancestor is a directory" check to

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035358#comment-16035358 ] Steve Loughran commented on HADOOP-13786: - Patch 030: evolution based on integration testing

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Open (was: Patch Available) > Add S3Guard committer for zero-rename commits to

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Patch Available (was: Open) > Add S3Guard committer for zero-rename commits to

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Attachment: HADOOP-13786-HADOOP-13345-030.patch > Add S3Guard committer for zero-rename

[jira] [Commented] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035330#comment-16035330 ] Hadoop QA commented on HADOOP-14481: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035327#comment-16035327 ] Sean Mackrory commented on HADOOP-14457: I filed HADOOP-14484 for the missing test case (and

[jira] [Assigned] (HADOOP-14484) Ensure deleted parent directory tombstones are overwritten when implicitly recreated

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HADOOP-14484: -- Assignee: Sean Mackrory > Ensure deleted parent directory tombstones are overwritten

[jira] [Created] (HADOOP-14484) Ensure deleted parent directory tombstones are overwritten when implicitly recreated

2017-06-02 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14484: -- Summary: Ensure deleted parent directory tombstones are overwritten when implicitly recreated Key: HADOOP-14484 URL: https://issues.apache.org/jira/browse/HADOOP-14484

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035313#comment-16035313 ] Aaron Fabbri commented on HADOOP-14457: --- Thanks for the detail here [~ste...@apache.org]. {quote}

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035306#comment-16035306 ] Daryn Sharp commented on HADOOP-14445: -- I had a feeling "nameservice" alluded to the hdfs HA

[jira] [Created] (HADOOP-14483) increase default value of fs.s3a.multipart.size to 128M

2017-06-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14483: --- Summary: increase default value of fs.s3a.multipart.size to 128M Key: HADOOP-14483 URL: https://issues.apache.org/jira/browse/HADOOP-14483 Project: Hadoop

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035283#comment-16035283 ] Steve Loughran commented on HADOOP-14457: - Update: looked at {{finishedWrite}} in more detail.

[jira] [Comment Edited] (HADOOP-13998) initial s3guard preview

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035280#comment-16035280 ] Sean Mackrory edited comment on HADOOP-13998 at 6/2/17 7:23 PM:

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035280#comment-16035280 ] Sean Mackrory commented on HADOOP-13998: [~ste...@apache.org] - regarding that test issue, that

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035268#comment-16035268 ] Sean Mackrory commented on HADOOP-13998: {quote}If these tests were working before you turned

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035262#comment-16035262 ] Steve Loughran commented on HADOOP-14457: - OK, I am effectively seeing this in my committer

[jira] [Updated] (HADOOP-14283) S3A may hang due to bug in AWS SDK 1.11.86

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14283: -- Attachment: ITestS3AConcurrentRename.java Attaching related Hadoop scale test but I'm leaning

[jira] [Updated] (HADOOP-14283) S3A may hang due to bug in AWS SDK 1.11.86

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14283: -- Attachment: HADOOP-14283.001.patch Attaching patch which bumps SDK from 1.11.86 to 1.11.134.

[jira] [Updated] (HADOOP-14482) Update BUILDING.txt to include the correct steps to install zstd library

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14482: - Description: The current BUILDING.txt includes the following steps for installing zstd

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035217#comment-16035217 ] Steve Loughran commented on HADOOP-13998: - regarding tests, I'm seeing something up with the

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035218#comment-16035218 ] Arun Suresh commented on HADOOP-14445: -- [~daryn], agreed that duplicating the entries is bad if the

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035211#comment-16035211 ] Aaron Fabbri commented on HADOOP-14468: --- I created this JIRA to follow up on [your

[jira] [Updated] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14481: - Status: Patch Available (was: Open) > Print stack trace when native bzip2 library does

[jira] [Created] (HADOOP-14482) Update BUILDING.txt to include the correct steps to install zstd library

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HADOOP-14482: Summary: Update BUILDING.txt to include the correct steps to install zstd library Key: HADOOP-14482 URL: https://issues.apache.org/jira/browse/HADOOP-14482

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035169#comment-16035169 ] Yongjun Zhang commented on HADOOP-14445: Thanks [~daryn]. When I say it's unavoidable, I mean,

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035159#comment-16035159 ] Daryn Sharp commented on HADOOP-14445: -- bq. It seems unavoidable if we want to implement

[jira] [Updated] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14481: - Attachment: HADOOP-14481.001.patch Attach a very simple fix. With this fix, I am

[jira] [Assigned] (HADOOP-14472) Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently

2017-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-14472: -- Assignee: Mingliang Liu > Azure: TestReadAndSeekPageBlobAfterWrite fails

[jira] [Commented] (HADOOP-14472) Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently

2017-06-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035094#comment-16035094 ] Mingliang Liu commented on HADOOP-14472: Tested against US WEST region. Now all unit/live tests

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035077#comment-16035077 ] Steve Loughran commented on HADOOP-13998: - bq. We've run our standard downstream Hive, Spark,

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035064#comment-16035064 ] Steve Loughran commented on HADOOP-14468: - What's the reason for this? To pick up changes to

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035059#comment-16035059 ] Steve Loughran commented on HADOOP-14457: - you know we do something in BlockOutputStream when

[jira] [Created] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HADOOP-14481: Summary: Print stack trace when native bzip2 library does not load Key: HADOOP-14481 URL: https://issues.apache.org/jira/browse/HADOOP-14481 Project: Hadoop

[jira] [Updated] (HADOOP-14481) Print stack trace when native bzip2 library does not load

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14481: - Description: When I ran hadoop checknative on my machine, it was not able to load

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035041#comment-16035041 ] Xiao Chen commented on HADOOP-14474: Thanks Allen, created HADOOP-14480 for the long shot. > Use

[jira] [Updated] (HADOOP-14480) Remove Oracle JDK usage in Dockerfile

2017-06-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14480: --- Description: Further to the discussions in HADOOP-14474, we should look for a long-term solution

[jira] [Created] (HADOOP-14480) Remove Oracle JDK usage in Dockerfile

2017-06-02 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-14480: -- Summary: Remove Oracle JDK usage in Dockerfile Key: HADOOP-14480 URL: https://issues.apache.org/jira/browse/HADOOP-14480 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035034#comment-16035034 ] Allen Wittenauer commented on HADOOP-14474: --- As a sidenote, I hope people are aware this is

[jira] [Updated] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14474: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 2.6.6

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035008#comment-16035008 ] Yongjun Zhang commented on HADOOP-14445: Thanks [~daryn]. {quote} No more config-based

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034999#comment-16034999 ] Xiao Chen commented on HADOOP-14474: Thanks [~aw] for kicking off a jenkins job and reviewing. bq.

[jira] [Updated] (HADOOP-14429) getFsAction method of FTPFileSystem always returned FsAction.NONE

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14429: - Summary: getFsAction method of FTPFileSystem always returned FsAction.NONE (was: getFsAction

[jira] [Comment Edited] (HADOOP-14429) getFsAction method of FTPFileSystem always return FsAction.NONE

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032531#comment-16032531 ] Hongyuan Li edited comment on HADOOP-14429 at 6/2/17 4:16 PM: -- [~yzhangal]

[jira] [Updated] (HADOOP-14469) the listStatus method of FTPFileSystem should filter the path "." and ".."

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Summary: the listStatus method of FTPFileSystem should filter the path "." and ".." (was: the

[jira] [Updated] (HADOOP-14470) the ternary operator in create method in class CommandWithDestination is redundant

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14470: - Description: in if statement,the lazyPersist is always true, thus the ternary operator is

[jira] [Updated] (HADOOP-14470) the ternary operator in create method in class CommandWithDestination is redundant

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14470: - Description: in if statement,the lazyPersist is always true, thus the ternary operator is

[jira] [Updated] (HADOOP-14470) the ternary operator in create method in class CommandWithDestination is redundant

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14470: - Description: in if statement,the lazyPersist is always true, thus the ternary operator is

[jira] [Updated] (HADOOP-14470) the ternary operator in create method in class CommandWithDestination is redundant

2017-06-02 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14470: - Description: in if statement,the lazyPersist is always true, thus the ternary operator is

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034925#comment-16034925 ] Allen Wittenauer commented on HADOOP-14474: --- This should probably work. +1 > Use OpenJDK 7

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034842#comment-16034842 ] Hadoop QA commented on HADOOP-14474: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14436) Remove the redundant colon in ViewFs.md

2017-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034832#comment-16034832 ] Hudson commented on HADOOP-14436: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11818 (See

[jira] [Commented] (HADOOP-12360) Create StatsD metrics2 sink

2017-06-02 Thread Michael Moss (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034826#comment-16034826 ] Michael Moss commented on HADOOP-12360: --- Hi, I'm curious what this section of code is trying to

[jira] [Commented] (HADOOP-14474) Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034819#comment-16034819 ] Hadoop QA commented on HADOOP-14474: (!) A patch to the testing environment has been detected.

[jira] [Updated] (HADOOP-14436) Remove the redundant colon in ViewFs.md

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14436: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s:

[jira] [Created] (HADOOP-14479) Erasurecode testcase failures with ISA-L

2017-06-02 Thread Ayappan (JIRA)
Ayappan created HADOOP-14479: Summary: Erasurecode testcase failures with ISA-L Key: HADOOP-14479 URL: https://issues.apache.org/jira/browse/HADOOP-14479 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-14436) Remove the redundant colon in ViewFs.md

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14436: -- Summary: Remove the redundant colon in ViewFs.md (was: The ViewFs.md's minor

[jira] [Commented] (HADOOP-14473) Optimize NativeAzureFileSystem::seek for forward seeks

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034683#comment-16034683 ] Rajesh Balamohan commented on HADOOP-14473: --- Since it was easier to combine this patch with

[jira] [Assigned] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HADOOP-14478: - Assignee: Rajesh Balamohan > Optimize NativeAzureFsInputStream for positional

[jira] [Updated] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14478: -- Attachment: HADOOP-14478.002.patch Attaching .2 version with fixes in seek(). Also

[jira] [Commented] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034628#comment-16034628 ] Hadoop QA commented on HADOOP-14436: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034613#comment-16034613 ] Brahma Reddy Battula commented on HADOOP-14436: --- [~maobaolong] thanks for uploading the

[jira] [Updated] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14436: -- Status: Patch Available (was: Open) > The ViewFs.md's minor error about a

[jira] [Commented] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034545#comment-16034545 ] ASF GitHub Bot commented on HADOOP-14436: - Github user maobaolong commented on the issue:

[jira] [Commented] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034541#comment-16034541 ] maobaolong commented on HADOOP-14436: - [~brahma] Thank you advance. I'm glad to join you. Now I

[jira] [Updated] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-06-02 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HADOOP-14436: Attachment: HADOOP-14436.patch > The ViewFs.md's minor error about a redundant colon >

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034518#comment-16034518 ] Steve Loughran commented on HADOOP-14475: - You are probably the first person to play with this.

[jira] [Commented] (HADOOP-14472) Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034493#comment-16034493 ] Steve Loughran commented on HADOOP-14472: - Seems reasonable. Which endpoint did you test

[jira] [Commented] (HADOOP-14473) Optimize NativeAzureFileSystem::seek for forward seeks

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034491#comment-16034491 ] Steve Loughran commented on HADOOP-14473: - This is going to read forward no matter how big the

[jira] [Commented] (HADOOP-14473) Optimize NativeAzureFileSystem::seek for forward seeks

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034485#comment-16034485 ] Steve Loughran commented on HADOOP-14473: - which endpoint did you test against? -1 until that's

[jira] [Commented] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034484#comment-16034484 ] Steve Loughran commented on HADOOP-14478: - Usual rule: which endpoint have you tested this with?

[jira] [Commented] (HADOOP-14477) FileSystem Simplify / Optimize listStatus Method

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034480#comment-16034480 ] Steve Loughran commented on HADOOP-14477: - test failure is unlrelated; checkstyles are new As

[jira] [Commented] (HADOOP-14477) FileSystem Simplify / Optimize listStatus Method

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034481#comment-16034481 ] Steve Loughran commented on HADOOP-14477: - test failure is unlrelated; checkstyles are new As

[jira] [Assigned] (HADOOP-14477) FileSystem Simplify / Optimize listStatus Method

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-14477: --- Assignee: BELUGA BEHR > FileSystem Simplify / Optimize listStatus Method >

[jira] [Updated] (HADOOP-14477) FileSystem Simplify / Optimize listStatus Method

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14477: Component/s: fs > FileSystem Simplify / Optimize listStatus Method >

[jira] [Commented] (HADOOP-14163) Refactor existing hadoop site to use more usable static website generator

2017-06-02 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034306#comment-16034306 ] Akira Ajisaka commented on HADOOP-14163: Cool. Now Apache Hadoop 3.0.0-alpha3 is released. Would

[jira] [Updated] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14478: -- Description: Azure's {{BlobbInputStream}} internally buffers 4 MB of data

[jira] [Updated] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14478: -- Attachment: HADOOP-14478.001.patch Attaching .1 patch for review. This includes

[jira] [Created] (HADOOP-14478) Optimize NativeAzureFsInputStream for positional reads

2017-06-02 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HADOOP-14478: - Summary: Optimize NativeAzureFsInputStream for positional reads Key: HADOOP-14478 URL: https://issues.apache.org/jira/browse/HADOOP-14478 Project: Hadoop