[jira] [Commented] (HADOOP-12760) sun.misc.Cleaner has moved to a new location in OpenJDK 9

2018-02-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369772#comment-16369772 ] Akira Ajisaka commented on HADOOP-12760: 04 patch: rebased > sun.misc.Cleaner h

[jira] [Updated] (HADOOP-12760) sun.misc.Cleaner has moved to a new location in OpenJDK 9

2018-02-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12760: --- Attachment: HADOOP-12760.04.patch > sun.misc.Cleaner has moved to a new location in OpenJDK

[jira] [Commented] (HADOOP-15235) Authentication Tokens should use HMAC instead of MAC

2018-02-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369702#comment-16369702 ] Xiao Chen commented on HADOOP-15235: +1, thanks Robert! > Authentication Tokens sho

[jira] [Commented] (HADOOP-15247) Move commons-net up to 3.6

2018-02-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369558#comment-16369558 ] genericqa commented on HADOOP-15247: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-15146) Remove DataOutputByteBuffer

2018-02-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369538#comment-16369538 ] genericqa commented on HADOOP-15146: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369533#comment-16369533 ] genericqa commented on HADOOP-15107: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info

2018-02-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369523#comment-16369523 ] Hudson commented on HADOOP-15070: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Com

[jira] [Commented] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369507#comment-16369507 ] Steve Loughran commented on HADOOP-15107: - test: s3a ireland w/ s3guard auth >

[jira] [Updated] (HADOOP-15247) Move commons-net up to 3.6

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15247: Status: Patch Available (was: Open) patch 001; > Move commons-net up to 3.6 > -

[jira] [Updated] (HADOOP-15247) Move commons-net up to 3.6

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15247: Attachment: HADOOP-15247-001.patch > Move commons-net up to 3.6 >

[jira] [Resolved] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15070. - Resolution: Fixed Fix Version/s: 3.1.0 it does apply to trunk, I just need to be

[jira] [Updated] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15070: Status: Open (was: Patch Available) only just noticed this was +1'd updating patch ASAP.

[jira] [Commented] (HADOOP-9747) Reduce unnecessary UGI synchronization

2018-02-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369490#comment-16369490 ] Kihwal Lee commented on HADOOP-9747: [~bharatviswa], can you take a look at the lates

[jira] [Created] (HADOOP-15247) Move commons-net up to 3.6

2018-02-19 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15247: --- Summary: Move commons-net up to 3.6 Key: HADOOP-15247 URL: https://issues.apache.org/jira/browse/HADOOP-15247 Project: Hadoop Common Issue Type: Sub-ta

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Status: Patch Available (was: In Progress) > Prove the correctness of the new committers,

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Description: I'm writing about the paper on the committers, one which, being a proper pape

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Attachment: HADOOP-15107-001.patch > Prove the correctness of the new committers, or fix w

[jira] [Commented] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369485#comment-16369485 ] Steve Loughran commented on HADOOP-15107: - Patch 001 See also the [latest PDF}

[jira] [Updated] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14124: Issue Type: Sub-task (was: Bug) Parent: HADOOP-15220 > S3AFileSystem silently del

[jira] [Updated] (HADOOP-14070) S3a: Failed to reset the request input stream

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14070: Target Version/s: 3.2.0 > S3a: Failed to reset the request input stream >

[jira] [Commented] (HADOOP-14070) S3a: Failed to reset the request input stream

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369474#comment-16369474 ] Steve Loughran commented on HADOOP-14070: - Reviewing. Sorry, I'd missed this bef

[jira] [Commented] (HADOOP-15137) ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

2018-02-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369471#comment-16369471 ] genericqa commented on HADOOP-15137: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-15146) Remove DataOutputByteBuffer

2018-02-19 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HADOOP-15146: - Attachment: HADOOP-15146.5.patch > Remove DataOutputByteBuffer > --- > >

[jira] [Updated] (HADOOP-15146) Remove DataOutputByteBuffer

2018-02-19 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HADOOP-15146: - Status: Patch Available (was: Open) > Remove DataOutputByteBuffer > ---

[jira] [Updated] (HADOOP-15146) Remove DataOutputByteBuffer

2018-02-19 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HADOOP-15146: - Status: Open (was: Patch Available) > Remove DataOutputByteBuffer > ---

[jira] [Commented] (HADOOP-15137) ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

2018-02-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369432#comment-16369432 ] Bharat Viswanadham commented on HADOOP-15137: - Hi [~shaneku...@gmail.com] T

[jira] [Updated] (HADOOP-15137) ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

2018-02-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15137: Attachment: HADOOP-15137.02.patch > ClassNotFoundException: > org.apache.hadoop.y

[jira] [Commented] (HADOOP-14070) S3a: Failed to reset the request input stream

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369423#comment-16369423 ] Steve Loughran commented on HADOOP-14070: - Looks like the stream reset logic isn

[jira] [Updated] (HADOOP-14070) S3a: Failed to reset the request input stream

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14070: Issue Type: Sub-task (was: Bug) Parent: HADOOP-15220 > S3a: Failed to reset the r

[jira] [Resolved] (HADOOP-14143) S3A Path Style Being Ignore

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14143. - Resolution: Cannot Reproduce > S3A Path Style Being Ignore > ---

[jira] [Resolved] (HADOOP-14286) S3A index title links in hadoop-aws don't work in docs

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14286. - Resolution: Won't Fix Moot now that s3n is no more > S3A index title links in hadoop-aw

[jira] [Resolved] (HADOOP-15201) Automatically determine region & hence S3 endpoint of buckets

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15201. - Resolution: Duplicate Duplicate of HADOOP-14931, that JIRA wasn't attached to the s3a-ub

[jira] [Updated] (HADOOP-14391) s3a: auto-detect region for bucket and use right endpoint

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14391: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-15220 > s3a: auto-detect r

[jira] [Resolved] (HADOOP-14529) retire s3n

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14529. - Resolution: Duplicate > retire s3n > -- > > Key: HADOOP-14529 >

[jira] [Resolved] (HADOOP-10218) Using brace glob pattern in S3N URL causes exception due to Path created with empty string

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-10218. - Resolution: Won't Fix Fix Version/s: 3.0.1 > Using brace glob pattern in S3N URL

[jira] [Commented] (HADOOP-10218) Using brace glob pattern in S3N URL causes exception due to Path created with empty string

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369347#comment-16369347 ] Steve Loughran commented on HADOOP-10218: - Ignoring the fact that glob expansion

[jira] [Resolved] (HADOOP-13517) TestS3NContractRootDir.testRecursiveRootListing failing

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13517. - Resolution: Won't Fix Fix Version/s: 3.0.1 > TestS3NContractRootDir.testRecursive

[jira] [Commented] (HADOOP-12806) Hadoop fs s3a lib not working with temporary credentials in AWS Lambda

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369338#comment-16369338 ] Steve Loughran commented on HADOOP-12806: - Given the auth chain is configurable,

[jira] [Resolved] (HADOOP-12806) Hadoop fs s3a lib not working with temporary credentials in AWS Lambda

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12806. - Resolution: Fixed Fix Version/s: 2.8.0 > Hadoop fs s3a lib not working with tempo

[jira] [Resolved] (HADOOP-10494) Ensure Jets3tFileSystemStore respects URI path for block files

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-10494. - Resolution: Won't Fix Fix Version/s: 3.0.1 closing as a wontfix; we don't ship S3

[jira] [Resolved] (HADOOP-9328) INSERT INTO a S3 external table with no reduce phase results in FileNotFoundException

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-9328. Resolution: Cannot Reproduce > INSERT INTO a S3 external table with no reduce phase results

[jira] [Resolved] (HADOOP-11606) intermittent failure of TestS3AFileSystemContract.testRenameRootDirForbidden

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-11606. - Resolution: Cannot Reproduce > intermittent failure of TestS3AFileSystemContract.testRen

[jira] [Updated] (HADOOP-11606) intermittent failure of TestS3AFileSystemContract.testRenameRootDirForbidden

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11606: Component/s: test > intermittent failure of TestS3AFileSystemContract.testRenameRootDirFor

[jira] [Commented] (HADOOP-15231) WavefrontSink for Hadoop Metrics2

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369314#comment-16369314 ] ASF GitHub Bot commented on HADOOP-15231: - Github user howardyoo commented on th

[jira] [Commented] (HADOOP-14821) Executing the command 'hdfs -Dhadoop.security.credential.provider.path=file1.jceks,file2.jceks' fails if permission is denied to some files

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369315#comment-16369315 ] Steve Loughran commented on HADOOP-14821: - I believe HADOOP-14507 may help here.

[jira] [Resolved] (HADOOP-15095) S3a committer factory to warn when default FileOutputFormat committer is created

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15095. - Resolution: Duplicate Fix Version/s: 3.1.0 > S3a committer factory to warn when d

[jira] [Commented] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369307#comment-16369307 ] Steve Loughran commented on HADOOP-15107: - Add logging @ info of committer type,

[jira] [Commented] (HADOOP-15230) org.apache.hadoop.metrics2.GraphiteSink is not implemented correctly

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369304#comment-16369304 ] ASF GitHub Bot commented on HADOOP-15230: - Github user howardyoo commented on th

[jira] [Resolved] (HADOOP-15216) S3AInputStream to handle reconnect on read() failure better

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15216. - Resolution: Duplicate > S3AInputStream to handle reconnect on read() failure better > --

[jira] [Resolved] (HADOOP-15241) transient failure of ITestCommitOperations.testCommitEmptyFile; fault injection related

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15241. - Resolution: Cannot Reproduce Fix Version/s: 3.1.0 > transient failure of ITestCom

[jira] [Resolved] (HADOOP-14291) S3a "Bad Request" message to include diagnostics

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14291. - Resolution: Won't Fix My cloudstore util already does more in terms of diagnostics than

[jira] [Commented] (HADOOP-15146) Remove DataOutputByteBuffer

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369203#comment-16369203 ] Steve Loughran commented on HADOOP-15146: - We are nearly there! h3. TestDataBy

[jira] [Commented] (HADOOP-13761) S3Guard: implement retries for DDB failures and throttling; translate exceptions

2018-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369187#comment-16369187 ] Steve Loughran commented on HADOOP-13761: - bq. Or just call them Retry with a cl