[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; load via credential provider

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977343#comment-15977343 ] Steve Loughran commented on HADOOP-14324: - I'm going to highlight that pickup via getPassword()

[jira] [Commented] (HADOOP-14334) S3 SSEC tests to downgrade when running against a mandatory encryption object store

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977505#comment-15977505 ] Steve Loughran commented on HADOOP-14334: - or just add an option to skip these tests, which will

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977595#comment-15977595 ] Rushabh S Shah commented on HADOOP-14333: - If you read back [~daryn]'s

[jira] [Comment Edited] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977638#comment-15977638 ] Rushabh S Shah edited comment on HADOOP-14333 at 4/20/17 10:04 PM: ---

[jira] [Commented] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977335#comment-15977335 ] Naveen Gangam commented on HADOOP-14333: [~yzhangal] Should this be a public API? Is there an

[jira] [Commented] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977393#comment-15977393 ] Rushabh S Shah commented on HADOOP-14333: - bq. s there an alternate means to accomplish the same

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-14333: -- Affects Version/s: 3.0.0-alpha3 2.8.1 > New exception thrown

[jira] [Commented] (HADOOP-14323) ITestS3GuardListConsistency failure w/ Local, authoritative metadata store

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977611#comment-15977611 ] Hadoop QA commented on HADOOP-14323: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11656) Classpath isolation for downstream clients

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977354#comment-15977354 ] Allen Wittenauer commented on HADOOP-11656: --- bq. Apache ships source. Apache Hadoop also

[jira] [Comment Edited] (HADOOP-14141) Store KMS SSL keystore password in catalina.properties

2017-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977510#comment-15977510 ] John Zhuge edited comment on HADOOP-14141 at 4/20/17 9:02 PM: -- Committed to

[jira] [Updated] (HADOOP-14141) Store KMS SSL keystore password in catalina.properties

2017-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14141: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977314#comment-15977314 ] Rushabh S Shah commented on HADOOP-14104: - bq. Since the impact is wide (many different versions

[jira] [Assigned] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HADOOP-14333: -- Assignee: Yongjun Zhang > HADOOP-14104 changed DFSClient API

[jira] [Commented] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977379#comment-15977379 ] Rushabh S Shah commented on HADOOP-14333: - If I understood the hive code correctly,

[jira] [Updated] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14324: Summary: Switch to fs.s3a.server-side-encryption.key as property for encryption secret;

[jira] [Updated] (HADOOP-14334) S3 SSEC tests to downgrade when running against a mandatory encryption object store

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14334: Priority: Minor (was: Major) > S3 SSEC tests to downgrade when running against a

[jira] [Created] (HADOOP-14334) S3 SSEC tests to downgrade when running against a mandatory encryption object store

2017-04-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14334: --- Summary: S3 SSEC tests to downgrade when running against a mandatory encryption object store Key: HADOOP-14334 URL: https://issues.apache.org/jira/browse/HADOOP-14334

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977638#comment-15977638 ] Rushabh S Shah commented on HADOOP-14333: - bq. why is this not floated up to FileSystem and

[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977640#comment-15977640 ] Hadoop QA commented on HADOOP-14324: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977295#comment-15977295 ] Rushabh S Shah commented on HADOOP-14104: - [~yzhangal] thanks for reporting ! I will discuss

[jira] [Updated] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Description: Though Hive should be fixed not to access DFSClient which is private to

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977324#comment-15977324 ] Yongjun Zhang commented on HADOOP-14104: Thanks a lot [~shahrs87]. I created HADOOP-14333. This

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977325#comment-15977325 ] Yongjun Zhang commented on HADOOP-14104: Hive code {code} private boolean

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977287#comment-15977287 ] Yongjun Zhang commented on HADOOP-14104: HI [~rushabh.shah], [~andrew.wang], [~daryn], Just

[jira] [Commented] (HADOOP-14313) Replace/improve Hadoop's byte[] comparator

2017-04-20 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977299#comment-15977299 ] Sean Busbey commented on HADOOP-14313: -- I'd favor moving to the Guava one. It's not flagged Beta,

[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977496#comment-15977496 ] Steve Loughran commented on HADOOP-14324: - Example stack trace of the new error. This is running

[jira] [Commented] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977514#comment-15977514 ] Yongjun Zhang commented on HADOOP-14333: HI [~shahrs87], Agree that returning false when

[jira] [Updated] (HADOOP-14333) Exception thrown by DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-14333: -- Summary: Exception thrown by DFSClient API isHDFSEncryptionEnabled broke hacky hive

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-14333: -- Summary: New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled

[jira] [Commented] (HADOOP-11656) Classpath isolation for downstream clients

2017-04-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977587#comment-15977587 ] Sangjin Lee commented on HADOOP-11656: -- {quote} Will the shaded client jar be published to maven

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977635#comment-15977635 ] Allen Wittenauer commented on HADOOP-14333: --- bq. The right way to ask whether the path is

[jira] [Updated] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; load via credential provider

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14324: Status: Patch Available (was: Open) > Switch to fs.s3a.server-side-encryption.key as

[jira] [Updated] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; load via credential provider

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14324: Status: Open (was: Patch Available) > Switch to fs.s3a.server-side-encryption.key as

[jira] [Updated] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; load via credential provider

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14324: Attachment: HADOOP-14324-branch-2-003.patch HADOOP-14324 Patch 003 * Error strings

[jira] [Updated] (HADOOP-13760) S3Guard: add delete tracking

2017-04-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-13760: --- Attachment: HADOOP-13760-HADOOP-13345.001.patch Attaching an initial patch to start getting

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977642#comment-15977642 ] Yongjun Zhang commented on HADOOP-14333: Thanks [~aw] and [~shahrs87]. Agree that Hive project

[jira] [Commented] (HADOOP-14329) Thread leakage in Hadoop RollingAverages metric collection

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977341#comment-15977341 ] Hadoop QA commented on HADOOP-14329: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11656) Classpath isolation for downstream clients

2017-04-20 Thread Christopher Tubbs (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977447#comment-15977447 ] Christopher Tubbs commented on HADOOP-11656: bq. Apache Hadoop also ships binaries. I'm

[jira] [Created] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14333: -- Summary: HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code Key: HADOOP-14333 URL: https://issues.apache.org/jira/browse/HADOOP-14333

[jira] [Commented] (HADOOP-14329) Thread leakage in Hadoop RollingAverages metric collection

2017-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977323#comment-15977323 ] Arpit Agarwal commented on HADOOP-14329: Thanks. It doesn't look like a leak to me. The

[jira] [Comment Edited] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977379#comment-15977379 ] Rushabh S Shah edited comment on HADOOP-14333 at 4/20/17 8:11 PM: -- If I

[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977454#comment-15977454 ] Steve Loughran commented on HADOOP-14324: - I'm pretty happy with the new code; this is the first

[jira] [Updated] (HADOOP-14323) ITestS3GuardListConsistency failure w/ Local, authoritative metadata store

2017-04-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14323: -- Attachment: HADOOP-14323-HADOOP-13345.002.patch V2 patch with improved assert message that

[jira] [Commented] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977575#comment-15977575 ] Allen Wittenauer commented on HADOOP-14333: --- bq. Though Hive should be fixed not to access

[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977579#comment-15977579 ] John Zhuge commented on HADOOP-14324: - +1 Patch 003 LGTM with a nit:

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977598#comment-15977598 ] Rushabh S Shah commented on HADOOP-14333: - I didn't read the update from [~aw] before my last

[jira] [Created] (HADOOP-14335) Improve DynamoDB schema update story

2017-04-20 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14335: -- Summary: Improve DynamoDB schema update story Key: HADOOP-14335 URL: https://issues.apache.org/jira/browse/HADOOP-14335 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-14335) Improve DynamoDB schema update story

2017-04-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977747#comment-15977747 ] Sean Mackrory commented on HADOOP-14335: This is definitely the case for HADOOP-13760, and may

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977749#comment-15977749 ] Yongjun Zhang commented on HADOOP-14333: Thanks for the discussion here guys. I just posted a

[jira] [Updated] (HADOOP-14324) Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14324: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14324) Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977850#comment-15977850 ] Hadoop QA commented on HADOOP-14324: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14324) Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977852#comment-15977852 ] Mingliang Liu commented on HADOOP-14324: I fixed [~jzhuge]'s last comment about test when

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977880#comment-15977880 ] Rushabh S Shah commented on HADOOP-14333: - Can we please hold off committing patch v2 until

[jira] [Created] (HADOOP-14336) Cleanup findbugs warnings found by Spotbugs

2017-04-20 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HADOOP-14336: -- Summary: Cleanup findbugs warnings found by Spotbugs Key: HADOOP-14336 URL: https://issues.apache.org/jira/browse/HADOOP-14336 Project: Hadoop Common

[jira] [Assigned] (HADOOP-14327) KerberosAuthenticationHandler#authenticate throws meaningless exception when server principals set is empty

2017-04-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HADOOP-14327: --- Assignee: Yuanbo Liu > KerberosAuthenticationHandler#authenticate throws meaningless

[jira] [Commented] (HADOOP-13760) S3Guard: add delete tracking

2017-04-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977711#comment-15977711 ] Sean Mackrory commented on HADOOP-13760: Also, this is a schema change but the .001. patch

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977792#comment-15977792 ] Hadoop QA commented on HADOOP-14333: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-14310) RolloverSignerSecretProvider.LOG should be @VisibleForTesting

2017-04-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HADOOP-14310: - Assignee: Arun Shanmugam Kumar > RolloverSignerSecretProvider.LOG should be

[jira] [Updated] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12940: --- Issue Type: Bug (was: Sub-task) Parent: (was: HADOOP-12939) > Fix warnings

[jira] [Updated] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12940: --- Status: Open (was: Patch Available) > Fix warnings from findbugs 3.0.1 in hadoop-common >

[jira] [Updated] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12940: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-14336 > Fix warnings from findbugs

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Attachment: HADOOP-14333.003.patch > New exception thrown by (private) DFSClient API

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977968#comment-15977968 ] Yongjun Zhang commented on HADOOP-14333: Thanks much [~andrew.wang] and [~shahrs87]. Uploaded

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Attachment: (was: HADOOP-14333.001.patch) > New exception thrown by (private) DFSClient

[jira] [Commented] (HADOOP-13714) Tighten up our compatibility guidelines for Hadoop 3

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977735#comment-15977735 ] Allen Wittenauer commented on HADOOP-13714: --- First: HADOOP-11696 (and those are old stats!)

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977751#comment-15977751 ] Andrew Wang commented on HADOOP-14333: -- I took a look at Hive's usage of DFSClient. They're digging

[jira] [Commented] (HADOOP-14310) RolloverSignerSecretProvider.LOG should be @VisibleForTesting

2017-04-20 Thread Arun Shanmugam Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977826#comment-15977826 ] Arun Shanmugam Kumar commented on HADOOP-14310: --- Hi, I am a newbie. I can take this issue.

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977997#comment-15977997 ] Hadoop QA commented on HADOOP-14333: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-14338) Fix warnings from Spotbugs in hadoop-yarn

2017-04-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HADOOP-14338: Summary: Fix warnings from Spotbugs in hadoop-yarn Key: HADOOP-14338 URL: https://issues.apache.org/jira/browse/HADOOP-14338 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14339) Fix warnings from Spotbugs in hadoop-mapreduce

2017-04-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HADOOP-14339: Summary: Fix warnings from Spotbugs in hadoop-mapreduce Key: HADOOP-14339 URL: https://issues.apache.org/jira/browse/HADOOP-14339 Project: Hadoop Common

[jira] [Updated] (HADOOP-14337) Fix warnings from Spotbugs in hadoop-hdfs

2017-04-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HADOOP-14337: --- Status: Patch Available (was: Open) > Fix warnings from Spotbugs in hadoop-hdfs >

[jira] [Updated] (HADOOP-14337) Fix warnings from Spotbugs in hadoop-hdfs

2017-04-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HADOOP-14337: --- Attachment: HADOOP-14337.001.patch Attach the initial patch. Kindly review. > Fix warnings from

[jira] [Updated] (HADOOP-12668) Support excluding weak Ciphers in HttpServer2 through ssl-server.xml

2017-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-12668: Summary: Support excluding weak Ciphers in HttpServer2 through ssl-server.xml (was: Support

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Attachment: HADOOP-14333.001.patch > New exception thrown by (private) DFSClient API

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977691#comment-15977691 ] Allen Wittenauer commented on HADOOP-14333: --- bq. But I think Transparent encryption is only

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Status: Patch Available (was: Open) > New exception thrown by (private) DFSClient API

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Attachment: HADOOP-14333.002.patch > New exception thrown by (private) DFSClient API

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977832#comment-15977832 ] Andrew Wang commented on HADOOP-14333: -- +1 LGTM, can remove the unused SocketTimeoutException on

[jira] [Commented] (HADOOP-14324) Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977868#comment-15977868 ] Hudson commented on HADOOP-14324: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11617 (See

[jira] [Comment Edited] (HADOOP-13714) Tighten up our compatibility guidelines for Hadoop 3

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977735#comment-15977735 ] Allen Wittenauer edited comment on HADOOP-13714 at 4/20/17 10:43 PM: -

[jira] [Reopened] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HADOOP-12940: --- It's effectively the same thing. Let's see if this patch applies still. > Fix

[jira] [Updated] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-12940: -- Status: Patch Available (was: Reopened) > Fix warnings from findbugs 3.0.1 in

[jira] [Commented] (HADOOP-14138) Remove S3A ref from META-INF service discovery, rely on existing core-default entry

2017-04-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977816#comment-15977816 ] Aaron Fabbri commented on HADOOP-14138: --- [~ste...@apache.org]'s original proposal here seems like

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977761#comment-15977761 ] Yongjun Zhang commented on HADOOP-14333: Thanks [~andrew.wang]. Discussed with Andrew and he

[jira] [Commented] (HADOOP-12940) Fix warnings from findbugs 3.0.1 in hadoop-common

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977801#comment-15977801 ] Hadoop QA commented on HADOOP-12940: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977809#comment-15977809 ] Hadoop QA commented on HADOOP-14333: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14324) Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14324: --- Summary: Refine S3 server-side-encryption key as encryption secret; improve error reporting

[jira] [Updated] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14324: --- Attachment: HADOOP-14324-trunk-003.patch > Switch to fs.s3a.server-side-encryption.key as

[jira] [Updated] (HADOOP-14337) Fix findbugs issues after switching from Findbugs to Spotbugs in project

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14337: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-14336 > Fix findbugs issues after

[jira] [Commented] (HADOOP-14336) Cleanup findbugs warnings found by Spotbugs

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977971#comment-15977971 ] Mingliang Liu commented on HADOOP-14336: I linked [HADOOP-14337] here for easier tracking. >

[jira] [Updated] (HADOOP-12940) Fix warnings from Spotbugs in hadoop-common

2017-04-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12940: --- Attachment: HADOOP-12940.02.patch > Fix warnings from Spotbugs in hadoop-common >

[jira] [Updated] (HADOOP-12940) Fix warnings from Spotbugs in hadoop-common

2017-04-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-12940: --- Status: Patch Available (was: Open) > Fix warnings from Spotbugs in hadoop-common >

[jira] [Created] (HADOOP-14340) Enable KMS and HttpFS to exclude weak SSL ciphers

2017-04-20 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14340: --- Summary: Enable KMS and HttpFS to exclude weak SSL ciphers Key: HADOOP-14340 URL: https://issues.apache.org/jira/browse/HADOOP-14340 Project: Hadoop Common

[jira] [Commented] (HADOOP-14310) RolloverSignerSecretProvider.LOG should be @VisibleForTesting

2017-04-20 Thread Arun Shanmugam Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978056#comment-15978056 ] Arun Shanmugam Kumar commented on HADOOP-14310: --- [~templedf] Shouldn't we make the LOG

[jira] [Commented] (HADOOP-14337) Fix warnings from Spotbugs in hadoop-hdfs

2017-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978094#comment-15978094 ] Hadoop QA commented on HADOOP-14337: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13760) S3Guard: add delete tracking

2017-04-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978049#comment-15978049 ] Aaron Fabbri commented on HADOOP-13760: --- qq: What sort of testing have you done so far on this v1

[jira] [Updated] (HADOOP-14340) Enable KMS and HttpFS to exclude SSL ciphers

2017-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14340: Summary: Enable KMS and HttpFS to exclude SSL ciphers (was: Enable KMS and HttpFS to exclude

[jira] [Commented] (HADOOP-14313) Replace/improve Hadoop's byte[] comparator

2017-04-20 Thread Vikas Vishwakarma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15978048#comment-15978048 ] Vikas Vishwakarma commented on HADOOP-14313: [~busbey] I was looking at the changes to

[jira] [Updated] (HADOOP-14333) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14333: --- Attachment: HADOOP-14333.001.patch > New exception thrown by (private) DFSClient API

[jira] [Commented] (HADOOP-14324) Switch to fs.s3a.server-side-encryption.key as property for encryption secret; improve error reporting and diagnostics

2017-04-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977804#comment-15977804 ] Mingliang Liu commented on HADOOP-14324: +1 > Switch to fs.s3a.server-side-encryption.key as

  1   2   >