[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554585#comment-16554585 ] Xiao Chen commented on HADOOP-15593: Thanks for revving [~gabor.bota] and [~eyang] for the prompt

[jira] [Comment Edited] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553838#comment-16553838 ] Xiao Chen edited comment on HADOOP-15593 at 7/24/18 5:57 AM: - Thanks

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553838#comment-16553838 ] Xiao Chen commented on HADOOP-15593: I'm also looking at this particular code block: {code}

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

2018-07-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553822#comment-16553822 ] Xiao Chen commented on HADOOP-15609: Thanks Kitti, patch 4 LGTM. Will wait for another day in case

[jira] [Updated] (HADOOP-15596) Stack trace should not be printed out when running hadoop key commands

2018-07-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15596: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (HADOOP-15596) Stack trace should not be printed out when running hadoop key commands

2018-07-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551509#comment-16551509 ] Xiao Chen commented on HADOOP-15596: Thanks Kitti. +1 on patch 3, committing this. > Stack trace

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551105#comment-16551105 ] Xiao Chen commented on HADOOP-15593: Thanks [~gabor.bota] for working on this and others for

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

2018-07-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549923#comment-16549923 ] Xiao Chen commented on HADOOP-15609: Patch 3 looks pretty good to me, thanks for revving Kitti. +1

[jira] [Commented] (HADOOP-15596) Stack trace should not be printed out when running hadoop key commands

2018-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548810#comment-16548810 ] Xiao Chen commented on HADOOP-15596: Good question on the LBKMSCP log level! While it makes perfect

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

2018-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548807#comment-16548807 ] Xiao Chen commented on HADOOP-15609: Thanks for revving Kitti, and Steve for the review.

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

2018-07-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547059#comment-16547059 ] Xiao Chen commented on HADOOP-15609: Thanks for the patch Kitti. I actually prefer we confine this

[jira] [Commented] (HADOOP-15596) Stack trace should not be printed out when running hadoop key commands

2018-07-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546078#comment-16546078 ] Xiao Chen commented on HADOOP-15596: Thanks for working on this Kitti. Looks pretty good. I added a

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

2018-07-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545725#comment-16545725 ] Xiao Chen commented on HADOOP-15609: Thanks [~knanasi] for filing the Jira and [~jojochuang] for

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540727#comment-16540727 ] Xiao Chen commented on HADOOP-14445: Ping [~shahrs87] [~yzhangal] [~jojochuang] [~daryn], anyone

[jira] [Updated] (HADOOP-15581) Set default jetty log level to INFO in KMS

2018-07-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15581: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (HADOOP-15581) Set default jetty log level to INFO in KMS

2018-07-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537418#comment-16537418 ] Xiao Chen commented on HADOOP-15581: +1. log4j config change so no tests needed. Thanks Kitti. >

[jira] [Updated] (HADOOP-15591) KMSClientProvider should log KMS DT acquisition at INFO level

2018-07-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15591: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Moved] (HADOOP-15591) KMSClientProvider should log KMS DT acquisition at INFO level

2018-07-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen moved HDFS-13716 to HADOOP-15591: --- Affects Version/s: (was: 3.1.0) 3.1.0

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2018-07-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534397#comment-16534397 ] Xiao Chen commented on HADOOP-14104: Hi [~aajayaraj], As the above discussion goes, the way to

[jira] [Commented] (HADOOP-15550) Avoid static initialization of ObjectMappers

2018-06-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522898#comment-16522898 ] Xiao Chen commented on HADOOP-15550: +1, thanks for identifying and fixing this Todd! Also thanks

[jira] [Commented] (HADOOP-15550) Avoid static initialization of ObjectMappers

2018-06-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520740#comment-16520740 ] Xiao Chen commented on HADOOP-15550: Thanks Todd and Steve. Latest patch looks great! Sorry for the

[jira] [Commented] (HADOOP-15550) Avoid static initialization of ObjectMappers

2018-06-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519656#comment-16519656 ] Xiao Chen commented on HADOOP-15550: +1. Thanks Todd! (Sorry I wasn't explicit, the KMSCP and DTA

[jira] [Commented] (HADOOP-15550) Avoid static initialization of ObjectMappers

2018-06-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519556#comment-16519556 ] Xiao Chen commented on HADOOP-15550: Thanks for the explanation.

[jira] [Commented] (HADOOP-15550) Avoid static initialization of ObjectMappers

2018-06-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518965#comment-16518965 ] Xiao Chen commented on HADOOP-15550: Thanks for the work here Todd. Looks pretty good to me. Just

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: (was: HADOOP-14445.14.patch) > Delegation tokens are not shared between KMS

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517354#comment-16517354 ] Xiao Chen commented on HADOOP-14445: Reattached patch 14 with deprecation warning and unit test

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.14.patch > Delegation tokens are not shared between KMS instances >

[jira] [Commented] (HADOOP-15527) loop until TIMEOUT before sending kill -9

2018-06-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517350#comment-16517350 ] Xiao Chen commented on HADOOP-15527: Hi [~eyang], It turns out the fix is not in the correct

[jira] [Updated] (HADOOP-15307) NFS: flavor AUTH_SYS should use VerifierNone

2018-06-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15307: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (HADOOP-15307) NFS: flavor AUTH_SYS should use VerifierNone

2018-06-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15307: --- Summary: NFS: flavor AUTH_SYS should use VerifierNone (was: Improve NFS error handling:

[jira] [Commented] (HADOOP-15307) Improve NFS error handling: Unsupported verifier flavorAUTH_SYS

2018-06-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509965#comment-16509965 ] Xiao Chen commented on HADOOP-15307: +1, based on the verbal understanding of the HDFS-5085

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Status: Patch Available (was: Open) > Delegation tokens are not shared between KMS instances >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Release Note: A new configuration, `hadoop.security.kms.client.token.use.uri.format`, is

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Release Note: +Whether the KMS client provider should use uri format as delegation tokens' +

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505761#comment-16505761 ] Xiao Chen commented on HADOOP-14445: Continuing on [this

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-06-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.14.patch > Delegation tokens are not shared between KMS instances >

[jira] [Commented] (HADOOP-15499) Performance severe drop when running RawErasureCoderBenchmark with NativeRSRawErasureCoder

2018-06-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504250#comment-16504250 ] Xiao Chen commented on HADOOP-15499: +1, thanks Sammi! > Performance severe drop when running

[jira] [Updated] (HADOOP-15217) FsUrlConnection does not handle paths with spaces

2018-06-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15217: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1 3.2.0

[jira] [Commented] (HADOOP-15217) FsUrlConnection does not handle paths with spaces

2018-06-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502807#comment-16502807 ] Xiao Chen commented on HADOOP-15217: +1 > FsUrlConnection does not handle paths with spaces >

[jira] [Updated] (HADOOP-15217) FsUrlConnection does not handle paths with spaces

2018-06-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15217: --- Summary: FsUrlConnection does not handle paths with spaces (was:

[jira] [Comment Edited] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-06-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497253#comment-16497253 ] Xiao Chen edited comment on HADOOP-15507 at 6/5/18 4:14 AM: Updating patch

[jira] [Updated] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-06-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15507: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-06-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501266#comment-16501266 ] Xiao Chen commented on HADOOP-15507: Thanks for the review Haibo and Fabbri.  bq. manually tested

[jira] [Commented] (HADOOP-15217) org.apache.hadoop.fs.FsUrlConnection does not handle paths with spaces

2018-06-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501034#comment-16501034 ] Xiao Chen commented on HADOOP-15217: Thanks very much for the thoughts here Zsolt, and the

[jira] [Commented] (HADOOP-15217) org.apache.hadoop.fs.FsUrlConnection does not handle paths with spaces

2018-06-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499746#comment-16499746 ] Xiao Chen commented on HADOOP-15217: Thanks Zsolt for revving and the discussion about testing. In

[jira] [Commented] (HADOOP-15217) org.apache.hadoop.fs.FsUrlConnection does not handle paths with spaces

2018-06-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498520#comment-16498520 ] Xiao Chen commented on HADOOP-15217: Thanks [~josephfourny] for reporting the issue with great

[jira] [Commented] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497267#comment-16497267 ] Xiao Chen commented on HADOOP-15507: Added a screenshot of what this would look like > Add

[jira] [Updated] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15507: --- Attachment: image-2018-05-31-15-29-45-729.png > Add MapReduce counters about EC bytes read >

[jira] [Updated] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15507: --- Status: Patch Available (was: Open) Updating patch 1 to demonstrate the idea and solicit early

[jira] [Updated] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15507: --- Attachment: HADOOP-15507.01.patch > Add MapReduce counters about EC bytes read >

[jira] [Commented] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497247#comment-16497247 ] Xiao Chen commented on HADOOP-15507: (Write counters are calculated at FSDataOutputStream, and it's

[jira] [Created] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-15507: -- Summary: Add MapReduce counters about EC bytes read Key: HADOOP-15507 URL: https://issues.apache.org/jira/browse/HADOOP-15507 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-15507) Add MapReduce counters about EC bytes read

2018-05-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15507: --- Target Version/s: 3.2.0 > Add MapReduce counters about EC bytes read >

[jira] [Commented] (HADOOP-15499) Performance severe drop when running RawErasureCoderBenchmark with NativeRSRawErasureCoder

2018-05-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495421#comment-16495421 ] Xiao Chen commented on HADOOP-15499: Thanks for reporting and working on this issue Sammi. I agree

[jira] [Updated] (HADOOP-15473) Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15473: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.5 2.7.7

[jira] [Updated] (HADOOP-15473) Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15473: --- Summary: Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by

[jira] [Commented] (HADOOP-15473) Configure serialFilter to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490919#comment-16490919 ] Xiao Chen commented on HADOOP-15473: Committing this, thanks Akira and Kitti for the additional

[jira] [Commented] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489583#comment-16489583 ] Xiao Chen commented on HADOOP-15450: Thanks all for the work here. As [~gabor.bota] found out in an

[jira] [Commented] (HADOOP-15473) Configure serialFilter to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488404#comment-16488404 ] Xiao Chen commented on HADOOP-15473: +1 on patch 5. Will wait until Friday morning to allow others

[jira] [Commented] (HADOOP-15473) Configure serialFilter to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486746#comment-16486746 ] Xiao Chen commented on HADOOP-15473: Thanks [~gabor.bota] for the work here, and everyone for the

[jira] [Commented] (HADOOP-15487) ConcurrentModificationException resulting in Kerberos authentication error.

2018-05-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483427#comment-16483427 ] Xiao Chen commented on HADOOP-15487: Thanks [~jojochuang] for creating the jira and tagging me.

[jira] [Commented] (HADOOP-15401) ConcurrentModificationException on Subject.getPrivateCredentials in UGI constructor

2018-05-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483500#comment-16483500 ] Xiao Chen commented on HADOOP-15401: Thanks for the comment [~yzhangal]. For the specific

[jira] [Updated] (HADOOP-15154) Abstract new method assertCapability for StreamCapabilities testing

2018-05-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15154: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (HADOOP-15154) Abstract new method assertCapability for StreamCapabilities testing

2018-05-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480220#comment-16480220 ] Xiao Chen commented on HADOOP-15154: Thanks Zsolt for the patch and Steve for the review. +1 pending

[jira] [Commented] (HADOOP-15154) Abstract new method assertCapability for StreamCapabilities testing

2018-05-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476094#comment-16476094 ] Xiao Chen commented on HADOOP-15154: Thanks Zsolt for working on this, looks pretty good to me

[jira] [Commented] (HADOOP-15441) After HADOOP-14445, encryption zone operations print unnecessary INFO logs

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466486#comment-16466486 ] Xiao Chen commented on HADOOP-15441: Changed links based on Wei-Chiu's comment > After

[jira] [Updated] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15408: --- Resolution: Invalid Status: Resolved (was: Patch Available) With HADOOP-14445 reverted

[jira] [Updated] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15431: --- Resolution: Invalid Status: Resolved (was: Patch Available) With HADOOP-14445 reverted

[jira] [Assigned] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HADOOP-15408: -- Assignee: Rushabh S Shah > HADOOP-14445 broke Spark. > - > >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Fix Version/s: (was: 3.0.3) (was: 2.9.2) (was:

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Fix Version/s: (was: 3.2.0) > Delegation tokens are not shared between KMS instances >

[jira] [Comment Edited] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466221#comment-16466221 ] Xiao Chen edited comment on HADOOP-14445 at 5/7/18 7:54 PM: Reopening Jira

[jira] [Updated] (HADOOP-15390) Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15390: --- Fix Version/s: 2.10.0 > Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens >

[jira] [Commented] (HADOOP-15390) Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466369#comment-16466369 ] Xiao Chen commented on HADOOP-15390: Just found out this was missing from branch-2, cherry-picked

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Status: Patch Available (was: Reopened) > Delegation tokens are not shared between KMS instances >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.branch-2.8.revert.patch > Delegation tokens are not shared between KMS

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.revert.patch > Delegation tokens are not shared between KMS instances >

[jira] [Reopened] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HADOOP-14445: Reopening Jira as I'm reverting those changes. Will remove fix versions as I proceed. Some minor

[jira] [Commented] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464607#comment-16464607 ] Xiao Chen commented on HADOOP-15431: Hi [~djp], I plan to revert HADOOP-14445 from everywhere on

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-05-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464600#comment-16464600 ] Xiao Chen commented on HADOOP-14445: Had an offline discussion with [~daryn], [~shahrs87],

[jira] [Commented] (HADOOP-14841) Kms client should disconnect if unable to get output stream from connection.

2018-05-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463044#comment-16463044 ] Xiao Chen commented on HADOOP-14841: +1 on patch 5. Thanks! > Kms client should disconnect if

[jira] [Commented] (HADOOP-14841) Kms client should disconnect if unable to get output stream from connection.

2018-05-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462905#comment-16462905 ] Xiao Chen commented on HADOOP-14841: Thanks for revving Rushabh. I'd suggest to explicitly say

[jira] [Commented] (HADOOP-14841) Let KMS Client retry 'No content to map' EOFExceptions

2018-05-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462762#comment-16462762 ] Xiao Chen commented on HADOOP-14841: I'm ok with disconnect. +1 pending the comment change. Please

[jira] [Commented] (HADOOP-14841) Let KMS Client retry 'No content to map' EOFExceptions

2018-05-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461984#comment-16461984 ] Xiao Chen commented on HADOOP-14841: Enjoyed reading the RCA comment above - excellent work!

[jira] [Commented] (HADOOP-14841) Let KMS Client retry 'No content to map' EOFExceptions

2018-05-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461339#comment-16461339 ] Xiao Chen commented on HADOOP-14841: Thanks for the work here guys! Didn't look into details yet,

[jira] [Assigned] (HADOOP-14841) Let KMS Client retry 'No content to map' EOFExceptions

2018-05-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HADOOP-14841: -- Assignee: Rushabh S Shah (was: Xiao Chen) > Let KMS Client retry 'No content to map'

[jira] [Commented] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461330#comment-16461330 ] Xiao Chen commented on HADOOP-15431: Thanks for the review Daryn. bq. We need to re-evalute the

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461298#comment-16461298 ] Xiao Chen commented on HADOOP-15408: Could you please clarify? Fine as in "won't NPE" or fine as in

[jira] [Commented] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460444#comment-16460444 ] Xiao Chen commented on HADOOP-15431: Patch 2 to fix the test failure. [~shahrs87], could you take a

[jira] [Updated] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15431: --- Attachment: HADOOP-15431.02.patch > KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has

[jira] [Comment Edited] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460227#comment-16460227 ] Xiao Chen edited comment on HADOOP-15408 at 5/1/18 10:23 PM: - Uploaded a

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460227#comment-16460227 ] Xiao Chen commented on HADOOP-15408: Uploaded a poc.patch for discussion. Idea is simple: do not

[jira] [Updated] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15408: --- Attachment: HADOOP-15408.trunk.poc.patch > HADOOP-14445 broke Spark. > - >

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459988#comment-16459988 ] Xiao Chen commented on HADOOP-15408: bq. Please file jiras against the components you've identified

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459983#comment-16459983 ] Xiao Chen commented on HADOOP-15408: bq. We believe we are running the latest version of spark which

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459926#comment-16459926 ] Xiao Chen commented on HADOOP-15408: Thanks [~daryn] for the comment and background. I want this

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459485#comment-16459485 ] Xiao Chen commented on HADOOP-15408: I find cycles to test this today, and was able to reproduce

[jira] [Updated] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15431: --- Status: Patch Available (was: Open) Patch 1 with a fix and unit test. Verified that the failing

[jira] [Updated] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15431: --- Attachment: HADOOP-15431.01.patch > KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has

[jira] [Created] (HADOOP-15431) KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service

2018-05-01 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-15431: -- Summary: KMSTokenRenewer should work with KMS_DELEGATION_TOKEN which has ip:port as service Key: HADOOP-15431 URL: https://issues.apache.org/jira/browse/HADOOP-15431

<    1   2   3   4   5   6   7   8   9   10   >