[jira] [Updated] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15349: Status: Patch Available (was: Open) > S3Guard DDB retryBackoff to be more informative on limits

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539750#comment-16539750 ] Prasanth Jayachandran commented on HADOOP-15598: Results from JMH microbenchmark. As we

[jira] [Commented] (HADOOP-15316) GenericTestUtils can exceed maxSleepTime

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539820#comment-16539820 ] genericqa commented on HADOOP-15316: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Status: Patch Available (was: Open) > DataChecksum calculate checksum is

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539753#comment-16539753 ] Prasanth Jayachandran commented on HADOOP-15598: [~gopalv]/[~vinodkv] can someone

[jira] [Updated] (HADOOP-15316) GenericTestUtils can exceed maxSleepTime

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-15316: Status: Patch Available (was: Open) > GenericTestUtils can exceed maxSleepTime >

[jira] [Assigned] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned HADOOP-14212: --- Assignee: Adam Antal > Expose SecurityEnabled boolean field in JMX for other services

[jira] [Commented] (HADOOP-15316) GenericTestUtils can exceed maxSleepTime

2018-07-11 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539674#comment-16539674 ] Sean Mackrory commented on HADOOP-15316: Thanks for picking this up. The code looks good to me.

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539704#comment-16539704 ] genericqa commented on HADOOP-15349: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable lock

2018-07-11 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HADOOP-15598: -- Summary: DataChecksum calculate checksum is contented on hashtable lock Key: HADOOP-15598 URL: https://issues.apache.org/jira/browse/HADOOP-15598

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Summary: DataChecksum calculate checksum is contented on hashtable

[jira] [Commented] (HADOOP-15586) Fix wrong log statements in AbstractService

2018-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539862#comment-16539862 ] Antal Bálint Steinbach commented on HADOOP-15586: - Hi [~snemeth], +1 It looks fine for

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Attachment: HADOOP-15598.1.patch > DataChecksum calculate checksum is

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539756#comment-16539756 ] Prasanth Jayachandran commented on HADOOP-15598: Another profiler attached where ~94%

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Issue Type: Improvement (was: Bug) > DataChecksum calculate checksum is

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Priority: Minor (was: Major) > DataChecksum calculate checksum is

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Attachment: Screen Shot 2018-07-11 at 2.01.54 AM.png > DataChecksum

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540157#comment-16540157 ] Steve Loughran commented on HADOOP-14556: - AWS extended Assume role lifespans from 1h to 12h in

[jira] [Work started] (HADOOP-15400) Improve S3Guard documentation on Authoritative Mode implementation

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15400 started by Gabor Bota. --- > Improve S3Guard documentation on Authoritative Mode implementation >

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540214#comment-16540214 ] Adam Antal commented on HADOOP-14212: - MXBeans added for ResourceManager and NodeManager, added

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540241#comment-16540241 ] Steve Loughran commented on HADOOP-14212: - I like publishing info as metrics, we use it for S3A

[jira] [Assigned] (HADOOP-14784) [KMS] Improve KeyAuthorizationKeyProvider#toString()

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14784: --- Assignee: (was: Gabor Bota) > [KMS] Improve KeyAuthorizationKeyProvider#toString() >

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Parent Issue: HADOOP-15220 (was: HADOOP-15226) > Stabilize S3A Assumed Role support >

[jira] [Updated] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-14212: Attachment: HADOOP-14212.003.patch > Expose SecurityEnabled boolean field in JMX for other

[jira] [Commented] (HADOOP-15594) Exclude commons-lang3 from hadoop-client-minicluster

2018-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540230#comment-16540230 ] Hudson commented on HADOOP-15594: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14558 (See

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540233#comment-16540233 ] Steve Loughran commented on HADOOP-15598: - looks good, but we'll wait for Yetus to do a test

[jira] [Commented] (HADOOP-15531) Use commons-text instead of commons-lang in some classes to fix deprecation warnings

2018-07-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540235#comment-16540235 ] Takanobu Asanuma commented on HADOOP-15531: --- HADOOP-15594 resolved. Rebased the patch and

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540234#comment-16540234 ] Steve Loughran commented on HADOOP-15598: - BTW, does this affect branch-3.1 too? If so, change

[jira] [Work started] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14212 started by Adam Antal. --- > Expose SecurityEnabled boolean field in JMX for other services besides >

[jira] [Commented] (HADOOP-15594) Exclude commons-lang3 from hadoop-client-minicluster

2018-07-11 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540194#comment-16540194 ] Akira Ajisaka commented on HADOOP-15594: LGTM, +1 > Exclude commons-lang3 from

[jira] [Updated] (HADOOP-15594) Exclude commons-lang3 from hadoop-client-minicluster

2018-07-11 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15594: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15594) Exclude commons-lang3 from hadoop-client-minicluster

2018-07-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540210#comment-16540210 ] Takanobu Asanuma commented on HADOOP-15594: --- Thanks for the review and the commit,

[jira] [Updated] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-14212: Status: Patch Available (was: Open) > Expose SecurityEnabled boolean field in JMX for other

[jira] [Comment Edited] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540214#comment-16540214 ] Adam Antal edited comment on HADOOP-14212 at 7/11/18 3:03 PM: -- MXBeans

[jira] [Work stopped] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14212 stopped by Adam Antal. --- > Expose SecurityEnabled boolean field in JMX for other services besides >

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15598: Status: Open (was: Patch Available) > DataChecksum calculate checksum is contented on

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15598: Attachment: HADOOP-15598.1.patch > DataChecksum calculate checksum is contented on

[jira] [Updated] (HADOOP-15531) Use commons-text instead of commons-lang in some classes to fix deprecation warnings

2018-07-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15531: -- Attachment: HADOOP-15531.3.patch > Use commons-text instead of commons-lang in some

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15598: Status: Patch Available (was: Open) > DataChecksum calculate checksum is contented on

[jira] [Updated] (HADOOP-15589) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15589: Status: Patch Available (was: Open) > Broken link within documentation -

[jira] [Updated] (HADOOP-15589) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15589: Attachment: HADOOP-15589.001.patch > Broken link within documentation -

[jira] [Commented] (HADOOP-15589) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540367#comment-16540367 ] genericqa commented on HADOOP-15589: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540434#comment-16540434 ] genericqa commented on HADOOP-15598: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HADOOP-15598: -- Assignee: Prasanth Jayachandran > DataChecksum calculate checksum

[jira] [Commented] (HADOOP-15589) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540503#comment-16540503 ] Akira Ajisaka commented on HADOOP-15589: +1, moving to HDFS project. > Broken link within

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540513#comment-16540513 ] Prasanth Jayachandran commented on HADOOP-15598: [~ste...@apache.org] Yeah. There will

[jira] [Updated] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-14212: Attachment: HADOOP-14212.002.patch > Expose SecurityEnabled boolean field in JMX for other

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540076#comment-16540076 ] Adam Antal commented on HADOOP-14212: - Patch for DN with tests uploaded. Modified test passed in my

[jira] [Work started] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14154 started by Gabor Bota. --- > Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[jira] [Commented] (HADOOP-15541) AWS SDK can mistake stream timeouts for EOF and throw SdkClientExceptions

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540126#comment-16540126 ] Steve Loughran commented on HADOOP-15541: - OK. cherry picked to branch-3.1; lets close this

[jira] [Updated] (HADOOP-15541) AWS SDK can mistake stream timeouts for EOF and throw SdkClientExceptions

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15541: Resolution: Fixed Fix Version/s: 3.1.1 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15397) Failed to start the estimator of Resource Estimator Service

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540133#comment-16540133 ] genericqa commented on HADOOP-15397: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15397) Failed to start the estimator of Resource Estimator Service

2018-07-11 Thread zhangbutao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangbutao updated HADOOP-15397: Description: You would get the following log, if you start the estmator using  script  

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540003#comment-16540003 ] Adam Antal commented on HADOOP-14212: - Added patch for SNN. Unit testing is not applicable (no

[jira] [Updated] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

2018-07-11 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-14212: Attachment: HADOOP-14212.001.patch > Expose SecurityEnabled boolean field in JMX for other

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540137#comment-16540137 ] Gabor Bota commented on HADOOP-15349: - is it enough? > S3Guard DDB retryBackoff to be more

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540136#comment-16540136 ] Steve Loughran commented on HADOOP-15349: - patch seems good though > S3Guard DDB retryBackoff

[jira] [Assigned] (HADOOP-15589) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15589: --- Assignee: Gabor Bota > Broken link within documentation -

[jira] [Resolved] (HADOOP-15232) AWSCredentialProviderList to throw custom NoCredentialsException; retry logic to handle

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15232. - Resolution: Duplicate > AWSCredentialProviderList to throw custom

[jira] [Resolved] (HADOOP-14592) ITestS3ATemporaryCredentials to cover all ddb metastore ops with session credentials

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14592. - Resolution: Duplicate HADOOP-15572 does this only more strictly >

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540135#comment-16540135 ] Steve Loughran commented on HADOOP-15349: - Sorry, missed your comment. I'd just set capacity to

[jira] [Updated] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14154: Attachment: HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode

[jira] [Commented] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540271#comment-16540271 ] Gabor Bota commented on HADOOP-14154: - I've added a specification for the solution to this issue.

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540325#comment-16540325 ] Yongjun Zhang edited comment on HADOOP-15538 at 7/11/18 4:20 PM: - BTW,

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0) > DataChecksum calculate

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Affects Version/s: 3.1.1 > DataChecksum calculate checksum is contented on

[jira] [Updated] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14154: Attachment: (was: HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540322#comment-16540322 ] Yongjun Zhang commented on HADOOP-15538: Thanks a lot [~mi...@cloudera.com]. Good inputs! The

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540325#comment-16540325 ] Yongjun Zhang commented on HADOOP-15538: BTW, I agree very much with  {code:java} The bottom

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540359#comment-16540359 ] Steve Loughran commented on HADOOP-15598: - added. FWIW, we might want to add some class which

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540270#comment-16540270 ] Prasanth Jayachandran commented on HADOOP-15598: Thanks [~ste...@apache.org] for the

[jira] [Updated] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14154: Attachment: HADOOP-14154-spec-001.pdf > Persist isAuthoritative bit in DynamoDBMetaStore

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-15598: - Priority: Major (was: Minor) > DataChecksum calculate checksum is contented on

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-15598: - Target Version/s: 3.2.0, 3.1.1, 3.0.4 (was: 3.2.0, 3.1.1) > DataChecksum calculate

[jira] [Commented] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540593#comment-16540593 ] Wei-Chiu Chuang commented on HADOOP-15598: -- LGTM. Linked HADOOP-12925 to this jira. From git

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Description: When profiling a multi-threaded hive streaming ingest,

[jira] [Commented] (HADOOP-15531) Use commons-text instead of commons-lang in some classes to fix deprecation warnings

2018-07-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540958#comment-16540958 ] Takanobu Asanuma commented on HADOOP-15531: --- The failed tests passed in my local computer.

[jira] [Updated] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-15593: - Priority: Critical (was: Major) > UserGroupInformation TGT renewer throws NPE >

[jira] [Created] (HADOOP-15599) Improve TrashPolicyDefault error message

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HADOOP-15599: Summary: Improve TrashPolicyDefault error message Key: HADOOP-15599 URL: https://issues.apache.org/jira/browse/HADOOP-15599 Project: Hadoop Common

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540727#comment-16540727 ] Xiao Chen commented on HADOOP-14445: Ping [~shahrs87] [~yzhangal] [~jojochuang] [~daryn], anyone

[jira] [Commented] (HADOOP-15531) Use commons-text instead of commons-lang in some classes to fix deprecation warnings

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540712#comment-16540712 ] genericqa commented on HADOOP-15531: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15598) DataChecksum calculate checksum is contented on hashtable synchronization

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HADOOP-15598: --- Attachment: hadoop-sync-contention.svg > DataChecksum calculate checksum

[jira] [Assigned] (HADOOP-15599) Improve TrashPolicyDefault error message

2018-07-11 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15599: --- Assignee: Gabor Bota > Improve TrashPolicyDefault error message >

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

2018-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540646#comment-16540646 ] Wei-Chiu Chuang commented on HADOOP-15593: -- This is happening to a YARN RM too. Since it

[jira] [Created] (HADOOP-15600) Set default proxy user settings to non-routable IP addresses and default users group

2018-07-11 Thread Eric Yang (JIRA)
Eric Yang created HADOOP-15600: -- Summary: Set default proxy user settings to non-routable IP addresses and default users group Key: HADOOP-15600 URL: https://issues.apache.org/jira/browse/HADOOP-15600

[jira] [Created] (HADOOP-15601) Change yarn.admin.acl setting to be more restricted

2018-07-11 Thread Eric Yang (JIRA)
Eric Yang created HADOOP-15601: -- Summary: Change yarn.admin.acl setting to be more restricted Key: HADOOP-15601 URL: https://issues.apache.org/jira/browse/HADOOP-15601 Project: Hadoop Common