[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: (was: HADOOP-14445.05.patch) > Delegation tokens are not shared between KMS

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.05.patch > Delegation tokens are not shared between KMS instances >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Status: Patch Available (was: Open) > Delegation tokens are not shared between KMS instances >

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390877#comment-16390877 ] Xiao Chen commented on HADOOP-14445: Patch 5 ready for review.  All previous comments addressed,

[jira] [Commented] (HADOOP-15296) Fix a wrong link for RBF in the top page

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390873#comment-16390873 ] Yiqun Lin commented on HADOOP-15296: LGTM, +1, committing... > Fix a wrong link for RBF in the top

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: HADOOP-14445.05.patch > Delegation tokens are not shared between KMS instances >

[jira] [Commented] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390822#comment-16390822 ] Xiao Chen commented on HADOOP-15280: Thanks for working on this issue [~bharatviswa]. I agree we

[jira] [Commented] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390797#comment-16390797 ] genericqa commented on HADOOP-15280: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HADOOP-15280: --- Assignee: Bharat Viswanadham > TestKMS.testWebHDFSProxyUserKerb and

[jira] [Commented] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390754#comment-16390754 ] Bharat Viswanadham commented on HADOOP-15280: - [~xiaochen] This change is due to different

[jira] [Updated] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15280: Attachment: HADOOP-15280.00.patch > TestKMS.testWebHDFSProxyUserKerb and

[jira] [Updated] (HADOOP-15280) TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15280: Status: Patch Available (was: Open) > TestKMS.testWebHDFSProxyUserKerb and

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390733#comment-16390733 ] Xiao Chen commented on HADOOP-12897: Hi [~ajayydv] and [~arpitagarwal], do you plan to look into the

[jira] [Updated] (HADOOP-15158) AliyunOSS: Supports role based credential in URL

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HADOOP-15158: Fix Version/s: (was: 3.0.1) (was: 2.9.1) (was:

[jira] [Commented] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390703#comment-16390703 ] Wangda Tan commented on HADOOP-15262: - [~wujinhu], removed fix version, it should be set by

[jira] [Updated] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HADOOP-15262: Fix Version/s: (was: 3.0.1) (was: 2.9.1) (was:

[jira] [Commented] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390652#comment-16390652 ] genericqa commented on HADOOP-15262: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390620#comment-16390620 ] wujinhu edited comment on HADOOP-15262 at 3/8/18 2:47 AM: -- Attach

[jira] [Comment Edited] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385641#comment-16385641 ] wujinhu edited comment on HADOOP-15262 at 3/8/18 2:36 AM: -- Thanks [~Sammi] for

[jira] [Commented] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390620#comment-16390620 ] wujinhu commented on HADOOP-15262: -- Attach HADOOP-15262.005.patch! Set a upper limit to waiting list

[jira] [Commented] (HADOOP-12502) SetReplication OutOfMemoryError

2018-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390614#comment-16390614 ] Aaron Fabbri commented on HADOOP-12502: --- Thanks for the updated patch.. Will try to review this

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390602#comment-16390602 ] Aaron Fabbri commented on HADOOP-15273: --- LGTM. +1 Testing: I only ran the TestCopyMapper unit

[jira] [Updated] (HADOOP-15262) AliyunOSS: rename() to move files in a directory in parallel

2018-03-07 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15262: - Attachment: HADOOP-15262.005.patch > AliyunOSS: rename() to move files in a directory in parallel >

[jira] [Commented] (HADOOP-15295) Remove redundant logging related to tags from Configuration

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390444#comment-16390444 ] genericqa commented on HADOOP-15295: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390440#comment-16390440 ] Chris Douglas commented on HADOOP-15292: +1 > Distcp's use of pread is slowing it down. >

[jira] [Commented] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390431#comment-16390431 ] genericqa commented on HADOOP-15297: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390429#comment-16390429 ] Aaron Fabbri commented on HADOOP-15206: --- Just reviewing this as part of a backport. Quick question

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390390#comment-16390390 ] genericqa commented on HADOOP-15273: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390383#comment-16390383 ] Steve Loughran commented on HADOOP-15292: - LGTM.  Chris. what say you? > Distcp's use of pread

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390359#comment-16390359 ] Steve Loughran commented on HADOOP-15209: - checkstyle are on method length and a line being 84

[jira] [Updated] (HADOOP-15295) Remove redundant logging related to tags from Configuration

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15295: Status: Patch Available (was: Open) > Remove redundant logging related to tags from

[jira] [Updated] (HADOOP-15295) Remove redundant logging related to tags from Configuration

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15295: Attachment: HADOOP-15295.000.patch > Remove redundant logging related to tags from Configuration

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390297#comment-16390297 ] genericqa commented on HADOOP-15273: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Patch Available (was: Open) > distcp can't handle remote stores with different

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390291#comment-16390291 ] Steve Loughran commented on HADOOP-15273: - Patch 003 * fixes checkstyle * fixes tests With

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Open (was: Patch Available) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Target Version/s: 3.1.0 Status: Patch Available (was: Open) > distcp can't

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Attachment: HADOOP-15273-003.patch > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Priority: Critical (was: Blocker) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Open (was: Patch Available) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15297: Status: Patch Available (was: Open) FYI: [~devaraj] [~ehiggs] [~fabbri][~leftnoteasy]

[jira] [Commented] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390281#comment-16390281 ] Steve Loughran commented on HADOOP-15297: - HADOOP-15297 patch 001 * make etag feature optional,

[jira] [Updated] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15297: Attachment: HADOOP-15297-001.patchh > Make s3a etag -> checksum publishing option >

[jira] [Commented] (HADOOP-15278) log s3a at info

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390262#comment-16390262 ] genericqa commented on HADOOP-15278: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15297: --- Summary: Make s3a etag -> checksum publishing option Key: HADOOP-15297 URL: https://issues.apache.org/jira/browse/HADOOP-15297 Project: Hadoop Common

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Patch Available (was: Open) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Attachment: HADOOP-15273-002.patch > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Open (was: Patch Available) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-14937) initial part uploads seem to block unnecessarily in S3ABlockOutputStream

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14937: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > initial part uploads seem to block

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390179#comment-16390179 ] Steve Loughran commented on HADOOP-15273: - This is what you get now {code} Checksum mismatch

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Priority: Blocker (was: Critical) > distcp can't handle remote stores with different

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Anis Elleuch (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390171#comment-16390171 ] Anis Elleuch commented on HADOOP-15267: --- Thanks for merging this patch [~ste...@apache.org]. >

[jira] [Updated] (HADOOP-15278) log s3a at info

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15278: Status: Patch Available (was: Open) patch 001; s3a logging is commented out & so gets

[jira] [Updated] (HADOOP-15278) log s3a at info

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15278: Attachment: HADOOP-15278-001.patch > log s3a at info > --- > >

[jira] [Commented] (HADOOP-15278) log s3a at info

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390165#comment-16390165 ] Steve Loughran commented on HADOOP-15278: - Actually, this is what you see in the default {code}

[jira] [Comment Edited] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390143#comment-16390143 ] Steve Loughran edited comment on HADOOP-15273 at 3/7/18 8:20 PM: -

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390143#comment-16390143 ] Steve Loughran commented on HADOOP-15273: - copymapper contains test to look for string of

[jira] [Commented] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390141#comment-16390141 ] genericqa commented on HADOOP-15292: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15278) log s3a at info

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390131#comment-16390131 ] Steve Loughran commented on HADOOP-15278: - Nope, nothing by default {code} bin/hadoop fs -ls

[jira] [Comment Edited] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390031#comment-16390031 ] Steve Loughran edited comment on HADOOP-15267 at 3/7/18 8:10 PM: - +1 OK

[jira] [Updated] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15267: Affects Version/s: 2.9.0 3.0.0 > S3A multipart upload fails when

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390120#comment-16390120 ] Steve Loughran commented on HADOOP-15267: - +[~fabbri]: FYI > S3A multipart upload fails when

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390093#comment-16390093 ] genericqa commented on HADOOP-15273: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390061#comment-16390061 ] Steve Loughran commented on HADOOP-15267: - backported to 3.0.x; not got time right now to do

[jira] [Updated] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15267: Fix Version/s: 3.0.2 > S3A multipart upload fails when SSE-C encryption is enabled >

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390051#comment-16390051 ] Hudson commented on HADOOP-15267: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13787 (See

[jira] [Commented] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390047#comment-16390047 ] Virajith Jalaparti commented on HADOOP-15292: - [^HADOOP-15292.002.patch] fixes

[jira] [Updated] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15292: Status: Patch Available (was: Open) > Distcp's use of pread is slowing it down.

[jira] [Comment Edited] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390047#comment-16390047 ] Virajith Jalaparti edited comment on HADOOP-15292 at 3/7/18 7:07 PM: -

[jira] [Updated] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15292: Status: Open (was: Patch Available) > Distcp's use of pread is slowing it down.

[jira] [Updated] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15292: Attachment: HADOOP-15292.002.patch > Distcp's use of pread is slowing it down. >

[jira] [Updated] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15267: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Status: Patch Available (was: Open) Patch 001 * allows -skipcrccheck everywhere * when

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Attachment: HADOOP-15273-001.patch > distcp can't handle remote stores with different

[jira] [Commented] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389953#comment-16389953 ] Steve Loughran commented on HADOOP-15273: - An initial distcp always does a checksum check during

[jira] [Assigned] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15273: --- Assignee: Steve Loughran > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Description: When using distcp without {{-skipcrcchecks}} . If there's a checksum

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Priority: Critical (was: Minor) > distcp can't handle remote stores with different

[jira] [Updated] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15273: Summary: distcp can't handle remote stores with different checksum algorithms (was:

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389675#comment-16389675 ] genericqa commented on HADOOP-15267: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15277) remove .FluentPropertyBeanIntrospector from CLI operation log output

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15277: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-14831 > remove

[jira] [Commented] (HADOOP-15273) distcp to downgrade on checksum algorithm mismatch to "files unchanged"

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389633#comment-16389633 ] Steve Loughran commented on HADOOP-15273: - oh, and the text is actually wrong, as the arg is

[jira] [Commented] (HADOOP-10786) Fix UGI#reloginFromKeytab on Java 8

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389630#comment-16389630 ] Steve Loughran commented on HADOOP-10786: - Looks like it's in branch-2.7 {code} > git log --grep

[jira] [Commented] (HADOOP-15292) Distcp's use of pread is slowing it down.

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389616#comment-16389616 ] Steve Loughran commented on HADOOP-15292: - # I like the extra instrumentation & probes; if it

[jira] [Commented] (HADOOP-15293) TestLogLevel fails on Java 9

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389605#comment-16389605 ] genericqa commented on HADOOP-15293: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389597#comment-16389597 ] Steve Loughran commented on HADOOP-15267: - now that I've remembered to hit "submit patch", if

[jira] [Updated] (HADOOP-15267) S3A multipart upload fails when SSE-C encryption is enabled

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15267: Status: Patch Available (was: Open) > S3A multipart upload fails when SSE-C encryption

[jira] [Commented] (HADOOP-13126) Add Brotli compression codec

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389593#comment-16389593 ] genericqa commented on HADOOP-13126: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13126) Add Brotli compression codec

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389588#comment-16389588 ] Steve Loughran commented on HADOOP-13126: - Not noticed this before. It would seem OK for Hadoop

[jira] [Commented] (HADOOP-15293) TestLogLevel fails on Java 9

2018-03-07 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389496#comment-16389496 ] Takanobu Asanuma commented on HADOOP-15293: --- Uploaded the 1st patch. The error message is

[jira] [Updated] (HADOOP-15293) TestLogLevel fails on Java 9

2018-03-07 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15293: -- Status: Patch Available (was: Open) > TestLogLevel fails on Java 9 >

[jira] [Updated] (HADOOP-15293) TestLogLevel fails on Java 9

2018-03-07 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15293: -- Attachment: HADOOP-15293.1.patch > TestLogLevel fails on Java 9 >

[jira] [Commented] (HADOOP-15293) TestLogLevel fails on Java 9

2018-03-07 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389439#comment-16389439 ] Takanobu Asanuma commented on HADOOP-15293: --- I would like to work on this issue. Thanks. >

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14445: --- Attachment: (was: HADOOP-14445.004.patch) > Delegation tokens are not shared between KMS

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389216#comment-16389216 ] Xiao Chen commented on HADOOP-14445: Attached a preliminary [^HADOOP-14445.004.patch] that handles