[jira] [Commented] (HADOOP-15961) S3A committers: make sure there's regular progress() calls

[ https://issues.apache.org/jira/browse/HADOOP-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771474#comment-16771474 ] lqjacklee commented on HADOOP-15961: [~ste...@apache.org] I will update the code today. thanks . >

[jira] [Commented] (HADOOP-16105) WASB in secure mode does not set connectingUsingSAS

[ https://issues.apache.org/jira/browse/HADOOP-16105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771499#comment-16771499 ] David McGinnis commented on HADOOP-16105: - [~ste...@apache.org]: That's fine. That's the same

[jira] [Commented] (HADOOP-15870) S3AInputStream.remainingInFile should use nextReadPos

[ https://issues.apache.org/jira/browse/HADOOP-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771400#comment-16771400 ] Hadoop QA commented on HADOOP-15870: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16077) Add an option in ls command to include storage policy

[ https://issues.apache.org/jira/browse/HADOOP-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-16077: -- Attachment: HADOOP-16077-09.patch > Add an option in ls command to include storage policy >

[jira] [Created] (HADOOP-16120) Lazily allocate KMS delegation tokens

Ruslan Dautkhanov created HADOOP-16120: -- Summary: Lazily allocate KMS delegation tokens Key: HADOOP-16120 URL: https://issues.apache.org/jira/browse/HADOOP-16120 Project: Hadoop Common

[GitHub] BELUGABEHR opened a new pull request #497: [HDFS-14295] Add CachedThreadPool for DataNode Transfers

BELUGABEHR opened a new pull request #497: [HDFS-14295] Add CachedThreadPool for DataNode Transfers URL: https://github.com/apache/hadoop/pull/497 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-16119) KMS on Hadoop RPC Engine

[ https://issues.apache.org/jira/browse/HADOOP-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771387#comment-16771387 ] Jonathan Eagles commented on HADOOP-16119: -- \\cc [~daryn], [~anu] > KMS on Hadoop RPC Engine

[jira] [Commented] (HADOOP-15920) get patch for S3a nextReadPos(), through Yetus

[ https://issues.apache.org/jira/browse/HADOOP-15920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771393#comment-16771393 ] Hadoop QA commented on HADOOP-15920: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-16119) KMS on Hadoop RPC Engine

[ https://issues.apache.org/jira/browse/HADOOP-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771387#comment-16771387 ] Jonathan Eagles edited comment on HADOOP-16119 at 2/18/19 9:34 PM: ---

[jira] [Updated] (HADOOP-16112) After exist the baseTrashPath's subDir, delete the subDir leads to don't modify baseTrashPath

[ https://issues.apache.org/jira/browse/HADOOP-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HADOOP-16112: - Attachment: (was: HADOOP-16112.001.patch) > After exist the baseTrashPath's subDir, delete

[jira] [Updated] (HADOOP-16112) After exist the baseTrashPath's subDir, delete the subDir leads to don't modify baseTrashPath

[ https://issues.apache.org/jira/browse/HADOOP-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HADOOP-16112: - Attachment: HADOOP-16112.001.patch > After exist the baseTrashPath's subDir, delete the subDir

[jira] [Created] (HADOOP-16117) Upgrade to latest AWS SDK

Steve Loughran created HADOOP-16117: --- Summary: Upgrade to latest AWS SDK Key: HADOOP-16117 URL: https://issues.apache.org/jira/browse/HADOOP-16117 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-16112) After exist the baseTrashPath's subDir, delete the subDir leads to don't modify baseTrashPath

[ https://issues.apache.org/jira/browse/HADOOP-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HADOOP-16112: - Attachment: (was: HADOOP-16112.001.patch) > After exist the baseTrashPath's subDir, delete

[jira] [Updated] (HADOOP-16112) After exist the baseTrashPath's subDir, delete the subDir leads to don't modify baseTrashPath

[ https://issues.apache.org/jira/browse/HADOOP-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HADOOP-16112: - Attachment: HADOOP-16112.001.patch > After exist the baseTrashPath's subDir, delete the subDir

[jira] [Created] (HADOOP-16118) S3Guard create bucket process to support on-demand DDB tables

Steve Loughran created HADOOP-16118: --- Summary: S3Guard create bucket process to support on-demand DDB tables Key: HADOOP-16118 URL: https://issues.apache.org/jira/browse/HADOOP-16118 Project:

[jira] [Commented] (HADOOP-11223) Offer a read-only conf alternative to new Configuration()

[ https://issues.apache.org/jira/browse/HADOOP-11223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770994#comment-16770994 ] Steve Loughran commented on HADOOP-11223: - I could probably also modify the config if it was

[jira] [Commented] (HADOOP-15269) S3 returning 400 on the directory /test/ GET of getFileStatus

[ https://issues.apache.org/jira/browse/HADOOP-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771028#comment-16771028 ] Steve Loughran commented on HADOOP-15269: - Seen this surface again on testing a hadoop 2.8 run:

[jira] [Commented] (HADOOP-14603) S3A input stream to support ByteBufferReadable

[ https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771190#comment-16771190 ] Sahil Takiar commented on HADOOP-14603: --- Looked into this a bit while working on HDFS-3246, as

[jira] [Updated] (HADOOP-16107) FilterFileSystem doesn't wrap all create() or new builder calls; may skip CRC logic

[ https://issues.apache.org/jira/browse/HADOOP-16107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16107: Summary: FilterFileSystem doesn't wrap all create() or new builder calls; may skip CRC

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771258#comment-16771258 ] Steve Loughran commented on HADOOP-15843: - Update: I've just reverted this and am applying &

[jira] [Commented] (HADOOP-16104) Wasb tests to downgrade to skip when test a/c is namespace enabled

[ https://issues.apache.org/jira/browse/HADOOP-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771259#comment-16771259 ] Masatake Iwasaki commented on HADOOP-16104: --- [~ste...@apache.org] thanks for the input. Tests

[jira] [Commented] (HADOOP-16104) Wasb tests to downgrade to skip when test a/c is namespace enabled

[ https://issues.apache.org/jira/browse/HADOOP-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771262#comment-16771262 ] Masatake Iwasaki commented on HADOOP-16104: --- {quote}BTW, take a look at HADOOP-16068, which

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771225#comment-16771225 ] Hudson commented on HADOOP-15843: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15988 (See

[jira] [Commented] (HADOOP-11127) Improve versioning and compatibility support in native library for downstream hadoop-common users.

[ https://issues.apache.org/jira/browse/HADOOP-11127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771255#comment-16771255 ] Steve Loughran commented on HADOOP-11127: - +1 for any patch which does that > Improve

[GitHub] elek opened a new pull request #496: HDDS-1129. Fix findbug/checkstyle errors hdds projects

elek opened a new pull request #496: HDDS-1129. Fix findbug/checkstyle errors hdds projects URL: https://github.com/apache/hadoop/pull/496 HDDS-1114 fixed all the findbug/checkstyle problems but in the mean time new patches are committed with newer error. Here I would like to

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15281: Resolution: Fixed Status: Resolved (was: Patch Available) Closing as fixed.

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771191#comment-16771191 ] Steve Loughran commented on HADOOP-15625: - thanks, ben, not had a chance to. running

[GitHub] BELUGABEHR opened a new pull request #495: [HDFS-14292] Added ExecutorService to DataXceiverServer

BELUGABEHR opened a new pull request #495: [HDFS-14292] Added ExecutorService to DataXceiverServer URL: https://github.com/apache/hadoop/pull/495 This is an automated message from the Apache Git Service. To respond to the

[jira] [Reopened] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-15843: - > s3guard bucket-info command to not print a stack trace on bucket-not-found >

[jira] [Updated] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15843: Status: Patch Available (was: Reopened) patch 03: patch 002 as applied to trunk;

[jira] [Commented] (HADOOP-16105) WASB in secure mode does not set connectingUsingSAS

[ https://issues.apache.org/jira/browse/HADOOP-16105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771282#comment-16771282 ] Steve Loughran commented on HADOOP-16105: - I got this when trying to invoke the new test {code}

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771319#comment-16771319 ] Hadoop QA commented on HADOOP-15843: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11127) Improve versioning and compatibility support in native library for downstream hadoop-common users.

[ https://issues.apache.org/jira/browse/HADOOP-11127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771270#comment-16771270 ] john lilley commented on HADOOP-11127: -- Well, maybe winutils cannot be entirely replace by the

[jira] [Updated] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15843: Attachment: HADOOP-15843-03.patch > s3guard bucket-info command to not print a stack

[jira] [Commented] (HADOOP-16105) WASB in secure mode does not set connectingUsingSAS

[ https://issues.apache.org/jira/browse/HADOOP-16105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771289#comment-16771289 ] Steve Loughran commented on HADOOP-16105: - David, afraid I'm going to say no to the new test

[jira] [Commented] (HADOOP-15961) S3A committers: make sure there's regular progress() calls

[ https://issues.apache.org/jira/browse/HADOOP-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771294#comment-16771294 ] Steve Loughran commented on HADOOP-15961: - Have you had a chance to update this patch? I do

[jira] [Commented] (HADOOP-15871) Some input streams does not obey "java.io.InputStream.available" contract

[ https://issues.apache.org/jira/browse/HADOOP-15871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771325#comment-16771325 ] Steve Loughran commented on HADOOP-15871: - In S3A I'm going to have it return what the inner S3

[jira] [Updated] (HADOOP-15920) get patch for S3a nextReadPos(), through Yetus

[ https://issues.apache.org/jira/browse/HADOOP-15920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15920: Status: Open (was: Patch Available) > get patch for S3a nextReadPos(), through Yetus >

[jira] [Commented] (HADOOP-15870) S3AInputStream.remainingInFile should use nextReadPos

[ https://issues.apache.org/jira/browse/HADOOP-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771329#comment-16771329 ] Steve Loughran commented on HADOOP-15870: - HADOOP-15870. S3AInputStream.remainingInFile should

[jira] [Updated] (HADOOP-15920) get patch for S3a nextReadPos(), through Yetus

[ https://issues.apache.org/jira/browse/HADOOP-15920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15920: Attachment: HADOOP-15870-004.patch > get patch for S3a nextReadPos(), through Yetus >

[jira] [Updated] (HADOOP-15920) get patch for S3a nextReadPos(), through Yetus

[ https://issues.apache.org/jira/browse/HADOOP-15920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15920: Status: Patch Available (was: Open) > get patch for S3a nextReadPos(), through Yetus >

[jira] [Updated] (HADOOP-15870) S3AInputStream.remainingInFile should use nextReadPos

[ https://issues.apache.org/jira/browse/HADOOP-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15870: Status: Patch Available (was: Open) > S3AInputStream.remainingInFile should use

[jira] [Updated] (HADOOP-15870) S3AInputStream.remainingInFile should use nextReadPos

[ https://issues.apache.org/jira/browse/HADOOP-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15870: Attachment: HADOOP-15870-004.patch > S3AInputStream.remainingInFile should use

[jira] [Commented] (HADOOP-14603) S3A input stream to support ByteBufferReadable

[ https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771334#comment-16771334 ] Steve Loughran commented on HADOOP-14603: - I've seen the SDK 2 is out, I don't want to run to

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771359#comment-16771359 ] Ben Roling commented on HADOOP-15625: - Thanks [~ste...@apache.org].  I'm not taking it personally. 

[jira] [Created] (HADOOP-16119) KMS on Hadoop RPC Engine

Jonathan Eagles created HADOOP-16119: Summary: KMS on Hadoop RPC Engine Key: HADOOP-16119 URL: https://issues.apache.org/jira/browse/HADOOP-16119 Project: Hadoop Common Issue Type: Bug