[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742115#comment-16742115 ] Adam Antal commented on HADOOP-15843: - Please correct me if I'm wrong, but I suggest not to modify

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Attachment: HADOOP-15999.001.patch > [s3a] Better support for out-of-band operations >

[jira] [Commented] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742302#comment-16742302 ] Andrew Olson commented on HADOOP-16047: --- Thanks [~ste...@apache.org] > Avoid expensive rename

[jira] [Resolved] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16047. - Resolution: Duplicate closing as duplicate...please reattach your proposal there as

[jira] [Updated] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15999: Status: Patch Available (was: In Progress) This integration test is for documenting and

[jira] [Comment Edited] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742311#comment-16742311 ] Andrew Olson edited comment on HADOOP-15281 at 1/14/19 5:10 PM: We've

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742125#comment-16742125 ] Gabor Bota commented on HADOOP-15843: - The modification in {{initMetadataStore}} is not needed,

[jira] [Created] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
Andrew Olson created HADOOP-16047: - Summary: Avoid expensive rename when DistCp is writing to S3 Key: HADOOP-16047 URL: https://issues.apache.org/jira/browse/HADOOP-16047 Project: Hadoop Common

[jira] [Commented] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742212#comment-16742212 ] Andrew Olson commented on HADOOP-16047: --- Instead of a new config property, would something like

[jira] [Commented] (HADOOP-16047) Avoid expensive rename when DistCp is writing to S3

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742269#comment-16742269 ] Steve Loughran commented on HADOOP-16047: - I'm going to close this as a duplicate, not because

[jira] [Updated] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-15843: Attachment: HADOOP-15843.002.patch > s3guard bucket-info command to not print a stack trace on

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742289#comment-16742289 ] Adam Antal commented on HADOOP-15843: - I think I incorporated the items we discussed, and uploaded

[jira] [Comment Edited] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742309#comment-16742309 ] Gabor Bota edited comment on HADOOP-15999 at 1/14/19 5:07 PM: -- This

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742319#comment-16742319 ] Steve Loughran commented on HADOOP-16043: - OK. If you can test that they all work on the 3.2

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742367#comment-16742367 ] Hudson commented on HADOOP-15843: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15769 (See

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2019-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742384#comment-16742384 ] Hudson commented on HADOOP-14556: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15770 (See

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742401#comment-16742401 ] Thomas Marquardt commented on HADOOP-16044: --- Good questions, and the answers are complicated

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742433#comment-16742433 ] Andrew Olson commented on HADOOP-15281: --- Ok, sounds good from here - thanks for the input. >

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742466#comment-16742466 ] Steve Loughran commented on HADOOP-16018: - If it didn't happen before the patch, and it happens

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742488#comment-16742488 ] Steve Loughran commented on HADOOP-15229: - FWIW, I think this PR can stop as "done" and leave

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742369#comment-16742369 ] Thomas Marquardt commented on HADOOP-16044: --- ABFS has been retrying on UnknownHostException

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742383#comment-16742383 ] Steve Loughran commented on HADOOP-16044: - bq With that said, if you have evidence this is a

[jira] [Updated] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16044: Resolution: Fixed Fix Version/s: 3.2.1 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-16045) Don't run TestDU on Windows

2019-01-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742457#comment-16742457 ] Lukas Majercak commented on HADOOP-16045: - Thanks [~elgoiri]. We'd need to backport

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742311#comment-16742311 ] Andrew Olson commented on HADOOP-15281: --- We've successfully tested a quick+dirty solution where

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742336#comment-16742336 ] Steve Loughran commented on HADOOP-15843: - BTW: +1 committed to trunk. Thanks! > s3guard

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742334#comment-16742334 ] Steve Loughran commented on HADOOP-15843: - bq. Tested on ireland. Got timeout on

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742350#comment-16742350 ] Hudson commented on HADOOP-16043: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15768 (See

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742449#comment-16742449 ] Devaraj K commented on HADOOP-15941: [~ajisakaa] / [~tasanuma0829] This is still failing for "mvn

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742458#comment-16742458 ] Steve Loughran commented on HADOOP-15625: - +HADOOP-15751 may be a symptom of the problem. Which

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742473#comment-16742473 ] Steve Loughran commented on HADOOP-15990: - time to look at this again # can you rebase to

[jira] [Commented] (HADOOP-15751) AWS Data read stack trace in S3a putObjectDirect

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742456#comment-16742456 ] Steve Loughran commented on HADOOP-15751: - seems to be caused by an EOF happening early

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Status: Open (was: Patch Available) > Add FileSystem builder-based openFile() API to

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Status: Patch Available (was: Open) Patch 019 * Rebased to trunk (some changes in

[jira] [Updated] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15843: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742356#comment-16742356 ] Steve Loughran commented on HADOOP-14556: - OK, taking larry's previous +1 & akira's happiness

[jira] [Commented] (HADOOP-16022) Increase Compression Buffer Sizes - Remove Magic Numbers

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742380#comment-16742380 ] Steve Loughran commented on HADOOP-16022: - That's a pretty old test suite there; you can look

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742378#comment-16742378 ] Gabor Bota commented on HADOOP-16043: - I've cherry-picked HADOOP-15987, *HADOOP-15947*, this (not

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742467#comment-16742467 ] Hudson commented on HADOOP-16044: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15771 (See

[jira] [Commented] (HADOOP-16019) ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742469#comment-16742469 ] Steve Loughran commented on HADOOP-16019: - LGTM +1 when I commit, I want to list you as the

[jira] [Commented] (HADOOP-15961) S3A committers: make sure there's regular progress() calls

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742474#comment-16742474 ] Steve Loughran commented on HADOOP-15961: - LGTM As with the all the object store patches;

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742359#comment-16742359 ] Steve Loughran commented on HADOOP-15281: - I think I'd prefer it as an option (painful as it is

[jira] [Commented] (HADOOP-15843) s3guard bucket-info command to not print a stack trace on bucket-not-found

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742357#comment-16742357 ] Hadoop QA commented on HADOOP-15843: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742373#comment-16742373 ] Hadoop QA commented on HADOOP-15999: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742453#comment-16742453 ] Steve Loughran commented on HADOOP-15625: - Not forgotten thisHADOOP-15229 helps set things

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Attachment: HADOOP-15229-019.patch > Add FileSystem builder-based openFile() API to

[GitHub] bharatviswa504 commented on issue #464: HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check.

2019-01-14 Thread GitBox
bharatviswa504 commented on issue #464: HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check. URL: https://github.com/apache/hadoop/pull/464#issuecomment-454218853 I have committed this to trunk. Thank You @elek for the contribution.

[GitHub] bharatviswa504 merged pull request #464: HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check.

2019-01-14 Thread GitBox
bharatviswa504 merged pull request #464: HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check. URL: https://github.com/apache/hadoop/pull/464 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, common-comm...@hadoop.apache.org

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2019-01-14 Thread lqjacklee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742642#comment-16742642 ] lqjacklee commented on HADOOP-15990: [~ste...@apache.org] What's error do you occur ? Do I need

[jira] [Reopened] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HADOOP-15941: > [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-004.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-004.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-005.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742703#comment-16742703 ] Hadoop QA commented on HADOOP-15941: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742712#comment-16742712 ] Akira Ajisaka commented on HADOOP-15941: Thank you for providing the patch. Would you move the

[jira] [Updated] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15941: -- Attachment: HADOOP-15941-addendum.2.patch > [JDK 11] Compilation failure: package

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-01-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742638#comment-16742638 ] Sean Mackrory commented on HADOOP-15999: After a preliminary review I think this looks pretty

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-004.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742667#comment-16742667 ] Hadoop QA commented on HADOOP-16018: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742672#comment-16742672 ] Hadoop QA commented on HADOOP-16018: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742687#comment-16742687 ] Hadoop QA commented on HADOOP-16018: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742700#comment-16742700 ] Hadoop QA commented on HADOOP-16018: (!) A patch to the testing environment has been detected.

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742707#comment-16742707 ] Kai Xie commented on HADOOP-16018: -- image building process seems to have problems with nodejs

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742734#comment-16742734 ] Takanobu Asanuma commented on HADOOP-15941: --- Thanks for the review. Uploaded a new patch. It

[jira] [Commented] (HADOOP-15961) S3A committers: make sure there's regular progress() calls

2019-01-14 Thread lqjacklee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742645#comment-16742645 ] lqjacklee commented on HADOOP-15961: I notice that test pass , do you get any issue about the patch

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742649#comment-16742649 ] Akira Ajisaka commented on HADOOP-15941: I couldn't reproduce the error by "mvn clean compile

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742658#comment-16742658 ] Kai Xie commented on HADOOP-16018: -- Good idea! submitted branch-2-004 patch that only adds in a string

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Attachment: HADOOP-16018-branch-2-004.patch > DistCp won't reassemble chunks when blocks per chunk > 0

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Patch Available (was: Open) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Kai Xie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Xie updated HADOOP-16018: - Status: Open (was: Patch Available) > DistCp won't reassemble chunks when blocks per chunk > 0 >

[jira] [Updated] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15941: -- Attachment: HADOOP-15941-addendum.1.patch > [JDK 11] Compilation failure: package

[jira] [Updated] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-15941: -- Status: Patch Available (was: Reopened) > [JDK 11] Compilation failure: package

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742689#comment-16742689 ] Takanobu Asanuma commented on HADOOP-15941: --- Thanks for the report, [~devaraj.k], and thanks

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742624#comment-16742624 ] Hadoop QA commented on HADOOP-15229: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742652#comment-16742652 ] Akira Ajisaka commented on HADOOP-15941: I reproduced this when setting {{-Djavac.version=11}}.

[jira] [Commented] (HADOOP-16019) ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration

2019-01-14 Thread luhuachao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742743#comment-16742743 ] luhuachao commented on HADOOP-16019: thanks, luhuac...@cmss.chinamobile.com ,this email address is

[jira] [Commented] (HADOOP-16018) DistCp won't reassemble chunks when blocks per chunk > 0

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742844#comment-16742844 ] Hadoop QA commented on HADOOP-16018: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread GitBox
bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD. URL: https://github.com/apache/hadoop/pull/462#discussion_r246960327 ## File path: hadoop-ozone/dist/src/main/smoketest/test.sh ## @@ -24,6 +23,41 @@ mkdir

[GitHub] bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread GitBox
bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD. URL: https://github.com/apache/hadoop/pull/462#discussion_r246957925 ## File path: hadoop-ozone/dist/src/main/smoketest/test.sh ## @@ -24,6 +23,41 @@ mkdir

[GitHub] bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread GitBox
bharatviswa504 commented on a change in pull request #462: HDDS-764. Run S3 smoke tests with replication STANDARD. URL: https://github.com/apache/hadoop/pull/462#discussion_r246959924 ## File path: hadoop-ozone/dist/src/main/smoketest/test.sh ## @@ -38,8 +72,8 @@

[jira] [Commented] (HADOOP-15941) [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742787#comment-16742787 ] Hadoop QA commented on HADOOP-15941: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2019-01-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742750#comment-16742750 ] Anu Engineer commented on HADOOP-15990: --- {quote}[~Jitendra] [~anu] : what's the ozone S3 gateway

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742761#comment-16742761 ] Bharat Viswanadham commented on HADOOP-15990: - Yes, we support only V2 list in S3 Gateway.

[jira] [Commented] (HADOOP-16041) UserAgent string for ABFS

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741955#comment-16741955 ] Steve Loughran commented on HADOOP-16041: - +1 for picking up the version info, as that avoids

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741962#comment-16741962 ] Gabor Bota commented on HADOOP-16043: - As the S3GUARD_DDB_TABLE_NAME_KEY (fs.s3a.s3guard.ddb.table)

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741998#comment-16741998 ] Hadoop QA commented on HADOOP-16043: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741962#comment-16741962 ] Gabor Bota edited comment on HADOOP-16043 at 1/14/19 11:33 AM: --- As the

[jira] [Work stopped] (HADOOP-15960) Update guava to 27.0-jre in hadoop-common

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15960 stopped by Gabor Bota. --- > Update guava to 27.0-jre in hadoop-common >

[jira] [Commented] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742079#comment-16742079 ] Gabor Bota commented on HADOOP-16043: - It would be nice to have HADOOP-15987, this, and

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741983#comment-16741983 ] Steve Loughran commented on HADOOP-16044: - This is a silly question, but why is

[jira] [Updated] (HADOOP-16043) NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set

2019-01-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16043: Status: Patch Available (was: Open) > NPE in ITestDynamoDBMetadataStore when

  1   2   >