[jira] [Commented] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906056#comment-15906056 ] Hadoop QA commented on HADOOP-14170: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906028#comment-15906028 ] Mingliang Liu commented on HADOOP-14170: The v2 patch is to: # Use per-test directory (different

[jira] [Updated] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14170: --- Attachment: HADOOP-14170.002.patch > FileSystemContractBaseTest is not cleaning up test

[jira] [Commented] (HADOOP-14173) Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906014#comment-15906014 ] Hadoop QA commented on HADOOP-14173: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14039) ADLS should differentiate integration tests from contract tests

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14039: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-14112 > ADLS should differentiate

[jira] [Updated] (HADOOP-14173) Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14173: Status: Patch Available (was: Open) > Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE >

[jira] [Updated] (HADOOP-14173) Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14173: Attachment: HADOOP-14173.001.patch Patch 001 * Remove the unused property Testing done * Build

[jira] [Created] (HADOOP-14174) Set default ADLS access token provider type to ClientCredential

2017-03-10 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14174: --- Summary: Set default ADLS access token provider type to ClientCredential Key: HADOOP-14174 URL: https://issues.apache.org/jira/browse/HADOOP-14174 Project: Hadoop

[jira] [Updated] (HADOOP-14144) s3guard: CLI diff non-empty after import on new table

2017-03-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14144: --- Attachment: HADOOP-14144-HADOOP-13345.001.patch Attaching a patch that eliminates (and

[jira] [Created] (HADOOP-14173) Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE

2017-03-10 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14173: --- Summary: Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE Key: HADOOP-14173 URL: https://issues.apache.org/jira/browse/HADOOP-14173 Project: Hadoop Common

[jira] [Updated] (HADOOP-14168) S3GuardTool tests should not run if S3Guard is not set up

2017-03-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14168: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HADOOP-13345

[jira] [Commented] (HADOOP-14168) S3GuardTool tests should not run if S3Guard is not set up

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905944#comment-15905944 ] Hadoop QA commented on HADOOP-14168: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905942#comment-15905942 ] Chris Nauroth commented on HADOOP-14038: bq. Is there any way to deprecate properties with

[jira] [Updated] (HADOOP-14168) S3GuardTool tests should not run if S3Guard is not set up

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14168: --- Target Version/s: HADOOP-13345 Component/s: fs/s3 > S3GuardTool tests should not

[jira] [Updated] (HADOOP-14168) S3GuardTool tests should not run if S3Guard is not set up

2017-03-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14168: -- Attachment: HADOOP-14168-HADOOP-13345.003.patch Looks good to me. I removed the unused

[jira] [Commented] (HADOOP-14144) s3guard: CLI diff non-empty after import on new table

2017-03-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905901#comment-15905901 ] Sean Mackrory commented on HADOOP-14144: I've found that if you have empty directories already

[jira] [Assigned] (HADOOP-14172) S3Guard: import does not import empty directory

2017-03-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HADOOP-14172: -- Assignee: Sean Mackrory > S3Guard: import does not import empty directory >

[jira] [Created] (HADOOP-14172) S3Guard: import does not import empty directory

2017-03-10 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14172: -- Summary: S3Guard: import does not import empty directory Key: HADOOP-14172 URL: https://issues.apache.org/jira/browse/HADOOP-14172 Project: Hadoop Common

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905876#comment-15905876 ] Ryan Blue commented on HADOOP-13786: On UUID suffixes: the option is needed for the "append"

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905862#comment-15905862 ] Hadoop QA commented on HADOOP-13786: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13951) Precommit builds do not adequately protect against test malformed fs permissions.

2017-03-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905849#comment-15905849 ] Andrew Wang commented on HADOOP-13951: -- FYI that I also parameterized and renamed my clean job,

[jira] [Commented] (HADOOP-13951) Precommit builds do not adequately protect against test malformed fs permissions.

2017-03-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905846#comment-15905846 ] Andrew Wang commented on HADOOP-13951: -- Thanks Sean. I think this is probably HDFS-only, since it's

[jira] [Updated] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14104: --- Attachment: (was: HADOOP-14104-trunk-v3.patch) > Client should always ask namenode for

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905804#comment-15905804 ] Yongjun Zhang commented on HADOOP-14104: HI [~rushabh.shah], To avoid confusions to other

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905750#comment-15905750 ] Steve Loughran commented on HADOOP-13887: - most (all?) of us don't know about how s3 client side

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905743#comment-15905743 ] Steve Loughran commented on HADOOP-13786: - # {{FileCommitActions}} is my code. Thomas: blame me

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905736#comment-15905736 ] Hadoop QA commented on HADOOP-13887: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Igor Mazur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905731#comment-15905731 ] Igor Mazur commented on HADOOP-13887: - I have a question about adding symmetric and asymmetric

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Attachment: HADOOP-13786-HADOOP-13345-011.patch Patch 011; lot more of the tests are

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Patch Available (was: Open) > Add S3Guard committer for zero-rename commits to

[jira] [Updated] (HADOOP-14113) review ADL Docs

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14113: --- Fix Version/s: 2.8.0 Backported to branch-2.8 and branch-2 branches. Thanks all. > review

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Target Version/s: 2.8.0, 3.0.0-alpha3 (was: 3.0.0-alpha3) Fix Version/s: 2.8.0

[jira] [Updated] (HADOOP-14112) Über-jira adl:// Azure Data Lake Phase I: Stabilization

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14112: --- Target Version/s: 2.8.0, 3.0.0-alpha3 (was: 3.0.0-alpha3) > Über-jira adl:// Azure Data

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Open (was: Patch Available) > Add S3Guard committer for zero-rename commits to

[jira] [Updated] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13887: Attachment: HADOOP-14171-001.patch Patch 001 from Igor Mazur > Support for client-side

[jira] [Updated] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13887: Affects Version/s: 2.8.0 Target Version/s: 2.9.0 Component/s: fs/s3 >

[jira] [Updated] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13887: Status: Patch Available (was: Open) > Support for client-side encryption in S3A file

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905695#comment-15905695 ] Steve Loughran commented on HADOOP-13887: - First. the phrase "it should be trivial" is one of

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905710#comment-15905710 ] Steve Loughran commented on HADOOP-13887: - Can I also add that everyone who has been asking for

[jira] [Updated] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13887: Issue Type: Sub-task (was: New Feature) Parent: HADOOP-13204 > Support for

[jira] [Resolved] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14171. - Resolution: Duplicate Closing as a duplicate of HADOOP-13887 > Support for S3 Client

[jira] [Updated] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14171: Fix Version/s: (was: 2.8.0) > Support for S3 Client Encryption >

[jira] [Commented] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905704#comment-15905704 ] Steve Loughran commented on HADOOP-14171: - Igor, thanks for this, people have been asking for

[jira] [Updated] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-14169: - Attachment: HADOOP-14169.002.patch v002 patch addresses the few minor checkstyle issues >

[jira] [Assigned] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13887: --- Assignee: Igor Mazur > Support for client-side encryption in S3A file system >

[jira] [Commented] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905670#comment-15905670 ] Hadoop QA commented on HADOOP-14169: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905605#comment-15905605 ] John Zhuge commented on HADOOP-14038: - Discovered an issue related to the deprecation of ADLS

[jira] [Updated] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-14169: - Status: Patch Available (was: In Progress) > Implement listStatusIterator, listLocatedStatus

[jira] [Updated] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-14169: - Attachment: HADOOP-14169.001.patch v001 patch removes unused imports... > Implement

[jira] [Updated] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14038: Status: In Progress (was: Patch Available) > Rename ADLS credential properties >

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905556#comment-15905556 ] John Zhuge commented on HADOOP-14038: - [~aw], [~ste...@apache.org], and [~cnauroth], Is there any

[jira] [Work started] (HADOOP-12527) Upgrade Avro dependency to 1.7.7 or later

2017-03-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-12527 started by Sean Busbey. > Upgrade Avro dependency to 1.7.7 or later >

[jira] [Updated] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-14169: - Attachment: HADOOP-14169.000.patch Attaching v0 patch with a very simple fix to implement

[jira] [Commented] (HADOOP-13951) Precommit builds do not adequately protect against test malformed fs permissions.

2017-03-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905499#comment-15905499 ] Sean Busbey commented on HADOOP-13951: -- Updated the following jobs to do the find/chmod as a

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905498#comment-15905498 ] Ryan Blue commented on HADOOP-13786: For the staging committer drawbacks, I think there's a clear

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905482#comment-15905482 ] Chris Douglas commented on HADOOP-14153: bq. since HADOOP-13037 is backported to 2.8.0, should

[jira] [Updated] (HADOOP-14111) cut some obsolete, ignored s3 tests in TestS3Credentials

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14111: Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was:

[jira] [Commented] (HADOOP-14162) Improve release scripts to automate missing steps

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905450#comment-15905450 ] Steve Loughran commented on HADOOP-14162: - At this point I will note that * I don't think

[jira] [Updated] (HADOOP-14164) Update the skin of maven-site during doc generation

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14164: Component/s: build > Update the skin of maven-site during doc generation >

[jira] [Updated] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated HADOOP-14062: - Resolution: Fixed Status: Resolved (was: Patch Available) committed the new patch to trunk and

[jira] [Updated] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Igor Mazur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Mazur updated HADOOP-14171: Attachment: (was: patch.diff) > Support for S3 Client Encryption >

[jira] [Updated] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Igor Mazur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Mazur updated HADOOP-14171: Attachment: patch.diff > Support for S3 Client Encryption > > >

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905411#comment-15905411 ] Yongjun Zhang commented on HADOOP-14104: Thanks [~andrew.wang]. {quote} The FileEncryptionInfo

[jira] [Work started] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs

2017-03-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14169 started by Erik Krogen. > Implement listStatusIterator, listLocatedStatus for ViewFs >

[jira] [Updated] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Igor Mazur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Mazur updated HADOOP-14171: Attachment: patch.diff > Support for S3 Client Encryption > > >

[jira] [Created] (HADOOP-14171) Support for S3 Client Encryption

2017-03-10 Thread Igor Mazur (JIRA)
Igor Mazur created HADOOP-14171: --- Summary: Support for S3 Client Encryption Key: HADOOP-14171 URL: https://issues.apache.org/jira/browse/HADOOP-14171 Project: Hadoop Common Issue Type: New

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-10 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905342#comment-15905342 ] Thomas Demoor commented on HADOOP-13786: Hi Ryan, thanks for contributing to this effort. Both

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905334#comment-15905334 ] John Zhuge commented on HADOOP-14153: - [~liuml07], [~chris.douglas], since HADOOP-13037 is

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905319#comment-15905319 ] John Zhuge commented on HADOOP-14038: - Thanks [~vishwajeet.dusane] for the quick review. 1.

[jira] [Commented] (HADOOP-13453) S3Guard: Instrument new functionality with Hadoop metrics.

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905231#comment-15905231 ] Steve Loughran commented on HADOOP-13453: - I'm afraid HADOOP-13914 has just broken the patch,

[jira] [Commented] (HADOOP-14120) needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject()

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905124#comment-15905124 ] Steve Loughran commented on HADOOP-14120: - this does look good. However, I do have to be strict:

[jira] [Commented] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905121#comment-15905121 ] Steve Loughran commented on HADOOP-14170: - good catch. One reason I've been switching to

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905028#comment-15905028 ] Vishwajeet Dusane commented on HADOOP-14038: Thanks [~jzhuge], Quick glance over the patch5

[jira] [Commented] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904893#comment-15904893 ] Hadoop QA commented on HADOOP-14170: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14161) Failed to rename file in S3A during FileOutputFormat commitTask

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14161: Priority: Minor (was: Major) & downrating to minor as you are trying to do something

[jira] [Updated] (HADOOP-14161) Failed to rename file in S3A during FileOutputFormat commitTask

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14161: Summary: Failed to rename file in S3A during FileOutputFormat commitTask (was: Failed to

[jira] [Commented] (HADOOP-14161) Failed to rename S3AFileStatus

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904888#comment-15904888 ] Steve Loughran commented on HADOOP-14161: - well, you know my stance on directs to s3, ":dont".

[jira] [Commented] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904795#comment-15904795 ] Hadoop QA commented on HADOOP-14170: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14170: --- Attachment: HADOOP-14170.001.patch > FileSystemContractBaseTest is not cleaning up test

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13914: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Updated] (HADOOP-14157) FsUrlStreamHandlerFactory "Illegal character in path" parsing file URL on Windows

2017-03-10 Thread Simon Scott (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Scott updated HADOOP-14157: - Target Version/s: 3.0.0-alpha2, 2.6.5, 2.7.3 (was: 2.7.3, 2.6.5, 3.0.0-alpha2)

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904725#comment-15904725 ] Hadoop QA commented on HADOOP-13914: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13946: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.8.0

[jira] [Comment Edited] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900403#comment-15900403 ] Mingliang Liu edited comment on HADOOP-13946 at 3/10/17 8:19 AM: - Chris'

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Comment Edited] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904301#comment-15904301 ] Mingliang Liu edited comment on HADOOP-14170 at 3/10/17 8:14 AM: - One

[jira] [Updated] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14170: --- Status: Patch Available (was: Open) > FileSystemContractBaseTest is not cleaning up test

[jira] [Updated] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14170: --- Attachment: HADOOP-14170.000.patch > FileSystemContractBaseTest is not cleaning up test

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904673#comment-15904673 ] Hadoop QA commented on HADOOP-14038: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

2017-03-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904301#comment-15904301 ] Mingliang Liu edited comment on HADOOP-14170 at 3/10/17 8:08 AM: - One