[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Patch Available (was: Open) > Allow DistCp to use MultiThreadedMapper >

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Open (was: Patch Available) > Allow DistCp to use MultiThreadedMapper >

[jira] [Comment Edited] (HADOOP-13836) Securing Hadoop RPC using SSL

2017-01-11 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820360#comment-15820360 ] kartheek muthyala edited comment on HADOOP-13836 at 1/12/17 7:23 AM: -

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-trunk.4.patch Added a message to

[jira] [Updated] (HADOOP-13836) Securing Hadoop RPC using SSL

2017-01-11 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated HADOOP-13836: --- Attachment: SecureIPC Performance Analysis-OSS.pdf Hi all, I am posting the

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-branch26.4.patch > Allow DistCp to use

[jira] [Comment Edited] (HADOOP-13836) Securing Hadoop RPC using SSL

2017-01-11 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820325#comment-15820325 ] kartheek muthyala edited comment on HADOOP-13836 at 1/12/17 7:05 AM: -

[jira] [Updated] (HADOOP-13836) Securing Hadoop RPC using SSL

2017-01-11 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated HADOOP-13836: --- Attachment: Secure IPC OSS Proposal-1.pdf Secure IPC design draft - v1 > Securing

[jira] [Commented] (HADOOP-13962) Update ADLS SDK to 2.1.4

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820218#comment-15820218 ] John Zhuge commented on HADOOP-13962: - Patch 001 also passed basic {{dfs -ls/-put/-cat}} and

[jira] [Commented] (HADOOP-13933) Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers

2017-01-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820194#comment-15820194 ] Surendra Singh Lilhore commented on HADOOP-13933: - Thanks [~linyiqun] for review...

[jira] [Updated] (HADOOP-13933) Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers

2017-01-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HADOOP-13933: Attachment: HADOOP-13933.005.patch > Add haadmin -getAllServiceState

[jira] [Updated] (HADOOP-13983) Print better error when accessing a non-existent store

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13983: Release Note: (was: The error message when accessing a non-existent store is not user friendly:

[jira] [Updated] (HADOOP-13979) Live unit tests leak files in home dir on ADLS store

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13979: Summary: Live unit tests leak files in home dir on ADLS store (was: Live unit tests leaks files

[jira] [Updated] (HADOOP-13982) Print better error when accessing a store without permission

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13982: Summary: Print better error when accessing a store without permission (was: Print better error

[jira] [Created] (HADOOP-13983) Print better error when accessing a non-existent store

2017-01-11 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-13983: --- Summary: Print better error when accessing a non-existent store Key: HADOOP-13983 URL: https://issues.apache.org/jira/browse/HADOOP-13983 Project: Hadoop Common

[jira] [Created] (HADOOP-13982) Print better error message when accessing a store without permission

2017-01-11 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-13982: --- Summary: Print better error message when accessing a store without permission Key: HADOOP-13982 URL: https://issues.apache.org/jira/browse/HADOOP-13982 Project: Hadoop

[jira] [Commented] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820036#comment-15820036 ] Aaron Fabbri commented on HADOOP-13877: --- +1 v2 patch, pending testing. I'm cool with the

[jira] [Commented] (HADOOP-13981) S3Guard CLI: Add documentation

2017-01-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820005#comment-15820005 ] Aaron Fabbri commented on HADOOP-13981: --- Is there a central place for CLI documentation, or would

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820003#comment-15820003 ] Aaron Fabbri commented on HADOOP-13650: --- I created another JIRA HADOOP-13980 for the fsck stuff.

[jira] [Created] (HADOOP-13981) S3Guard CLI: Add documentation

2017-01-11 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13981: - Summary: S3Guard CLI: Add documentation Key: HADOOP-13981 URL: https://issues.apache.org/jira/browse/HADOOP-13981 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13980) S3Guard CLI: Add fsck check command

2017-01-11 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13980: - Summary: S3Guard CLI: Add fsck check command Key: HADOOP-13980 URL: https://issues.apache.org/jira/browse/HADOOP-13980 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819990#comment-15819990 ] Aaron Fabbri commented on HADOOP-13650: --- Also wanted to comment on the addition of fsck features.

[jira] [Commented] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819991#comment-15819991 ] Andrew Wang commented on HADOOP-13978: -- Arun, for sure, go ahead. I didn't see this pop up as a New

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819969#comment-15819969 ] Aaron Fabbri commented on HADOOP-13650: --- Nice work on this [~eddyxu]. Overall I think it looks

[jira] [Commented] (HADOOP-13957) prevent bad PATHs

2017-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819855#comment-15819855 ] Allen Wittenauer commented on HADOOP-13957: --- Is there a use case for something writable in the

[jira] [Commented] (HADOOP-13673) Update scripts to be smarter when running with privilege

2017-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819826#comment-15819826 ] Allen Wittenauer commented on HADOOP-13673: --- ping [~andrew.wang]. I'd like to get this into

[jira] [Updated] (HADOOP-13673) Update scripts to be smarter when running with privilege

2017-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13673: -- Release Note: Apache Hadoop is now able to switch to the appropriate user prior to

[jira] [Commented] (HADOOP-13957) prevent bad PATHs

2017-01-11 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819843#comment-15819843 ] Andres Perez commented on HADOOP-13957: --- Maybe this should be implemented as a configuration

[jira] [Created] (HADOOP-13979) Live unit tests leaks files in home dir on ADLS store

2017-01-11 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-13979: --- Summary: Live unit tests leaks files in home dir on ADLS store Key: HADOOP-13979 URL: https://issues.apache.org/jira/browse/HADOOP-13979 Project: Hadoop Common

[jira] [Updated] (HADOOP-13673) Update scripts to be smarter when running with privilege

2017-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13673: -- Release Note: Apache Hadoop is now able to switch to appropriate user prior to

[jira] [Updated] (HADOOP-13673) Update scripts to be smarter when running with privilege

2017-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13673: -- Release Note: Apache Hadoop is now able to switch to the appropriate user prior to

[jira] [Commented] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819792#comment-15819792 ] Hadoop QA commented on HADOOP-13978: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819782#comment-15819782 ] Arun Suresh commented on HADOOP-13978: -- [~andrew.wang], Can I maybe update the patch to add some

[jira] [Commented] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819765#comment-15819765 ] Kai Zheng commented on HADOOP-13978: It is pretty good to me, looking at the Aliyun OSS related.

[jira] [Updated] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13978: - Status: Patch Available (was: Open) > Update project release notes for 3.0.0-alpha2 >

[jira] [Updated] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13978: - Attachment: HADOOP-13978.001.patch Patch attached. I generated the release notes and found two

[jira] [Created] (HADOOP-13978) Update project release notes for 3.0.0-alpha2

2017-01-11 Thread Andrew Wang (JIRA)
Andrew Wang created HADOOP-13978: Summary: Update project release notes for 3.0.0-alpha2 Key: HADOOP-13978 URL: https://issues.apache.org/jira/browse/HADOOP-13978 Project: Hadoop Common

[jira] [Commented] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819733#comment-15819733 ] Hadoop QA commented on HADOOP-13975: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13050) Upgrade to AWS SDK 1.11.45

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13050: - Release Note: The dependency on the AWS SDK has been bumped to 1.11.45. > Upgrade to AWS SDK

[jira] [Updated] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-12718: - Release Note: The `hadoop fs -ls` command now prints "Permission denied" rather than "No such

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Patch Available (was: Open) > Allow DistCp to use MultiThreadedMapper >

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-trunk.3.patch Fixed checkstyle issues. > Allow

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Open (was: Patch Available) > Allow DistCp to use MultiThreadedMapper >

[jira] [Updated] (HADOOP-11804) Shaded Hadoop client artifacts and minicluster

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-11804: - Release Note: The `hadoop-client` Maven artifact available in 2.x releases pulls Hadoop's

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-branch26.3.patch Fixed checkstyle issues. > Allow

[jira] [Updated] (HADOOP-13977) IntelliJ Compilation error in ITUseMiniCluster.java

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13977: - Affects Version/s: 3.0.0-alpha2 > IntelliJ Compilation error in ITUseMiniCluster.java >

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Patch Available (was: Open) > Allow DistCp to use MultiThreadedMapper >

[jira] [Commented] (HADOOP-13961) Fix compilation failure from missing hadoop-kms test jar

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819631#comment-15819631 ] Hudson commented on HADOOP-13961: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #0 (See

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-branch26.2.patch > Allow DistCp to use

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Open (was: Patch Available) > Allow DistCp to use MultiThreadedMapper >

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-trunk.2.patch > Allow DistCp to use

[jira] [Commented] (HADOOP-13961) Fix compilation failure from missing hadoop-kms test jar

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819594#comment-15819594 ] John Zhuge commented on HADOOP-13961: - Thanks [~andrew.wang], [~sjlee0], [~aw], and [~kasha] for

[jira] [Updated] (HADOOP-13961) Fix compilation failure from missing hadoop-kms test jar

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13961: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819572#comment-15819572 ] Hadoop QA commented on HADOOP-13975: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13961) Fix compilation failure from missing hadoop-kms test jar

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13961: - Summary: Fix compilation failure from missing hadoop-kms test jar (was: Fix compilation

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819571#comment-15819571 ] Andrew Wang commented on HADOOP-13961: -- +1 LGTM, did some local testing too. Will commit shortly.

[jira] [Assigned] (HADOOP-13961) mvn install fails on trunk

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HADOOP-13961: Assignee: Andrew Wang (was: Sangjin Lee) > mvn install fails on trunk >

[jira] [Updated] (HADOOP-13961) Fix compilation failure

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13961: - Summary: Fix compilation failure (was: mvn install fails on trunk) > Fix compilation failure >

[jira] [Commented] (HADOOP-13977) IntelliJ Compilation error in ITUseMiniCluster.java

2017-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819533#comment-15819533 ] Miklos Szegedi commented on HADOOP-13977: - I checked the root cause. Building in IntelliJ worked

[jira] [Issue Comment Deleted] (HADOOP-13977) IntelliJ Compilation error in ITUseMiniCluster.java

2017-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated HADOOP-13977: Comment: was deleted (was: I verified and this was introduced in HADOOP-11656.) >

[jira] [Commented] (HADOOP-13805) UGI.getCurrentUser() fails if user does not have a keytab associated

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819530#comment-15819530 ] Wei-Chiu Chuang commented on HADOOP-13805: -- [~tucu00] I am not expert in UGI and user

[jira] [Commented] (HADOOP-13977) IntelliJ Compilation error in ITUseMiniCluster.java

2017-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819529#comment-15819529 ] Miklos Szegedi commented on HADOOP-13977: - I verified and this was introduced in HADOOP-11656.

[jira] [Created] (HADOOP-13977) IntelliJ Compilation error in ITUseMiniCluster.java

2017-01-11 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created HADOOP-13977: --- Summary: IntelliJ Compilation error in ITUseMiniCluster.java Key: HADOOP-13977 URL: https://issues.apache.org/jira/browse/HADOOP-13977 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819514#comment-15819514 ] Zheng Shao edited comment on HADOOP-13975 at 1/11/17 11:26 PM: --- Example

[jira] [Commented] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819514#comment-15819514 ] Zheng Shao commented on HADOOP-13975: - Example usage: bin/hadoop distcp

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Status: Patch Available (was: In Progress) > Allow DistCp to use MultiThreadedMapper >

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-trunk.1.patch > Allow DistCp to use

[jira] [Updated] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-13975: Attachment: HADOOP-distcp-multithreaded-mapper-branch26.1.patch > Allow DistCp to use

[jira] [Work started] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13975 started by Zheng Shao. --- > Allow DistCp to use MultiThreadedMapper >

[jira] [Commented] (HADOOP-13976) Path globbing does not match newlines

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819460#comment-15819460 ] Hadoop QA commented on HADOOP-13976: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13114) DistCp should have option to compress data on write

2017-01-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819365#comment-15819365 ] Koji Noguchi commented on HADOOP-13114: --- bq. Could you please elucidate your concern if its not

[jira] [Updated] (HADOOP-13976) Path globbing does not match newlines

2017-01-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HADOOP-13976: - Attachment: HADOOP-13976.001.patch > Path globbing does not match newlines >

[jira] [Updated] (HADOOP-13976) Path globbing does not match newlines

2017-01-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HADOOP-13976: - Status: Patch Available (was: Open) > Path globbing does not match newlines >

[jira] [Created] (HADOOP-13976) Path globbing does not match newlines

2017-01-11 Thread Eric Badger (JIRA)
Eric Badger created HADOOP-13976: Summary: Path globbing does not match newlines Key: HADOOP-13976 URL: https://issues.apache.org/jira/browse/HADOOP-13976 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13975) Allow DistCp to use MultiThreadedMapper

2017-01-11 Thread Zheng Shao (JIRA)
Zheng Shao created HADOOP-13975: --- Summary: Allow DistCp to use MultiThreadedMapper Key: HADOOP-13975 URL: https://issues.apache.org/jira/browse/HADOOP-13975 Project: Hadoop Common Issue Type:

[jira] [Work started] (HADOOP-13956) Read ADLS credentials from Credential Provider

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13956 started by John Zhuge. --- > Read ADLS credentials from Credential Provider >

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818945#comment-15818945 ] Chris Nauroth commented on HADOOP-13589: Reviewing patch 004, we still need to update

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818916#comment-15818916 ] Hudson commented on HADOOP-13336: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11107 (See

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818706#comment-15818706 ] Hadoop QA commented on HADOOP-13336: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13912) S3a Multipart Committer (avoid rename)

2017-01-11 Thread chao Guan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818702#comment-15818702 ] chao Guan commented on HADOOP-13912: Do you mean HADOOP-13786? > S3a Multipart Committer (avoid

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818690#comment-15818690 ] Hadoop QA commented on HADOOP-13589: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818662#comment-15818662 ] Steve Loughran commented on HADOOP-13589: - tests completed against s3 ireland, with params

[jira] [Updated] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13589: Status: Patch Available (was: Open) > S3Guard: Allow execution of all S3A integration

[jira] [Updated] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13589: Attachment: HADOOP-13589-HADOOP-13345-004.patch Patch 004: setup s3guard for all FS

[jira] [Commented] (HADOOP-13972) Access multiple Azure Data Lake stores with different SPIs

2017-01-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818555#comment-15818555 ] John Zhuge commented on HADOOP-13972: - Sounds good [~ste...@apache.org]. I am all for code reuse and

[jira] [Created] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-01-11 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13974: --- Summary: S3a CLI to support list/purge of pending multipart commits Key: HADOOP-13974 URL: https://issues.apache.org/jira/browse/HADOOP-13974 Project: Hadoop

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818513#comment-15818513 ] Steve Loughran commented on HADOOP-13786: - Final committer will need to handle speculative

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) > S3A to support per-bucket configuration >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-011.patch Turns out that the patch doesn't work in branch-2.8,

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) > S3A to support per-bucket configuration >

[jira] [Resolved] (HADOOP-13912) S3a Multipart Committer (avoid rename)

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13912. - Resolution: Duplicate closing as duplicate of HADOOP-1786; adding subjiras there > S3a

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818440#comment-15818440 ] Steve Loughran commented on HADOOP-13786: - Multipart algorithm summarised by Thomas Demoor on

[jira] [Commented] (HADOOP-13972) Access multiple Azure Data Lake stores with different SPIs

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818304#comment-15818304 ] Steve Loughran commented on HADOOP-13972: - I propose you follow the pattern of HADOOP-13336,

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818289#comment-15818289 ] Steve Loughran commented on HADOOP-13589: - I thought I'd done that but you are right, I only do

[jira] [Updated] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13589: Status: Open (was: Patch Available) > S3Guard: Allow execution of all S3A integration

[jira] [Commented] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818281#comment-15818281 ] Steve Loughran commented on HADOOP-13876: - we can just add it to core-site.xml and have it

[jira] [Commented] (HADOOP-13970) garbage data read from the beginning of a tar file

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818275#comment-15818275 ] Steve Loughran commented on HADOOP-13970: - at a guess, there's no untarring taking place: the

[jira] [Commented] (HADOOP-13973) S3 requests failing: java.lang.IllegalStateException: Connection is not open

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818246#comment-15818246 ] Steve Loughran commented on HADOOP-13973: - The problem arises in S3A reopen(), which attempts to

[jira] [Commented] (HADOOP-13973) S3 requests failing: java.lang.IllegalStateException: Connection is not open

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818235#comment-15818235 ] Steve Loughran commented on HADOOP-13973: - Stack 2: GET {code} java.lang.IllegalStateException:

[jira] [Commented] (HADOOP-13973) S3 requests failing: java.lang.IllegalStateException: Connection is not open

2017-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818232#comment-15818232 ] Steve Loughran commented on HADOOP-13973: - Stack one, HEAD request {code} Caused by:

  1   2   >