[jira] [Updated] (HADOOP-13597) Switch KMS from Tomcat to Jetty

2016-12-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13597: Attachment: HADOOP-13597.002.patch Patch 002 - Add “hadoop kms” sub-command. kms.sh is now just a

[jira] [Updated] (HADOOP-13257) Improve Azure Data Lake contract tests.

2016-12-01 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishwajeet Dusane updated HADOOP-13257: --- Status: Open (was: Patch Available) > Improve Azure Data Lake contract tests. >

[jira] [Updated] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated HADOOP-13835: --- Attachment: HADOOP-13835.006.patch -006 1) Fix a typo in CMakeLists.txt 2) Fix path for

[jira] [Commented] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713913#comment-15713913 ] Varun Vasudev commented on HADOOP-13835: [~ajisakaa] - I think the latest patch is ready for

[jira] [Commented] (HADOOP-13827) Add reencryptEncryptedKey interface to KMS

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713786#comment-15713786 ] Hadoop QA commented on HADOOP-13827: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13827) Add reencryptEncryptedKey interface to KMS

2016-12-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13827: --- Summary: Add reencryptEncryptedKey interface to KMS (was: Add reencryptEDEK interface for KMS) >

[jira] [Updated] (HADOOP-13827) Add reencryptEDEK interface for KMS

2016-12-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13827: --- Attachment: HADOOP-13827.03.patch Patch 3 addressed all comments, and added docs. Didn't find any

[jira] [Updated] (HADOOP-12304) Applications using FileContext fail with the default file system configured to be wasb/s3/etc.

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12304: Fix Version/s: 2.8.0 > Applications using FileContext fail with the default file system

[jira] [Commented] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713548#comment-15713548 ] Andrew Wang commented on HADOOP-13852: -- Hi Steve, there's also a reference in

[jira] [Commented] (HADOOP-13709) Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713498#comment-15713498 ] Hadoop QA commented on HADOOP-13709: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13709) Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits

2016-12-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HADOOP-13709: - Attachment: HADOOP-13709.007.patch Thanks for the comments, [~jlowe]! {quote} The synchronized

[jira] [Updated] (HADOOP-13854) KMS should log error details even if a request is malformed

2016-12-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13854: --- Attachment: HADOOP-13854.01.patch Attaching patch 1. This should be {{warn}} instead of {{debug}}

[jira] [Updated] (HADOOP-5323) Trash documentation should describe its directory structure and configurations

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-5323: --- Fix Version/s: 2.8.0 > Trash documentation should describe its directory structure and

[jira] [Commented] (HADOOP-13854) KMS should log error details even if a request is malformed

2016-12-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713372#comment-15713372 ] Xiao Chen commented on HADOOP-13854: One example entry in the audit log is this intermittently:

[jira] [Updated] (HADOOP-9242) Duplicate surefire plugin config in hadoop-common

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-9242: --- Fix Version/s: 2.8.0 > Duplicate surefire plugin config in hadoop-common >

[jira] [Created] (HADOOP-13854) KMS should log error details even if a request is malformed

2016-12-01 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-13854: -- Summary: KMS should log error details even if a request is malformed Key: HADOOP-13854 URL: https://issues.apache.org/jira/browse/HADOOP-13854 Project: Hadoop Common

[jira] [Commented] (HADOOP-13709) Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits

2016-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713310#comment-15713310 ] Jason Lowe commented on HADOOP-13709: - The synchronized map needs to be locked explicitly when

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713241#comment-15713241 ] Mingliang Liu commented on HADOOP-13449: Thanks for the tip of disabling s3n integration tests.

[jira] [Commented] (HADOOP-12927) Update netty-all to 4.0.34.Final

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713203#comment-15713203 ] Haibo Chen commented on HADOOP-12927: - [~ozawa], [~vinayrpet] Any specific reason why we are not

[jira] [Resolved] (HADOOP-13848) Missing auth-keys.xml prevents detecting test code build problem

2016-12-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-13848. - Resolution: Duplicate Fix Version/s: 2.8.0 > Missing auth-keys.xml prevents detecting

[jira] [Reopened] (HADOOP-13848) Missing auth-keys.xml prevents detecting test code build problem

2016-12-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-13848: - > Missing auth-keys.xml prevents detecting test code build problem >

[jira] [Commented] (HADOOP-13257) Improve Azure Data Lake contract tests.

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713157#comment-15713157 ] Mingliang Liu commented on HADOOP-13257: {quote} 6. When generating Parameterized.Parameters,

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713155#comment-15713155 ] Aaron Fabbri commented on HADOOP-13449: --- That use case for Mock S3 Client + Real DDB client (for

[jira] [Commented] (HADOOP-13578) Add Codec for ZStandard Compression

2016-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713137#comment-15713137 ] Jason Lowe commented on HADOOP-13578: - I forgot to mention it would also be good to address at least

[jira] [Commented] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2016-12-01 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713133#comment-15713133 ] Luke Miner commented on HADOOP-13811: - So I printed out the classpath and it points to the snapshot

[jira] [Commented] (HADOOP-13578) Add Codec for ZStandard Compression

2016-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713129#comment-15713129 ] Jason Lowe commented on HADOOP-13578: - Thanks for updating the patch! I'm torn on the buffer size,

[jira] [Commented] (HADOOP-13257) Improve Azure Data Lake contract tests.

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713109#comment-15713109 ] Mingliang Liu commented on HADOOP-13257: Hi [~vishwajeet.dusane], I just committed the

[jira] [Commented] (HADOOP-13849) Bzip2 java-builtin and system-native have almost the same compress speed

2016-12-01 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712862#comment-15712862 ] Ravi Prakash commented on HADOOP-13849: --- That makes sense Steve and Tao Li! Thanks for your

[jira] [Commented] (HADOOP-13673) Update scripts to be smarter when running with privilege

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712627#comment-15712627 ] Hadoop QA commented on HADOOP-13673: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-13673) Update scripts to be smarter when running with privilege

2016-12-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712531#comment-15712531 ] Allen Wittenauer edited comment on HADOOP-13673 at 12/1/16 5:38 PM:

[jira] [Comment Edited] (HADOOP-13673) Update scripts to be smarter when running with privilege

2016-12-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712531#comment-15712531 ] Allen Wittenauer edited comment on HADOOP-13673 at 12/1/16 5:35 PM:

[jira] [Updated] (HADOOP-13673) Update scripts to be smarter when running with privilege

2016-12-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13673: -- Summary: Update scripts to be smarter when running with privilege (was: Update

[jira] [Updated] (HADOOP-13673) Update sbin/start-* and sbin/stop-* to be smarter

2016-12-01 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13673: -- Attachment: HADOOP-13673.01.patch -01: * some basic docs * hdfs/yarn/hadoop now

[jira] [Comment Edited] (HADOOP-13597) Switch KMS from Tomcat to Jetty

2016-12-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704129#comment-15704129 ] John Zhuge edited comment on HADOOP-13597 at 12/1/16 4:37 PM: -- Patch 001 -

[jira] [Commented] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712269#comment-15712269 ] Steve Loughran commented on HADOOP-13853: - note that given all the other overheads of a commit,

[jira] [Commented] (HADOOP-13257) Improve Azure Data Lake contract tests.

2016-12-01 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712275#comment-15712275 ] Vishwajeet Dusane commented on HADOOP-13257: Thanks [~liuml07] for taking some time to

[jira] [Commented] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712267#comment-15712267 ] Steve Loughran commented on HADOOP-13853: - DEBUG-level logs of the work used to create a marker

[jira] [Created] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

2016-12-01 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13853: --- Summary: S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts Key: HADOOP-13853 URL: https://issues.apache.org/jira/browse/HADOOP-13853

[jira] [Updated] (HADOOP-13022) S3 MD5 check fails on Server Side Encryption-KMS with AWS and default key is used

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13022: Target Version/s: 2.9.0 Priority: Minor (was: Major) > S3 MD5 check fails on

[jira] [Commented] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712133#comment-15712133 ] Hadoop QA commented on HADOOP-13835: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711975#comment-15711975 ] Steve Loughran commented on HADOOP-13811: - I don't see it either. Why not try logging the URL

[jira] [Updated] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated HADOOP-13835: --- Attachment: HADOOP-13835.005.patch -005 Fix the compile errors in mapreduce. > Move Google

[jira] [Commented] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711838#comment-15711838 ] Hadoop QA commented on HADOOP-13852: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13849) Bzip2 java-builtin and system-native have almost the same compress speed

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711831#comment-15711831 ] Steve Loughran commented on HADOOP-13849: - Well, if you want to work on it, feel free.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711793#comment-15711793 ] Steve Loughran commented on HADOOP-13449: - Some of these tests are failing because dynamo db is

[jira] [Commented] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711777#comment-15711777 ] Hadoop QA commented on HADOOP-13835: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13852: Affects Version/s: 3.0.0-alpha1 Status: Patch Available (was: Open) >

[jira] [Updated] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13852: Attachment: HADOOP-13852-001.patch Patch allows a build with an argument like

[jira] [Created] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-01 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13852: --- Summary: hadoop build to allow hadoop version property to be explicitly set Key: HADOOP-13852 URL: https://issues.apache.org/jira/browse/HADOOP-13852 Project:

[jira] [Updated] (HADOOP-13850) s3guard to log choice of metadata store at debug

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13850: Assignee: Mingliang Liu > s3guard to log choice of metadata store at debug >

[jira] [Updated] (HADOOP-13850) s3guard to log choice of metadata store at debug

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13850: Resolution: Fixed Status: Resolved (was: Patch Available) committed to

[jira] [Updated] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated HADOOP-13835: --- Attachment: HADOOP-13835.004.patch Thanks for the review [~ajisakaa]! I've addressed your

[jira] [Commented] (HADOOP-13835) Move Google Test Framework code from mapreduce to hadoop-common

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711277#comment-15711277 ] Akira Ajisaka commented on HADOOP-13835: Would you remove the following setting in rat plugin?