[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806720#comment-15806720 ] Hadoop QA commented on HADOOP-13953: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13953: --- Attachment: HADOOP-13953.04.patch Patch 4 for the test failure. IMO those should be skipped rather

[jira] [Updated] (HADOOP-13747) Use LongAdder for more efficient metrics tracking

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13747: Target Version/s: 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > Use LongAdder for more efficient

[jira] [Updated] (HADOOP-13806) MetricsSourceBuilder doesn't set hasAtMetric when the Source object is reregistered

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13806: Target Version/s: 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > MetricsSourceBuilder doesn't set

[jira] [Updated] (HADOOP-12630) Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory access coredumps

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12630: Target Version/s: 2.7.4, 2.6.6 (was: 2.8.0, 2.7.4, 2.6.6) > Misuse of sun.misc.Unsafe by

[jira] [Commented] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806472#comment-15806472 ] Hadoop QA commented on HADOOP-13885: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13929) ADLS should not check in contract-test-options.xml

2017-01-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806425#comment-15806425 ] John Zhuge commented on HADOOP-13929: - Thanks both of you for the input: * No go on

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806403#comment-15806403 ] Mingliang Liu commented on HADOOP-13345: Yeah, the two points both make sense to me. I'll get my

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806381#comment-15806381 ] Mingliang Liu commented on HADOOP-13336: +1 Nice work! I'll hold on commit in 3 days if

[jira] [Commented] (HADOOP-13839) Fix outdated tracing documentation

2017-01-06 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806371#comment-15806371 ] Colin P. McCabe commented on HADOOP-13839: -- Thanks, [~elek] and [~iwasakims]! > Fix outdated

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806367#comment-15806367 ] Hadoop QA commented on HADOOP-13908: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13438) Optimize IPC server protobuf decoding

2017-01-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806207#comment-15806207 ] Andrew Wang commented on HADOOP-13438: -- I used the typo list and exclude list for alpha1 when doing

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806195#comment-15806195 ] Chris Nauroth commented on HADOOP-13908: [~liuml07], thank you for the update. I agree with

[jira] [Comment Edited] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806095#comment-15806095 ] Mingliang Liu edited comment on HADOOP-13908 at 1/6/17 11:10 PM: - Chris

[jira] [Updated] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13908: --- Attachment: HADOOP-13908-HADOOP-13345.005.patch > S3Guard: Existing tables may not be

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806095#comment-15806095 ] Mingliang Liu commented on HADOOP-13908: Chris and I have checked the test failure of v4 patch.

[jira] [Updated] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HADOOP-13885: Attachment: HADOOP-13885.02.patch Thanks for the review [~andrew.wang]. Can you

[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805979#comment-15805979 ] Hadoop QA commented on HADOOP-13953: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805955#comment-15805955 ] Manoj Govindassamy commented on HADOOP-13885: - * sure, will make getLinkTarget() return

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805942#comment-15805942 ] Mingliang Liu commented on HADOOP-13650: {quote} In the current

[jira] [Commented] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805852#comment-15805852 ] Hadoop QA commented on HADOOP-13877: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805850#comment-15805850 ] Aaron Fabbri commented on HADOOP-13336: --- +1 (binding only on HADOOP-13345 feature branch).

[jira] [Commented] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805841#comment-15805841 ] Andrew Wang commented on HADOOP-13885: -- Hi Manoj, bq. I was following the getFileStatus() to

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805823#comment-15805823 ] Hadoop QA commented on HADOOP-13336: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805814#comment-15805814 ] Steve Loughran commented on HADOOP-13914: - Good writeup. I had a talk with mingliang & rajesh

[jira] [Updated] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13953: --- Attachment: HADOOP-13953.03.patch Thanks for the review [~jojochuang]. Patch 3 to address the

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805797#comment-15805797 ] Hadoop QA commented on HADOOP-13336: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13877: --- Attachment: HADOOP-13877-HADOOP-13345.002.patch In current unit test, the cases that are

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805782#comment-15805782 ] Steve Loughran commented on HADOOP-13589: - now we can do per-bucket config, this should just be

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-HADOOP-13345-004.patch patch 004; address Aaron's comments >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) > S3A to support per-bucket configuration >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) > S3A to support per-bucket configuration >

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805774#comment-15805774 ] Steve Loughran commented on HADOOP-13336: - h2. "fs.s3a.impl". is the only property you can't

[jira] [Comment Edited] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805774#comment-15805774 ] Steve Loughran edited comment on HADOOP-13336 at 1/6/17 9:16 PM: -

[jira] [Commented] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805771#comment-15805771 ] Steve Loughran commented on HADOOP-13877: - OK +1 > S3Guard: fix TestDynamoDBMetadataStore when

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-HADOOP-13345-003.patch patch 003. Fix javadoc. S3AFS declares

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) > S3A to support per-bucket configuration >

[jira] [Commented] (HADOOP-13931) S3AGuard: Use BatchWriteItem in DynamoDBMetadataStore#put()

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805702#comment-15805702 ] Mingliang Liu commented on HADOOP-13931: Thanks [~cnauroth] for your review and commit, and

[jira] [Commented] (HADOOP-13929) ADLS should not check in contract-test-options.xml

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805670#comment-15805670 ] Steve Loughran commented on HADOOP-13929: - I understand the enable/disable thing. Essentially we

[jira] [Commented] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805631#comment-15805631 ] Aaron Fabbri commented on HADOOP-13877: --- Agreed, but different test cases use different bucket

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805590#comment-15805590 ] Aaron Fabbri commented on HADOOP-13336: --- +1 (non-binding) once you remove the change of debug log

[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805557#comment-15805557 ] Wei-Chiu Chuang commented on HADOOP-13953: -- Thanks [~xiaochen] for filing the bug report and

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) cancel for javadoc. One other thing I'm going to

[jira] [Commented] (HADOOP-13453) S3Guard: Instrument new functionality with Hadoop metrics.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805499#comment-15805499 ] Steve Loughran commented on HADOOP-13453: - # these should all go into

[jira] [Commented] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805387#comment-15805387 ] Steve Loughran commented on HADOOP-13877: - this looks simpler than the other patch > S3Guard:

[jira] [Commented] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805379#comment-15805379 ] Steve Loughran commented on HADOOP-13936: - Smaller batch sizes? It could cause throttling

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805360#comment-15805360 ] Hadoop QA commented on HADOOP-13336: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11694) Über-jira: S3a phase II: robustness, scale and performance

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805339#comment-15805339 ] Steve Loughran commented on HADOOP-11694: - Note that I've not quite closed it, we have that

[jira] [Commented] (HADOOP-13826) S3A Deadlock in multipart copy due to thread pool limits.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805340#comment-15805340 ] Steve Loughran commented on HADOOP-13826: - thanks, I'll look at this now > S3A Deadlock in

[jira] [Resolved] (HADOOP-11694) Über-jira: S3a phase II: robustness, scale and performance

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-11694. - Resolution: Fixed Fix Version/s: 2.8.0 I am declaring this JIRA done: the key

[jira] [Updated] (HADOOP-11417) review filesystem seek logic, clarify/confirm spec, test & fix compliance

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11417: Target Version/s: 2.9.0 (was: 2.8.0) > review filesystem seek logic, clarify/confirm

[jira] [Updated] (HADOOP-13276) S3a operations keep retrying if the password is wrong

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13276: Parent Issue: HADOOP-13204 (was: HADOOP-11694) > S3a operations keep retrying if the

[jira] [Updated] (HADOOP-13713) ITestS3AContractRootDir.testRmEmptyRootDirNonRecursive failing intermittently

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13713: Parent Issue: HADOOP-13204 (was: HADOOP-11694) >

[jira] [Updated] (HADOOP-13362) DefaultMetricsSystem leaks the source name when a source unregisters

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13362: Priority: Blocker (was: Critical) > DefaultMetricsSystem leaks the source name when a source

[jira] [Commented] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805318#comment-15805318 ] Steve Loughran commented on HADOOP-13402: - HDFS's rename(src, dest, options) doesn't let you

[jira] [Updated] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13811: Parent Issue: HADOOP-13204 (was: HADOOP-11694) > s3a: getFileStatus fails with

[jira] [Updated] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13402: Parent Issue: HADOOP-13204 (was: HADOOP-11694) > S3A should allow renaming to a

[jira] [Updated] (HADOOP-13636) s3a rm on the CLI generates deprecation warning on io.bytes.per.checksum

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13636: Affects Version/s: 2.8.0 Priority: Minor (was: Major) > s3a rm on the CLI

[jira] [Updated] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13402: Target Version/s: (was: 2.8.0) > S3A should allow renaming to a pre-existing

[jira] [Updated] (HADOOP-13636) s3a rm on the CLI generates deprecation warning on io.bytes.per.checksum

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13636: Parent Issue: HADOOP-13204 (was: HADOOP-11694) > s3a rm on the CLI generates deprecation

[jira] [Updated] (HADOOP-13648) s3a home directory to be "/"

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13648: Parent Issue: HADOOP-13204 (was: HADOOP-11694) > s3a home directory to be "/" >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Target Version/s: 2.9.0 Status: Patch Available (was: Open) > S3A to

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-HADOOP-13345-002.patch Patch 002. This one I like When a new FS

[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805303#comment-15805303 ] Hadoop QA commented on HADOOP-13953: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HADOOP-13908: -- Assignee: Chris Nauroth (was: Mingliang Liu) > S3Guard: Existing tables may not be

[jira] [Updated] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13908: --- Assignee: Mingliang Liu (was: Chris Nauroth) > S3Guard: Existing tables may not be

[jira] [Updated] (HADOOP-13931) S3AGuard: Use BatchWriteItem in DynamoDBMetadataStore#put()

2017-01-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13931: --- Resolution: Fixed Fix Version/s: HADOOP-13345 Status: Resolved (was:

[jira] [Commented] (HADOOP-13929) ADLS should not check in contract-test-options.xml

2017-01-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805224#comment-15805224 ] Chris Nauroth commented on HADOOP-13929: I know John is making more changes, but here is my

[jira] [Updated] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13953: --- Attachment: HADOOP-13953.02.patch > Make FTPFileSystem's data connection mode and transfer mode

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804744#comment-15804744 ] Hadoop QA commented on HADOOP-13650: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-13650: --- Attachment: HADOOP-13650-HADOOP-13345.004.patch Upload patch to fix findbugs and javadoc

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) > S3A to support per-bucket configuration >

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804365#comment-15804365 ] Lei (Eddy) Xu commented on HADOOP-13650: bq. DDB table region is always the s3 bucket region for

[jira] [Commented] (HADOOP-13774) Rest Loaded App fails

2017-01-06 Thread Omar Bouras (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804254#comment-15804254 ] Omar Bouras commented on HADOOP-13774: -- Sorry for the missing information. Affect version updated

[jira] [Updated] (HADOOP-13774) Rest Loaded App fails

2017-01-06 Thread Omar Bouras (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Bouras updated HADOOP-13774: - Affects Version/s: 2.7.3 > Rest Loaded App fails > - > >

[jira] [Comment Edited] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804093#comment-15804093 ] Mingliang Liu edited comment on HADOOP-13908 at 1/6/17 9:25 AM: When I

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804093#comment-15804093 ] Mingliang Liu commented on HADOOP-13908: When I tested the v4 patch when the table was not

[jira] [Comment Edited] (HADOOP-13931) S3AGuard: Use BatchWriteItem in DynamoDBMetadataStore#put()

2017-01-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803082#comment-15803082 ] Mingliang Liu edited comment on HADOOP-13931 at 1/6/17 8:58 AM:

[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804037#comment-15804037 ] Hadoop QA commented on HADOOP-13953: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13315) FileContext#umask is not initialized properly

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13315: Fix Version/s: (was: 2.9.0) > FileContext#umask is not initialized properly >

[jira] [Updated] (HADOOP-13395) Enhance TestKMSAudit

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13395: Fix Version/s: (was: 2.9.0) > Enhance TestKMSAudit > > >

[jira] [Updated] (HADOOP-12597) In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12597: Fix Version/s: (was: 2.9.0) > In kms-site.xml configuration >

[jira] [Updated] (HADOOP-12605) Fix intermittent failure of TestIPC.testIpcWithReaderQueuing

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12605: Fix Version/s: (was: 2.9.0) > Fix intermittent failure of TestIPC.testIpcWithReaderQueuing >

[jira] [Updated] (HADOOP-12712) Fix some cmake plugin and native build warnings

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12712: Fix Version/s: (was: 2.9.0) > Fix some cmake plugin and native build warnings >

[jira] [Updated] (HADOOP-12761) incremental maven build is not really incremental

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12761: Fix Version/s: (was: 2.9.0) > incremental maven build is not really incremental >

[jira] [Updated] (HADOOP-13707) If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13707: Fix Version/s: (was: 2.9.0) > If kerberos is enabled while HTTP SPNEGO is not configured,

[jira] [Updated] (HADOOP-12773) HBase classes fail to load with client/job classloader enabled

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-12773: Fix Version/s: (was: 2.9.0) > HBase classes fail to load with client/job classloader enabled

[jira] [Updated] (HADOOP-13290) Appropriate use of generics in FairCallQueue

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-13290: Fix Version/s: (was: 2.9.0) > Appropriate use of generics in FairCallQueue >

[jira] [Updated] (HADOOP-11361) Fix a race condition in MetricsSourceAdapter.updateJmxCache

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HADOOP-11361: Fix Version/s: (was: 2.9.0) > Fix a race condition in MetricsSourceAdapter.updateJmxCache >