[jira] [Updated] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-12802: -- Attachment: HADOOP-12802.01.patch > local FileContext does not rename .crc file >

[jira] [Updated] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-12802: -- Status: Patch Available (was: Open) > local FileContext does not rename .crc file > -

[jira] [Updated] (HADOOP-14628) Upgrade maven enforcer plugin to 3.0.0

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14628: --- Summary: Upgrade maven enforcer plugin to 3.0.0 (was: Upgrade maven enforce plugin to 3

[jira] [Created] (HADOOP-14628) Upgrade maven enforce plugin to 3.0.0

2017-07-06 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HADOOP-14628: -- Summary: Upgrade maven enforce plugin to 3.0.0 Key: HADOOP-14628 URL: https://issues.apache.org/jira/browse/HADOOP-14628 Project: Hadoop Common Issue Typ

[jira] [Commented] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077681#comment-16077681 ] Hudson commented on HADOOP-14587: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Com

[jira] [Updated] (HADOOP-11875) [JDK9] Renaming _ as a one-character identifier to another identifier

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-11875: --- Attachment: HADOOP-11875.11.patch 11: rebased > [JDK9] Renaming _ as a one-character identi

[jira] [Commented] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Wenxin He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077661#comment-16077661 ] Wenxin He commented on HADOOP-14587: OK, I’ll upload the patch for branch-2 when res

[jira] [Updated] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14587: --- Fix Version/s: 3.0.0-beta1 > Use GenericTestUtils.setLogLevel when available in hadoop-commo

[jira] [Commented] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077650#comment-16077650 ] Akira Ajisaka commented on HADOOP-14587: Hi [~vincent he], would you create a pa

[jira] [Comment Edited] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077648#comment-16077648 ] Akira Ajisaka edited comment on HADOOP-14587 at 7/7/17 6:01 AM: --

[jira] [Commented] (HADOOP-14587) Use GenericTestUtils.setLogLevel when available in hadoop-common

2017-07-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077648#comment-16077648 ] Akira Ajisaka commented on HADOOP-14587: 1, checking this in. > Use GenericTes

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077520#comment-16077520 ] Hongyuan Li edited comment on HADOOP-1 at 7/7/17 3:24 AM:

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077520#comment-16077520 ] Hongyuan Li commented on HADOOP-1: -- socket is complex, i don't like to open a n

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076628#comment-16076628 ] Hongyuan Li edited comment on HADOOP-14623 at 7/7/17 3:19 AM:

[jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077510#comment-16077510 ] Hadoop QA commented on HADOOP-14548: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077503#comment-16077503 ] Hadoop QA commented on HADOOP-14457: | (/) *{color:green} 1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077499#comment-16077499 ] Aaron Fabbri commented on HADOOP-14468: --- {quote} That said, looking at all the pla

[jira] [Updated] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14548: -- Fix Version/s: HADOOP-13345 Status: Patch Available (was: Open) > S3Guard: issues

[jira] [Updated] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14548: -- Attachment: HADOOP-14548-HADOOP-13345.001.patch Attaching documentation-only patch (v1). It l

[jira] [Updated] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-06 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14457: --- Attachment: HADOOP-14457-HADOOP-13345.010.patch So attaching a patch that follows the design

[jira] [Commented] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077403#comment-16077403 ] Aaron Fabbri commented on HADOOP-14620: --- Looks like you are on a fairly old versio

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077314#comment-16077314 ] Hadoop QA commented on HADOOP-14553: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Status: Patch Available (was: Open) > Add (parallelized) integration tests to hadoop-azur

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Attachment: HADOOP-14553-005.patch Patch 005 Move a lot more to the parallel phase of the

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Status: Open (was: Patch Available) > Add (parallelized) integration tests to hadoop-azur

[jira] [Commented] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077199#comment-16077199 ] Hadoop QA commented on HADOOP-13435: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-12802: -- Target Version/s: 3.0.0-alpha4 > local FileContext does not rename .crc file > ---

[jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077153#comment-16077153 ] Steve Loughran commented on HADOOP-14548: - S3n tests will all skip if you don't

[jira] [Updated] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2017-07-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13435: --- Attachment: HADOOP-13435.004.patch > Add thread local mechanism for aggregating file system

[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076950#comment-16076950 ] John Zhuge commented on HADOOP-14627: - [~ASikaria] It does not hurt to call ```getPa

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076845#comment-16076845 ] Steve Loughran commented on HADOOP-14468: - That said, looking at all the places

[jira] [Commented] (HADOOP-14467) S3Guard: Improve FNFE message when opening a stream

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076839#comment-16076839 ] Steve Loughran commented on HADOOP-14467: - without s3guard, this can arise if

[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread Atul Sikaria (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076836#comment-16076836 ] Atul Sikaria commented on HADOOP-14627: --- Thanks [~ste...@apache.org] for reviewing

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076817#comment-16076817 ] Steve Loughran commented on HADOOP-14468: - The general code path for file IO is

[jira] [Commented] (HADOOP-13761) S3Guard: implement retries

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076805#comment-16076805 ] Steve Loughran commented on HADOOP-13761: - we need to implement retry logic in a

[jira] [Commented] (HADOOP-14576) DynamoDB tables may leave ACTIVE state after initial connection

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076792#comment-16076792 ] Steve Loughran commented on HADOOP-14576: - this parallel rename -it is how hive

[jira] [Updated] (HADOOP-14577) ITestS3AInconsistency.testGetFileStatus failing in -DS3guard test runs

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14577: Summary: ITestS3AInconsistency.testGetFileStatus failing in -DS3guard test runs (was: ITe

[jira] [Commented] (HADOOP-14577) ITestS3AInconsistency.testGetFileStatus failing

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076688#comment-16076688 ] Steve Loughran commented on HADOOP-14577: - I was about to say worksforme, but on

[jira] [Updated] (HADOOP-14499) Findbugs warning in LocalMetadataStore

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14499: Resolution: Fixed Fix Version/s: HADOOP-13345 Status: Resolved (was: Pat

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076628#comment-16076628 ] Hongyuan Li commented on HADOOP-14623: -- futuremore, flush method is to confirm that

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-07-06 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076511#comment-16076511 ] Yonger edited comment on HADOOP-14475 at 7/6/17 1:42 PM: - @steve

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-07-06 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076511#comment-16076511 ] Yonger commented on HADOOP-14475: - [~stevea] the method you mentioned give an empty url

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076504#comment-16076504 ] Steve Loughran commented on HADOOP-14553: - {code} -public class TestNativeAzureF

[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076496#comment-16076496 ] Steve Loughran commented on HADOOP-14627: - * A test would still be good, if just

[jira] [Resolved] (HADOOP-8740) Build target to generate findbugs html output

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HADOOP-8740. -- Resolution: Invalid > Build target to generate findbugs html output > -

[jira] [Commented] (HADOOP-13414) Hide Jetty Server version header in HTTP responses

2017-07-06 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076160#comment-16076160 ] Surendra Singh Lilhore commented on HADOOP-13414: - Thanks [~vinayrpet] f

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076154#comment-16076154 ] Hongyuan Li commented on HADOOP-14623: -- i don't think so, setting it to 1 does not