[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076950#comment-16076950 ] John Zhuge commented on HADOOP-14627: - [~ASikaria] It does not hurt to call ```getPaswordString```

[jira] [Updated] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2017-07-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13435: --- Attachment: HADOOP-13435.004.patch > Add thread local mechanism for aggregating file system

[jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077153#comment-16077153 ] Steve Loughran commented on HADOOP-14548: - S3n tests will all skip if you don't provide the

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Attachment: HADOOP-14553-005.patch Patch 005 Move a lot more to the parallel phase of

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Status: Patch Available (was: Open) > Add (parallelized) integration tests to

[jira] [Updated] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-12802: -- Target Version/s: 3.0.0-alpha4 > local FileContext does not rename .crc file >

[jira] [Commented] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077199#comment-16077199 ] Hadoop QA commented on HADOOP-13435: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14553: Status: Open (was: Patch Available) > Add (parallelized) integration tests to

[jira] [Commented] (HADOOP-14624) Add GenericTestUtils.DelayAnswer that accept slf4j logger API

2017-07-06 Thread Wenxin He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075984#comment-16075984 ] Wenxin He commented on HADOOP-14624: 17 new warnings in javac are caused by new deprecated method

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076154#comment-16076154 ] Hongyuan Li commented on HADOOP-14623: -- i don't think so, setting it to 1 does not means that it

[jira] [Commented] (HADOOP-13414) Hide Jetty Server version header in HTTP responses

2017-07-06 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076160#comment-16076160 ] Surendra Singh Lilhore commented on HADOOP-13414: - Thanks [~vinayrpet] for review and

[jira] [Resolved] (HADOOP-8740) Build target to generate findbugs html output

2017-07-06 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HADOOP-8740. -- Resolution: Invalid > Build target to generate findbugs html output >

[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076496#comment-16076496 ] Steve Loughran commented on HADOOP-14627: - * A test would still be good, if just to verify that

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076504#comment-16076504 ] Steve Loughran commented on HADOOP-14553: - {code} -public class

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-07-06 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076511#comment-16076511 ] Yonger commented on HADOOP-14475: - [~stevea] the method you mentioned give an empty url to skip the

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-07-06 Thread Yonger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076511#comment-16076511 ] Yonger edited comment on HADOOP-14475 at 7/6/17 1:42 PM: - @steve the method you

[jira] [Commented] (HADOOP-14577) ITestS3AInconsistency.testGetFileStatus failing

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076688#comment-16076688 ] Steve Loughran commented on HADOOP-14577: - I was about to say worksforme, but once I do

[jira] [Updated] (HADOOP-14577) ITestS3AInconsistency.testGetFileStatus failing in -DS3guard test runs

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14577: Summary: ITestS3AInconsistency.testGetFileStatus failing in -DS3guard test runs (was:

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076628#comment-16076628 ] Hongyuan Li commented on HADOOP-14623: -- futuremore, flush method is to confirm that data has been

[jira] [Updated] (HADOOP-14499) Findbugs warning in LocalMetadataStore

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14499: Resolution: Fixed Fix Version/s: HADOOP-13345 Status: Resolved (was:

[jira] [Commented] (HADOOP-14576) DynamoDB tables may leave ACTIVE state after initial connection

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076792#comment-16076792 ] Steve Loughran commented on HADOOP-14576: - this parallel rename -it is how hive implements a

[jira] [Commented] (HADOOP-13761) S3Guard: implement retries

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076805#comment-16076805 ] Steve Loughran commented on HADOOP-13761: - we need to implement retry logic in all AWS calls

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076817#comment-16076817 ] Steve Loughran commented on HADOOP-14468: - The general code path for file IO is one of two

[jira] [Commented] (HADOOP-14627) Enable new features of ADLS SDK (MSI, Device Code auth)

2017-07-06 Thread Atul Sikaria (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076836#comment-16076836 ] Atul Sikaria commented on HADOOP-14627: --- Thanks [~ste...@apache.org] for reviewing. Will do a

[jira] [Commented] (HADOOP-14467) S3Guard: Improve FNFE message when opening a stream

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076839#comment-16076839 ] Steve Loughran commented on HADOOP-14467: - without s3guard, this can arise if # a file is

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076845#comment-16076845 ] Steve Loughran commented on HADOOP-14468: - That said, looking at all the places we call

[jira] [Updated] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-06 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14457: --- Attachment: HADOOP-14457-HADOOP-13345.010.patch So attaching a patch that follows the

[jira] [Updated] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14548: -- Fix Version/s: HADOOP-13345 Status: Patch Available (was: Open) > S3Guard: issues

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077499#comment-16077499 ] Aaron Fabbri commented on HADOOP-14468: --- {quote} That said, looking at all the places we call

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077520#comment-16077520 ] Hongyuan Li commented on HADOOP-1: -- socket is complex, i don't like to open a new socket just

[jira] [Updated] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14548: -- Attachment: HADOOP-14548-HADOOP-13345.001.patch Attaching documentation-only patch (v1). It

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077503#comment-16077503 ] Hadoop QA commented on HADOOP-14457: | (/) *{color:green} 1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077510#comment-16077510 ] Hadoop QA commented on HADOOP-14548: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076628#comment-16076628 ] Hongyuan Li edited comment on HADOOP-14623 at 7/7/17 3:19 AM: -- futuremore,

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077520#comment-16077520 ] Hongyuan Li edited comment on HADOOP-1 at 7/7/17 3:24 AM: -- socket is

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077314#comment-16077314 ] Hadoop QA commented on HADOOP-14553: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2017-07-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077403#comment-16077403 ] Aaron Fabbri commented on HADOOP-14620: --- Looks like you are on a fairly old version. Can you