[jira] [Created] (HADOOP-14750) s3guard to provide better diags on ddb init failures

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14750: --- Summary: s3guard to provide better diags on ddb init failures Key: HADOOP-14750 URL: https://issues.apache.org/jira/browse/HADOOP-14750 Project: Hadoop Common

Re: Question about how to best contribute

2017-08-08 Thread Akira Ajisaka
Hi Lars, Thank you for your questions! > So, this is my request for comments on these questions: > * Is there any interest in this at all? > ** "This" being patches for code style & things like FindBugs & Checkstyle > warnings Yes. I'm interested in this. > * Size of the patches: Rather one

[jira] [Created] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Yonger (JIRA)
Yonger created HADOOP-14745: --- Summary: s3a getFileStatus can't return expect result when existing a file and directory with the same name Key: HADOOP-14745 URL: https://issues.apache.org/jira/browse/HADOOP-14745

Re: HADOOP-14163 proposal for new hadoop.apache.org

2017-08-08 Thread Akira Ajisaka
Thanks Allen for the comment. Yes, it can be done without creating another git repo. In the near future, I'd like to enable CI job to push the site to asf-site branch automatically when the site source is changed. If we have a separate repository for web site, Pro: CI job can detect the change

How can i understand parent is file

2017-08-08 Thread Fu, Yong
When test my code, I found this case failed, but can't understand why a parent can be a file(org.apache.hadoop.fs.s3a. ITestS3AMiscOperations ) . @Test(expected = FileAlreadyExistsException.class) public void testCreateNonRecursiveParentIsFile() throws IOException { Path parent =

[jira] [Created] (HADOOP-14746) Cut S3AOutputStream

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14746: --- Summary: Cut S3AOutputStream Key: HADOOP-14746 URL: https://issues.apache.org/jira/browse/HADOOP-14746 Project: Hadoop Common Issue Type: Sub-task

[jira] [Resolved] (HADOOP-14745) s3a getFileStatus can't return expect result when existing a file and directory with the same name

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14745. - Resolution: Invalid > s3a getFileStatus can't return expect result when existing a file

[jira] [Created] (HADOOP-14747) S3AInputStream to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14747: --- Summary: S3AInputStream to implement CanUnbuffer Key: HADOOP-14747 URL: https://issues.apache.org/jira/browse/HADOOP-14747 Project: Hadoop Common

[jira] [Created] (HADOOP-14748) Wasb input streams to implement CanUnbuffer

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14748: --- Summary: Wasb input streams to implement CanUnbuffer Key: HADOOP-14748 URL: https://issues.apache.org/jira/browse/HADOOP-14748 Project: Hadoop Common

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-08-08 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/486/ [Aug 7, 2017 7:45:46 AM] (sunilg) YARN-6951. Fix debug log when Resource Handler chain is enabled. [Aug 7, 2017 9:47:33 AM] (aajisaka) HDFS-12198. Document missing namenode metrics that were added

Re: How can i understand parent is file

2017-08-08 Thread Steve Loughran
> On 8 Aug 2017, at 13:45, Fu, Yong wrote: > > When test my code, I found this case failed, but can't understand why a > parent can be a file(org.apache.hadoop.fs.s3a. ITestS3AMiscOperations > ) . > Is this AWS S3 or another S3-compatible endpoint? The test is expecting

Re: HADOOP-14163 proposal for new hadoop.apache.org

2017-08-08 Thread Allen Wittenauer
> On Aug 8, 2017, at 12:36 AM, Akira Ajisaka wrote: > > Now I'm okay with not creating another repo. > I'm thinking the following procedures may work: > > 1. Create ./asf-site directory > 2. Add the content of https://github.com/elek/hadoop-site-proposal to the >

Re: Question about how to best contribute

2017-08-08 Thread Lars Francke
Thanks John, another one for my list of things to look at. On Mon, Aug 7, 2017 at 11:24 PM, John Zhuge wrote: > And check out HADOOP-12145 > Organize and update > CodeReviewChecklist wiki. > > Thanks, your contribution

Re: Question about how to best contribute

2017-08-08 Thread Lars Francke
Thanks for the ideas Steve. Hi Lars & Welcome! > > Maybe the first step here would be look at those style guides and think > how to bring them up to date, especially with stuff like lambda-expressions > in java 8, and mnodules forthcoming in in java 9, SLF4J logging, Junit 5 -> > 5 testing, code

Re: Question about how to best contribute

2017-08-08 Thread Lars Francke
Hi Akira, > > So, this is my request for comments on these questions: > > * Is there any interest in this at all? > > ** "This" being patches for code style & things like FindBugs & > Checkstyle > > warnings > > Yes. I'm interested in this. > > > * Size of the patches: Rather one big patch or

Re: Question about how to best contribute

2017-08-08 Thread Chris Douglas
Lars- Welcome! As a mild refinement of enthusiasm for this proposal: when you approach a "cleanup", please consider the cost to tracing the lineage of changes in the codebase. Working on a project as large and long-running as Hadoop, we often need to trace what motivated a particular change

Re: HADOOP-14163 proposal for new hadoop.apache.org

2017-08-08 Thread Allen Wittenauer
Something else to consider. The main hadoop repo has precommit support. I could easily see a quick and dirty maven pom.xml and dockerfile put in place to build the website against “patches” uploaded to JIRA or github. - To

[jira] [Created] (HADOOP-14749) review s3guard docs & code prior to merge

2017-08-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14749: --- Summary: review s3guard docs & code prior to merge Key: HADOOP-14749 URL: https://issues.apache.org/jira/browse/HADOOP-14749 Project: Hadoop Common