[jira] [Created] (HDFS-7884) NullPointerException in BlockSender

2015-03-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7884: - Summary: NullPointerException in BlockSender Key: HDFS-7884 URL: https://issues.apache.org/jira/browse/HDFS-7884 Project: Hadoop HDFS Issue Type:

Re: Looking to a Hadoop 3 release

2015-03-04 Thread Stack
In general +1 on 3.0.0. Its time. If we start now, it might make it out by 2016. If we start now, downstreamers can start aligning themselves to land versions that suit at about the same time. While two big items have been called out as possible incompatible changes, and there is ongoing

Re: Looking to a Hadoop 3 release

2015-03-04 Thread Andrew Wang
Let's not dismiss this quite so handily. Sean, Jason, and Stack replied on HADOOP-11656 pointing out that while we could make classpath isolation opt-in via configuration, what we really want longer term is to have it on by default (or just always on). Stack in particular points out the practical

Re: Reviving HADOOP-7435: Making Jenkins pre-commit build work with branches

2015-03-04 Thread Karthik Kambatla
Thanks for reviving this on email, Vinod. Newer folks like me might not be aware of this JIRA/effort. This would be wonderful to have so (1) we know the status of release branches (branch-2, etc.) and also (2) feature branches (YARN-2928). Jonathan's or Matt's proposal for including branch name

Re: Reviving HADOOP-7435: Making Jenkins pre-commit build work with branches

2015-03-04 Thread Sean Busbey
+1 If we can make things look like HBase support for precommit testing on branches (HBASE-12944), that would make it easier for new and occasional contributors who might end up working in other ecosystem projects. AFAICT, Jonathan's proposal for branch names in patch names does this. On Wed,

Re: Dose hdfs support the configuration that different blocks can have different number of replcias?

2015-03-04 Thread Lipeng Wan
Hi Andrew, By using the -setrep command, can we change the replication factor of existing files? Or, can we change the replication factor of files dynamically? If that's possible, how much data movement overhead will occur? Thanks! Lipeng On Tue, Mar 3, 2015 at 2:57 PM, Andrew Wang

[jira] [Created] (HDFS-7885) Datanode should not trust the generation stamp provided by client

2015-03-04 Thread vitthal (Suhas) Gogate (JIRA)
vitthal (Suhas) Gogate created HDFS-7885: Summary: Datanode should not trust the generation stamp provided by client Key: HDFS-7885 URL: https://issues.apache.org/jira/browse/HDFS-7885

Reviving HADOOP-7435: Making Jenkins pre-commit build work with branches

2015-03-04 Thread Vinod Kumar Vavilapalli
Hi all, I'd like us to revive the effort at https://issues.apache.org/jira/browse/HADOOP-7435 to make precommit builds being able to work with branches. Having the Jenkins verify patches on branches is very useful even if there may be relaxed review oversight on the said-branch. Unless there

Re: Dose hdfs support the configuration that different blocks can have different number of replcias?

2015-03-04 Thread Andrew Wang
Lipeng, -setrep allows you to change the replication of an existing file. You can also specify the replication factor when you initially create a file. Not sure what you mean by dynamically, that to me means calling setrep. There is replication or invalidation work done as part of running

RE: Looking to a Hadoop 3 release

2015-03-04 Thread Zheng, Kai
Might I have some comments for this, just providing my thought. Thanks. If we start now, it might make it out by 2016. If we start now, downstreamers can start aligning themselves to land versions that suit at about the same time. Not only for down streamers to align with the long term

Re: Looking to a Hadoop 3 release

2015-03-04 Thread Karthik Kambatla
On Wed, Mar 4, 2015 at 10:46 AM, Stack st...@duboce.net wrote: In general +1 on 3.0.0. Its time. If we start now, it might make it out by 2016. If we start now, downstreamers can start aligning themselves to land versions that suit at about the same time. While two big items have been called

[jira] [Created] (HDFS-7887) Asynchronous native RPC v9 client

2015-03-04 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7887: Summary: Asynchronous native RPC v9 client Key: HDFS-7887 URL: https://issues.apache.org/jira/browse/HDFS-7887 Project: Hadoop HDFS Issue Type: New Feature

Re: Reviving HADOOP-7435: Making Jenkins pre-commit build work with branches

2015-03-04 Thread Zhijie Shen
+1. It¹s really helpful for branch development. To continue Karthik¹s point, is it good make pre-commit testing against branch-2 as the default too like that against trunk? On 3/4/15, 1:47 PM, Sean Busbey bus...@cloudera.com wrote: +1 If we can make things look like HBase support for precommit

[jira] [Created] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-04 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7886: Summary: TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes Key: HDFS-7886 URL: https://issues.apache.org/jira/browse/HDFS-7886 Project: Hadoop HDFS

[jira] [Created] (HDFS-7890) Improve information on Top users for metrics in RollingWindowsManager .

2015-03-04 Thread J.Andreina (JIRA)
J.Andreina created HDFS-7890: Summary: Improve information on Top users for metrics in RollingWindowsManager . Key: HDFS-7890 URL: https://issues.apache.org/jira/browse/HDFS-7890 Project: Hadoop HDFS

[jira] [Created] (HDFS-7888) Change DataStream/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-04 Thread Li Bo (JIRA)
Li Bo created HDFS-7888: --- Summary: Change DataStream/DFSOutputStream/DFSPacket for convenience of subclassing Key: HDFS-7888 URL: https://issues.apache.org/jira/browse/HDFS-7888 Project: Hadoop HDFS

Re: Looking to a Hadoop 3 release

2015-03-04 Thread Allen Wittenauer
One of the questions that keeps popping up is “what exactly is in trunk?” As some may recall, I had done some experiments creating the change log based upon JIRA. While the interest level appeared to be approaching zero, I kept playing with it a bit and eventually also started playing with

[jira] [Created] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-04 Thread Li Bo (JIRA)
Li Bo created HDFS-7889: --- Summary: Subclass DFSOutputStream to support writing striping layout files Key: HDFS-7889 URL: https://issues.apache.org/jira/browse/HDFS-7889 Project: Hadoop HDFS Issue

RE: 2.7 status

2015-03-04 Thread Zheng, Kai
Thanks Vinod for the hints. I have updated the both patches aligning with latest codes, and added more unit tests. The building results look reasonable. Thanks anyone that would give them more review and I would update in timely manner. Regards, Kai -Original Message- From: Vinod

[jira] [Created] (HDFS-7883) Move the Hadoop constants in HTTPServer.java to CommonConfigurationKeys class

2015-03-04 Thread nijel (JIRA)
nijel created HDFS-7883: --- Summary: Move the Hadoop constants in HTTPServer.java to CommonConfigurationKeys class Key: HDFS-7883 URL: https://issues.apache.org/jira/browse/HDFS-7883 Project: Hadoop HDFS

[jira] [Created] (HDFS-7882) Audit logging should be added for Rolling Upgrade ( Rollback , Downgrade )

2015-03-04 Thread J.Andreina (JIRA)
J.Andreina created HDFS-7882: Summary: Audit logging should be added for Rolling Upgrade ( Rollback , Downgrade ) Key: HDFS-7882 URL: https://issues.apache.org/jira/browse/HDFS-7882 Project: Hadoop HDFS

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #113

2015-03-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/113/changes Changes: [arp] HDFS-7757. Misleading error messages in FSImage.java. (Contributed by Brahma Reddy Battula) [wangda] YARN-3272. Surface container locality info in RM web UI (Jian He via wangda) [stevel] HADOOP-11183.

Hadoop-Hdfs-trunk - Build # 2054 - Failure

2015-03-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2054/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7287 lines...] [mkdir] Created dir:

Hadoop-Hdfs-trunk-Java8 - Build # 113 - Failure

2015-03-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/113/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6997 lines...] [mkdir] Created dir: