Re: Re-swizzle 2.3

2014-01-29 Thread Arun C Murthy
Mostly ready for a jira perspective. Committers - Henceforth, please use extreme caution while committing to branch-2.3. Please commit *only* blockers to 2.3. thanks, Arun On Jan 28, 2014, at 3:30 PM, Arun C Murthy a...@hortonworks.com wrote: Fixing up stuff now, thanks to Andrew for

Re: Re-swizzle 2.3

2014-01-29 Thread Jason Lowe
I noticed that somehow the target version field in JIRA was invisibly cleared on most of the Blocker/Critical JIRAs that were originally targeted for 2.3.0/2.4.0. I happened to have an old browser tab lying around from an earlier query for these and I tried to fix them up, marking some for

[jira] [Created] (HDFS-5848) Add a DatanodeCommand to inform datanodes that rolling upgrade is in progress

2014-01-29 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5848: Summary: Add a DatanodeCommand to inform datanodes that rolling upgrade is in progress Key: HDFS-5848 URL: https://issues.apache.org/jira/browse/HDFS-5848

[jira] [Created] (HDFS-5849) Removing ACL from an inode fails if it has only a default ACL.

2014-01-29 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5849: --- Summary: Removing ACL from an inode fails if it has only a default ACL. Key: HDFS-5849 URL: https://issues.apache.org/jira/browse/HDFS-5849 Project: Hadoop HDFS

Re: Re-swizzle 2.3

2014-01-29 Thread Doug Cutting
On Wed, Jan 29, 2014 at 12:30 PM, Jason Lowe jl...@yahoo-inc.com wrote: It is a bit concerning that the JIRA history showed that the target version was set at some point in the past but no record of it being cleared. Perhaps the version itself was renamed? Doug

[jira] [Created] (HDFS-5850) DNS Issues during TrashEmptier initialization can silently leave it non-functional

2014-01-29 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5850: Summary: DNS Issues during TrashEmptier initialization can silently leave it non-functional Key: HDFS-5850 URL: https://issues.apache.org/jira/browse/HDFS-5850 Project:

[jira] [Resolved] (HDFS-5771) Track progress when loading fsimage

2014-01-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5771. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) I committed the patch to

Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Stack
What do others think? See here if you do not have access: http://goo.gl/j05wkf It might be a shade darker but I can't tell for sure. It looks way too close to me. I'd think we'd intentionally go out of our way to put a vendor's signature color on our Apache software. Asking here before I file

Re: Re-swizzle 2.3

2014-01-29 Thread Andrew Wang
I just finished tuning up branch-2.3 and fixing up the HDFS and Common CHANGES.txt in trunk, branch-2, and branch-2.3. I had to merge back a few JIRAs committed between the swizzle and now where the fix version was 2.3 but weren't in branch-2.3. I think the only two HDFS and Common JIRAs that are

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Stack
On Wed, Jan 29, 2014 at 3:01 PM, Stack st...@duboce.net wrote: What do others think? See here if you do not have access: http://goo.gl/j05wkf It might be a shade darker but I can't tell for sure. It looks way too close to me. I'd think we'd intentionally go out of our way to put a

[jira] [Created] (HDFS-5851) Support memory as a storage medium

2014-01-29 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5851: --- Summary: Support memory as a storage medium Key: HDFS-5851 URL: https://issues.apache.org/jira/browse/HDFS-5851 Project: Hadoop HDFS Issue Type: Sub-task

Re: Re-swizzle 2.3

2014-01-29 Thread Aaron T. Myers
I just filed this JIRA as a blocker for 2.3: https://issues.apache.org/jira/browse/HADOOP-10310 The tl;dr is that JNs will not work with security enabled without this fix. If others don't think that supporting QJM with security enabled warrants a blocker for 2.3, then we can certainly lower the

[jira] [Created] (HDFS-5852) Change the colors on the hdfs UI

2014-01-29 Thread stack (JIRA)
stack created HDFS-5852: --- Summary: Change the colors on the hdfs UI Key: HDFS-5852 URL: https://issues.apache.org/jira/browse/HDFS-5852 Project: Hadoop HDFS Issue Type: Bug Reporter: stack

Re: Re-swizzle 2.3

2014-01-29 Thread Stack
I filed https://issues.apache.org/jira/browse/HDFS-5852 as a blocker. See what ye all think. Thanks, St.Ack On Wed, Jan 29, 2014 at 3:52 PM, Aaron T. Myers a...@cloudera.com wrote: I just filed this JIRA as a blocker for 2.3: https://issues.apache.org/jira/browse/HADOOP-10310 The tl;dr is

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Stack
On Wed, Jan 29, 2014 at 4:09 PM, Alejandro Abdelnur t...@cloudera.comwrote: IMO we should't be distributing binaries. And if we do so,they should be built by a Jenkins job. That would address the second item above. I filed https://issues.apache.org/jira/browse/HDFS-5852 for the color issue

BlockPlacementPolicy and File Deletion

2014-01-29 Thread Engin Sözer
Hello all, I'm currently trying to develop a Block Placement Policy in my research project. However, I'm having some problems. If anybody could hep me, I would really appreciate that. Below are my questions: 1) In the block placement policy, how can I get the name of the original file that

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Suresh Srinivas
Stack, 4. Bigtop/Oozie, other Apache projects altogether, have Cloudera references in their UI (?) so the take away is HWX can do it too, or, because I raise an issue here -- it is only legit if I do it too in all projects under the Apache rainbow? My point was different; these type of

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Alejandro Abdelnur
On Wed, Jan 29, 2014 at 5:38 PM, Suresh Srinivas sur...@hortonworks.comwrote: Have you looked at Oozie and are you going to open a jira to change that as well? Excuse me, what are we taking about here? The only references to Cloudera in Oozie source are in the Apache Oozie site branch

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Alejandro Abdelnur
By bad, there is one reference in the Oozie pom.xml to Cloudera's Maven repo. This is is required to host a doxia twiki plugin modified by Oozie with extensions to handle Oozie documentation generation. This was discussed and accepted by the Apache Oozie developers. Thanks. On Wed, Jan 29, 2014

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Stack
On Wed, Jan 29, 2014 at 8:48 PM, Suresh Srinivas sur...@hortonworks.comwrote: Please be more civil in your communique. Your attack dog 'flair' has likely ruined my little survey. No one is going to comment afraid that they'll get their heads cut off. Right next to imploring civil

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Stack
On Wed, Jan 29, 2014 at 9:07 PM, Joe Bounour jboun...@ddn.com wrote: Hello I find fascinating how all the HWX folks jumped on Stack (Not taking any side, I am Switzerland/french), many against one As a developer, it seems not a relevant topic, true but to be fair, Hortonwork, Cloudera

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Vinod Kumar Vavilapalli
My response was to your direct association of the green color to HWX green as if it were deliberately done. Nobody here intentionally left a vendor's signature like you claimed. And to your other comment Does the apache binary have to be compiled by 'hortonmu'? Could it be compiled by

Re: Re-swizzle 2.3

2014-01-29 Thread Vinod Kumar Vavilapalli
Okay, I'll look at YARN and MR CHANGES.txt problems. Seems like they aren't addressed yet. +Vinod On Jan 29, 2014, at 3:24 PM, Andrew Wang andrew.w...@cloudera.com wrote: I just finished tuning up branch-2.3 and fixing up the HDFS and Common CHANGES.txt in trunk, branch-2, and branch-2.3.

[jira] [Created] (HDFS-5853) Add hadoop.user.group.metrics.percentiles.intervals to hdfs-default.xml

2014-01-29 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-5853: --- Summary: Add hadoop.user.group.metrics.percentiles.intervals to hdfs-default.xml Key: HDFS-5853 URL: https://issues.apache.org/jira/browse/HDFS-5853 Project: Hadoop