Re: difference between mapred-site.xml and conf/masters

2012-08-06 Thread Karthik Kambatla
My understanding is that conf/masters is used only by the bin/ or sbin/ scripts - like start-*.sh, while the conf property is used by the Hadoop daemons running on that particular node. Hope that helps, Karthik On Mon, Aug 6, 2012 at 5:32 PM, Momina Khan momina.a...@gmail.com wrote: Hi, I am

Re: Help with dev environment setup for Hadoop MR

2012-09-09 Thread Karthik Kambatla
Hi Sudhir http://wiki.apache.org/hadoop/EclipseEnvironment is a good place to start for your eclipse setup. For deploying a cluster off of your local changes, you can either package it (mvn package) or just build the jars and replace the jars in an existing setup. Hope that helps. Karthik On

Re: Unstuck QA bot

2012-12-12 Thread Karthik Kambatla
Brilliant! Thanks Todd. On Wed, Dec 12, 2012 at 8:39 PM, Stack st...@duboce.net wrote: Thanks Todd. St.Ack On Wed, Dec 12, 2012 at 6:34 PM, Todd Lipcon t...@cloudera.com wrote: The QA bot was previously pointing at a JIRA filter which matched all Patch Available issues. That number has

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-07 Thread Karthik Kambatla
+1 (non-binding) Downloaded src tar ball, built binary tar ball, ran a couple of sample MR jobs on a pseudo-dist cluster. On Thu, Feb 7, 2013 at 10:24 AM, Andrew Wang andrew.w...@cloudera.comwrote: Verified the tarball checksums. Ran a couple example jobs on a 3 node cluster successfully,

Re: [VOTE] Plan to create release candidate Monday 3/18

2013-03-11 Thread Karthik Kambatla
+1 (non-binding) On Sun, Mar 10, 2013 at 8:38 PM, Matt Foley ma...@apache.org wrote: Hi all, I have created branch-1.2 from branch-1, and propose to cut the first release candidate for 1.2.0 on Monday 3/18 (a week from tomorrow), or as soon thereafter as I can achieve a stable build.

Re: [VOTE] Plan to create release candidate for 0.23.7

2013-03-15 Thread Karthik Kambatla
+1 (non-binding) On Fri, Mar 15, 2013 at 9:12 AM, Robert Evans ev...@yahoo-inc.com wrote: +1 On 3/13/13 11:31 AM, Thomas Graves tgra...@yahoo-inc.com wrote: Hello all, I think enough critical bug fixes have went in to branch-0.23 that warrant another release. I plan on creating a 0.23.7

Compatibility in Apache Hadoop

2013-04-22 Thread Karthik Kambatla
Hadoop devs, Eli and I have been working on a writeup on compatibility for developers, downstream projects and end users. The wiki page - http://wiki.apache.org/hadoop/Compatibility - is a strawman effort towards consolidating prior discussions and decisions; including the API classification

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Karthik Kambatla
On Tue, Apr 23, 2013 at 9:00 AM, Steve Loughran ste...@hortonworks.comwrote: On 22 April 2013 18:32, Eli Collins e...@cloudera.com wrote: On Mon, Apr 22, 2013 at 5:42 PM, Steve Loughran ste...@hortonworks.com wrote: There's a separate issue that says we make some guarantee that the

Use hadoop.relaxed.worker.version.check to allow versions in the same major version?

2013-04-26 Thread Karthik Kambatla
Hi devs, Given that we have API compatibility within a major release, I was wondering if it would make sense to augment the worker version check to allow workers from a different minor/point release in the same major release? The motivation for this is rolling upgrade within a major release. We

Re: Use hadoop.relaxed.worker.version.check to allow versions in the same major version?

2013-04-26 Thread Karthik Kambatla
within a release). We should do so for Yarn as well, MAPREDUCE-4150 tracks this. I don't think Ahmed is working on it so would be great for you or someone else to take it. Thanks, Eli On Fri, Apr 26, 2013 at 10:21 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi devs, Given that we

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Karthik Kambatla
Hi Arun, Can we add HADOOP-9517 to the list - having compatibility guidelines should help us support users and downstream projects better? Thanks Karthik On Wed, May 15, 2013 at 10:57 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, A considerable number of people have expressed

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Karthik Kambatla
+1 (non-binding) On Tue, May 21, 2013 at 4:13 PM, Jitendra Pandey jiten...@hortonworks.comwrote: +1 On Tue, May 21, 2013 at 4:02 PM, Eli Collins e...@cloudera.com wrote: +1 thanks Matt. On Tue, May 21, 2013 at 2:10 PM, Matt Foley ma...@apache.org wrote: Hi all, This has

Re: Heads up: branch-2.1-beta

2013-06-15 Thread Karthik Kambatla
Re-posting here to the wider audience: HADOOP-9517 (Document Hadoop Compatibility): I believe I have incorporated all suggestions so far. It would be great if people could take another look at it. I ll iterate fast on any comments so we get this in by the time rest of the code pieces are

Re: No marketplace entries found to handle Execution compile-protoc

2013-06-29 Thread Karthik Kambatla
Not sure about the errors you see. Here is something that worked for me in the past - http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/ and there is a comment that mentions building an eclipse plugin for the same. I have since moved to IntelliJ - it might

Re: [VOTE] Release Apache Hadoop 0.23.9

2013-07-08 Thread Karthik Kambatla
+1 (non-binding). Ran a pseudo-distributed cluster and few sample jobs. Everything worked as expected. On Mon, Jul 8, 2013 at 6:16 AM, Thomas Graves tgra...@yahoo-inc.com wrote: Friendly reminder this vote ends today please try it out if you have time. Thanks, Tom Graves On 7/1/13 12:20

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Karthik Kambatla
Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to have a single version of avro. On Tue, Sep 17, 2013 at 6:51 AM, Andrew Wang andrew.w...@cloudera.comwrote: Hey all, Sorry to hijack the vote thread, but it'd be good to get some input on my email from yesterday re:

Re: newbie:need guidance

2013-09-22 Thread Karthik Kambatla
Redirecting to common-dev@ On Sun, Sep 22, 2013 at 1:08 PM, ankit nadig ankitr...@gmail.com wrote: Hi, im a newbie...i want to learn and contribute to hadoop.I've set up a single node cluster on ubuntu 12.04 . and i know c,c++ and am currently learning Java in college. I haven't read any

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-07 Thread Karthik Kambatla
+1 (non-binding) Ran a pseudo-dist cluster and a few jobs. On Mon, Oct 7, 2013 at 10:03 AM, Steve Loughran ste...@hortonworks.comwrote: +1 pointed my mvn repository (and plugin repository) at the staging site, added 2.2.0 as the version, ran all my local tests bringing up hbase and

FileUtil.copyMerge()

2010-10-10 Thread Karthik Kambatla
Hi guys, [Not very sure if this is the right place for this] This is regarding the issue https://issues.apache.org/jira/browse/HADOOP-2120 common/src/java/org/apache/hadoop/fs/FileUtil.java has a bug in FileUtil.copyMerge(). The method takes a directory, and returns false if the input is a

Re: Next releases

2013-12-05 Thread Karthik Kambatla
We should be able to ship YARN HA in Jan. We are two sub-tasks away from main functionality (patches in progress for both). YARN-149 has some duplicate sub-tasks. We should definitely be able to test / fix any critical issues by Jan. On Thu, Dec 5, 2013 at 3:57 PM, Arun C Murthy

Re: Will there be a 2.2 patch releases?

2014-01-05 Thread Karthik Kambatla
On Sat, Jan 4, 2014 at 9:48 AM, Raymie Stata rst...@altiscale.com wrote: I took a look at items in 2.3 and 2.4, as well as CDH5 and HDP2 (also looked at a few of the patches to assess their risk levels), and came up with the following strawman propose of bug-patches to be included in a 2.2.1

Re: Re-swizzle 2.3

2014-02-06 Thread Karthik Kambatla
I have marked MAPREDUCE-5744 a blocker for 2.3. Committing it shortly. Will pull it out of branch-2.3 if anyone objects. On Thu, Feb 6, 2014 at 2:04 PM, Arpit Agarwal aagar...@hortonworks.comwrote: Merged HADOOP-10273 to branch-2.3 as r1565456. On Wed, Feb 5, 2014 at 4:49 PM, Arpit Agarwal

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Karthik Kambatla
+1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014 at 10:40 PM, Roman Shaposhnik r...@apache.org wrote: Very nice! I'll take it for the usual round of testing in Bigtop. Should take a few days, but I'll keep you guys

Re: Fixing MAPREDUCE-5748

2014-03-19 Thread Karthik Kambatla
Hey Hussein Thanks for picking MAPREDUCE-5748 up. Can you post the patch on the JIRA, and we can continue the conversation there? Thanks Karthik On Wed, Mar 19, 2014 at 12:55 PM, Hussein Baghdadi hubaghd...@gmail.comwrote: Hi, I tried to fix MAPREDUCE-5748 What I did is to add another

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Karthik Kambatla
+1 on supporting new clients with old servers of the same major version, and updating the policy to capture that clearly. On Wed, Mar 19, 2014 at 1:59 PM, Chris Nauroth cnaur...@hortonworks.comwrote: I'd like to discuss clarification of part of our compatibility policy. Here is a link to the

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Karthik Kambatla
We should definitely get YARN-1726 in, if we are spinning a new RC. Otherwise, I guess we could include it in 2.4.1, along with any other critical issues that get reported on 2.4.0 or have missed this RC. On Thu, Apr 3, 2014 at 12:45 PM, Sandy Ryza sandy.r...@cloudera.com wrote: While the

Re: Plans of moving towards JDK7 in trunk

2014-04-08 Thread Karthik Kambatla
+1 to NOT breaking compatibility in branch-2. I think it is reasonable to require JDK7 for trunk, if we limit use of JDK7-only API to security fixes etc. If we make other optimizations (like IO), it would be a pain to backport things to branch-2. I guess this all depends on when we see ourselves

Re: DISCUSS: use SLF4J APIs in new modules?

2014-04-10 Thread Karthik Kambatla
+1 to use slf4j. I would actually vote for (1) new modules must-use, (2) new classes in existing modules are strongly recommended to use, (3) existing classes can switch to. That would take us closer to using slf4j everywhere faster. On Thu, Apr 10, 2014 at 8:17 AM, Alejandro Abdelnur

Re: DISCUSS: use SLF4J APIs in new modules?

2014-04-11 Thread Karthik Kambatla
On Fri, Apr 11, 2014 at 1:37 AM, Steve Loughran ste...@hortonworks.comwrote: On 10 April 2014 16:38, Karthik Kambatla ka...@cloudera.com wrote: +1 to use slf4j. I would actually vote for (1) new modules must-use, (2) new classes in existing modules are strongly recommended to use, (3

Re: Policy on adding timeouts to tests

2014-04-15 Thread Karthik Kambatla
becomes questionable, because now the fast machine is running with the longer timeout too. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Apr 14, 2014 at 9:41 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks Just wanted to check what our policy for adding timeouts

#Contributors on JIRA

2014-05-12 Thread Karthik Kambatla
Hi devs Looks like we ran over the max contributors allowed for a project, again. I don't remember what we did last time and can't find it in my email either. Can we bump up the number of contributors allowed? Otherwise, we might have to remove some of the currently inactive contributors from

Re: hadoop-2.5 - June end?

2014-06-11 Thread Karthik Kambatla
+1 to getting 2.5 by end of June. I would love to help with the release in any way. Some of the YARN features like work-preserving RM/ NM restart seem to going well; it would be great to get 2.6 out as soon as they are done, may be end of July. Again, I am willing to volunteer to do the necessary

Re: hadoop-2.5 - June end?

2014-06-23 Thread Karthik Kambatla
I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might need some help from someone more familiar with HDFS. On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd appreciate some help here. Due to family reasons (all good ones), I'll be

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Karthik Kambatla
+1 (non-binding) On Tue, Jun 24, 2014 at 8:54 AM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 (binding) Jason On 06/24/2014 03:53 AM, Arun C Murthy wrote: Folks, As discussed, I'd like to call a vote on changing our by-laws to change release votes from 7 days to 5. I've

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-25 Thread Karthik Kambatla
+1 (non-binding) Stood up a pseudo-dist cluster and ran a few MR jobs. On Wed, Jun 25, 2014 at 9:05 AM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 (binding) - Verified signatures and digests - Deployed binary tarball to a single-node cluster and ran some MR example jobs - Built

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
I was trying to do a JIRA bulk update to target all non-blockers to 2.6, but doesn't look like the bulk-update tool doesn't have Target Version. Does anyone know if that is true or if it is me not having permissions? On Thu, Jun 26, 2014 at 12:08 AM, Karthik Kambatla ka...@cloudera.com wrote

Re: Moving to JDK7, JDK8 and new major releases

2014-06-27 Thread Karthik Kambatla
As someone else already mentioned, we should announce one future release (may be, 2.5) as the last JDK6-based release before making the move to JDK7. I am comfortable calling 2.5 the last JDK6 release. On Fri, Jun 27, 2014 at 11:26 AM, Andrew Wang andrew.w...@cloudera.com wrote: Hi all,

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
till that point of time. I am also pushing for Shared Cache: YARN-1492 reviews. Again, like I said before, we can take it as we go. +Vinod Hortonworks Inc. http://hortonworks.com/ On Thu, Jun 26, 2014 at 12:08 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, For 2.5, looks

Re: Moving to JDK7, JDK8 and new major releases

2014-06-27 Thread Karthik Kambatla
JDK6 release and solicit their feedback. Once they are comfortable we can pull the trigger in 2.7. thanks, Arun On Jun 27, 2014, at 11:34 AM, Karthik Kambatla ka...@cloudera.com wrote: As someone else already mentioned, we should announce one future release (may be, 2.5) as the last

Updating keys in /www/www.apache.org/dist/hadoop/core

2014-07-02 Thread Karthik Kambatla
The wiki page on how-to-release mentions the following: Once you commit your changes, log into people.apache.org and pull updates to /www/www.apache.org/dist/hadoop/core. However, when I do an svn update, I see several conflicts. Can someone with more experience with the releases take a look at

Branching 2.5

2014-07-02 Thread Karthik Kambatla
Committers, I am working on branching 2.5. Will send an update as soon as I am done branching.

Re: Branching 2.5

2014-07-03 Thread Karthik Kambatla
caution when merging to branch-2.5 and target non-blockers preferably to 2.6 On Wed, Jul 2, 2014 at 10:24 PM, Karthik Kambatla ka...@cloudera.com wrote: Committers, I am working on branching 2.5. Will send an update as soon as I am done branching.

Re: Branching 2.5

2014-07-09 Thread Karthik Kambatla
, Karthik Kambatla ka...@cloudera.com wrote: I just 1. moved non-blocker 2.5 JIRAs to 2.6. 2. created branch-2.5 and added sections for 2.6.0 in all CHANGES.txt in trunk and branch-2. 3. Will create branch-2.5.0 when we are ready to create an RC There are 11 pending blockers for 2.5.0: http

Re: Branching 2.5

2014-07-16 Thread Karthik Kambatla
We are down to 4 blockers and looks like they are all actively being worked on. Please reconsider marking new JIRAs as blockers. Thanks Karthik PS: I moved out a couple of JIRAs that didn't seem like true blockers to 2.6. On Wed, Jul 9, 2014 at 11:43 AM, Karthik Kambatla ka...@cloudera.com

[DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-22 Thread Karthik Kambatla
Hi devs As you might have noticed, we have several classes and methods in them that are not annotated at all. This is seldom intentional. Avoiding incompatible changes to all these classes can be considerable baggage. I was wondering if we should add an explicit disclaimer in our compatibility

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Karthik Kambatla
to track those rather than track all the classes that should be @Private. Hopefully if users understand that's how things work they'll help file JIRAs for interfaces that need to be @Public to get their work done. Jason On 07/22/2014 04:54 PM, Karthik Kambatla wrote: Hi devs As you might

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-25 Thread Karthik Kambatla
is consistent with what we publish for our JavaDocs. IncludePublicAnnotationsStandardDoclet, used in the root pom.xml, filters out classes that don't explicitly have the Public annotation. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 23, 2014 at 10:55 AM, Karthik Kambatla ka

Re: Branching 2.5

2014-07-25 Thread Karthik Kambatla
if there's any related issues to me. :) Thanks, Wangda On Thu, Jul 17, 2014 at 5:54 AM, Karthik Kambatla ka...@cloudera.com wrote: We are down to 4 blockers and looks like they are all actively being worked on. Please reconsider marking new

Re: Branching 2.5

2014-07-29 Thread Karthik Kambatla
committed YARN-2247, which is the last 2.5 blocker from YARN. On Sat, Jul 26, 2014 at 5:02 AM, Karthik Kambatla ka...@cloudera.com wrote: A quick update: All remaining blockers are on the verge of getting committed. Once that is done, I plan to cut a branch for 2.5.0 and get an RC out

Re: Branching 2.5

2014-07-30 Thread Karthik Kambatla
at 11:09 AM, Zhijie Shen zs...@hortonworks.com wrote: I've just committed YARN-2247, which is the last 2.5 blocker from YARN. On Sat, Jul 26, 2014 at 5:02 AM, Karthik Kambatla ka...@cloudera.com wrote: A quick update: All remaining blockers are on the verge of getting committed

Re: Branching 2.5

2014-08-01 Thread Karthik Kambatla
, Jul 29, 2014 at 5:41 PM, Karthik Kambatla ka...@cloudera.com wrote: Devs, I created branch-2.5.0 and was trying to cut an RC, but ran into issues with creating one. If anyone knows what is going on, please help me out. I ll continue looking into it otherwise. https

[VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc0) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC0/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc0/ The maven artifacts are staged at

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
I am obviously a +1 (non-binding). I brought a pseudo-distributed cluster and ran a few HDFS commands and MR jobs. On Fri, Aug 1, 2014 at 4:16 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc0) for Hadoop 2.5.0. The RC is available

[DISCUSS] Migrate from svn to git for source control?

2014-08-01 Thread Karthik Kambatla
Hi folks, From what I hear, a lot of devs use the git mirror for development/reviews and use subversion primarily for checking code in. I was wondering if it would make more sense just to move to git. In addition to subjective liking of git, I see the following advantages in our workflow: 1.

Re: Branching 2.5

2014-08-01 Thread Karthik Kambatla
Tom White helped me figure it out, and closed the Nexus repository for me. Thanks Tom for helping and Stack for offering to help. On Fri, Aug 1, 2014 at 11:28 AM, Karthik Kambatla ka...@cloudera.com wrote: Folks, I think we are very close to voting on RC0. Just wanted to check one

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
Missed Andrew's email in the other thread. Looks like we might need HDFS-6793. I ll wait to see if others find any other issues, so I can address them all together. On Fri, Aug 1, 2014 at 4:25 PM, Karthik Kambatla ka...@cloudera.com wrote: I am obviously a +1 (non-binding). I brought

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-04 Thread Karthik Kambatla
to be in Gerrit. On 2 August 2014 00:43, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, From what I hear, a lot of devs use the git mirror for development/reviews and use subversion primarily for checking code in. I was wondering if it would make more sense just

[VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-05 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc1) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC1/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc1/ The maven artifacts are staged at:

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-05 Thread Karthik Kambatla
This vote is cancelled due to the incompatible issue. On Fri, Aug 1, 2014 at 5:28 PM, Karthik Kambatla ka...@cloudera.com wrote: Missed Andrew's email in the other thread. Looks like we might need HDFS-6793. I ll wait to see if others find any other issues, so I can address them all

Re: [VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-05 Thread Karthik Kambatla
+1 (non-binding) Brought up a pseudo distributed cluster. Ran a few HDFS operations and a couple of example MR jobs. Checked metrics being written out through FileSink. On Tue, Aug 5, 2014 at 5:37 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-05 Thread Karthik Kambatla
review board is great. One concern is that the development workflow can change and it can confuse us. What do you think? Thanks, - Tsuyoshi On Sat, Aug 2, 2014 at 8:43 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, From what I hear, a lot of devs use the git mirror

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-05 Thread Karthik Kambatla
If we are to start a vote thread, will people prefer a vote thread that includes potential workflows as well? On Tue, Aug 5, 2014 at 5:40 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for your opinions, everyone. Looks like most people are for the change and no one is against it. Let

Re: [VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-06 Thread Karthik Kambatla
-test-options.xml for the contract tests. All passed On 6 August 2014 01:37, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc1) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC1

[VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-06 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at:

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-06 Thread Karthik Kambatla
, Karthik Kambatla ka...@cloudera.com wrote: If we are to start a vote thread, will people prefer a vote thread that includes potential workflows as well? On Tue, Aug 5, 2014 at 5:40 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for your

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-06 Thread Karthik Kambatla
+1 (non-binding) Brought up a pseudo distributed cluster. Ran a few HDFS operations and a couple of example MR jobs. Checked metrics being written out through FileSink. On Wed, Aug 6, 2014 at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-08 Thread Karthik Kambatla
Thanks Steve. Including that in the proposal. By the way, from our project bylaws (http://hadoop.apache.org/bylaws.html), I can't tell what kind of a vote this would be. On Thu, Aug 7, 2014 at 1:22 AM, Steve Loughran ste...@hortonworks.com wrote: On 6 August 2014 22:16, Karthik Kambatla ka

[VOTE] Migration from subversion to git for version control

2014-08-08 Thread Karthik Kambatla
I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2. Force-push to be disabled on trunk and branch-* branches. Applying changes from any of

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-11 Thread Karthik Kambatla
, could you create new tar ball with the documentations? Thanks, - Tsuyoshi On Thu, Aug 7, 2014 at 5:59 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-11 Thread Karthik Kambatla
to update binary tarball without modifying source code. +1(non-binding) to continue the voting. Thanks, - Tsuyoshi On Tue, Aug 12, 2014 at 3:47 AM, Karthik Kambatla ka...@cloudera.com wrote: Thanks Akira for catching the missing docs. Let me work on *updating* the binary tarball to include

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-11 Thread Karthik Kambatla
Can someone please verify the signatures on the new binary and the old source tarballs to make sure it is all good? If it is, I believe we can go ahead and close the vote. On Mon, Aug 11, 2014 at 9:49 PM, Karthik Kambatla ka...@cloudera.com wrote: I have updated the binary tar ball to include

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-12 Thread Karthik Kambatla
files are not compiled. Would you please generate documents with 'mvn site site:stage /path/to/deploy'? I'm +1 (non-binding) if the documents are included. Thanks, Akira (2014/08/12 13:49), Karthik Kambatla wrote: I have updated the binary tar ball to include the docs, by building the docs

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-12 Thread Karthik Kambatla
on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-12 Thread Karthik Kambatla
on the announcements (and don't like to be left out, equally importantly) On 12 August 2014 17:16, Karthik Kambatla ka...@cloudera.com wrote: Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014

Re: [DISCUSS] Switch to log4j 2

2014-08-15 Thread Karthik Kambatla
Using asynchronous loggers for improved performance sounds reasonable. However, IMO we already log too much at INFO level (particularly YARN). Logging more at DEBUG level and lowering the overhead of enabling DEBUG logging is preferable. One concern is the defaults. Based on what I read on the

Re: [VOTE] Migration from subversion to git for version control

2014-08-16 Thread Karthik Kambatla
hit...@apache.org wrote: +1 — Hitesh On Aug 8, 2014, at 7:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion

Re: [VOTE] Migration from subversion to git for version control

2014-08-17 Thread Karthik Kambatla
Filed https://issues.apache.org/jira/browse/INFRA-8195. I encourage folks to watch the issue and at least some of us help with verifying the migration moves everything. On Sat, Aug 16, 2014 at 8:25 AM, Karthik Kambatla ka...@cloudera.com wrote: Thanks everyone for voting. Here is my +1 (non

Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-18 Thread Karthik Kambatla
Hi devs Tsuyoshi just brought it to my notice that the published tarballs don't have LICENSE, NOTICE and README at the top-level. Instead, they are only under common, hdfs, etc. Now that we have already announced the release and the jars/functionality doesn't change, I propose we just update the

Re: Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-20 Thread Karthik Kambatla
fixes to trigger a rerelease? With all the testing that entails? A simple 2.5.1 rebuild with the same hadoop source tree would be a lot easier to push out thanks, Arun On Mon, Aug 18, 2014 at 12:42 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi devs

Updates on migration to git

2014-08-22 Thread Karthik Kambatla
Hi folks, For the SCM migration, feel free to follow https://issues.apache.org/jira/browse/INFRA-8195 Most of this is planned to be handled this Sunday. As a result, the subversion repository would be read-only. If this is a major issue for you, please shout out. Daniel Gruno, the one helping

Re: Updates on migration to git

2014-08-22 Thread Karthik Kambatla
Also, does anyone know what we use for integration between JIRA and svn? I am assuming svn2jira. On Fri, Aug 22, 2014 at 3:48 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, For the SCM migration, feel free to follow https://issues.apache.org/jira/browse/INFRA-8195 Most

Re: Updates on migration to git

2014-08-23 Thread Karthik Kambatla
understand Giri maintains those builds, do we have anyone else who has access in case Giri is not reachable? Giri - please shout out if you can help us with this either on Sunday or Monday. Thanks Karthik On Fri, Aug 22, 2014 at 3:50 PM, Karthik Kambatla ka...@cloudera.com wrote: Also, does

Re: Updates on migration to git

2014-08-24 Thread Karthik Kambatla
Thanks Giri. By the way, writes to svn are now disabled. On Saturday, August 23, 2014, Giridharan Kesavan gkesa...@hortonworks.com wrote: ​I can take a look at this on Monday. ​ -giri On Sat, Aug 23, 2014 at 6:31 PM, Karthik Kambatla ka...@cloudera.com javascript:; wrote: Couple

Re: Updates on migration to git

2014-08-25 Thread Karthik Kambatla
, but it doesn't have to be. For git-flow workflows (which we use in slider) master/ is for releases, develop/ for dev. On 24 August 2014 02:31, Karthik Kambatla ka...@cloudera.com wrote: Couple of things: 1. Since no one expressed any reservations against doing this on Sunday

Re: Updates on migration to git

2014-08-25 Thread Karthik Kambatla
, Karthik Kambatla ka...@cloudera.com wrote: Thanks for your input, Steve. Sorry for sending the email out that late, I sent it as soon as I could. On Mon, Aug 25, 2014 at 2:20 AM, Steve Loughran ste...@hortonworks.com wrote: just caught up with this after some offlininess...15:48 PST

Re: Missing Snapshots for 2.5.0

2014-08-26 Thread Karthik Kambatla
Thanks for reporting this, Mark. It appears the artifacts are published to https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-common/2.5.0/, but haven't propagated to http://central.maven.org/maven2/org/apache/hadoop/hadoop-common/ I am following up on this, and

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
Last I heard, the import is still going on and appears closer to getting done. Thanks for your patience with the migration. I ll update you as and when there is something. Eventually, the git repo should be at the location in the wiki. On Mon, Aug 25, 2014 at 3:45 PM, Karthik Kambatla ka

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
basis. Was there any voting on this in PMC and should we have a vote to ensure everyone is one the same page on doing this and how to go about it? Regards, Suresh On Tue, Aug 26, 2014 at 9:17 AM, Karthik Kambatla ka...@cloudera.com wrote: Last I heard, the import is still going

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
The git repository is now ready for inspection. I ll take a look shortly, but it would be great if a few others could too. Once we are okay with it, we can ask it to be writable. On Tuesday, August 26, 2014, Karthik Kambatla ka...@cloudera.com wrote: Hi Suresh There was one vote thread

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
comfortable with making the git repo writable under these conditions? I ll let other people poke around and report. Thanks for your cooperation, Karthik On Tue, Aug 26, 2014 at 1:19 PM, Karthik Kambatla ka...@cloudera.com wrote: The git repository is now ready for inspection. I ll take a look shortly

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
and branch-2, verified all the branches are present. Also checked a few branches and the recent commit history matches our existing repo. Everything looks good so far. On Tue, Aug 26, 2014 at 1:19 PM, Karthik Kambatla ka...@cloudera.com wrote: The git repository is now ready for inspection. I ll

Re: Updates on migration to git

2014-08-26 Thread Karthik Kambatla
experience, especially when a project has committers new to git, force-push support causes more trouble than it's worth. -Todd On Tue, Aug 26, 2014 at 4:39 PM, Karthik Kambatla ka...@cloudera.com wrote: Looks like our git repo is good to go. On INFRA-8195, I am asking Daniel to enable

Re: Missing Snapshots for 2.5.0

2014-08-27 Thread Karthik Kambatla
There was an issue with the infrastructure. It is now fixed and the 2.5.0 artifacts are available. Mark - can you please retry now. Thanks Karthik On Tue, Aug 26, 2014 at 6:54 AM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for reporting this, Mark. It appears the artifacts

Git repo ready to use

2014-08-27 Thread Karthik Kambatla
Hi folks, I am very excited to let you know that the git repo is now writable. I committed a few changes (CHANGES.txt fixes and branching for 2.5.1) and everything looks good. Current status: 1. All branches have the same names, including trunk. 2. Force push is disabled on trunk,

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
Oh.. a couple more things. The git commit hashes have changed and are different from what we had on our github. This might interfere with any build automations that folks have. Another follow-up item: email and JIRA integration On Wed, Aug 27, 2014 at 1:33 AM, Karthik Kambatla ka

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
? branch-2.5 looks good to me. Regards, Vinay On Wed, Aug 27, 2014 at 2:10 PM, Karthik Kambatla ka...@cloudera.com wrote: Oh.. a couple more things. The git commit hashes have changed and are different from what we had on our github. This might interfere with any build automations

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
at 1:40 AM, Karthik Kambatla ka...@cloudera.com wrote: Oh.. a couple more things. The git commit hashes have changed and are different from what we had on our github. This might interfere with any build automations that folks have. Another follow-up item: email and JIRA integration On Wed

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
It appears the comments from Hudson on our JIRAs (post commits) are not setup by the INFRA team. Do we use any other scripts for this? If yes, do we want to fix those scripts or use svngit2jira? On Wed, Aug 27, 2014 at 10:18 AM, Karthik Kambatla ka...@cloudera.com wrote: The emails for commits

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
=cloudstack.git;h=7260e8d This is more concise and easier to look at than the Hudson list. On Wed, Aug 27, 2014 at 10:48 AM, Karthik Kambatla ka...@cloudera.com wrote: It appears the comments from Hudson on our JIRAs (post commits) are not setup by the INFRA team. Do we use any other scripts

Re: Git repo ready to use

2014-08-27 Thread Karthik Kambatla
builds still use subversion as source. Should Jenkins point to git ? Cheers On Wed, Aug 27, 2014 at 1:40 AM, Karthik Kambatla ka...@cloudera.com wrote: Oh.. a couple more things. The git commit hashes have changed and are different from what we had on our github. This might

  1   2   3   >