Re: Disable some of the Hudson integration comments on JIRA

> On 1 Dec 2015, at 00:03, Allen Wittenauer wrote: > > >> On Nov 30, 2015, at 3:46 PM, Chris Nauroth wrote: >> >> To be exhaustive, we'd also add the various -Drequire options for full >> inclusion of all optional native components. Unfortunately, that gets >> tricky because of the various b

Re: Google Cloud Storage connector into Hadoop

1. do what chris says: go for the abstract contract tests. They'll find the troublespots in your code, like the way seek(-1) appears to have entertaining results, what happens on operations to closed files, etc, and help identify where the semantics of your FS varies from HDFS. 2. You will nee

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

> On 16 Dec 2015, at 06:41, Akira AJISAKA wrote: > > Thanks Junping for starting release process. > I noticed there are duplicated tags: > > * release-2.6.3-RC0 > * release-2.6.3-RC0.1 > * release-2.6.3-RC1 > > Could you remove RC0.1 and RC1? > > Regards, > Akira the ASF has locked down tag

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, binding Did a build and test with slider with the build set to -Dhadoop.version=2.6.3 this does a D/L and test from the staging repo. All artifacts were located, and the tests completed > On 12 Dec 2015, at 00:16, Junping Du wrote: > > > Hi all developers in hadoop community, > I've

Re: [RESULT] [VOTE] Release Apache Hadoop 2.6.3 RC0

> On 17 Dec 2015, at 13:36, Junping Du wrote: > > Hi all in community, > I give my binding +1 to close the vote for 2.6.3 RC0. With 18 +1s (10 > binding), one +0 (non-binding) and no -1s, the vote passes. > > Thanks for everyone who tried the release candidate and voted. Thanks Vinod, > S

FYI: windows 2.6.3 binaries

I've just built up and published on github the windows binaries to go with the 2.6.3 release https://github.com/steveloughran/winutils/tree/master/hadoop-2.6.3/bin these are just off the release commit, #95d8146, built on windows server 2012/64 bit. They aren't official ASF artifacts, but I'v

Re: [DISCUSSION] Release Plan for Apache Hadoop 2.6.4

> On 6 Jan 2016, at 23:59, Junping Du wrote: > > Hello folks, > Hope everyone had a wonderful holiday and good rest in passed weeks. I got to spend the break cutting a new release of slider after some colleagues vetoed the previous RC. So, mixed. > > Any thoughts? Especially on schedu

is jenkins testing PRs?

I submitted some PR-based patches last week —they haven't been tested yet https://issues.apache.org/jira/browse/YARN-4567 Is there a way for someone like me with Jenkins admin rights to kick this off?

[DISCUSS} why is checkstyle harassing me on indentation?

Yetus checkstyle is going a bit overboard on indentation policy https://builds.apache.org/job/PreCommit-HADOOP-Build/8434/artifact/patchprocess/diff-checkstyle-hadoop-common-project_hadoop-common.txt I am happy with it going on about javadocs, box/unbox, charsets. But complaining that something

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

> On 14 Jan 2016, at 20:57, Vinod Kumar Vavilapalli wrote: > > Hi all, > > I've created an updated release candidate RC2 for Apache Hadoop 2.7.2. > > As discussed before, this is the next maintenance release to follow up 2.7.1. > > The RC is available for validation at: > http://people.apach

Re: hadoop wiki access

> On 3 Feb 2016, at 18:33, Xiao Chen wrote: > > Hello community, > > I'm not sure whether a contributor can ask for wiki edit permission? > > I'm working on HDFS-9629 and may need to update > https://wiki.apache.org/hadoop/HowToRelease. done, but do bear in mind the release guidelines are pre

Re: [Release thread] 2.8.0 release activities

> On 3 Feb 2016, at 23:53, Vinod Kumar Vavilapalli wrote: > > Seems like all the features listed in the Roadmap wiki are in. I’m going to > try cutting an RC this weekend for a first/non-stable release off of > branch-2.8. > > Let me know if anyone has any objections/concerns. > > Thanks > +

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

> On 3 Feb 2016, at 07:01, Junping Du wrote: > > Hi community folks, > I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next > maintenance release to follow up 2.6.3.) according to email thread of release > plan 2.6.4 [1]. Below is details of this release candidate: > > The

Re: [Important] What is the practical maximum HDFS blocksize used in clusters?

> On 16 Feb 2016, at 08:04, Vinayakumar B wrote: > > Hi All, > > Just wanted to know, what is the maximum and practical dfs.block.size used in > production/test clusters. > > Current default value is 128MB and it can support upto 128TB ( Yup, right. > It's just a configuration value though)

Re: Looking to a Hadoop 3 release

> On 19 Feb 2016, at 11:27, Dmitry Sivachenko wrote: > > >> On 19 Feb 2016, at 01:35, Andrew Wang wrote: >> >> Hi all, >> >> Reviving this thread. I've seen renewed interest in a trunk release since >> HDFS erasure coding has not yet made it to branch-2. Along with JDK8, the >> shell script

Re: Introduce Apache Kerby to Hadoop

ish to make the Kerberos deploying, troubleshooting and further > enhancement can be much easier and thereafter possible. > > > > Wish this is a good beginning, and eventually Apache Kerby can benefit other > projects in the ecosystem as well. > > > >

Re: Looking to a Hadoop 3 release

> On 20 Feb 2016, at 15:34, Junping Du wrote: > > Shall we consolidate effort for 2.8.0 and 3.0.0? It doesn't sounds reasonable > to have two alpha releases to go in parallel. Is EC feature the main > motivation of releasing hadoop 3 here? If so, I don't understand why this > feature cannot l

Re: [crypto][chimera] Next steps

> On 22 Feb 2016, at 17:28, Colin P. McCabe wrote: > > I would highly recommend shading this library when it is used in > Hadoop and/or Spark, to prevent version skew problems between Hadoop > and Spark like we have had in the past. > > What is the strategy for handling JNI components? I think

Re: Introduce Apache Kerby to Hadoop

initial steps upgrading MiniKDC to use Kerby is >> the right thing we could do. After some interactions with Kerby project, we >> may have more ideas how to proceed on the followings. >>> >>>>> Long term, I'd like Hadoop 3 to be Kerby-ized >>&

Re: node.js and more as dependencies

> On 2 Mar 2016, at 05:55, Haohui Mai wrote: > > +1 on adding npm / gulp / mocha to be part of the build dependencies > (not runtime). The main benefit is modularity -- for example, in the > HDFS UI we manually duplicate the navigation bars and footer. We don't > have unit tests for them due to

Re: Branch policy question

> On 22 Mar 2016, at 16:14, Allen Wittenauer wrote: > > > Since it’s nearly impossible for me to get timely reviews for some > build and script changes, is it possible for me to setup a branch, self > review+commit to that branch, then request a branch merge? I’m basically > looking a

Re: Branch policy question

> On 22 Mar 2016, at 18:23, Andrew Wang wrote: > > A branch sounds fine, but how are we going to get 3 +1's to merge it? If > it's hard to find one reviewer, seems even harder to find two. Given that only one +1 is needed to merge a non-branch patch, he could in theory convert the entire branc

Re: Branch policy question

> On 24 Mar 2016, at 02:24, Chris Douglas wrote: > > CTR is- and always has been- admissible in a branch. > > On Wed, Mar 23, 2016 at 2:11 PM, Steve Loughran > wrote: >> Given that only one +1 is needed to merge a non-branch patch, he could in >> theory co

Re: [DISCUSS] 2.7.3 release?

> On 30 Mar 2016, at 07:42, Akira AJISAKA wrote: > > I'd like to help the release process as a release manager. > First, I'll look into the jiras in the following lists. > > * 2.7.3 critical/blocker issues (19): https://s.apache.org/X5pt > * 2.8.0 critical/blocker issues (61): https://s.apache.

Re: [Release thread] 2.8.0 release activities

> On 4 Apr 2016, at 22:16, Vinod Kumar Vavilapalli wrote: > > Here we go again. The blocker / critical tickets ballooned up a lot, I see 64 > now! : https://issues.apache.org/jira/issues/?filter=12334985 > > Also, the docs target (mvn package -Pdocs -DskipTests) is completely busted > on bran

Re: Commit History Edit Alert

Force pushes break everyone who has been pulling them down, and has the potential to stamp on other people's changes that they got in between the original push and the commit. That's more common in PST than for us in the EU, who can work across all three branches without race conditions surfaci

Re: [Release thread] 2.8.0 release activities

> On 23 Apr 2016, at 01:24, Vinod Kumar Vavilapalli wrote: > > We are not converging - there’s still 58 more. I need help from the community > in addressing / review 2.8.0 blockers. If folks can start with reviewing > Patch available tickets, that’ll be great. > > I'm still doing the s3a s

every JIRA is now getting a no-longer-employed message

whenever someone opens a new JIRA, it gains an auto attachment, "ran...@yahoo-inc.com is no longer with Yahoo! Inc." ... e.g https://issues.apache.org/jira/browse/HADOOP-13099 Does anyone know how to turn this off? It's coming in as a watcher on new issues —but I

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

> > On 10 May 2016, at 16:32, Akira AJISAKA wrote: > > Hi developers, > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. +1 Given Robert Kanter first filed the patch to do this —why not give him the honour. In fact, why not have a webex screen share of the occasion so

Re: Compatibility guidelines for toString overrides

> On 12 May 2016, at 17:57, Chris Nauroth wrote: > > I'm in favor of making a statement in the compatibility guidelines that > there is no guarantee of stability or backwards-compatibility for > toString() output. If a proposed patch introduces new dependencies on a > stable toString() output,

Re: Jira Lock Down Upgraded?

> On 13 May 2016, at 06:56, Xiao Chen wrote: > > FYI - I pinged infra but the answer is only people with > PMC/committer/contributor *Roles* on jira can comment. Hadoop's contributor > list seems to be reached it's limit, so cannot be added. you can add new contributors (I did this yesterday t

Re: Compatibility guidelines for toString overrides

On 14 May 2016, at 18:39, Allen Wittenauer mailto:a...@apache.org>> wrote: On May 12, 2016, at 12:20 PM, Chris Nauroth mailto:cnaur...@hortonworks.com>> wrote: Hello Allen, The intent is not for this rule to override other compatibility rules, such as the important CLI output rule. It's als

ASF JIRA spam lockdown

FYI, ASF JIRA's spam lockdown has got a bit more aggressive, and you may find it blocking you https://status.apache.org/ gives the (observed) status of JIRA. If you can't connect, have a look at the status page —and if JIRA is up but blocking you, talk to ASF Infra on their hipchat channel abo

Re: Different JIRA permissions for HADOOP and HDFS

> On 16 May 2016, at 09:21, Zhihai Xu wrote: > > Currently I also have permission issue to access the JIRA. I can't assign > the JIRA(I created) to myself. For example, > https://issues.apache.org/jira/browse/MAPREDUCE-6696 and > https://issues.apache.org/jira/browse/HIVE-13760. I can't find the

checkstyle and package-info

I've got checkstyle rejecting a patch as there's no package-info.java file —in src/test https://issues.apache.org/jira/browse/HADOOP-13130 I'm happy to argue the merits of the package-info files in production code: they can be good, if people put in the effort to write and maintain, but not f

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

> On 16 May 2016, at 02:43, Andrew Wang wrote: > > Hi common-dev, > > We have a first cut of the L&N files on HADOOP-12893. Many thanks to Xiao > Chen and Akira Ajisaka for doing the brunt of this work. However, full ASF > compliance will require a lot more Maven work. In the meanwhile, our > r

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

> On 16 May 2016, at 23:58, Andrew Wang wrote: > > Very happy to announce that we've committed HADOOP-11858. I'm looking > forward to writing my first lambda in Java. I also attached a video to the > JIRA so we can all relive this moment in Hadoop development history. > > It sounds like there's

Re: Hadoop CI with alternate architectures.

> On 18 May 2016, at 16:29, Allen Wittenauer wrote: > > > > That’s really a question for infrastructure-...@apache.org . They > manage the ASF build infrastructure which Apache Hadoop and lots of other > projects utilize. (Bigtop uses something custom, which I think is funded by > Cl

Re: Is Hadoop's TooRunner thread-safe?

I'd rather move new code to JCommander; its way, way better at parsing, as it uses annotation + introspection for its binding > On 18 May 2016, at 19:05, Chris Nauroth wrote: > > Hello, > > Thank you for reporting this. The root cause is that commons-cli > OptionBuilder is not thread-safe. >

Re: ASF OS X Build Infrastructure

> On 19 May 2016, at 18:08, Chris Nauroth wrote: > > Allen, thank you for doing this. > > Regarding lack of personal access to anything but Linux, I'll take this as > an opportunity to remind everyone that ASF committers (not just limited to > Hadoop committers) are entitled to a free MSDN lice

review needed for HADOOP-12754

Can someone look @ https://issues.apache.org/jira/browse/HADOOP-12754 its a one-liner for diagnostics only: whoever is fielding Kerberos problems will appreciate it

Re: yes, I did just break the 2.8 build

now fixed with a rollback. > On 20 May 2016, at 14:02, Steve Loughran wrote: > > > I do know that I've broken the 2.8 build; doing a check that the rollback of > HADOOP-13145 will fix it >

yes, I did just break the 2.8 build

I do know that I've broken the 2.8 build; doing a check that the rollback of HADOOP-13145 will fix it oops [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-te

Re: ASF OS X Build Infrastructure

> On 20 May 2016, at 10:40, Lars Francke wrote: > >> >> Regarding lack of personal access to anything but Linux, I'll take this as >> an opportunity to remind everyone that ASF committers (not just limited to >> Hadoop committers) are entitled to a free MSDN license, which can get you >> a Wind

Re: [DISCUSS] upgrade tomcat from 6.0.44 to 6.0.45 and use non apache.org mirror

> On 23 May 2016, at 19:52, Allen Wittenauer > wrote: > > Some potential ways to fix this: > > a) Move away from tomcat to one of the other two? three? maybe even > four? application servers that are already in the Apache Hadoop build > > b) Move to embedded tomcat so that the ja

Re: [DISCUSS] Replacing the automatic Jenkins jobs with Apache Yetus qbt

> On 1 Jun 2016, at 04:53, Andrew Wang wrote: > > I'm in favor of something that helps unify the current mess of Jenkins > jobs. We do something similar for our internal Hadoop repo: each branch has > a "build.sh" and "test.sh" script that builds and then runs the tests. This > predates Yetus, e

Re: Why there are so many revert operations on trunk?

+1 This is a good summary, And we are better off resolving issues through discussions on emails, rather than JIRA, and everyone behaving amicably towards each other. I think we should be more willing to do feature branches, especially for things like - anything deep into the codebase - self

Re: [DISCUSS] Increased use of feature branches

> On 10 Jun 2016, at 20:37, Anu Engineer wrote: > > I actively work on two branches (Diskbalancer and ozone) and I agree with > most of what Sangjin said. > There is an overhead in working with branches, there are both technical costs > and administrative issues > which discourages developer

Re: A top container module like hadoop-cloud for cloud integration modules

> On 13 Jun 2016, at 14:02, Zheng, Kai wrote: > > Hi, > > Noticed it's an obvious trend Hadoop is supporting more and more cloud > platforms, I suggest we have a top container module to hold such integration > modules, like the ones for aws, openstack, azure and upcoming one aliyun. The > ra

hadoop-build-tools/src/main/resources/META-INF/

I see (presumably from the licensing work), that I'm now getting hadoop-build-tools/src/main/resources/META-INF/ as an untracked directory. If this is generated, should it be in the source tree? And if so, should it be committed, or listed in .gitignore? --

Re: Heads up: branch-2.1-beta

Arun, What do I do if I have I minor patch that I'd like to get out into 2.1, but where I don't want to introduce instability into that 2.1 branch if you are trying to make a beta release? For example, HADOOP-9651 changes the exception that RawLoc

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

On 26 June 2013 09:17, Arun C Murthy wrote: > Folks, > > > The RC tag in svn is here: > http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 > > The maven artifacts are available via repository.apache.org. > > did all the poms go up? [INFO] --

Re: write access to hbase wiki

done On 1 July 2013 19:47, erman pattuk wrote: > Hi, > > I was planning to add our current project, BigSecret, to the powered-by > list of HBase. https://wiki.apache.org/hadoop/PoweredBy > I believe I need to get write permissions to do so. My username is > ermanpattuk. > > Thanks, > > Erman Pat

Re: [DISCUSSION] Hadoop Karaf support

thanks -I've commented on it briefly. Could you print the blog post to PDF and attach it too -it ensures that it will stay with the JIRA forever On 8 July 2013 06:14, Jean-Baptiste Onofré wrote: > Hi folks, > > Maybe some of you remember the discussion about OSGi support some months > ago. > >

HADOOP-8545 swift reviewers needed

Hi, I've been through suresh's review of the HADOOP-8545 patch and pulled in the changes -that patch is now ready for review by anyone, testing even better. I'd like to get this in not just because we've been working on it for a long time, but because I'm trying to specify more rigorously what f

Re: HADOOP-8545 swift reviewers needed

;ll help out testing the Hadoop on Swift work. I have a single-node Swift > setup and will first try running the unit tests against the setup. > > I'm guessing the most up-to-date documentation is the > hadoop-openstack/src/site/apt/index.apt.vm > added in HADOOP-8545? Thanks,

Re: protobuf 2.5.0 failure should be known by wiki

create a wiki account then ask for write access & we'll set you up On 10 July 2013 01:56, Akira AJISAKA wrote: > Hi, > > I've installed ProtocolBuffer 2.5.0 according to [[wiki: > HowToContribute]]. And that's why I failed to build hadoop and I had to > downgrade protobuf to 2.4.1. > > Now I kno

Re: Bringing Hadoop to Fedora

On 8 July 2013 19:28, Tim St Clair wrote: > Arun, > > > https://issues.apache.org/jira/browse/HADOOP-9680 / 9623 > > fixing S3 is something that is niggling me as something I want to sit down and do once the Swift stuff is in -and once we've clarified some quirks w/ the FS API, and got some more

Re: protobuf 2.5.0 failure should be known by wiki

On 10 July 2013 18:54, Akira AJISAKA wrote: > Thank you for your comments. > > > > create a wiki account then ask for write access & we'll set you up > > I created a wiki account. > (https://wiki.apache.org/**hadoop/AkiraAjisaka > ) > Would you set up

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

On 30 July 2013 14:29, Arun C Murthy wrote: > Folks, > > I've created another release candidate (rc1) for hadoop-2.1.0-beta that I > would like to get released. This RC fixes a number of issues reported on > the previous candidate. > > This release represents a *huge* amount of work done by the c

Re: Java 7 and Hadoop

would be nice for JDK7 builds to work on OSX -gave up the last time I tried, though we should see if the mvn plugins have been updated for this https://issues.apache.org/jira/browse/HADOOP-9350 http://steveloughran.blogspot.co.uk/2013/03/hadoop-java7-and-osx-or-what-is-it.html It looks like there

Re: [UPDATE] Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845

On 13 August 2013 13:09, Alejandro Abdelnur wrote: > There is no indication that protoc 2.5.0 is breaking anything. > clearly then this is not a stack trace: INFO] [INFO] Building Apache Hadoop Common 3.0.0-SNAPSHOT [INFO

Re: [UPDATE] Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845

we get all this sorted out, we had some > miscommunication on how to install protoc in the jenkins boxes and instead > having 2.4.1 and 2.5.0 side to side we got only 2.5.0. > > By tomorrow we should have things mostly sorted out. > > Thanks > > > On Tue, Aug 13, 2013 at 3:

Re: What's the status of IPv6 support?

On 16 August 2013 10:05, Andrew Pennebaker wrote: > Thanks for the link! > > I understand a lack of support *for* IPv6, what I don't understand is why > IPv6 must be disabled in order for Hadoop to work. On systems with both > IPv4 and IPv6, I thought IPv4 apps could ignore IPv6 as if it weren't

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

On 16 August 2013 02:50, Jun Ping Du wrote: > Hi Tsuyoshi, >I just checked Hadoop wiki on HowToContribute and it points > ProtocolBuffer things to YARN Readme which is already updated to 2.5.0 now. > > Thanks, > > Junping > > I remember spending time on that page trying to document protobuf,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

+1, binding Review process # symlink /usr/local/bin/protoc to the homebrew installed 2.5.0 version # delete all 2.1.0-beta artifacts in the mvn repo: find ~/.m2 -name 2.1.0-beta -print | xargs rm -rf # checkout hbase apache/branch-0.95 (commit # b58d596 ) # switch to ASF repo (arun's privat

moving JIRA releases

Should we go through the JIRA workflow of releasing 2.1-beta, and move all open targeted-at-2.1-beta issues to something else -2.1.0? Currently JIRA still views 2.1-beta as unreleased -steve -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to w

Re: hadoop wiki page

sure, create a wiki account, email the login name here and we'll give you write access On 30 August 2013 02:34, Pere Ferrera wrote: > Hello, > > "Datasalt (http://www.datasalt.com/) is a Hadoop consulting company which > released two open-source products on top of Hadoop (Pangool, an easier > l

Re: hadoop wiki page

OK, try logging in now On 31 August 2013 02:42, Pere Ferrera wrote: > Thanks, I just did, login name: *ferrerabertran* > > > On Fri, Aug 30, 2013 at 10:15 PM, Steve Loughran >wrote: > > > sure, create a wiki account, email the login name here and we'll give you &g

Re: hadoop wiki page

/ private training and custom Hadoop development. I get: Sorry, can not save page because "t.co" is not allowed in this wiki. There's actually "t.co" within "datasalt.com" but I don't see how to avoid this. Any suggestion? On Sun, Sep 1, 2013 at 6:53 AM,

help needed to test a patch for Java7 on OSX

There's now a patch (and instructions of a manual stage) to get hadoop to build on java7 on OSX before I commit it, I need to make sure it doesn't break on any other platforms. Can anyone with Linux, Windows, PowerPC, Arm, whatever (and free time, obviously) and an openjdk7 or closed-jdk7, apply

Re: help needed to test a patch for Java7 on OSX

Wed, Sep 11, 2013 at 1:51 AM, Steve Loughran >wrote: > > > There's now a patch (and instructions of a manual stage) to get hadoop to > > build on java7 on OSX > > > > before I commit it, I need to make sure it doesn't break on any other > > platforms.

Re: unit testing and execution guide

Have a look at https://wiki.apache.org/hadoop/HowToDevelopUnitTests , which (now) explains the miniclusters​ -which you can use for testing against in-VM HDFS and YARN cluster simulations. Passing unit tests doesn't mean your code works in a real cluster, but failing them does mean that it won't -a

Re: symlink support in Hadoop 2 GA

On 17 September 2013 23:05, Eli Collins wrote: > (Looping in Arun since this impacts 2.x releases) > > I updated the versions on HADOOP-8040 and sub-tasks to reflect where > the changes have landed. All of these changes (modulo HADOOP-9417) > were merged to branch-2.1 and are in the 2.1.0 release

Re: symlink support in Hadoop 2 GA

On 18 September 2013 12:53, Alejandro Abdelnur wrote: > On Wed, Sep 18, 2013 at 11:29 AM, Steve Loughran >wrote: > > > I'm reluctant for this as while delaying the release, because we are > going > > to find problems all the way up the stack -which will requi

Re: Newbie:Need guidance

Hi. You need to know that we don't really consider Hadoop a good place to learn about Java or distributed system programming: it is simply too complex. It's like learning C by writing linux kernel device drivers -so we explicitly warn against trying to do this http://wiki.apache.org/hadoop/Hadoop

Re: question about when do resource matching in YARN

On 21 September 2013 09:19, Sandy Ryza wrote: > I don't believe there is any reason scheduling decisions need to be coupled > with NodeManager heartbeats. It doesn't sidestep any race conditions > because a NodeManager could die immediately after heartbeating. > > historically its been done for

Re: [VOTE] Release Apache Hadoop 2.2.0

+1 pointed my mvn repository (and plugin repository) at the staging site, added 2.2.0 as the version, ran all my local tests bringing up hbase and accumulo dynamically. On 7 October 2013 08:00, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.2.0 that I wou

Re: [VOTE] Release Apache Hadoop 2.2.0

forgot to mention my vote is binding. to repeat my previous. +1 binding I've also now tested it in secure mode -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privile

Re: how to compile with OpenIndiana or Solaris

for hadoop 2.x, the log4j. properties file for each project should be in src/test/resources but there's a risk that tests in sub projects that include hadoop-commons-test.jar (or other -test JARs, like hadoop-hdfs) may pick up the version in the test jar ahead of any one that they have locally -so

moving up the release versions in JIRA

I've just moved the version 2.2.0 to the released category for HADOOP,COMMON and MAPREDUCE , ~6 JIRAs marked as fix for 2.2.0 went into 2.2.1 I can't do it for YARN -someone with admin rights there will have to do it -it'd be good to have it consistent before the issues start arriving. Remember:

Re: Hive Hbase Integration

this list isn't the place to find developers on those projects. More importantly, you'll find developers tend to ignore such questions on the list -expecting you to ask such things on the user lists. All that happens is that when you do have a serious problem, there's a risk it gets ignored. Pleas

Re: Question on hadoop dependencies.

Why hello Peter, Which version are you using? The reason those dependencies are declared are because things like Jetty use them -and the classpath for the server side Hadoop is "things needed to run Hadoop". Client-side I think there's too much in the maven dependency tree (servlets, jetty, ...)

Re: Question on hadoop dependencies.

On 30 October 2013 13:07, Petar Tahchiev wrote: > Oh, hi Steve, > > didn't know you were on this list :) ... > Well I didn' t know you were doing Hadoop stuff > > So spring-data-solr (1.1.SNAPSHOT) uses solr 4.5.1 (just came out a few > days ago), which uses Hadoop 2.0.5-alpha. > I would be

Re: Hadoop in Fedora updated to 2.2.0

On 30 October 2013 18:43, Robert Rati wrote: > I've updated the version of Hadoop in Fedora 20 to 2.2.0. This means > Hadoop 2.2.0 will be the included in the official release of Fedora 20. > > Hadoop on Fedora is running against numerous updated dependencies, > including: > Java 7 (OpenJDK Iced

Re: Next releases

On 8 November 2013 02:42, Arun C Murthy wrote: > Gang, > > Thinking through the next couple of releases here, appreciate f/b. > > # hadoop-2.2.1 > > I was looking through commit logs and there is a *lot* of content here > (81 commits as on 11/7). Some are features/improvements and some are fix

Re: Next releases

On 13 November 2013 18:11, Arun C Murthy wrote: > > HADOOP-9623 > Update jets3t dependency to 0.9.0 > > I saw that change -I don't think its a bad one, but I do think we need more testing of blobstores & especially big operations, like 6Gb uploads (which should now work with the 0.9.0 jet

Re: scope of jersey-test-framework-grizzly2

looks accidental, file a patch & link it to HADOOP-9991 On 13 November 2013 05:09, Ted Yu wrote: > Hi, > To answer some question on dev@hbase, I noticed the following > dependencies: > > [INFO] +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0:compile > [INFO] | +- org.apache.hadoop:

svn playing up?

I've been doing some trivial pom patches, along with the one line HDFS-5075 patch branch-2 $ svn status M hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt M hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/libexec/httpfs-config.sh branch-2 $ svn commit -m "HDFS-5075 httpfs-config.sh calls out inc

Re: Hadoop in Fedora updated to 2.2.0

I've just been through some of these as part of my background project, "fix up the POMs" https://issues.apache.org/jira/browse/HADOOP-9991. 1. I've applied the simple low/risk ones. 2. I've not done the bookkeeper one, as people working with that code need to play with it first. 3. I'

Re: Question on hadoop dependencies.

just hope you guys release cleaned 2.3 > first :) > > > 2013/10/30 Roman Shaposhnik > > > On Wed, Oct 30, 2013 at 1:07 PM, Steve Loughran > > wrote: > > > On 30 October 2013 13:07, Petar Tahchiev > wrote: > > >> So spring-data-solr (1.1.SNAPSHOT)

Re: Next releases

On 14 November 2013 17:15, Colin McCabe wrote: > > > HADOOP-9623 > > Update jets3t dependency to 0.9.0 > > I'm fine with reverting HADOOP-9623 from branch-2.2 and pushing it out > to branch-2.3. It does bring in httpcore, a dependency that wasn't > there before. > > I think http componen

Re: Hadoop in Fedora updated to 2.2.0

up -which is why its an area people are scared of. https://issues.apache.org/jira/browse/HADOOP-1158 now, if you were to work with the MR team to replace that with some netty-based protocol that issue would go away (or at least move) > Rob > > > On 11/13/2013 03:31 PM, Steve Loughran w

Re: Will there be a 2.2 patch releases?

the last discussion on this was in november -I presume that's still the plan http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201311.mbox/%3CA31E1430-33BE-437C-A61E-050F9A67C109%40hortonworks.com%3E On 3 January 2014 04:10, Raymie Stata wrote: > Nudge, any thoughts? > > On Sun, Dec 2

Video: how to commit a patch to hadoop

For new committers and for the curious, I've just stuck up a screen capture with commentary on how to commit a patch to the Hadoop SVN repository http://youtu.be/txW3m7qWdzw It's 27 minutes long, not just because of the commentary but because you have to be as rigorous committing a one-line patch

Re: [jira] [Created] (HADOOP-10226) Help! My Hadoop doesn't work!

there's a real reason for this, I have not been struck down with an inability to diagnose trivial problems. I wanted a "what not to do" example: http://www.slideshare.net/steve_l/2014-0110-reporting-a-bug http://youtu.be/NaJlRk5aTRQ On 12 January 2014 21:10, Steve Loughra

Re: Write Access to Hadoop wiki

done -try now On 12 January 2014 16:15, Lewis John Mcgibbney wrote: > Hi Folks, > I would please like write access > id: LewisJohnMcgibbney > Lewis John McGibbney > Thank you very much in advance > Lewis > > -- > *Lewis* > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use

Help! My Hadoop doesn't work: the video

As a requested followup to the "how to commit" video, one on how to file a bug, or more importantly, when to paste an exception into a web browser or learn to use basic networking tools before trying to bring up a Hadoop cluster http://youtu.be/NaJlRk5aTRQ http://www.slideshare.net/steve_l/2014-0

Re: Logistics for releasing 2.4

I'd like the (trivial) bug fix of HADOOP-10085 in. Patch is one line of production code (sync clone of a list in the getter), a few hundred lines of test. On 21 January 2014 21:26, Andrew Wang wrote: > Arun, great to hear 2.3 is coming down the pipe! I also agree with Suresh > that we should mo

Re: Logistics for releasing 2.4

the JIRA I referenced is ready to go -it just needs review On 22 January 2014 20:04, Andrew Wang wrote: > Thanks for the comments everyone. > > Vinod, if you think YARN-149 isn't ready yet, we can leave it out. > Alternatively, we could release note it as "beta" with said known issues, > and le

<    1   2   3   4   5   6   7   8   9   10   >