[jira] [Created] (MAPREDUCE-2940) Build fails with ant 1.7.0 but works with 1.8.0

2011-09-07 Thread Joep Rottinghuis (JIRA)
Build fails with ant 1.7.0 but works with 1.8.0 --- Key: MAPREDUCE-2940 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2940 Project: Hadoop Map/Reduce Issue Type: Bug Components:

Hadoop-Mapreduce-trunk-Commit - Build # 853 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/853/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9903 lines...] [exec] depbase=`echo

[jira] [Created] (MAPREDUCE-2941) In secure mode RM WebUI shows wrong user for application

2011-09-07 Thread Arun C Murthy (JIRA)
In secure mode RM WebUI shows wrong user for application Key: MAPREDUCE-2941 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2941 Project: Hadoop Map/Reduce Issue Type: Bug

Hadoop-Mapreduce-trunk-Commit - Build # 854 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/854/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9903 lines...] [exec] depbase=`echo

Re: Defects to be committed to 0.20.205 branch

2011-09-07 Thread Arun C Murthy
Hi Venu, Please go ahead and provide patches for them - I'll review. thanks, Arun On Sep 5, 2011, at 9:47 PM, Venu Gopala Rao wrote: Hi Matt, The following defects are important defects encountered by us in our regular Hadoop usage. We have submitted patches to these defects in the

Stale patches

2011-09-07 Thread Arun C Murthy
Gang, I'm starting to go through the PA queue and review stuff. Unfortunately a lot of patches have gone stale due to recent merge of MR-279 and code restructuring for maven. If you guys can rebase I promise to review all I can soon-ish and commit appropriately. I'll use a fair bar for 0.23

[jira] [Resolved] (MAPREDUCE-2068) TaskInProgress contains duplicate idWithinJob() / getIdWithinJob() accessors

2011-09-07 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2068. Resolution: Not A Problem Thanks for checking in Arun, Marking as resolved. Not a problem

Re: Stale patches

2011-09-07 Thread Harsh J
Thanks Arun, I'll rebase/reimpl the ones where its necessary. On Wed, Sep 7, 2011 at 1:31 PM, Arun C Murthy a...@hortonworks.com wrote: Also, I'll start to punt patches which only make sense for 'classic' MapReduce with MRv2 committed. Makes sense? I'm fine with this, and would like it if you

[jira] [Created] (MAPREDUCE-2942) TestNMAuditLogger.testNMAuditLoggerWithIP failing

2011-09-07 Thread Vinod Kumar Vavilapalli (JIRA)
TestNMAuditLogger.testNMAuditLoggerWithIP failing - Key: MAPREDUCE-2942 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2942 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2945) Hbase Batch Import Insertion Method

2011-09-07 Thread Arsalan Bilal (JIRA)
Hbase Batch Import Insertion Method --- Key: MAPREDUCE-2945 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2945 Project: Hadoop Map/Reduce Issue Type: Task Components: examples Affects

[jira] [Resolved] (MAPREDUCE-2945) Hbase Batch Import Insertion Method

2011-09-07 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2945. Resolution: Invalid Arsalan, The Apache JIRA is for filing issues or opening discussion

Hadoop-Mapreduce-trunk - Build # 809 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/809/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9393 lines...] [ivy:resolve] -- artifact

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Vinod Kumar Vavilapalli
There are a bunch of so called tools in hadoop-mapreduce-project/src/tools - DistCp, HadoopArchives, Rumen etc. And contrib projects are in src/contrib in all of common, hdfs and mapred source trees. Not sure how the distinction was ever made. The last time we had a discussion about moving

Mavenization for MR1 - HADOOP-7590

2011-09-07 Thread Alejandro Abdelnur
Do we still want/need to do this? Thanks. Alejandro

[jira] [Created] (MAPREDUCE-2946) TaskTrackers fail at startup

2011-09-07 Thread Owen O'Malley (JIRA)
TaskTrackers fail at startup Key: MAPREDUCE-2946 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2946 Project: Hadoop Map/Reduce Issue Type: Bug Components: tasktracker Affects Versions:

[jira] [Resolved] (MAPREDUCE-2946) TaskTrackers fail at startup

2011-09-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved MAPREDUCE-2946. -- Resolution: Invalid I forgot to chmod the task-controller to setuid. Sorry for the

Re: Mavenization for MR1 - HADOOP-7590

2011-09-07 Thread Mahadev Konar
Yes, I think we need this, both for 0.23 and 0.24. The current form of build is causing a lot of issues. Folks are not aware of checking ant after running maven and unknowingly break the builds. thanks mahadev On Sep 7, 2011, at 7:16 AM, Alejandro Abdelnur wrote: Do we still want/need to

Re: Mavenization for MR1 - HADOOP-7590

2011-09-07 Thread Vinod Kumar Vavilapalli
+1 for doing this. I am willing to help too. But I think we should be discussing about tools and contrib separately from this ticket (which is how you started that issue BTW). OTOH, this fixes only one part of the remaining bits. I've been seeing first-hand from people working on some of the

[jira] [Created] (MAPREDUCE-2947) Sort fails on YARN+MR with lots of task failures

2011-09-07 Thread Vinod Kumar Vavilapalli (JIRA)
Sort fails on YARN+MR with lots of task failures Key: MAPREDUCE-2947 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2947 Project: Hadoop Map/Reduce Issue Type: Bug Components:

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Alejandro Abdelnur
Agreed, we should not have a dumping ground. IMO, what it would go into hadoop-tools (i.e. distcp, streaming and someone could argue for FsShell as well) are effectively hadoop CLI utilities. Having them in a separate module rather in than in the core module (common, hdfs, mapreduce) does not mean

MRv1 in 0.23+

2011-09-07 Thread Milind.Bhandarkar
Folks, Has the community decided how long MRv1 will remain part of the codebase, after 0.23 ? The reason I am asking is, for those who are working on forward porting LinuxTaskController fixes (from 0.20.2xx) to 0.22, will they have to patch 0.23 and trunk as well ? Or should these branches be

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Mahadev Konar
I like the idea of having tools as a seperate module and I dont think that it will be a dumping ground unless we choose to make one of it. +1 for hadoop tools module under trunk. thanks mahadev On Wed, Sep 7, 2011 at 11:18 AM, Alejandro Abdelnur t...@cloudera.com wrote: Agreed, we should not

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Milind.Bhandarkar
+1 for separate hadoop-tools module. However, if a tool is broken at release time, and no one comes forward to fix it, it should be removed. (i.e. Unlike contrib modules, where build and test failures were tolerated.) - milind On 9/7/11 11:27 AM, Mahadev Konar maha...@hortonworks.com wrote: I

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Alejandro Abdelnur
Makes sense On Wed, Sep 7, 2011 at 11:32 AM, milind.bhandar...@emc.com wrote: +1 for separate hadoop-tools module. However, if a tool is broken at release time, and no one comes forward to fix it, it should be removed. (i.e. Unlike contrib modules, where build and test failures were

Re: MRv1 in 0.23+

2011-09-07 Thread Eli Collins
My understanding is that the MR1 code is currently needed to run the tests because there is no Mini MR cluster for MR2. So the code is needed until the tests can run against MR2 (not sure if there's an effort underway). However, see MR-2736, if we remove the ability to run the daemons I don't

[jira] [Created] (MAPREDUCE-2948) Hadoop streaming test failure, post MR-2767

2011-09-07 Thread Milind Bhandarkar (JIRA)
Hadoop streaming test failure, post MR-2767 --- Key: MAPREDUCE-2948 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2948 Project: Hadoop Map/Reduce Issue Type: Bug Components:

Hadoop-Mapreduce-trunk-Commit - Build # 855 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/855/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9903 lines...] [exec] g++

Re: MRv1 in 0.23+

2011-09-07 Thread Robert Evans
There is a MiniYarnCluster and a MiniMRYarnCluster, it is just that the tests have not been ported over to use them yet. --Bobby On 9/7/11 2:01 PM, Eli Collins e...@cloudera.com wrote: My understanding is that the MR1 code is currently needed to run the tests because there is no Mini MR

Hadoop-Mapreduce-22-branch - Build # 67 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/67/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2258 lines...] A

Hadoop-Mapreduce-trunk-Commit - Build # 856 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/856/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9902 lines...] [exec] depbase=`echo

Re: MRv1 in 0.23+

2011-09-07 Thread Eli Collins
Is there a jira for that? Seems like most tests wouldn't be MR1 specific. On Wed, Sep 7, 2011 at 2:59 PM, Robert Evans ev...@yahoo-inc.com wrote: There is a MiniYarnCluster and a MiniMRYarnCluster, it is just that the tests have not been ported over to use them yet. --Bobby On 9/7/11 2:01

Hadoop-Mapreduce-trunk-Commit - Build # 857 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/857/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9902 lines...] [exec] depbase=`echo

Hadoop-Mapreduce-trunk-Commit - Build # 858 - Still Failing

2011-09-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/858/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9902 lines...] [exec] depbase=`echo

RE: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Rottinghuis, Joep
Does a separate hadoop-tools module imply that there will be a separate Jenkins build as well? Thanks, Joep From: Alejandro Abdelnur [t...@cloudera.com] Sent: Wednesday, September 07, 2011 11:35 AM To: mapreduce-dev@hadoop.apache.org Subject: Re: Hadoop

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-07 Thread Amareshwari Sri Ramadasu
It is good to have hadoop-tools module separately. But as I asked before we need to answer some questions here. I'm trying to answer them myself. Comments are welcome. 1. Should the patches for tools be created against Hadoop Common? Here, I meant should Hadoop common mailing list be used Or