[jira] [Created] (MAPREDUCE-2966) Add ShutDown hooks for MRV2 processes

2011-09-09 Thread Abhijit Suresh Shingate (JIRA)
Add ShutDown hooks for MRV2 processes - Key: MAPREDUCE-2966 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2966 Project: Hadoop Map/Reduce Issue Type: Improvement Components: applicationmas

[jira] [Created] (MAPREDUCE-2967) PB implementations of all records should have getters, setters and getProto() properly synchronized

2011-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
PB implementations of all records should have getters, setters and getProto() properly synchronized --- Key: MAPREDUCE-2967 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (MAPREDUCE-2968) ContainerID record should get rid of ApplicationId field

2011-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
ContainerID record should get rid of ApplicationId field - Key: MAPREDUCE-2968 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2968 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2969) Make the NodeManager delete unused distributed-cache entires by LRU policy

2011-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
Make the NodeManager delete unused distributed-cache entires by LRU policy -- Key: MAPREDUCE-2969 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2969 Project: Hadoop Map/Red

Hadoop-Mapreduce-trunk-Commit - Build # 870 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/870/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9913 lines...] [exec] depbase=`echo impl/

[jira] [Created] (MAPREDUCE-2970) Null Pointer Exception while submitting a Job, If mapreduce.framework.name property is not set.

2011-09-09 Thread Venu Gopala Rao (JIRA)
Null Pointer Exception while submitting a Job, If mapreduce.framework.name property is not set. --- Key: MAPREDUCE-2970 URL: https://issues.apache.org/jira/browse/MAPREDUC

MAPREDUCE-2864 Has been merged to trunk and 0.23

2011-09-09 Thread Robert Evans
MAPREDCUE-2864 was an effort to rename and reorganize the YARN configuration parameters to make them consistent. If you are setting anything in your yarn-site.xml then you will need to update your configuration. The patch did not provide backwards compatible mappings because there has never been

[jira] [Resolved] (MAPREDUCE-2572) Throttle the deletion of data from the distributed cache

2011-09-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans resolved MAPREDUCE-2572. Resolution: Duplicate This is not longer relevant because MRV1 is depre

[jira] [Created] (MAPREDUCE-2971) ant build mapreduce fails protected access jc.displayJobList(jobs);

2011-09-09 Thread Thomas Graves (JIRA)
ant build mapreduce fails protected access jc.displayJobList(jobs); - Key: MAPREDUCE-2971 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2971 Project: Hadoop Map/Reduce

Hadoop-Mapreduce-trunk - Build # 812 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/812/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11697 lines...] [ivy:resolve] -- artifact com.su

[jira] [Created] (MAPREDUCE-2972) Running commands from the hadoop-mapreduce-test-*.jar fails with ClassNotFoundException: junit.framework.TestCase

2011-09-09 Thread Jeffrey Naisbitt (JIRA)
Running commands from the hadoop-mapreduce-test-*.jar fails with ClassNotFoundException: junit.framework.TestCase -- Key: MAPREDUCE-2972 URL: https://

Re: MAPREDUCE-2864 Has been merged to trunk and 0.23

2011-09-09 Thread Robert Evans
A quick update. I found a bug in the script, and it has now been fixed. Please use this script instead. https://issues.apache.org/jira/secure/attachment/12493787/update.pl --Bobby Evans On 9/9/11 8:53 AM, "Robert Evans" wrote: > MAPREDCUE-2864 was an effort to rename and reorganize the YARN c

Research projects for hadoop

2011-09-09 Thread Saikat Kanjilal
Hi Folks,I was looking through the following wiki page: http://wiki.apache.org/hadoop/HadoopResearchProjects and was wondering if there's been any work done (or any interest to do work) for the following topics: Integration of Virtualization (such as Xen) with Hadoop toolsHow does one integr

[jira] [Created] (MAPREDUCE-2973) Logic for determining whether to create a new JVM can interfere with Capacity-Scheduler and JVM reuse

2011-09-09 Thread Jonathon Hare (JIRA)
Logic for determining whether to create a new JVM can interfere with Capacity-Scheduler and JVM reuse - Key: MAPREDUCE-2973 URL: https://issues.apache.org/jira/bro

[jira] [Created] (MAPREDUCE-2974) Remove references to yui.yahooapis.com from queueinfo.jsp

2011-09-09 Thread Priyo Mustafi (JIRA)
Remove references to yui.yahooapis.com from queueinfo.jsp - Key: MAPREDUCE-2974 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2974 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2975) ResourceManager Delegate is not getting initialized with yarn-site.xml as default configuration.

2011-09-09 Thread Mahadev konar (JIRA)
ResourceManager Delegate is not getting initialized with yarn-site.xml as default configuration. Key: MAPREDUCE-2975 URL: https://issues.apache.org/jira/browse/MAPRED

Re: Research projects for hadoop

2011-09-09 Thread Robert Evans
The biggest issue with Xen and other virtualization technologies is that often there is an IO penalty involved with using them. For many jobs this is not an acceptable trade off. I do know, however, that there has been some discussion about using Linux Containers for isolation of Map/Reduce pr

RE: Research projects for hadoop

2011-09-09 Thread Saikat Kanjilal
How about using virtual box and centos 64 bit to serve as a linux container for isolating map/reduce processes? I have setup this up in the past, its really easy. > From: ev...@yahoo-inc.com > To: mapreduce-dev@hadoop.apache.org > Date: Fri, 9 Sep 2011 10:30:37 -0700 > Subject: Re: Research p

Re: Research projects for hadoop

2011-09-09 Thread Arun C Murthy
Saikat, As Robert pointed out, performance is a primary criterion - maybe you can come back with benchmarks? Try sorts with >100G data. Also, MRv2 makes it easy to play with these, you might want to try that. Arun On Sep 9, 2011, at 10:34 AM, Saikat Kanjilal wrote: > > How about using virt

[jira] [Created] (MAPREDUCE-2976) regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure)

2011-09-09 Thread Patrick Hunt (JIRA)
regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure) -- Key: MAPREDUCE-2976 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2976

[jira] [Created] (MAPREDUCE-2977) ResourceManager needs to renew and cancel tokens associated with a job

2011-09-09 Thread Owen O'Malley (JIRA)
ResourceManager needs to renew and cancel tokens associated with a job -- Key: MAPREDUCE-2977 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2977 Project: Hadoop Map/Reduce

RE: Research projects for hadoop

2011-09-09 Thread Segel, Mike
Why would you want to take a perfectly good machine and then try to virtualize it? I mean if I have 4 quad core cpus, I can run a lot of simultaneous map tasks. However if I virtualize the box, I lose at least 1 core per VM so I end up with 4 nodes that have less capabilities and performance tha

RE: Research projects for hadoop

2011-09-09 Thread Saikat Kanjilal
Thanks all for your feedback on this, I'll research some more and gather some benchmarks, also what about the provisioning of long running services via HOD, is anyone looking at this project or has done work on this? Regards > From: mse...@navteq.com > To: common-...@hadoop.apache.org; mapreduc

Re: Research projects for hadoop

2011-09-09 Thread Andrew Purtell
Both Hadoop and virtualization are means to an end. That end is to consolidate workloads traditionally deployed to separate servers so the average utilization and ROI of a given server increases. Companies looking to consolidate data-intensive computation may be better served moving to Hadoop i

missing yarn builds in the repository

2011-09-09 Thread Shawna Qian
Hello: When I browser the repository for 0.23.0-SNAPSHOT for yarn stuff, it is not present there. Can somebody put it there so that we can use it from maven repo? Thx Shawna

Hadoop-Mapreduce-trunk-Commit - Build # 871 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/871/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7715 lines...] [ivy:resolve] -- artifact

Re: missing yarn builds in the repository

2011-09-09 Thread Giridharan Kesavan
Yarn pom's are not automated to publish artifacts to the snapshot repo yet. -Giri On Fri, Sep 9, 2011 at 11:19 AM, Shawna Qian wrote: > Hello: > > When I browser the repository for 0.23.0-SNAPSHOT for yarn stuff, it is not > present there.  Can somebody put it there so that we can use it from ma

Hadoop-Mapreduce-trunk-Commit - Build # 872 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/872/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7714 lines...] [ivy:resolve] /home/jenkin

[jira] [Created] (MAPREDUCE-2978) hudson findbugs not reporting properly

2011-09-09 Thread Thomas Graves (JIRA)
hudson findbugs not reporting properly -- Key: MAPREDUCE-2978 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2978 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Ver

[jira] [Resolved] (MAPREDUCE-2941) In secure mode RM WebUI shows wrong user for application

2011-09-09 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-2941. -- Resolution: Fixed Fixed via MAPREDUCE-2953. > In secure mode RM WebUI shows wrong

Re: Jenkins's Links to FindBugs warnings not useful

2011-09-09 Thread Thomas Graves
This still seems to be broken. And I think hudson findbugs isn't reporting properly. Anyone who has hudson access can you take a look at: https://issues.apache.org/jira/browse/MAPREDUCE-2978 Tom On 9/6/11 1:10 PM, "Giridharan Kesavan" wrote: > this requires a fix to the test-patch script ; >

Hadoop-Mapreduce-trunk-Commit - Build # 873 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/873/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9914 lines...] [exec] depbase=`echo impl/

Re: Hadoop-Mapreduce-trunk - Build # 758 - Still Failing

2011-09-09 Thread Todd Lipcon
It looks like the thing killing the builds is TestJvmManager.java, not the eclipse plugin. Any idea why the Trunk-Commit build is apparently not picking up the latest common-test artifact? Any luck getting my ssh keys on the machine so you aren't the only one who can debug this? -Todd On Thu, Au

Hadoop-Mapreduce-trunk-Commit - Build # 874 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/874/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9913 lines...] [exec] libtool: link: g++

[jira] [Created] (MAPREDUCE-2979) Remove ClientProtocolProvider configuration under mapreduce-client-core

2011-09-09 Thread Siddharth Seth (JIRA)
Remove ClientProtocolProvider configuration under mapreduce-client-core --- Key: MAPREDUCE-2979 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2979 Project: Hadoop Map/Reduce

Re: Jenkins's Links to FindBugs warnings not useful

2011-09-09 Thread Giridharan Kesavan
like is said before it requires fix to the test-patch.sh script. "this requires a fix to the test-patch script ; JIRA_COMMENT_FOOTER="Findbugs warnings: $BUILD_URL/artifact/trunk/patchprocess/newPatchFindbugsWarnings${module_suffix}.html test-patch script currently updates findbugs url with trunk

Hadoop-Mapreduce-22-branch - Build # 68 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/68/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2258 lines...] A src/examples/org/apache/h

Hadoop-Mapreduce-trunk-Commit - Build # 875 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/875/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9914 lines...] [exec] depbase=`echo impl/

[jira] [Created] (MAPREDUCE-2980) Fetch failures and other related issues in Jetty 6.1.26

2011-09-09 Thread Todd Lipcon (JIRA)
Fetch failures and other related issues in Jetty 6.1.26 --- Key: MAPREDUCE-2980 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2980 Project: Hadoop Map/Reduce Issue Type: Bug

Hadoop-Mapreduce-trunk-Commit - Build # 876 - Still Failing

2011-09-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/876/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7715 lines...] [ivy:resolve] /home/jenkin