[jira] [Created] (MAPREDUCE-2662) Gridmix v3 should bailout in cpu emulation ON, if a trace doesn't contains the cpu resource usage information.

2011-07-08 Thread Vinay Kumar Thota (JIRA)
Gridmix v3 should bailout in cpu emulation ON, if a trace doesn't contains the cpu resource usage information. -- Key: MAPREDUCE-2662 URL: https://issues.a

[jira] [Created] (MAPREDUCE-2663) Refactoring StateMachineFactory inner classes

2011-07-08 Thread Ahmed Radwan (JIRA)
Refactoring StateMachineFactory inner classes - Key: MAPREDUCE-2663 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2663 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2

Re: MR1 next steps

2011-07-08 Thread Robert Evans
+1 for #2, So long as there are no feature regressions, as was talked about in a different thread. --Bobby On 7/7/11 7:20 PM, "Luke Lu" wrote: On Thu, Jul 7, 2011 at 9:58 AM, Eli Collins wrote: > I think #2 makes the most sense. +1. Supporting legacy servers in 0.23 is really redundant, when

Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Devaraj K
Hi, I am getting this below errors when I try to generate eclipse files using eclipse-files target. Can anybody help me? Buildfile: D:\svn\nextgenmapreduce\mapreduce\build.xml ivy-download: [get] Getting:

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Josh Wills
You want to generate them using mvn instead. See the mapreduce/yarn/README file for how to do it. On Fri, Jul 8, 2011 at 7:00 AM, Devaraj K wrote: > Hi, > > > > I am getting this below errors when I try to generate eclipse files using > eclipse-files target. Can anybody help me? > > > > > > B

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Robert Evans
I mapreduce/INSTALL also has some important information in it, and be aware that you do not have to install the avro plugin any more. Maven can download it and install it automatically now, but the README was never updated. Also be sure to install protocol buffers. The build will fail without

Hadoop-Mapreduce-trunk - Build # 731 - Still Failing

2011-07-08 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/731/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 237213 lines...] [junit]0.9:96658 [junit]

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Josh Wills
Hey Bobby- Vinod and I did a cleanup pass over INSTALL and yarn/README in https://issues.apache.org/jira/browse/MAPREDUCE-2645. Please take a look and check if there's anything else we need to add/update. Josh On Fri, Jul 8, 2011 at 7:25 AM, Robert Evans wrote: > I mapreduce/INSTALL also has s

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Haoyuan Li
Hi Josh, Which configuration file could tell Yarn the location of HDFS? This could be found on http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL Thank you. Best, Haoyuan On Fri, Jul 8, 2011 at 10:58 PM, Josh Wills wrote: > Hey Bobby- > > Vinod and I did a cleanu

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Haoyuan Li
Hi Josh, Which configuration file could tell Yarn the location of HDFS? This could not be found on http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL Thank you. Best, Haoyuan On Fri, Jul 8, 2011 at 10:58 PM, Josh Wills wrote: > Hey Bobby- > > Vinod and I did a cl

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Robert Evans
Hey Josh, I just updated now, and did not realize that it had been fixed. Everything mostly looks good. Then name of the tar ball is now -all.tar.gz not -bin.tar.gz It also doesn't talk about how you need to install the MAPRED, COMMON, and HDFS tar balls as well to get things to work, althoug

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Josh Wills
Haoyuan, Did you specify HADOOP_CONF_DIR, YARN_CONF_DIR, etc. as per Step 8 of the INSTALL doc? I've been running my mrv2 cluster in pseudo-distributed mode on my linux box- happy to send you my configs if you'd like to play. There are also a couple of changes you need to make to the yarn config f

[jira] [Created] (MAPREDUCE-2664) MR 279: Implement JobCounters for MRv2

2011-07-08 Thread Siddharth Seth (JIRA)
MR 279: Implement JobCounters for MRv2 -- Key: MAPREDUCE-2664 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2664 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Aff

[jira] [Created] (MAPREDUCE-2665) MR-279: Add hostname:port to NM and RM info/about page

2011-07-08 Thread Jonathan Eagles (JIRA)
MR-279: Add hostname:port to NM and RM info/about page -- Key: MAPREDUCE-2665 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2665 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2666) MR-279: Need to retrieve shuffle port number on AplicationMaster restart

2011-07-08 Thread Robert Joseph Evans (JIRA)
MR-279: Need to retrieve shuffle port number on AplicationMaster restart Key: MAPREDUCE-2666 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2666 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2667) MR279: mapred job -kill leaves application in RUNNING state

2011-07-08 Thread Thomas Graves (JIRA)
MR279: mapred job -kill leaves application in RUNNING state --- Key: MAPREDUCE-2667 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2667 Project: Hadoop Map/Reduce Issue Type: Bug

Re: Problem while running eclipse-files for Next Gen Mapreduce branch

2011-07-08 Thread Haoyuan Li
Thank you Josh. It will be great if you could send me your configs for pseudo-distributed mode. Best, Haoyuan On Sat, Jul 9, 2011 at 12:25 AM, Josh Wills wrote: > Haoyuan, > > Did you specify HADOOP_CONF_DIR, YARN_CONF_DIR, etc. as per Step 8 of the > INSTALL doc? I've been running my mrv2 clu

MR-279 branch: Problem opening files on the namenode web console (need to pick patches from trunk to resolve)

2011-07-08 Thread Ahmed Radwan
Hello, When using mrv2, I am seeing this error in the namenode web console when trying to open any file in the browser: Problem accessing /browseBlock.jsp. Reason: File does not exist: / at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:862)

Re: MR-279 branch: Problem opening files on the namenode web console (need to pick patches from trunk to resolve)

2011-07-08 Thread Mahadev Konar
HI Amhed, We are still working to start using trunk hdfs and trunk common for MR-279 (mapreduce). I think we are almost there and should be ready next week. For now we can probably skip fixing it since we are anyway going to move to trunk hdfs. Does that seem reasonable? thanks mahadev On Fri, J

Re: MR-279 branch: Problem opening files on the namenode web console (need to pick patches from trunk to resolve)

2011-07-08 Thread Ahmed Radwan
Makes sense. let's wait to move to trunk hdfs and common. Thanks Mahadev! On Fri, Jul 8, 2011 at 7:00 PM, Mahadev Konar wrote: > HI Amhed, > We are still working to start using trunk hdfs and trunk common for > MR-279 (mapreduce). I think we are almost there and should be ready > next week. For