[jira] [Created] (MAPREDUCE-6121) JobSubmitter.compareFs doesn't handle HA namespaces

2014-10-06 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-6121: Summary: JobSubmitter.compareFs doesn't handle HA namespaces Key: MAPREDUCE-6121 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121 Project: Hadoop Map

Re: [VOTE] Migration from subversion to git for version control

2014-08-12 Thread Thomas Graves
+1 (binding). Tom On Friday, August 8, 2014 9:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days.   1. Migrate from subversion to git for version control.  

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-27 Thread Thomas Graves
Thanks everyone for voting. The Vote passes with 11 +1¹s (5 binding, 6 non-binding) and no -1¹s. I¹ll push the release out. Tom On 6/19/14, 10:14 AM, Thomas Graves tgra...@yahoo-inc.com.INVALID wrote: Hey Everyone, There have been various bug fixes that have went into branch-0.23 since

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Thomas Graves
+1 Tom On 6/24/14, 3:53 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, As discussed, I'd like to call a vote on changing our by-laws to change release votes from 7 days to 5. I've attached the change to by-laws I'm proposing. Please vote, the vote will the usual period of 7 days.

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

2014-06-23 Thread Thomas Graves
I¹d be fine with 5 days. Any shorter and you could have issues with folks being just out for a weekend and miss the entire vote unless we explicitly tried to stay away from ending the vote on the weekend. Tom On 6/21/14, 12:54 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd like

[VOTE] Release Apache Hadoop 0.23.11

2014-06-19 Thread Thomas Graves
Hey Everyone, There have been various bug fixes that have went into branch-0.23 since the 0.23.10 release. We think its time to do a 0.23.11. This is also the last planned release off of branch-0.23 we plan on doing. The RC is available at:

Release Apache Hadoop 0.23.11 - last planned 0.23 release

2014-06-17 Thread Thomas Graves
Hey everyone, I plan on spinning a 0.23.11 release candidate this week. This will be the last 0.23 release we plan on doing off of this branch. If anyone has questions or concerns with this please let me know. Thanks, Tom Graves

[jira] [Resolved] (MAPREDUCE-4225) RM/AM scheduling debug statement not adequate on #asks

2014-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4225. -- Resolution: Invalid Release Note: resolving for now, reopen if its still

[jira] [Resolved] (MAPREDUCE-3627) ClusterSetup docs for permissions on mapreduce.jobhistory.done-dir don't match jobhistory server startup

2014-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-3627. -- Resolution: Duplicate Target Version/s: 2.4.0 (was: 0.23.0

Re: [VOTE] Release Apache Hadoop 0.23.10

2013-12-10 Thread Thomas Graves
With 6 +1's (4 binding, 2 non-binding) the vote passes. I'll publish this today. Tom On 12/3/13 12:22 AM, Thomas Graves tgra...@yahoo-inc.com wrote: Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release. We think its time

[VOTE] Release Apache Hadoop 0.23.10

2013-12-02 Thread Thomas Graves
Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release. We think its time to do a 0.23.10 so I have created a release candidate (rc0) for a Hadoop-0.23.10 release. The RC is available at:

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-08 Thread Thomas Graves
+1. Downloaded, verified signature/md5, CHANGES.txt, NOTICE, LICENSE, README, release notes, built the source tar ball, and ran a few small jobs on a pseudo-distributed cluster. Tom On 10/7/13 2:00 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0)

[jira] [Created] (MAPREDUCE-5504) mapred queue -info inconsistent with types

2013-09-11 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-5504: Summary: mapred queue -info inconsistent with types Key: MAPREDUCE-5504 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5504 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5395) Update Teragen algorithm

2013-07-16 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-5395: Summary: Update Teragen algorithm Key: MAPREDUCE-5395 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5395 Project: Hadoop Map/Reduce Issue

Re: [VOTE] Release Apache Hadoop 0.23.9

2013-07-09 Thread Thomas Graves
Thanks everyone for voting. The vote has passed with 9 +1's (4 non-binding and 5 binding) and 0 -1's. I will push the release. Tom On 7/1/13 12:20 PM, Thomas Graves tgra...@yahoo-inc.com wrote: I've created a release candidate (RC0) for hadoop-0.23.9 that I would like to release. The RC

Re: [VOTE] Release Apache Hadoop 0.23.9

2013-07-08 Thread Thomas Graves
Friendly reminder this vote ends today please try it out if you have time. Thanks, Tom Graves On 7/1/13 12:20 PM, Thomas Graves tgra...@yahoo-inc.com wrote: I've created a release candidate (RC0) for hadoop-0.23.9 that I would like to release. The RC is available at: http://people.apache.org

[VOTE] Release Apache Hadoop 0.23.9

2013-07-01 Thread Thomas Graves
I've created a release candidate (RC0) for hadoop-0.23.9 that I would like to release. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.9-candidate-0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.9-rc0/ The maven artifacts are

Re: [VOTE] Release Apache Hadoop 0.23.8

2013-06-04 Thread Thomas Graves
Thanks everyone for trying 0.23.8 out and voting. With 10 +1's (7 binding, 3 non-binding) and no -1's, the vote passes. I will push the release. Tom Graves On 5/28/13 11:00 AM, Thomas Graves tgra...@yahoo-inc.com wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)

2013-06-04 Thread Thomas Graves
Cos, The name of the mds file for the binary tar is missing a . in your apache directory: hadoop-2.0.5-alphatar.gz.mds http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/hadoop-2.0.5-alphatar .gz.mds Contents of it are fine though so you might just add the .. Also the NOTICE.txt, README.txt,

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-28 Thread Thomas Graves
The vote passed with 15 +1's (9 binding) and 0 -1's. I will start the release today. Thanks, Tom On 5/17/13 4:10 PM, Thomas Graves tgra...@yahoo-inc.com wrote: Hello all, We've had a few critical issues come up in 0.23.7 that I think warrants a 0.23.8 release. The main one is MAPREDUCE-5211

[VOTE] Release Apache Hadoop 0.23.8

2013-05-28 Thread Thomas Graves
I've created a release candidate (RC0) for hadoop-0.23.8 that I would like to release. This release is a sustaining release with several important bug fixes in it. The most critical one is MAPREDUCE-5211. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.8-candidate-0/ The

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-20 Thread Thomas Graves
for the release plan either way.) Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, May 17, 2013 at 7:25 PM, Eli Collins e...@cloudera.com wrote: +1 On Friday, May 17, 2013, Thomas Graves wrote: Hello all, We've had a few critical issues come up in 0.23.7 that I think warrants a 0.23.8

[VOTE] Plan to create release candidate for 0.23.8

2013-05-17 Thread Thomas Graves
Hello all, We've had a few critical issues come up in 0.23.7 that I think warrants a 0.23.8 release. The main one is MAPREDUCE-5211. There are a couple of other issues that I want finished up and get in before we spin it. Those include HDFS-3875, HDFS-4805, and HDFS-4835. I think those are on

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-17 Thread Thomas Graves
+1 (binding). I downloaded, verified signatures and checksums, built, and ran small jobs on a single node unsecure cluster. Tom On 4/12/13 4:56 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would like to release.

[jira] [Resolved] (MAPREDUCE-5015) Coverage fix for org.apache.hadoop.mapreduce.tools.CLI

2013-04-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-5015. -- Resolution: Fixed Fix Version/s: 0.23.8 2.0.5-beta

[VOTE] Release Apache Hadoop 0.23.7

2013-04-11 Thread Thomas Graves
I've created a release candidate (RC0) for hadoop-0.23.7 that I would like to release. This release is a sustaining release with several important bug fixes in it. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.7-candidate-0/ The RC tag in svn is here:

[jira] [Created] (MAPREDUCE-5137) AM web UI: clicking on Map Task results in 500 error

2013-04-09 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-5137: Summary: AM web UI: clicking on Map Task results in 500 error Key: MAPREDUCE-5137 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5137 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-4242) port gridmix tests to yarn

2013-04-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4242. -- Resolution: Duplicate MAPREDUCE-4991 pretty much covers these tests

[jira] [Resolved] (MAPREDUCE-4992) AM hangs in RecoveryService when recovering tasks with speculative attempts

2013-03-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4992. -- Resolution: Fixed resolving this as its committed. The additional work is being

[jira] [Created] (MAPREDUCE-5054) CS user left in list of active users for the queue even when application finished

2013-03-08 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-5054: Summary: CS user left in list of active users for the queue even when application finished Key: MAPREDUCE-5054 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5054

Re: Technical question on Capacity Scheduler.

2013-03-04 Thread Thomas Graves
There are 3 types of locality. - data local (node local) - your task gets scheduled on the node where the data is - rack local - your task is scheduled on the same rack as the data (usually 20-40 nodes in a rack), but its not on the exact node with the data. - off-switch (off-rack) - your task is

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-07 Thread Thomas Graves
+1 (binding). I downloaded it, verified checksums, built from source, installed (both binary and one I built) and ran some basic jobs. Tom On 2/6/13 9:59 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to

[jira] [Created] (MAPREDUCE-4975) streaming/gridmix docs missing

2013-02-04 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4975: Summary: streaming/gridmix docs missing Key: MAPREDUCE-4975 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4975 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4934) Maven RAT plugin is not checking all source files

2013-01-10 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4934: Summary: Maven RAT plugin is not checking all source files Key: MAPREDUCE-4934 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4934 Project: Hadoop Map

[jira] [Resolved] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2013-01-04 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4894. -- Resolution: Fixed Fix Version/s: 0.23.6 2.0.3-alpha

[jira] [Created] (MAPREDUCE-4758) jobhistory web ui not showing correct # failed reducers

2012-10-30 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4758: Summary: jobhistory web ui not showing correct # failed reducers Key: MAPREDUCE-4758 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4758 Project: Hadoop

[jira] [Created] (MAPREDUCE-4729) job history UI not showing all job attempts

2012-10-17 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4729: Summary: job history UI not showing all job attempts Key: MAPREDUCE-4729 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4729 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4724) job history web ui applications page should be sorted to display last app first

2012-10-15 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4724: Summary: job history web ui applications page should be sorted to display last app first Key: MAPREDUCE-4724 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4724

[jira] [Created] (MAPREDUCE-4713) mr-jobhistory-daemon.sh --config option doesn't work

2012-10-08 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4713: Summary: mr-jobhistory-daemon.sh --config option doesn't work Key: MAPREDUCE-4713 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4713 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-4713) mr-jobhistory-daemon.sh --config option doesn't work

2012-10-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4713. -- Resolution: Duplicate dup of MAPREDUCE-4712 mr-jobhistory

Re: Commits breaking compilation of MR 'classic' tests

2012-09-27 Thread Thomas Graves
So is someone signing up to do this port soon? Otherwise I don't see the point in us spending time keeping tests that mostly don't apply working. I used to spend a lot of time on this when we still had to compile contrib stuff out of ant and the majority of it was just fixing it so it compiles

[jira] [Created] (MAPREDUCE-4662) JobHistoryFilesManager thread pool never expands

2012-09-18 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4662: Summary: JobHistoryFilesManager thread pool never expands Key: MAPREDUCE-4662 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4662 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-4640) jobHistoryEventHandler doesn't fix done_intermediate parent directory permissions

2012-09-06 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4640: Summary: jobHistoryEventHandler doesn't fix done_intermediate parent directory permissions Key: MAPREDUCE-4640 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4640

[jira] [Created] (MAPREDUCE-4636) job history server needs more unit tests

2012-09-05 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4636: Summary: job history server needs more unit tests Key: MAPREDUCE-4636 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4636 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4633) history server doesn't set permissions on all subdirs

2012-09-04 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4633: Summary: history server doesn't set permissions on all subdirs Key: MAPREDUCE-4633 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4633 Project: Hadoop

[jira] [Created] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-30 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4612: Summary: job summary file permissions not set when its created Key: MAPREDUCE-4612 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4612 Project: Hadoop

[jira] [Created] (MAPREDUCE-4579) TestTaskAttempts fails jdk7

2012-08-23 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4579: Summary: TestTaskAttempts fails jdk7 Key: MAPREDUCE-4579 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4579 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-4569) TestHsWebServicesJobsQuery fails on jdk7

2012-08-21 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4569: Summary: TestHsWebServicesJobsQuery fails on jdk7 Key: MAPREDUCE-4569 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4569 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4571) TestHsWebServicesJobs fails on jdk7

2012-08-21 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4571: Summary: TestHsWebServicesJobs fails on jdk7 Key: MAPREDUCE-4571 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4571 Project: Hadoop Map/Reduce

[jira] [Reopened] (MAPREDUCE-4423) Potential infinite fetching of map output

2012-07-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened MAPREDUCE-4423: -- Potential infinite fetching of map output

[jira] [Created] (MAPREDUCE-4366) mapred metrics shows negative count of waiting maps and reduces

2012-06-25 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4366: Summary: mapred metrics shows negative count of waiting maps and reduces Key: MAPREDUCE-4366 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4366

[jira] [Created] (MAPREDUCE-4353) fix TestPipes

2012-06-19 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4353: Summary: fix TestPipes Key: MAPREDUCE-4353 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4353 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Resolved] (MAPREDUCE-4298) NodeManager crashed after running out of file descriptors

2012-06-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4298. -- Resolution: Duplicate dup of HADOOP-8495 NodeManager crashed

[jira] [Created] (MAPREDUCE-4341) add types to capacity scheduler properties

2012-06-14 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4341: Summary: add types to capacity scheduler properties Key: MAPREDUCE-4341 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4341 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4320) gridmix mainClass wrong in pom.xml

2012-06-06 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4320: Summary: gridmix mainClass wrong in pom.xml Key: MAPREDUCE-4320 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4320 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4311) Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings

2012-06-04 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4311: Summary: Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings Key: MAPREDUCE-4311 URL: https://issues.apache.org/jira/browse

[jira] [Created] (MAPREDUCE-4295) RM crashes due to DNS issue

2012-05-30 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4295: Summary: RM crashes due to DNS issue Key: MAPREDUCE-4295 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4295 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-4296) remove old aggregated logs

2012-05-30 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4296: Summary: remove old aggregated logs Key: MAPREDUCE-4296 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4296 Project: Hadoop Map/Reduce Issue

Re: can we remove Ant stuff now that MAPREDUCE-3543 (gridmix) has been mavenized?

2012-05-17 Thread Thomas Graves
There are a few jiras to finish some porting - like a few of the gridmix tests, but as you said we can revive them from svn at that point. So I'm +1. Tom On 5/17/12 11:36 AM, Alejandro Abdelnur t...@cloudera.com wrote: My take is that we should delete all the stuff from there and unwire

[jira] [Created] (MAPREDUCE-4267) mavenize pipes

2012-05-17 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4267: Summary: mavenize pipes Key: MAPREDUCE-4267 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4267 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-4242) port gridmix tests to yarn

2012-05-10 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4242: Summary: port gridmix tests to yarn Key: MAPREDUCE-4242 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4242 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-4238) mavenize data_join

2012-05-09 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4238: Summary: mavenize data_join Key: MAPREDUCE-4238 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4238 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-4239) gridmix has 11 findbugs warnings

2012-05-09 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4239: Summary: gridmix has 11 findbugs warnings Key: MAPREDUCE-4239 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4239 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4225) RM/AM scheduling debug statement not adequate on #asks

2012-05-04 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4225: Summary: RM/AM scheduling debug statement not adequate on #asks Key: MAPREDUCE-4225 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4225 Project: Hadoop

[jira] [Created] (MAPREDUCE-4213) nodemanager should cleanup running containers when shutdown

2012-05-01 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4213: Summary: nodemanager should cleanup running containers when shutdown Key: MAPREDUCE-4213 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4213 Project

[jira] [Created] (MAPREDUCE-4214) nodemanager should cleanup running containers when it starts

2012-05-01 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4214: Summary: nodemanager should cleanup running containers when it starts Key: MAPREDUCE-4214 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4214 Project

[jira] [Created] (MAPREDUCE-4196) nodemanager doesn't cleanup old logs/local files after restart

2012-04-25 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4196: Summary: nodemanager doesn't cleanup old logs/local files after restart Key: MAPREDUCE-4196 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4196 Project

[jira] [Created] (MAPREDUCE-4190) Improve web UI for task attempts userlog link

2012-04-23 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4190: Summary: Improve web UI for task attempts userlog link Key: MAPREDUCE-4190 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4190 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-4191) capacity scheduler: job unexpectedly exceeds queue capacity limit by one task

2012-04-23 Thread Thomas Graves (JIRA)
Thomas Graves created MAPREDUCE-4191: Summary: capacity scheduler: job unexpectedly exceeds queue capacity limit by one task Key: MAPREDUCE-4191 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4191

[jira] [Created] (MAPREDUCE-4160) some mrv1 ant tests fail with timeout - due to 4156

2012-04-17 Thread Thomas Graves (Created) (JIRA)
Components: test Affects Versions: 0.23.3 Reporter: Thomas Graves Assignee: Thomas Graves Looks like the old mrv1 history server is getting null error when trying to parse the a null for the TaskFinishedEvent successfulAttemptId which was added in jira 4156

[jira] [Created] (MAPREDUCE-4153) NM Application invalid state transition on reboot command from RM

2012-04-13 Thread Thomas Graves (Created) (JIRA)
Issue Type: Bug Components: mrv2, nodemanager Affects Versions: 0.23.2 Reporter: Thomas Graves If the RM goes down and comes back up, it tells the NM to reboot. When the NM reboots, if it has any applications it aggregates the logs for those applications

[jira] [Resolved] (MAPREDUCE-4142) MR test failures on branch-1

2012-04-12 Thread Thomas Graves (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-4142. -- Resolution: Invalid MR test failures on branch-1

[jira] [Resolved] (MAPREDUCE-1233) Incorrect Waiting maps/reduces in Jobtracker metrics

2012-04-09 Thread Thomas Graves (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-1233. -- Resolution: Fixed Fix Version/s: 0.20.203.0 Incorrect Waiting maps

[jira] [Created] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

2012-04-03 Thread Thomas Graves (Created) (JIRA)
Type: Bug Components: webapps Affects Versions: 0.23.2 Reporter: Thomas Graves Run a simple wordcount or sleep, and kill the job before it finishes. Go to the job history web ui and click the Counters link for that job. It displays 500 error. The job history log has

[jira] [Created] (MAPREDUCE-4096) tests seem to be randomly failing

2012-04-02 Thread Thomas Graves (Created) (JIRA)
: 2.0.0, trunk Reporter: Thomas Graves Looking at the output from test-patch from jenkins recently it seems that tests are randomly failing: jira MAPREDUCE-4089 is an example where 22 failed, the next time patch was put up 4 failed and in both cases the patch had nothing to do

[jira] [Created] (MAPREDUCE-4061) RM only has 1 AM launcher thread

2012-03-23 Thread Thomas Graves (Created) (JIRA)
: 0.23.2 Reporter: Thomas Graves Priority: Critical The application master launcher has a thread pool that is configured with core size 1, maximum 10. The thread pool will not create over the core size thread unless the queue it is using is full. We are using an unbounded

[jira] [Created] (MAPREDUCE-4062) AM Launcher thread can hang forever

2012-03-23 Thread Thomas Graves (Created) (JIRA)
: 0.23.2 Reporter: Thomas Graves We saw an instance where the RM stopped launch Application masters. We found that the launcher thread was hung because something weird/bad happened to the NM node. Currently there is only 1 launcher thread (jira 4061 to fix that). We need

[jira] [Created] (MAPREDUCE-4041) TestMapredGroupMappingServiceRefresh unit test failures

2012-03-20 Thread Thomas Graves (Created) (JIRA)
Components: mrv2 Affects Versions: 0.23.3 Reporter: Thomas Graves On branch-0.23 the following unit tests fail: org.apache.hadoop.security.TestMapredGroupMappingServiceRefresh.testGroupMappingRefresh

[jira] [Created] (MAPREDUCE-4042) unit test TestControlledMapReduceJob.testControlledMapReduceJob fails

2012-03-20 Thread Thomas Graves (Created) (JIRA)
Issue Type: Bug Components: mrv2 Affects Versions: 0.23.3 Reporter: Thomas Graves unit test TestControlledMapReduceJob.testControlledMapReduceJob fails. This is an ant test: ant test -Dtestcase=TestControlledMapReduceJob error: Timeout occurred. Please note

[jira] [Created] (MAPREDUCE-4024) RM webservices can't query on finalStatus

2012-03-16 Thread Thomas Graves (Created) (JIRA)
Affects Versions: 0.23.2 Reporter: Thomas Graves Assignee: Thomas Graves The resource manager web service api to get the list of apps doesn't have a query parameter for finalStatus. It has one for the state but since that isn't what is reported by app master so we really

[jira] [Resolved] (MAPREDUCE-3984) TestDBJob and TestDataDrivenDBInputFormat timeout

2012-03-12 Thread Thomas Graves (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-3984. -- Resolution: Duplicate dup of MAPREDUCE-3621 TestDBJob

[jira] [Created] (MAPREDUCE-3960) web proxy doesn't forward request to AM with configured hostname/IP

2012-03-02 Thread Thomas Graves (Created) (JIRA)
Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical If the host the web proxy is running on has an ip alias or similar and the config file is pointing to the hostname

[jira] [Created] (MAPREDUCE-3957) yarn daemonlog usage wrong

2012-03-01 Thread Thomas Graves (Created) (JIRA)
Reporter: Thomas Graves Priority: Minor $ yarn daemonlog USAGES: java org.apache.hadoop.log.LogLevel -getlevel host:port name java org.apache.hadoop.log.LogLevel -setlevel host:port name level The usage shouldn't print java org.apache.hadoop.log.LogLevel -- This message

[jira] [Created] (MAPREDUCE-3937) docs need updating on how to start proxyserver

2012-02-28 Thread Thomas Graves (Created) (JIRA)
: mrv2 Affects Versions: 0.23.2 Reporter: Thomas Graves Priority: Minor The docs (http://hadoop.apache.org/common/docs/r0.23.1/hadoop-yarn/hadoop-yarn-site/ClusterSetup.html) on how to start the proxyserver are wrong. It says to use yarn start, which should be use

[jira] [Created] (MAPREDUCE-3917) Use java.net.preferIPv4Stack to force IPv4 in yarn

2012-02-24 Thread Thomas Graves (Created) (JIRA)
Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves HADOOP-6056 made the changes for hadoop cli to use java.net.preferIPv4Stack to force IPv4. We should do the same things for the yarn commands. -- This message is automatically generated by JIRA. If you think it was sent

[jira] [Created] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

2012-02-23 Thread Thomas Graves (Created) (JIRA)
Issue Type: Bug Components: mrv2 Reporter: Thomas Graves Priority: Critical Fix For: 0.23.0 in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job. That no longer works on yarn. yarn has

[jira] [Created] (MAPREDUCE-3908) jobhistory server trying to load job conf file from wrong location

2012-02-23 Thread Thomas Graves (Created) (JIRA)
Issue Type: Bug Components: mrv1 Affects Versions: 0.23.0 Reporter: Thomas Graves I have seen a few instance where I try to click on the job configuration link from the job history server web ui and it gives a 500 message. Looking at the job history server log file

[jira] [Created] (MAPREDUCE-3897) capacity scheduler - maxActiveApplicationsPerUser calculation can be wrong

2012-02-22 Thread Thomas Graves (Created) (JIRA)
/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Priority: Critical The capacity scheduler calculates the maxActiveApplications and the maxActiveApplicationsPerUser based on the config

[jira] [Resolved] (MAPREDUCE-3037) Add a consistent method for getting the job configuration's XML within the AppMaster and the JobHistory

2012-02-17 Thread Thomas Graves (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-3037. -- Resolution: Won't Fix A user can use the webservices REST API introduced

[jira] [Created] (MAPREDUCE-3852) test TestLinuxResourceCalculatorPlugin failing

2012-02-10 Thread Thomas Graves (Created) (JIRA)
: mrv1 Affects Versions: 0.23.2 Reporter: Thomas Graves Priority: Blocker tests are failing: org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin.testParsingProcStatAndCpuFile org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin.testParsingProcMemFile

[jira] [Resolved] (MAPREDUCE-3853) TestLinuxResourceCalculatorPlugin is failing on trunk and 0.23 branch.

2012-02-10 Thread Thomas Graves (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved MAPREDUCE-3853. -- Resolution: Duplicate this is dup of MAPREDUCE-3852

[jira] [Created] (MAPREDUCE-3816) capacity scheduler web ui bar graphs for used capacity wrong

2012-02-06 Thread Thomas Graves (Created) (JIRA)
: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical The capacity scheduler web ui has bar graphs showing the capacity/used capacity/max capacity for each queue. The used capacity

[jira] [Created] (MAPREDUCE-3707) mapreduce/yarn source jars not included in dist tarball

2012-01-21 Thread Thomas Graves (Created) (JIRA)
Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Priority: Critical the mapreduce and yarn sources jars don't get included into the distribution tarball. It seems they get built by default just aren't assembled. -- This message is automatically

[jira] [Created] (MAPREDUCE-3702) internal server error trying access application master via proxy with filter enabled

2012-01-20 Thread Thomas Graves (Created) (JIRA)
Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical I had a hadoop.http.filter.initializers in place to do user authentication

[jira] [Created] (MAPREDUCE-3705) ant build fails on 0.23 branch

2012-01-20 Thread Thomas Graves (Created) (JIRA)
Reporter: Thomas Graves Assignee: Thomas Graves Priority: Blocker running the ant build in mapreduce on the latest 23 branch fails. Looks like the ivy properties file still has 0.24.0 and then the gridmix dependencies need to have rumen as dependency

[jira] [Created] (MAPREDUCE-3706) HTTP Circular redirect error on the job attempts page

2012-01-20 Thread Thomas Graves (Created) (JIRA)
Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Priority: Critical submitted job and tried to go to following url: http://rmhost.domain.com:8088/proxy/application_1326992308313_0004/mapreduce/attempts/job_1326992308313_4_4/m/NEW This resulted

[jira] [Created] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

2012-01-18 Thread Thomas Graves (Created) (JIRA)
Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Priority: Critical Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total

[jira] [Created] (MAPREDUCE-3689) RM web UI doesn't handle newline in job name

2012-01-18 Thread Thomas Graves (Created) (JIRA)
Affects Versions: 0.23.0 Reporter: Thomas Graves Priority: Blocker a user submitted a mapreduce job with a newline (\n) in the job name. This caused the resource manager web ui to get a javascript exception when loading the application and scheduler pages and the pages

[jira] [Created] (MAPREDUCE-3691) webservices add support to compress response

2012-01-18 Thread Thomas Graves (Created) (JIRA)
Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical The web services currently don't support header 'Accept-Encoding: gzip' Given that the responses have a lot of duplicate data like the property names in JSON

[jira] [Created] (MAPREDUCE-3680) FifoScheduler web service rest API can print out invalid JSON

2012-01-17 Thread Thomas Graves (Created) (JIRA)
: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves running a GET on the scheduler web services rest api (RM:port/ws/cluster/scheduler) with the FifoScheduler configured with no nodemanagers up yet and it prints out invalid json of NaN for the used

  1   2   >