Hi Jos! On Wed, Aug 8, 2012 at 1:17 PM, Jos Backus <j...@catnook.com> wrote: >> To the best of my knowledge that code in the trunk/branch-2 hasn't been >> maintained for quite some time. It seems to compile, but I can't make it >> work even with a patched version of wrapper scripts. Is your experience >> with that code different? Can you provide more details on what exact >> branch you're using and how exactly you're using TT/JT from there? >> > > Well, I am using the CDH4 RPMs, being under the impression that the changes > from the open source version are minimal. Are you saying that basically > MRv1 is deprecated/unsupported at this point as far as the Apache folks are > concerned? In that case, I should take the issue up with Cloudera if/once > we have a support contract :)
Different folks mean different things when they mention MRv1. For CDH4, MRv1 means the implementation of the 0.20.2+ mapreduce functionality made available to work on top of HDFS from the 2.0.0 Hadoop code line. Take a look at this archive: http://archive.cloudera.com/cdh4/cdh/4/mr1-latest.tar.gz (and especially the cloudera/patches folder) if you want to see how it is implemented. This work, is, of course, completely different from what some folks refer to as an upstream MRv1 codebase. To the best of my knowledge, the code available upstream under hadoop-mapreduce-project/src/java/org/apache/hadoop/mapreduce is no longer maintained maintained and may have bitrotted. It is certainly true, that, for example, the scripts for launching the TT/JT are gone, although it seems theoretically possible to run these daemons. So, here's my question again: which one are *you* interested in? > That doesn't bother me as it doesn't affect what I am working on :) I care > about someone breaking this interface for no reason. I could understand it > if MRv1 was no longer supported by Apache or Cloudera, but that appears to > not be that case from what I can tell. So in my mind it's just a bug. To the best of my knowledge, at this point Apache Hadoop community does NOT support (or develop) MRv1 functionality in trunk/branch-2. >> I already did, I sent you an email on May 11th :) Right now I'm trying to > get the scripts to work properly with CDH4, which is why I ran into this > problem. Then I checked the Apache repo and saw that it was broken there, > too, hence my email. At any rate, once I have the scripts in working order > I will send an update. Right. I remember that. What I was referring to is that perhaps you could consider posting the code on the JIRA so that it can be eventually included in the Bigtop project. It has to go via JIRA due to Apache rules. Thanks, Roman.
