Yes, Herriot can be used for integration tests of MR. Unit test is a very different thing and normally is done against a 'unit of compilation' e.g. a class, etc. Typically you won't expect to do unit tests against a deployed cluster.
There is fault injection framework wich works at the level of functional tests
(with mini-clusters). Shortly we'll be opening an initial version of smoke and
integration test framework (maven and JUnit based).
It'd be easier to provide you with a hint if you care to explain what you're
trying to solve.
Cos
On Thu, Feb 03, 2011 at 10:25AM, Edson Ramiro wrote:
> Thank you a lot Konstantin, you cleared my mind.
>
> So, Herriot is a framework designed to test Hadoop as a whole, and (IMHO) is
> a tool for help Hadoop developers and not for who is developing MR programs,
> but can we use Herriot to do unit, integration or other tests on our MR
> jobs?
>
> Do you know another test tool or test framework for Hadoop?
>
> Thanks in Advance
>
> --
> Edson Ramiro Lucas Filho
> {skype, twitter, gtalk}: erlfilho
> http://www.inf.ufpr.br/erlf07/
>
>
> On Wed, Feb 2, 2011 at 4:58 PM, Konstantin Boudnik <c...@apache.org> wrote:
>
> > (Moving to common-user where this belongs)
> >
> > Herriot is system test framework which runs against a real physical
> > cluster deployed with a specially crafted build of Hadoop. That
> > instrumented build of provides an extra APIs not available in Hadoop
> > otherwise. These APIs are created to facilitate cluster software
> > testability. Herriot isn't limited by MR but also covered (although in
> > a somewhat lesser extend) HDFS side of Hadoop.
> >
> > MRunit is for MR job "unit" testing as in making sure that your MR job
> > is ok and/or to allow you to debug it locally before scale deployment.
> >
> > So, long story short - they are very different ;) Herriot can do
> > intricate fault injection and can work closely with a deployed cluster
> > (say control Hadoop nodes and daemons); MRUnit is focused on MR jobs
> > testing.
> >
> > Hope it helps.
> > --
> > Take care,
> > Konstantin (Cos) Boudnik
> >
> >
> > On Wed, Feb 2, 2011 at 05:44, Edson Ramiro <erlfi...@gmail.com> wrote:
> > > Hi all,
> > >
> > > Plz, could you explain me the difference between MRUnit and Herriot?
> > >
> > > I've read the documentation of both and they seem very similar to me.
> > >
> > > Is Herriot an evolution of MRUnit?
> > >
> > > What can Herriot do that MRUnit can't?
> > >
> > > Thanks in Advance
> > >
> > > --
> > > Edson Ramiro Lucas Filho
> > > {skype, twitter, gtalk}: erlfilho
> > > http://www.inf.ufpr.br/erlf07/
> > >
> >
signature.asc
Description: Digital signature
