Charlie Groves wrote:
I'm using a local, single-node hadoop cluster to run pig's tests as I work on it. Is this the preferred way to run the tests? I ask because with this setup it takes several minutes for many of the tests to complete, which is different than the normal quick unit test cycle I'm used to.

I have set mapred.map.max.attempts and mapred.reduce.max.attempts to 1, so if I do break something, it fails after one attempt rather than several. Is there anything else I can tweak in the setup to speed things up?

I didn't check it, but it should be possible also to run the tests in "local" mode - that is, I mean that the "local" mode should also be a part of tests, if it's going to be supported as one of the backends ...


--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com

Reply via email to