All,

During my — not finished yet — struggle with the "using" clause for the order operator, I found out that the tests for the order clause where only run in MapReduce mode, not in local mode. I proposed a patch to fix this test, but Pi rightly suggest that we look for a more global approach to run the tests systematically in both modes. Indeed, I think I have read somewhere that the new (and very exciting) "illustrate" operator is only tested and only work in local mode — for now.

We could have an abstract test class responsible for PigContext setup and teardown (local mode or MiniCluster based). All (or most of) the unit tests would inherit from it. The ant script could run the test suite twice passing some property to the abstract class to define which PigContext version should be used. Some tests may still want to "skip" one of the two modes, but at least running test in two modes would become the default and natural behavior.

What do you think ?

--
Mathieu Poumeyrol — IDM

Reply via email to