[
https://issues.apache.org/jira/browse/PIG-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13013692#comment-13013692
]
Alan Gates commented on PIG-1899:
---------------------------------
bq. (1) There are several scripts that are placed directly under pig/tools. I
wonder if we have a test subdirectory under this
I've created two directories under tools, one 'test' for tools used by tests
and the other 'generate' for data generation tools.
On (2), (3), and (4), I agree these need addressed, but rather than hold the
initial patch for them I'd like to file separate JIRAs. They should be gating
issues on using this for nightly tests.
bq. pig/udfs/java/build.xml - not sure exactly what this is for but location is
kind of strange and it also refers to HowlDriver.
It's the build file for the UDFs. I removed the reference to Howl.
I removed the yahoo reference.
> Pig needs a tool for doing end to end testing efficiently
> ---------------------------------------------------------
>
> Key: PIG-1899
> URL: https://issues.apache.org/jira/browse/PIG-1899
> Project: Pig
> Issue Type: Test
> Components: tools
> Reporter: Alan Gates
> Assignee: Alan Gates
> Attachments: PIG-1899.patch, PIG-1899.patch, e2e.patch
>
>
> Pig currently uses junit for all testing. junit is good for unit tests, but
> limited for end to end and integration testing.
> Building an end to end test in junit is cumbersome (a lot of setup and such
> to do using MiniCluster). Given that expected results must be known
> beforehand and hand crafted they must be kept very small, usually ten or less
> rows. This does not lead to realistic testing scenarios.
> A test tool is needed that allows the test developer to write a Pig Latin
> script and specify a source of truth against which to test the results of
> running this Pig Latin script. A database or a previous version of Pig can
> then be used as that source of truth. This will allow developers to quickly
> add new tests that return more than trivial results.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
