[ http://issues.apache.org/jira/browse/NUTCH-116?page=all ]
Paul Baclace updated NUTCH-116:
-------------------------------
Attachment: required_by_TestNDFS_v3.patch
I found and fixed a problem with a standalone DataNode process exiting too
early (this was not detected by the current unit tests); this was because of
changes in the required_by_TestNDFS patch; main() will now join() all the
subthreads via runAndWait(NutchConf) and run(NutchConf) can be used to start
subthreads and without waiting for them to finish. The v3 patch has the
cumulative required_by_TestNDFS changes.
(comments_msgs_and_local_renames_during_TestNDFS.patch are still separate.)
> TestNDFS a JUnit test specifically for NDFS
> -------------------------------------------
>
> Key: NUTCH-116
> URL: http://issues.apache.org/jira/browse/NUTCH-116
> Project: Nutch
> Type: Test
> Components: fetcher, indexer, searcher
> Versions: 0.8-dev
> Reporter: Paul Baclace
> Attachments: TestNDFS.java, TestNDFS.java, required_by_TestNDFS.patch,
> required_by_TestNDFS_v2.patch, required_by_TestNDFS_v3.patch
>
> TestNDFS is a JUnit test for NDFS using "pseudo multiprocessing" (or more
> strictly, pseudo distributed) meaning all daemons run in one process and
> sockets are used to communicate between daemons.
> The test permutes various block sizes, number of files, file sizes, and
> number of datanodes. After creating 1 or more files and filling them with
> random data, one datanode is shutdown, and then the files are verfified.
> Next, all the random test files are deleted and we test for leakage
> (non-deletion) by directly checking the real directories corresponding to the
> datanodes still running.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
