[
https://issues.apache.org/jira/browse/CRUNCH-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Friedrich updated CRUNCH-24:
-------------------------------------
Attachment: CRUNCH-24-Cumulative-1.patch
The crunch module is now clean (see patch CRUNCH-24-Cumulative-1.patch) except
for WordCountHBaseIT which still creates an empty directory tree below
/tmp/hadoop-${USER} that I couldn't get rid of. This isn't serious though
because it's always the same name so files won't accumulate.
Next thing is scrunch. I don't know Scala so I'm not the best person to do
this. It shouldn't be as much as for crunch, all you have to do is track down
calls to Files.createTempDir() and FileHelper.createOutputPath(). There are
calls to deleteOnExit() but that never works for directories. Redirecting
"hadoop.tmp.dir" is necessary, too, I guess.
Thanks a lot for your help guys!
> Make test suite suitable for continuous integration
> ---------------------------------------------------
>
> Key: CRUNCH-24
> URL: https://issues.apache.org/jira/browse/CRUNCH-24
> Project: Crunch
> Issue Type: Task
> Affects Versions: 0.3.0
> Reporter: Matthias Friedrich
> Assignee: Matthias Friedrich
> Fix For: 0.3.0
>
> Attachments: 0001-CRUNCH-24-Clean-up-test-suite-output.patch,
> 0001-CRUNCH-24-Distributed-cache.patch,
> 0001-CRUNCH-24-make-testsuite-sutable-for-CI.patch,
> 0001-CRUNCH-24-make-testsuite-sutable-for-CI.patch,
> CRUNCH-24-Cumulative-1.patch, CRUNCH-24-gabriel.patch, CRUNCH-24-josh.patch
>
>
> Right now the integration test suite leaves about 80 files behind on /tmp
> making it unsuitable for a shared continuous integration environment.
> Examples for these files are test case output ("output*") and Crunch's own
> temporary files ("crunch*", see CRUNCH-21).
> We have to delete these files or make sure they aren't created on /tmp in the
> first place.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
