[
https://issues.apache.org/jira/browse/OODT-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001506#comment-13001506
]
Brian Foster commented on OODT-150:
-----------------------------------
ya, but what i've got in mind is a little more involved than what crawler1 had
. . . more like an auto-detect system for checksumming . . . just register a
checksummer to a mime-type or whatnot and the crawler would automatically
determine the checksum for the file . . . i need the crawler stuff to be
instant (milliseconds) -- using the workflow manager to do checksumming is
going to slow down the crawler . . . and i had a bunch of checksum stuff in the
crawler2 initially (MD5, PGP, . . .) -- you make me remove them because of you
wanted to keep the dependency tree small . . . i still have them on PEATE if
you want them . . . i also have an example on PEATE which uses the new
ExternAction to perform a checksum.
> ToggleAction addition to crawler
> --------------------------------
>
> Key: OODT-150
> URL: https://issues.apache.org/jira/browse/OODT-150
> Project: OODT
> Issue Type: New Feature
> Components: crawler
> Affects Versions: 0.2
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.3
>
> Attachments: crawler.OODT-150.2011-03-01.patch.txt
>
>
> Allows for cases where there are one of two (or more) actions which needs to
> run. For example: sometimes the same file types have different checksum files
> associated with it, this allows for either case.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira