create a droids-crawler module and move any crawler specific class from core
----------------------------------------------------------------------------

                 Key: DROIDS-55
                 URL: https://issues.apache.org/jira/browse/DROIDS-55
             Project: Droids
          Issue Type: Task
    Affects Versions: 0.01
            Reporter: Mingfai Ma



1. create a new module in svn, move any crawler specific code to the module.
https://svn.apache.org/repos/asf/incubator/droids/trunk/droids-crawler

2. create a JIRA component for crawler

3. define what should be in core and what should be in crawler. 
 - stuff like task, taskmaster, queue will be in core
 - stuff like fetcher/parser maybe in core or crawler
 - stuff like link extractor are crawler specific and should go to 
droids-crawler

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to