Thank you for your reply. I have a few more questions:
- Is there any workaround that I can use for now for what I want to do
(multiple crawls
and then combine the data for search).
- If I were to back down to 0.7, would the data from 0.8 crawls be
compatible with 0.7
(I use DFS)?
Thank you so much for your help!
From: Andrzej Bialecki <[EMAIL PROTECTED]>
Reply-To: [email protected]
To: [email protected]
Subject: Re: thanks, but what I wanted to do is to merge segments from
multiple crawls
Date: Mon, 03 Apr 2006 21:18:51 +0200
MIME-Version: 1.0
Received: from mail.apache.org ([209.237.227.199]) by
bay0-mc2-f10.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 3
Apr 2006 12:19:32 -0700
Received: (qmail 22912 invoked by uid 500); 3 Apr 2006 19:19:31 -0000
Received: (qmail 22901 invoked by uid 99); 3 Apr 2006 19:19:31 -0000
Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by
apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Apr 2006 12:19:31 -0700
Received: pass (asf.osuosl.org: local policy)
Received: from [69.44.16.11] (HELO getopt.org) (69.44.16.11) by
apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Apr 2006 12:19:30 -0700
Received: from [192.168.0.253] (75-mo3-2.acn.waw.pl
[62.121.105.75])(authenticated)by getopt.org (8.11.6/8.11.6) with ESMTP id
k33JJMW14395for <[email protected]>; Mon, 3 Apr 2006 14:19:22
-0500
X-Message-Info: JGTYoYF78jEHjJx36Oi8+Z3TmmkSEdPtfpLB7P/ybN8=
Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm
Precedence: bulk
List-Help: <mailto:[EMAIL PROTECTED]>
List-Unsubscribe: <mailto:[EMAIL PROTECTED]>
List-Post: <mailto:[email protected]>
List-Id: <nutch-user.lucene.apache.org>
Delivered-To: mailing list [email protected]
X-ASF-Spam-Status: No, hits=0.0 required=10.0tests=
X-Spam-Check-By: apache.org
User-Agent: Thunderbird 1.5 (Windows/20051201)
References: <[EMAIL PROTECTED]>
X-Virus-Checked: Checked by ClamAV on apache.org
Return-Path:
[EMAIL PROTECTED]
X-OriginalArrivalTime: 03 Apr 2006 19:19:32.0336 (UTC)
FILETIME=[89423F00:01C65753]
Olive g wrote:
For example, I want to crawl 20,000 pages everyday for 10 days and then
merge
the data for search. So far, I can't get it to work.
Any advices? Could someone let me know whether I can do this on 0.8 at
all?
Not yet. This functionality hasn't been ported yet from 0.7. It's on my
TODO list, but with a low priority.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today - it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
