Hi Jun,
I've discovered that if you modify the finally statement at
line 118 of UpdateDatabaseTool to look like the below, then the delete
works.
} finally {
if (fetch != null) {
fetch.close();
}
if (parse != null) {
parse.close();
}
}
Hope this helps,
Skip
-----Original Message-----
From: Jun Cai [mailto:[EMAIL PROTECTED]
Sent: 21 June 2004 15:27
To: [EMAIL PROTECTED]
Subject: Re: Re: [Nutch-dev] exception while crawling
Hello Stefan Groschupf,
Yes, after the exception is thrown, the application
stops. I can manually delete the file that are not
able to be deleted by the application.
Best regards,
======= At 2004-06-21, 15:21:57 you wrote: =======
>Can you figure out if the file is may be still open
by any hanging
>process. This is sometimes a problem under m$
windows.
>Can you manually delete the file? (make a backup
before you try this!)
>
>
>Am 21.06.2004 um 16:15 schrieb Jun Cai:
>
>> Hello Stefan Groschupf,
>>
>> I am running it on Windows XP, using CYGWIN,
>>
>> I think Win XP does have the limitation of max
number
>> of open files.
>>
>> But I run into exception, even if I crawl with
depth=1
>> for one web site.
>>
>> Best regards,
>>
>> ======= At 2004-06-21, 14:48:04 you wrote: =======
>>
>>> Linux?
>>> Windows?
>>> Does the user witch run the nutch processes have
the
>> rights to delete
>>> the files?
>>> How many files the system has still open?
>>> "sudo lsof"
>>>
>>>
>>> Stefan
>>>
>>> Am 21.06.2004 um 15:26 schrieb Jun Cai:
>>>
>>>> Hello ,
>>>>
>>>> I got the following exception while I am runing
the
>>>> simple crawl from tutorial. Can any guru
>>>> help me to find the reason?
>>>>
>>>> ...
>>>> ...
>>>> 040621 142201 Processing linksByMD5: Merged to
new
>> DB
>>>> containing 3083 records in
>>>> 0.04 seconds
>>>> 040621 142201 Processing linksByMD5: Merged
77075.0
>>>> records/second
>>>> 040621 142201 Update finished
>>>> Exception in thread "main" java.io.IOException:
>> Could
>>>> not delete crawl.test\segm
>>>> ents\20040621141936\parse_data\data
>>>> at
>>>>
>>
net.nutch.util.FileUtil.fullyDelete(FileUtil.java:22)
>>>> at
>>>>
>>
net.nutch.util.FileUtil.fullyDelete(FileUtil.java:25)
>>>> at
>>>>
>>
net.nutch.util.FileUtil.fullyDelete(FileUtil.java:25)
>>>> at
>>>>
net.nutch.tools.CrawlTool.main(CrawlTool.java:109)
>>>>
>>>> best regards
>>>>
>>>> Jun
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> __________________________________
>>>> Do you Yahoo!?
>>>> Yahoo! Mail - You care about security. So do we.
>>>> http://promotions.yahoo.com/new_mail
>>>>
>>>>
>>>>
>>
-------------------------------------------------------
>>>> This SF.Net email is sponsored by The 2004
>> JavaOne(SM) Conference
>>>> Learn from the experts at JavaOne(SM), Sun's
>> Worldwide Java Developer
>>>> Conference, June 28 - July 1 at the Moscone
Center
>> in San Francisco, CA
>>>> REGISTER AND SAVE! http://java.sun.com/javaone/sf
>> Priority Code
>>>> NWMGYKND
>>>> _______________________________________________
>>>> Nutch-developers mailing list
>>>> [EMAIL PROTECTED]
>>>>
>>
https://lists.sourceforge.net/lists/listinfo/nutch-developers
>>>>
>>>>
>>>
---------------------------------------------------------------
>>> enterprise information technology consulting
>>> open technology: http://www.media-style.com
>>> open source: http://www.weta-group.net
>>> open discussion: http://www.text-mining.org
>>>
>>>
>>>
>>>
-------------------------------------------------------
>>> This SF.Net email is sponsored by The 2004
>> JavaOne(SM) Conference
>>> Learn from the experts at JavaOne(SM), Sun's
>> Worldwide Java Developer
>>> Conference, June 28 - July 1 at the Moscone Center
in
>> San Francisco, CA
>>> REGISTER AND SAVE! http://java.sun.com/javaone/sf
>> Priority Code NWMGYKND
>>> _______________________________________________
>>> Nutch-developers mailing list
>>> [EMAIL PROTECTED]
>>>
https://lists.sourceforge.net/lists/listinfo/nutch-developers
>>>
>>> .
>>
>> = = = = = = = = = = = = = = = = = = = =
>>
>> Jun Cai
>> [EMAIL PROTECTED]
>> 2004-06-21
>>
>>
>>
>>
>>
>>
>> __________________________________
>> Do you Yahoo!?
>> Yahoo! Mail - You care about security. So do we.
>> http://promotions.yahoo.com/new_mail
>>
>>
>>
-------------------------------------------------------
>> This SF.Net email is sponsored by The 2004
JavaOne(SM) Conference
>> Learn from the experts at JavaOne(SM), Sun's
Worldwide Java Developer
>> Conference, June 28 - July 1 at the Moscone Center
in San Francisco, CA
>> REGISTER AND SAVE! http://java.sun.com/javaone/sf
Priority Code
>> NWMGYKND
>> _______________________________________________
>> Nutch-developers mailing list
>> [EMAIL PROTECTED]
>>
https://lists.sourceforge.net/lists/listinfo/nutch-developers
>>
>>
>---------------------------------------------------------------
>enterprise information technology consulting
>open technology: http://www.media-style.com
>open source: http://www.weta-group.net
>open discussion: http://www.text-mining.org
>
>
>
>-------------------------------------------------------
>This SF.Net email is sponsored by The 2004
JavaOne(SM) Conference
>Learn from the experts at JavaOne(SM), Sun's
Worldwide Java Developer
>Conference, June 28 - July 1 at the Moscone Center in
San Francisco, CA
>REGISTER AND SAVE! http://java.sun.com/javaone/sf
Priority Code NWMGYKND
>_______________________________________________
>Nutch-developers mailing list
>[EMAIL PROTECTED]
>https://lists.sourceforge.net/lists/listinfo/nutch-developers
>
>.
= = = = = = = = = = = = = = = = = = = =
Jun Cai
[EMAIL PROTECTED]
2004-06-21
__________________________________
Do you Yahoo!?
Yahoo! Mail is new and improved - Check it out!
http://promotions.yahoo.com/new_mail
-------------------------------------------------------
This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference
Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer
Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA
REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
This e-mail is only intended for the person(s) to whom it is addressed and
may contain confidential information. Aspect Group does not accept
responsibility for any loss or damage caused by this email or any
attachments. Unless clearly stated to the contrary, any opinions or comments
are personal to the writer and are not made on behalf of Aspect Group. If
you have received this e-mail in error, please notify us immediately at
[EMAIL PROTECTED] and then delete this message from your system. Please
do not copy it or use it for any purposes, or disclose its contents to any
other person. Thank you for your co-operation.
Aspect Group is the business name of Aspect Internet Holdings Limited,
Aspect Technologies Limited and Nettec Solutions Limited.
-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 -
digital self defense, top technical experts, no vendor pitches,
unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
