i created 100 fetchlists from a 50million url db and when i try an run fetch i'm getting a few fetches done and then tons of errors on url normalizer - anyone else seeing this?
050414 014446 fetching http://www.theastonline.com/ 050414 014446 fetching http://authoryellowpages.com/featureslist.asp 050414 014446 fetching http://www.bygonebyways.com/washington_101.htm 050414 014446 fetching http://www.simcoemediagroup.com/folder_1/templates/slideshow.html 050414 014446 fetching http://www.werathah.com/recom.htm 050414 014446 fetching http://www.mammothmountain.com/privacy/ 050414 014446 fetching http://www.staedte-verlag.de/html/stadtplan/l/lugau/index.htm 050414 014446 fetching http://www.manhattanassociates.com/industries/index.html 050414 014446 fetching http://www.bend.com/news/ar_view%5E3Far_id%5E3D20895.htm 050414 014447 fetch of http://www.g50mc.org/ failed with: org.apache.nutch.protocol.http.HttpError: HTTP Error: 403 050414 014447 fetching http://design.realestateabc.org/sharon7775/www/homebuying/ 050414 014447 fetch of http://www.bygonebyways.com/washington_101.htm failed with: org.apache.nutch.protocol.http.HttpError: HTTP Error: 404 050414 014447 fetching http://online.itp.ucsb.edu/online/infobio01/lancet1/oh/48.html 050414 014447 fetching http://www.trogloton.com/86_cj7e5.html 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://www.rcls.org/rclshq/radio/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 fetching http://www.phasetophase.nl/left.html 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://www.sfroundup.com/elysian/contract.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://online.itp.ucsb.edu/online/infobio01/lancet1/oh/48.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://www.easiestwayguitar.com/mini_course.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://www.staedte-verlag.de/html/stadtplan/l/lugau/index.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetch of http://www.wetcanvas.com/web/sites/8981/hrafninn/page09.html/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetching http://www.eapteka.ru/docs/ 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetching http://www.miamivalleytrails.org/search.htm 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014447 fetching http://chefmoz.org/United_States/DC/Washington/ 050414 014447 fetching http://www.hoteturbeachparadise.com/transport.asp 050414 014447 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.alphaomegadigital.com/_terms/privacy_policy.asp 050414 014448 fetch of http://eo.wikipedia.org/wiki/Psikanalizo failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.getacane.com/faqs.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://chefmoz.org/United_States/TX/La_Grange/Cottonwood_Cafe995597682.html 050414 014448 fetch of http://www.austinschools.org/crockett/Student%20Life/studlifehome.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.royalpontiac.com/hours.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.stasiarealtor.com/property.cfm 050414 014448 fetching http://www.coachlink.biz/about_us/help.php 050414 014448 fetching http://chefmoz.org/United_States/TX/Laredo/Chili%27s_Grill_and_Bar1005542310.html 050414 014448 fetch of http://chefmoz.org/United_States/UT/Logan/Arbys_Roast_Beef_Sandwiches983059712.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.hakikatkitabevi.com/download/download.htm 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.adaptoutdoors.com/catalog/index.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.infiltration.org/resources-infilnews02.html 050414 014448 fetch of http://authoryellowpages.com/featureslist.asp failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.loc.gov/ead/ag/aghome.html 050414 014448 fetch of http://www.manhattanassociates.com/industries/index.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.eduplace.com/rdg/author/say/bio.html 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://marketingfind.com/RealMedia/ads/click_lx.ads/marketingfind.com/allBlogs.html/293179092/Right1/bronto-contentsky-mf/content_sky.html/33666636396132303432353331383330 failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.werathah.com/recom.htm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://newportmansions.org/page7082.cfm failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.free-web-counters-online.com/cologne/cool_water_cologne.asp failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching https://secure.thorite.co.uk 050414 014448 fetch of https://secure.thorite.co.uk failed with: java.lang.NullPointerException 050414 014448 fetching http://www.luqiao.net/ 050414 014448 fetch of http://www.locusmag.com/index/s629.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.sierra.com/demos/preview/0,1690,2119,00.html 050414 014448 fetch of http://www.springfling.net/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.noendexport.com/Blow.htm 050414 014448 fetching http://www.turbolinux.co.jp/support/faq.html 050414 014448 fetching http://www.thetumblingt.com/events.htm 050414 014448 fetching http://www2k.biglobe.ne.jp/~barshu/ring/ering.cgi 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://buzz.yahoo.com/sports/basketball/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://biddn.com/ 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.mammothmountain.com/privacy/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.celticmanor.co.za/cape-town-medical-treatments.html 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://design.realestateabc.org/sharon7775/www/homebuying/ failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.ezines4all.com/at200405/index.htm 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.shibuyacity.tv/weddingcafe/setumei/index.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.frogsonice.com/froggy/songs.shtml 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://gravyboy.com/brian/october2003.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.webwriting-magazin.de/ 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://www.brasilianfutebol.com/soccerskillsL14.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer 050414 014448 fetching http://www.greymatter.com/hardcopy 050414 014448 Using URL normalizer: net.nutch.net.BasicUrlNormalizer 050414 014448 fetch of http://wape951.com/common/sponsored_links/software.html failed with: java.lang.RuntimeException: Couldn't create net.nutch.net.BasicUrlNormalizer __________________________________ Yahoo! Mail Mobile Take Yahoo! Mail with you! Check email on your mobile phone. http://mobile.yahoo.com/learn/mail __________________________________ Do you Yahoo!? Yahoo! Small Business - Try our new resources site! http://smallbusiness.yahoo.com/resources/ ------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
