sebastian-nagel commented on pull request #700: URL: https://github.com/apache/nutch/pull/700#issuecomment-979330868
Hi @lewismc, in addition to running local tests on just a few documents - a comparison of Tika parse results for an equivalent upgrade (/Digitalpebble/storm-crawler#920) showed that any custom extractors need to review metadata names. But the consolidation of Tika metadata names/keys is for sure an improvement for the long term. - just upgraded the [Common Crawl Nutch fork](/commoncrawl/nutch) and now running a crawl (several 100 million pages) with parse-tika enabled. I'll look for suspicious exceptions in the log files and will report tomorrow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@nutch.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
