[jira] [Comment Edited] (NUTCH-2703) parse-tika: Boilerpipe should not run for non-(X)HTML pages
[ https://issues.apache.org/jira/browse/NUTCH-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798827#comment-16798827 ] Hany Shehata edited comment on NUTCH-2703 at 3/22/19 8:43 AM: -- Hello [~markus17], I am new in Nutch/Linux world, appreciate your help guiding me how to install this patch. Update: --- I read about patching in Unix and Nutch contribution page as well; I've few question # Is patching just for source tree or it can be applied directly to binary downloadable folder? # Should I build Nutch after patching? was (Author: hanyshehata): Hello [~markus17], I am new in Nutch/Linux world, appreciate your help guiding me how to install this patch. > parse-tika: Boilerpipe should not run for non-(X)HTML pages > --- > > Key: NUTCH-2703 > URL: https://issues.apache.org/jira/browse/NUTCH-2703 > Project: Nutch > Issue Type: Bug > Components: parser, plugin >Affects Versions: 1.15 >Reporter: Hany Shehata >Priority: Critical > Fix For: 1.16 > > Attachments: NUTCH-2703.patch > > > Boilerpipe is running for non-(X)html pages which is require more resources. > In my testing scenario, I've large PDFs in my websites and by enabling > Boilerpipe I have to assign 8500MB for JAVA Heap to finish the crawl job > without issues. > Disabling Boilerpipe allow me to minimize the JVM Heap to 500MB with no > issues. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (NUTCH-2703) parse-tika: Boilerpipe should not run for non-(X)HTML pages
[ https://issues.apache.org/jira/browse/NUTCH-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798827#comment-16798827 ] Hany Shehata edited comment on NUTCH-2703 at 3/22/19 8:43 AM: -- Hello [~markus17], I am new in Nutch/Linux world, appreciate your help guiding me how to install this patch. Update: --- I read about patching in Unix and Nutch contribution page as well; I've few question # Is patching just for source tree or it can be applied directly to binary downloadable folder? # Should I build Nutch after patching? was (Author: hanyshehata): Hello [~markus17], I am new in Nutch/Linux world, appreciate your help guiding me how to install this patch. Update: --- I read about patching in Unix and Nutch contribution page as well; I've few question # Is patching just for source tree or it can be applied directly to binary downloadable folder? # Should I build Nutch after patching? > parse-tika: Boilerpipe should not run for non-(X)HTML pages > --- > > Key: NUTCH-2703 > URL: https://issues.apache.org/jira/browse/NUTCH-2703 > Project: Nutch > Issue Type: Bug > Components: parser, plugin >Affects Versions: 1.15 >Reporter: Hany Shehata >Priority: Critical > Fix For: 1.16 > > Attachments: NUTCH-2703.patch > > > Boilerpipe is running for non-(X)html pages which is require more resources. > In my testing scenario, I've large PDFs in my websites and by enabling > Boilerpipe I have to assign 8500MB for JAVA Heap to finish the crawl job > without issues. > Disabling Boilerpipe allow me to minimize the JVM Heap to 500MB with no > issues. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
