dpol1 commented on code in PR #2318: URL: https://github.com/apache/stormcrawler/pull/2318#discussion_r4553700762
########## archetype/src/main/resources/archetype-resources/README.md: ########## @@ -42,6 +42,7 @@ where _seeds.txt_ is a file containing URLs to inject, with one URL per line. You can now submit the flux topology using the storm command: ``` sh +export STORM_JAR_JVM_OPTS="-Djdk.xml.maxGeneralEntitySizeLimit=0 -Djdk.xml.totalEntitySizeLimit=0" Review Comment: Good point, the three archetype READMEs now say why: sitemaps and feeds with many entity references hit the JDK XML parser limits, and `storm local` doesn't pick up the worker childopts from crawler-conf.yaml. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
