GitMehdi-sys commented on PR #2261: URL: https://github.com/apache/stormcrawler/pull/2261#issuecomment-6397231540
Thanks both for the quick feedback, @rzo1 and @GGraziadei. That makes sense: without measurements I can’t justify changing the defaults that most new users start from, and I agree there’s no single value that fits every setup. I’ve narrowed this PR to documentation only: kept the documentation of the Storm topology settings that affect a crawl reverted the archetype crawler-conf.yaml changes, so the defaults stay as they are dropped the unrelated THIRD-PARTY.txt change filled in the PR description As a follow-up, I’m happy to look at StatusUpdaterBenchmark (#2213) with different parallelism and batch-size combinations, and add the results to the docs as a tuning reference. Does that work for you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
