GitHub user mvolikas added a comment to the discussion: Help us test StormCrawler 4.0 before the release
Thanks @rzo1! I think the [settings](https://github.com/DigitalPebble/stormcrawler-benchmark/blob/c67cc0e424e75de532a896eb49db0f02129b59ce/benchmark-conf.yaml) for the different backends are not comparable though. We have `opensearch.status.max.buckets: 1000` and `solr.status.bucket.maxsize: 10`. The setting `solr.status.batchUpdateSize: 500` does not have an effect in the non-cloud mode. The level of parallelism used is also different I believe. Should we maybe try to harmonize the settings in the archetype subprojects? GitHub link: https://github.com/apache/stormcrawler/discussions/2268#discussioncomment-19474166 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
