GitHub user jnioche added a comment to the discussion: Help us test 
StormCrawler 4.0 before the release

Thanks @mvolikas

> Minor. Wrong option -c in the archetype [Solr control 
> script](https://github.com/apache/stormcrawler/blob/main/external/solr/archetype/src/main/resources/archetype-resources/setup-solr.sh#L34).
>  Solr 10.1.0 is out so we can fix this and possible other issues during the 
> dependency update.

The dependency has been upgraded via Dependabot. @mvolikas can you please open 
an issue to describe the problem? And ideally a PR to fix it?

> Some Solr archetype defaults are not appropriate for crawls with many 
> different hosts (e.g. solr.status.bucket.maxsize). 

Something comparable to what is by default with OpenSearch would make sense. 

```
  opensearch.status.max.buckets: 50
  opensearch.status.max.urls.per.bucket: 2
```

https://github.com/apache/stormcrawler/blob/4a262acb90baa5f8bb22eaccaf1cd272f5e7fd3a/external/opensearch/archetype/src/main/resources/archetype-resources/opensearch-conf.yaml#L92-L93

GitHub link: 
https://github.com/apache/stormcrawler/discussions/2268#discussioncomment-19354042

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to