Sorry, but I have to turn my +1 into a -1.
There's a regression introduced recently which makes the Fetcher
always run with a single reduce task, even in distributed mode,
if more reducers have been configured. See
https://issues.apache.org/jira/browse/NUTCH-3201
This regression is a blocker - I'll withdraw the current release
candidate RC#1 and prepare a new one during the next days.
The regression was even visible in the logs while testing,
but I didn't grab it:
.../apache-nutch-1.23/runtime/deploy/bin/nutch fetch \
-Dmapreduce.job.reduces=2 -Dmapreduce.reduce.speculative=false \
-Dmapreduce.map.speculative=false -Dmapreduce.map.output.compress=true \
-D fetcher.timelimit.mins=2 crawl/segments/20260730193011 -threads 5
Job Counters
Launched map tasks=2
Launched reduce tasks=1
Best,
Sebastian
On 8/3/26 04:55, Lewis John McGibbney wrote:
Hi Seb,
Thanks for preparing the 1.23 RC. Excellent job.
Here's my +1.
- Rat checks pass
- sigs pass local checks
- Jenkins CI passes
(https://ci-builds.apache.org/job/Nutch/job/Nutch-Smoke-Test-Single-Node-Hadoop-Cluster/55/)
- local single node hadoop some tests pass indexing using Solr 8.X backend
Other note: during reviewing this RC I decided to log
https://issues.apache.org/jira/browse/NUTCH-3194 which has the added benefit of
being used/triggered whenever we create a tag. I will likely implement this
post release.
Thank you
lewismc
On 2026/07/30 19:49:56 Sebastian Nagel wrote:
Hi everybody,
A candidate for the Nutch 1.23 release is available at:
https://dist.apache.org/repos/dist/dev/nutch/1.23/
The release candidate is a zip and tar.gz archive of the binary and sources,
built from:
https://github.com/apache/nutch/tree/release-1.23
In addition, a staged maven repository is available here:
https://repository.apache.org/content/repositories/orgapachenutch-1028
We addressed 39 issues:
https://s.apache.org/c4qjb
Please vote on releasing this package as Apache Nutch 1.23.
The vote is open for the next 72 hours and passes if a majority
of at least three +1 Nutch PMC votes are cast.
[ ] +1 Release this package as Apache Nutch 1.23.
[ ] -1 Do not release this package because...
Cheers,
Sebastian
(On behalf of the Nutch PMC)
P.S.
Here is my +1.
- Tested most of Nutch tools and run a test crawl on a single-node cluster
running Hadoop 3.5.0, see
https://github.com/sebastian-nagel/nutch-test-single-node-cluster/
- Building from source package succeeds
- Crawling in local mode using the binary package succeeded
- Indexing crawled content into Solr 8.11.4
- Built and run a Nutch Docker container (using the release branch)
- Verified Javadocs
