+1 Peter.
I also reccommend investigating and identifying bottlenecks first; this
will benefit other users as well.
Also, if there is any chance the bottleneck is in River, I would be
very, very interested in constructing a benchmark based on your workload
that demonstrates the scaling problem. I would like to run it against
the latest unreleased version, which I think may fix some scaling
issues. If it still shows scaling problems, I want to track them down
and see whether they are fixable without clustering.
My most recent professional background, before retiring, was as a
performance architect working on multiprocessor servers for Cray
Research and Sun Microsystems. When I first got involved in River I was
thinking of doing some performance analysis and improvement, one of my
favorite games, but could not find a suitable benchmark, or an actual
user with a scaling problem.
Patricia