Lucas.. was there a reason you went with 5.1.10 or was it just the latest
when you started your Solr project?
just what was recent when i set things up.
Also, how many items are in your index and how big is your index size?
index size is 4.6GB with about 16M entities.
I downgraded to 5.0.8 for testing. Initially, I thought it was going to
be faster, but it slows down as it gets further into the index. It now
looks like it's probably going to take the same amount of time.
On the server timeout thing - that's a setting you'd have to put in
my.ini or my.cfg, there may also be a way to change it on the fly
without restarting the server. I suspect that when you are running a
multiple query setup like yours, it opens multiple connections, and when
one of them is busy doing some work, the others are idle. That may be
related to the timeout with the older connector version. On my setup, I
only have one query that retrieves records, so I'm probably not going to
run into that. I could be wrong about how it works - you can confirm or
refute this idea by looking at SHOW PROCESSLIST on your MySQL server
while it's working.
Each of my shards is reported by the replication handler at a little
over 12GB. This is with 7 million entities.
Shawn
