>I replied with the question if your linux installation actually >supports files larger than 4Gb.. if not then that could be a huge problem... cuz >then mysql will have problems with that particular table again.
Right, I used the information in the FAQ and adjusted MySQL as suggested. The error didn't seem to be because of that but then, I don't know for sure. >Then again, if you're limiting the hops to 4 this run as you >mentioned, instead of the default max hop you shouldn't run into this particular >problem again if you're indexing 10.000 sites. I've also broken down the URL's to smaller sizes. I'm doing 500 at a time to see how things go. I'm a little unclear about a few things due to doing it this way but I think I'll learn as I go. Thanks for the input. Mike
