Re: Sphinx index files rotation (and corrupted?)
Hello, well, I'd definitely check the sphinx docs what they say about large installations. Symlinks are just fine, and I even suggest a dedicated sphinx host, giving it enough CPU, memory and fast disk. Janos Original Message From: apfc...@gmail.com Sent: Tue Oct 25 23:54:52 GMT+02:00 2016 To: Piler User Subject: Re: Sphinx index files rotation (and corrupted?) Hi Janos, Ah, didn't know default only went up to 4 only. I did briefly go through sphinx.conf and saw there was no main5, but didn't want to try manually creating it. Anyways, I stopped searchd, ran "indexer main5", started searchd and GUI is returning results again. (indexer.main.sh and config-site.php were already modified for main5) BTW, what do you recommend for these index files as the archive grows into terabytes? It'll be okay to have mainxx.* or even mainxxx.*? If we need to move these files, using symbolic links won't be a problem? Thank you very much for the help! On Tue, Oct 25, 2016 at 2:59 PM, Janos SUTO wrote: > Hello, > > On 2016-10-25 21:03, apfc...@gmail.com wrote: > >> >> I've been rotating the main sphinx index (per >> http://www.mailpiler.org/wiki/current:administering-piler) and am now >> up to main5, but I don't see the main5.* created at >> /var/piler/sphinx/. It's been almost 24 hours since I made the change >> and restarted searchd and piler. >> > > the default install creates main1,2,3 and 4 'only'. I assume you have > created main5 index in sphinx.conf. Then you ran indexer main5 which > created main5.* files in /var/piler/sphinx. You also fixed indexer.main.sh > to use main5 instead of main4. And finally you edited config-site.php > and added main5 to the index list in SPHINX_MAIN_INDEX. > > Please confirm you did exactly the steps above. > > I tried searching via the gui just now and no results are being >> returned, not even from weeks ago when I exported/downloaded emails >> successfully. >> >> Should I re-create the sphinx data? >> > > not yet, see the procedure above. > > Janos > >
Re: Sphinx index files rotation (and corrupted?)
Hi Janos, Ah, didn't know default only went up to 4 only. I did briefly go through sphinx.conf and saw there was no main5, but didn't want to try manually creating it. Anyways, I stopped searchd, ran "indexer main5", started searchd and GUI is returning results again. (indexer.main.sh and config-site.php were already modified for main5) BTW, what do you recommend for these index files as the archive grows into terabytes? It'll be okay to have mainxx.* or even mainxxx.*? If we need to move these files, using symbolic links won't be a problem? Thank you very much for the help! On Tue, Oct 25, 2016 at 2:59 PM, Janos SUTO wrote: > Hello, > > On 2016-10-25 21:03, apfc...@gmail.com wrote: > >> >> I've been rotating the main sphinx index (per >> http://www.mailpiler.org/wiki/current:administering-piler) and am now >> up to main5, but I don't see the main5.* created at >> /var/piler/sphinx/. It's been almost 24 hours since I made the change >> and restarted searchd and piler. >> > > the default install creates main1,2,3 and 4 'only'. I assume you have > created main5 index in sphinx.conf. Then you ran indexer main5 which > created main5.* files in /var/piler/sphinx. You also fixed indexer.main.sh > to use main5 instead of main4. And finally you edited config-site.php > and added main5 to the index list in SPHINX_MAIN_INDEX. > > Please confirm you did exactly the steps above. > > I tried searching via the gui just now and no results are being >> returned, not even from weeks ago when I exported/downloaded emails >> successfully. >> >> Should I re-create the sphinx data? >> > > not yet, see the procedure above. > > Janos > >
Re: Sphinx index files rotation (and corrupted?)
Hello, On 2016-10-25 21:03, apfc...@gmail.com wrote: I've been rotating the main sphinx index (per http://www.mailpiler.org/wiki/current:administering-piler) and am now up to main5, but I don't see the main5.* created at /var/piler/sphinx/. It's been almost 24 hours since I made the change and restarted searchd and piler. the default install creates main1,2,3 and 4 'only'. I assume you have created main5 index in sphinx.conf. Then you ran indexer main5 which created main5.* files in /var/piler/sphinx. You also fixed indexer.main.sh to use main5 instead of main4. And finally you edited config-site.php and added main5 to the index list in SPHINX_MAIN_INDEX. Please confirm you did exactly the steps above. I tried searching via the gui just now and no results are being returned, not even from weeks ago when I exported/downloaded emails successfully. Should I re-create the sphinx data? not yet, see the procedure above. Janos
Sphinx index files rotation (and corrupted?)
Hello, I've been rotating the main sphinx index (per http://www.mailpiler.org/wiki/current:administering-piler) and am now up to main5, but I don't see the main5.* created at /var/piler/sphinx/. It's been almost 24 hours since I made the change and restarted searchd and piler. I tried searching via the gui just now and no results are being returned, not even from weeks ago when I exported/downloaded emails successfully. Should I re-create the sphinx data? Please advise, thanks a lot!
