Hello,
I'm glad that you figured out the problem.
Normally when things are ok, you shouldn't (no need to) reindex
unless somehow the sphinx index get corrupted (which is pretty
unlikely).
Janos
On 2013-07-24 11:24, JC Putter wrote:
Thanks,
I now noticed that there is a default sphinxsearch cronjob doing the
following which i think caused this issue. I removed it, will test it
further.
# Rebuild all indexes daily and notify searchd.
@daily root . /etc/default/sphinxsearch && if [ "$START" = "yes"
] && [ -x /usr/bin/indexer ]; then /usr/bin/indexer --quiet --rotate
--all; fi
# Example for rotating only specific indexes (usually these would be
part of
# a larger combined index).
# */5 * * * * root [ -x /usr/bin/indexer ] && /usr/bin/indexer
--quiet --rotate postdelta threaddelta
### PILERSTART
*/5 * * * * LC_ALL=C mpstat | tail -1 | awk '{print }' >
/var/piler/stat/cpu.stat
5,35 * * * * /usr/bin/indexer --quiet delta1 --rotate && sleep 2 &&
/usr/bin/indexer --quiet --merge main1 delta1 --merge-dst-range
deleted 0 0 --rotate
*/15 * * * * /usr/bin/indexer --quiet tag1 --rotate
*/15 * * * * /usr/bin/indexer --quiet note1 --rotate
### PILEREND
total 152
drwx------ 2 piler piler 4096 Jul 23 22:15 .
drwxr-xr-x 7 root root 4096 Jul 15 20:26 ..
-rw-r--r-- 1 piler piler 0 Jul 23 22:05 delta1.spa
-rw-r--r-- 1 piler piler 1 Jul 23 22:05 delta1.spd
-rw-r--r-- 1 piler piler 582 Jul 23 22:05 delta1.sph
-rw-r--r-- 1 piler piler 1 Jul 23 22:05 delta1.spi
-rw-r--r-- 1 piler piler 0 Jul 23 22:05 delta1.spk
-rw------- 1 piler piler 0 Jul 23 22:05 delta1.spl
-rw-r--r-- 1 piler piler 0 Jul 23 22:05 delta1.spm
-rw-r--r-- 1 piler piler 1 Jul 23 22:05 delta1.spp
-rw-r--r-- 1 piler piler 1 Jul 23 22:05 delta1.sps
-rw-r--r-- 1 piler piler 160 Jul 23 22:05 main1.spa
-rw-r--r-- 1 piler piler 498 Jul 23 22:05 main1.spd
-rw-r--r-- 1 piler piler 582 Jul 23 22:05 main1.sph
-rw-r--r-- 1 piler piler 1195 Jul 23 22:05 main1.spi
-rw-r--r-- 1 piler piler 0 Jul 23 22:05 main1.spk
-rw------- 1 piler piler 0 Jul 23 22:05 main1.spl
-rw-r--r-- 1 piler piler 0 Jul 23 22:05 main1.spm
-rw-r--r-- 1 piler piler 146 Jul 23 22:05 main1.spp
-rw-r--r-- 1 piler piler 1 Jul 23 22:05 main1.sps
-rw-r--r-- 1 root root 0 Jul 23 00:00 main2.spa
-rw-r--r-- 1 root root 1 Jul 23 00:00 main2.spd
-rw-r--r-- 1 root root 582 Jul 23 00:00 main2.sph
-rw-r--r-- 1 root root 1 Jul 23 00:00 main2.spi
-rw-r--r-- 1 root root 0 Jul 23 00:00 main2.spk
-rw------- 1 piler piler 0 Jul 23 12:14 main2.spl
-rw-r--r-- 1 root root 0 Jul 23 00:00 main2.spm
-rw-r--r-- 1 root root 1 Jul 23 00:00 main2.spp
-rw-r--r-- 1 root root 1 Jul 23 00:00 main2.sps
-rw-r--r-- 1 root root 0 Jul 23 00:00 main3.spa
-rw-r--r-- 1 root root 1 Jul 23 00:00 main3.spd
-rw-r--r-- 1 root root 582 Jul 23 00:00 main3.sph
-rw-r--r-- 1 root root 1 Jul 23 00:00 main3.spi
-rw-r--r-- 1 root root 0 Jul 23 00:00 main3.spk
-rw------- 1 piler piler 0 Jul 23 12:14 main3.spl
-rw-r--r-- 1 root root 0 Jul 23 00:00 main3.spm
-rw-r--r-- 1 root root 1 Jul 23 00:00 main3.spp
-rw-r--r-- 1 root root 1 Jul 23 00:00 main3.sps
-rw-r--r-- 1 root root 0 Jul 23 00:00 main4.spa
-rw-r--r-- 1 root root 1 Jul 23 00:00 main4.spd
-rw-r--r-- 1 root root 582 Jul 23 00:00 main4.sph
-rw-r--r-- 1 root root 1 Jul 23 00:00 main4.spi
-rw-r--r-- 1 root root 0 Jul 23 00:00 main4.spk
-rw------- 1 piler piler 0 Jul 23 12:14 main4.spl
-rw-r--r-- 1 root root 0 Jul 23 00:00 main4.spm
-rw-r--r-- 1 root root 1 Jul 23 00:00 main4.spp
-rw-r--r-- 1 root root 1 Jul 23 00:00 main4.sps
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 note1.spa
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 note1.spd
-rw-r--r-- 1 piler piler 289 Jul 23 22:15 note1.sph
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 note1.spi
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 note1.spk
-rw------- 1 piler piler 0 Jul 23 22:15 note1.spl
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 note1.spm
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 note1.spp
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 note1.sps
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 tag1.spa
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 tag1.spd
-rw-r--r-- 1 piler piler 288 Jul 23 22:15 tag1.sph
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 tag1.spi
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 tag1.spk
-rw------- 1 piler piler 0 Jul 23 22:15 tag1.spl
-rw-r--r-- 1 piler piler 0 Jul 23 22:15 tag1.spm
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 tag1.spp
-rw-r--r-- 1 piler piler 1 Jul 23 22:15 tag1.sps
On Tue, Jul 23, 2013 at 5:12 PM, Janos SUTO <[email protected]> wrote:
Hello,
On 2013-07-23 11:34, JC Putter wrote:
There seems to be an issue with my search, again it is only showing
email from today and not all the other days. I then do a reindex -a
and then i am able to search previous days as well..
I suspect that your sphinx database gets corrupted. Please show me
ls -la /var/piler/sphinx, and crontab -l -u piler
Janos