Hello,
We have an archive with ~14000000 of messages on it.
Users noticed that some messages missing in search.
I looked into this issue and found that messages were accepted by piler but
not indexed.
I used this script to find missing id's. Totally about 150000 were missed
from different period, all messages has attachments of different types,
size from 10k to 2Mb.
I am using piler 0.1.25-master-branch, build 869.
Here is the script i used. I hope it can help some of you. In case of lost
id's you will have less then 999 in total_found record.
# cat sphinx_search.bash
#!/bin/bash
for ((i=1000;i<=14000000;i=i+1000));
do
> /tmp/total_found
let T=$i-1000
echo "SELECT * FROM main1,dailydelta1,delta1 WHERE id > $T AND id <
$i LIMIT 0; SHOW META;" | mysql -h 127.0.0.1 -P 9306 | grep total_found > /
tmp/total_found
echo "From $T to $i `cat /tmp/total_found`" >> /tmp
/sphinx.index.log
done
