Re: Purging aged / deleted mails

2019-08-24 Thread BKH



Hi Janos,

i put

define('SPHINX_VERSION', 311);

below

#
# minimal sphinx configuration suited to piler
#

and over

source base
{
   type = mysql
   sql_host = localhost
   sql_db = piler
   sql_user = piler
   sql_pass = 0m8k1inn.

   sql_attr_uint = size
   sql_attr_uint = sent
   sql_attr_uint = attachments
}


after

systemctl restart rc.searchd.service i get:

systemctl status rc.searchd.service
● rc.searchd.service - LSB: sphinxsearch
   Loaded: loaded (/etc/init.d/rc.searchd; generated)
   Active: failed (Result: exit-code) since Sat 2019-08-24 16:08:49
CEST; 7s ago
 Docs: man:systemd-sysv-generator(8)
  Process: 7901 ExecStart=/etc/init.d/rc.searchd start (code=exited,
status=1/FAILURE)

Aug 24 16:08:49 piler01 rc.searchd[7901]: [Sat Aug 24 16:08:49.752 2019]
[7906] FATAL: failed to parse config file '/usr/local/etc/piler/sphin
Aug 24 16:08:49 piler01 rc.searchd[7901]: [Sat Aug 24 16:08:49.752 2019]
[7906] shutdown complete
Aug 24 16:08:49 piler01 rc.searchd[7901]: Sphinx 3.1.1 (commit 612d99f)
Aug 24 16:08:49 piler01 rc.searchd[7901]: Copyright (c) 2001-2018,
Andrew Aksyonoff
Aug 24 16:08:49 piler01 rc.searchd[7901]: Copyright (c) 2008-2016,
Sphinx Technologies Inc (http://sphinxsearch.com)
Aug 24 16:08:49 piler01 rc.searchd[7901]: ERROR: invalid section type
'define' in /usr/local/etc/piler/sphinx.conf line 5 col 7.
Aug 24 16:08:49 piler01 su[7904]: pam_unix(su:session): session closed
for user piler
Aug 24 16:08:49 piler01 systemd[1]: rc.searchd.service: Control process
exited, code=exited, status=1/FAILURE
Aug 24 16:08:49 piler01 systemd[1]: rc.searchd.service: Failed with
result 'exit-code'.
Aug 24 16:08:49 piler01 systemd[1]: Failed to start LSB: sphinxsearch.

What to do now?

Am 24.08.19 um 15:43 schrieb s...@acts.hu:
>
>
> Hello,
>
> did you fix the sphinx version number in sphinx.conf?
> For sphinx 3.1.1 it should be
>
> define('SPHINX_VERSION', 311);
>
> Janos
>
> On 2019-08-24 15:34, BKH wrote:
>> Hello,
>>
>> i made some progress in building a mail archiv with the help of piler.
>>
>> Now i tried to purge some aged / deleted (i know, it does not comply
>> with law, but for testing reasons ...).
>>
>> I used "pilerpurge.py" for doing this in the following way
>>
>> a) /usr/local/libexec/piler/pilerpurge.py -d -c
>> /usr/local/etc/piler/piler.conf (dry-run)
>>
>> /var/piler/store/00/5d5/45/bc/40005d5fc54e05e6008c009d46a045bc.m
>> /var/piler/store/00/5d5/cc/47/40005d5fc6152548bf14007cd1a2cc47.m
>> /var/piler/store/00/5d5/62/78/40005d5fc72926c174940087c1266278.m
>> /var/piler/store/00/5d5/34/b2/40005d5fc9d60b001bd400d981fc34b2.m
>> /var/piler/store/00/5d5/6c/21/40005d5fcf3b1b696afc00ae920f6c21.m
>> /var/piler/store/00/5d5/9c/28/40005d5fcf3b2b5b441c00ef888c9c28.m
>> /var/piler/store/00/5d5/ab/82/40005d5fcf3b39c0cc3400849050ab82.m
>> /var/piler/store/00/5d5/a4/2b/40005d5fcf3c0b70005c004e07c3a42b.m
>> /var/piler/store/00/5d5/69/35/40005d5fcf5606efa08c000e2d176935.m
>> /var/piler/store/00/5d5/6c/7a/40005d5fd0671b52702c0046ff4e6c7a.m
>> /var/piler/store/00/5d5/41/ff/40005d5fd06729cfa2dc00077df841ff.m
>>
>> b) /usr/local/libexec/piler/pilerpurge.py -c
>> /usr/local/etc/piler/piler.conf
>>
>> I waited abount ~30 minutes for for delta indexer, which indexed 3 times
>> (i changed index interval in crontab), but all deleted mails are shown.
>>
>> Looking into syslog i manually started die delta indexer and got some
>> messages i don't understand:
>>
>> /usr/local/libexec/piler/indexer.delta.sh
>>
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: 13 more warnings skipped.
>> WARNING: index 'delta1', source 'delta': no kbatch configured in the
>> index, sql_query_killlist in the source IGNORED!
>> WARNING: index 'delta1' source 'delta': no kbatch targets configured;
>> kill-list IGNORED!
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: 13 more warnings skipped.
>>
>> I'm using piler version 

Re: Purging aged / deleted mails

2019-08-24 Thread BKH



No, i forgot to do this ...
Does it matter where to put it in sphinx.conf?

Am 24.08.19 um 15:43 schrieb s...@acts.hu:
>
>
> Hello,
>
> did you fix the sphinx version number in sphinx.conf?
> For sphinx 3.1.1 it should be
>
> define('SPHINX_VERSION', 311);
>
> Janos
>
> On 2019-08-24 15:34, BKH wrote:
>> Hello,
>>
>> i made some progress in building a mail archiv with the help of piler.
>>
>> Now i tried to purge some aged / deleted (i know, it does not comply
>> with law, but for testing reasons ...).
>>
>> I used "pilerpurge.py" for doing this in the following way
>>
>> a) /usr/local/libexec/piler/pilerpurge.py -d -c
>> /usr/local/etc/piler/piler.conf (dry-run)
>>
>> /var/piler/store/00/5d5/45/bc/40005d5fc54e05e6008c009d46a045bc.m
>> /var/piler/store/00/5d5/cc/47/40005d5fc6152548bf14007cd1a2cc47.m
>> /var/piler/store/00/5d5/62/78/40005d5fc72926c174940087c1266278.m
>> /var/piler/store/00/5d5/34/b2/40005d5fc9d60b001bd400d981fc34b2.m
>> /var/piler/store/00/5d5/6c/21/40005d5fcf3b1b696afc00ae920f6c21.m
>> /var/piler/store/00/5d5/9c/28/40005d5fcf3b2b5b441c00ef888c9c28.m
>> /var/piler/store/00/5d5/ab/82/40005d5fcf3b39c0cc3400849050ab82.m
>> /var/piler/store/00/5d5/a4/2b/40005d5fcf3c0b70005c004e07c3a42b.m
>> /var/piler/store/00/5d5/69/35/40005d5fcf5606efa08c000e2d176935.m
>> /var/piler/store/00/5d5/6c/7a/40005d5fd0671b52702c0046ff4e6c7a.m
>> /var/piler/store/00/5d5/41/ff/40005d5fd06729cfa2dc00077df841ff.m
>>
>> b) /usr/local/libexec/piler/pilerpurge.py -c
>> /usr/local/etc/piler/piler.conf
>>
>> I waited abount ~30 minutes for for delta indexer, which indexed 3 times
>> (i changed index interval in crontab), but all deleted mails are shown.
>>
>> Looking into syslog i manually started die delta indexer and got some
>> messages i don't understand:
>>
>> /usr/local/libexec/piler/indexer.delta.sh
>>
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: 13 more warnings skipped.
>> WARNING: index 'delta1', source 'delta': no kbatch configured in the
>> index, sql_query_killlist in the source IGNORED!
>> WARNING: index 'delta1' source 'delta': no kbatch targets configured;
>> kill-list IGNORED!
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: key 'dict' was permanently removed from Sphinx configuration.
>> Refer to documentation for details.
>> WARNING: key 'docinfo' was permanently removed from Sphinx
>> configuration. Refer to documentation for details.
>> WARNING: 13 more warnings skipped.
>>
>> I'm using piler version 1.3.5 ans sphinxsearch 3.1.1
>>
>> Thanks for your help.
>>
>> BKH
>



Re: Purging aged / deleted mails

2019-08-24 Thread sj




Hello,

did you fix the sphinx version number in sphinx.conf?
For sphinx 3.1.1 it should be

define('SPHINX_VERSION', 311);

Janos

On 2019-08-24 15:34, BKH wrote:

Hello,

i made some progress in building a mail archiv with the help of piler.

Now i tried to purge some aged / deleted (i know, it does not comply
with law, but for testing reasons ...).

I used "pilerpurge.py" for doing this in the following way

a) /usr/local/libexec/piler/pilerpurge.py -d -c
/usr/local/etc/piler/piler.conf (dry-run)

/var/piler/store/00/5d5/45/bc/40005d5fc54e05e6008c009d46a045bc.m
/var/piler/store/00/5d5/cc/47/40005d5fc6152548bf14007cd1a2cc47.m
/var/piler/store/00/5d5/62/78/40005d5fc72926c174940087c1266278.m
/var/piler/store/00/5d5/34/b2/40005d5fc9d60b001bd400d981fc34b2.m
/var/piler/store/00/5d5/6c/21/40005d5fcf3b1b696afc00ae920f6c21.m
/var/piler/store/00/5d5/9c/28/40005d5fcf3b2b5b441c00ef888c9c28.m
/var/piler/store/00/5d5/ab/82/40005d5fcf3b39c0cc3400849050ab82.m
/var/piler/store/00/5d5/a4/2b/40005d5fcf3c0b70005c004e07c3a42b.m
/var/piler/store/00/5d5/69/35/40005d5fcf5606efa08c000e2d176935.m
/var/piler/store/00/5d5/6c/7a/40005d5fd0671b52702c0046ff4e6c7a.m
/var/piler/store/00/5d5/41/ff/40005d5fd06729cfa2dc00077df841ff.m

b) /usr/local/libexec/piler/pilerpurge.py -c 
/usr/local/etc/piler/piler.conf


I waited abount ~30 minutes for for delta indexer, which indexed 3 
times

(i changed index interval in crontab), but all deleted mails are shown.

Looking into syslog i manually started die delta indexer and got some
messages i don't understand:

/usr/local/libexec/piler/indexer.delta.sh

WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: key 'dict' was permanently removed from Sphinx configuration.
Refer to documentation for details.
WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: key 'dict' was permanently removed from Sphinx configuration.
Refer to documentation for details.
WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: 13 more warnings skipped.
WARNING: index 'delta1', source 'delta': no kbatch configured in the
index, sql_query_killlist in the source IGNORED!
WARNING: index 'delta1' source 'delta': no kbatch targets configured;
kill-list IGNORED!
WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: key 'dict' was permanently removed from Sphinx configuration.
Refer to documentation for details.
WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: key 'dict' was permanently removed from Sphinx configuration.
Refer to documentation for details.
WARNING: key 'docinfo' was permanently removed from Sphinx
configuration. Refer to documentation for details.
WARNING: 13 more warnings skipped.

I'm using piler version 1.3.5 ans sphinxsearch 3.1.1

Thanks for your help.

BKH