Re: failed to store index data

2023-03-19 Thread Jonathan Baecker

Ok, now everything work.

Thank you very much for your advises!


Am 19.03.23 um 20:52 schrieb Janos SUTO:

Yes, please. Reindex works just as before.

Janos
On Mar 19, 2023, at 20:47, Jonathan Baecker  wrote:


Thank you, that was the trick! But I still have to run: reindex -a?

Am 19.03.23 um 20:44 schrieb Janos SUTO:

From your previous emails, you set real-time (rt) indexing.
For such setup, don't run the indexer utility, no need for it
any longer. Also be sure to update the pilersearch.service as
in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
I think you'll be fine after that, manticore will create the
required index files. Janos On 2023-03-19 20:36, Jonathan
Baecker wrote:

This folder is empty and I also can not reindex. I recover
my system to a state where it was works. Maybe I miss a
step, so here are my steps: 1. piler 1.4.3 runs with
sphinx under debian 11. 2. I install manticore 6.0.x from
webpage 3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf 4. add db settings to
/usr/local/etc/piler/manticore.conf 4. apply all changes
from mailpiler doc about switching to manticore 5. when I
run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no
tables found in config file
'/usr/local/etc/piler/manticore.conf' 6. I reboot the
system to have all services running systemctl status
pilersearch.service show:     Process: 611
ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited,
status=0/SUCCESS)    Main PID: 615 (searchd)   Tasks:
10 (limit: 4675)  Memory: 52.2M     CPU: 314ms
 CGroup: /system.slice/pilersearch.service
 ├─614 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf  ├─615
/usr/bin/searchd --config /usr/local/etc/piler/sphinx.conf
 └─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312
--threads=2 Mär 19 20:27:40 piler searchd[611]: Copyright
(c) 2008-2016, Sphinx Technologies Inc
(http://sphinxsearch.com) Mär 19 20:27:40 piler
searchd[611]: Copyright (c) 2017-2023, Manticore Software
LTD (https://manticoresearch.com) Mär 19 20:27:40 piler
searchd[611]: WARNING: key 'docinfo' was permanently
removed from configuration. Refer to documentation for
details. So it still uses the old sphinx.conf Was my steps
ok? Am 19.03.23 um 18:48 schrieb Janos SUTO:

Your configs look fine. The errno=1064 means that no
such local index. Show me "ls -la
/var/piler/manticore/" output, too. In my test
environment it looks like: ls -la
/var/piler/manticore/ total 4796 drwx--  2 piler
piler    4096 Mar 19 17:43 . drwxr-xr-x 10 root 
root 4096 Mar 19 17:01 .. -rw---  1 piler
piler   8 Mar 19 17:43 binlog.001 -rw---  1
piler piler   0 Mar 19 17:03 binlog.lock
-rw---  1 piler piler  11 Mar 19 17:43
binlog.meta -rw---  1 piler piler    2731 Mar 19
17:43 manticore.log -rw---  1 piler piler   0
Mar 19 17:03 note1.lock -rw---  1 piler piler   
1200 Mar 19 17:03 note1.meta -rw---  1 piler
piler  20 Mar 19 17:03 note1.ram -rw---  1
piler piler   0 Mar 19 17:03 piler1.lock
-rw---  1 piler piler    1569 Mar 19 17:43
piler1.meta -rw---  1 piler piler 4862221 Mar 19
17:43 piler1.ram -rw---  1 piler piler 893 Mar
19 17:01 query.log -rw---  1 piler piler   0
Mar 19 17:03 tag1.lock -rw---  1 piler piler   
1199 Mar 19 17:03 tag1.meta -rw---  1 piler
piler  20 Mar 19 17:03 tag1.ram Janos On
2023-03-19 17:15, Jonathan Baecker wrote:

Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf # # minimal
manticore configuration suited to piler # index
piler1 {     type = rt     path =
/var/piler/manticore/piler1     rt_mem_limit =
512M     stored_fields =     min_word_len = 1    
min_prefix_len = 5     charset_table  = 0..9,
english, _, \  

Re: failed to store index data

2023-03-19 Thread Janos SUTO
Yes, please. Reindex works just as before.

Janos

On Mar 19, 2023, 20:47, at 20:47, Jonathan Baecker  wrote:
>
>
>Thank you, that was the trick! But I still have to run: reindex -a?
>
>Am 19.03.23 um 20:44 schrieb Janos SUTO:
>>
>>
>> From your previous emails, you set real-time (rt) indexing. For such
>> setup,
>> don't run the indexer utility, no need for it any longer.
>>
>> Also be sure to update the pilersearch.service as in
>>
>https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
>>
>> I think you'll be fine after that, manticore will create the required
>> index files.
>>
>> Janos
>>
>> On 2023-03-19 20:36, Jonathan Baecker wrote:
>>> This folder is empty and I also can not reindex. I recover my system
>>> to a state where it was works. Maybe I miss a step, so here are my
>>> steps:
>>>
>>> 1. piler 1.4.3 runs with sphinx under debian 11.
>>> 2. I install manticore 6.0.x from webpage
>>> 3. cp /usr/local/etc/piler/manticore.conf.dist
>>> /usr/local/etc/piler/manticore.conf
>>> 4. add db settings to /usr/local/etc/piler/manticore.conf
>>> 4. apply all changes from mailpiler doc about switching to manticore
>>> 5. when I run as piler user: indexer --all --config
>>> /usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
>>> found in config file '/usr/local/etc/piler/manticore.conf'
>>> 6. I reboot the system to have all services running
>>>
>>> systemctl status pilersearch.service show:
>>>
>>>     Process: 611 ExecStart=/usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
>>>    Main PID: 615 (searchd)
>>>   Tasks: 10 (limit: 4675)
>>>  Memory: 52.2M
>>>     CPU: 314ms
>>>  CGroup: /system.slice/pilersearch.service
>>>  ├─614 /usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf
>>>  ├─615 /usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf
>>>  └─620 /usr/bin/manticore-executor -n
>>> /tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2
>>>
>>> Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
>>> Technologies Inc (http://sphinxsearch.com)
>>> Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023,
>Manticore
>>> Software LTD (https://manticoresearch.com)
>>> Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
>>> permanently removed from configuration. Refer to documentation for
>>> details.
>>>
>>> So it still uses the old sphinx.conf
>>>
>>> Was my steps ok?
>>>
>>>
>>>
>>> Am 19.03.23 um 18:48 schrieb Janos SUTO:


 Your configs look fine. The errno=1064 means that no such local
>index.
 Show me "ls -la /var/piler/manticore/" output, too.

 In my test environment it looks like:

 ls -la /var/piler/manticore/
 total 4796
 drwx--  2 piler piler    4096 Mar 19 17:43 .
 drwxr-xr-x 10 root  root 4096 Mar 19 17:01 ..
 -rw---  1 piler piler   8 Mar 19 17:43 binlog.001
 -rw---  1 piler piler   0 Mar 19 17:03 binlog.lock
 -rw---  1 piler piler  11 Mar 19 17:43 binlog.meta
 -rw---  1 piler piler    2731 Mar 19 17:43 manticore.log
 -rw---  1 piler piler   0 Mar 19 17:03 note1.lock
 -rw---  1 piler piler    1200 Mar 19 17:03 note1.meta
 -rw---  1 piler piler  20 Mar 19 17:03 note1.ram
 -rw---  1 piler piler   0 Mar 19 17:03 piler1.lock
 -rw---  1 piler piler    1569 Mar 19 17:43 piler1.meta
 -rw---  1 piler piler 4862221 Mar 19 17:43 piler1.ram
 -rw---  1 piler piler 893 Mar 19 17:01 query.log
 -rw---  1 piler piler   0 Mar 19 17:03 tag1.lock
 -rw---  1 piler piler    1199 Mar 19 17:03 tag1.meta
 -rw---  1 piler piler  20 Mar 19 17:03 tag1.ram

 Janos

 On 2023-03-19 17:15, Jonathan Baecker wrote:
> Ah sorry! Here is the output, but I run:
> /usr/local/etc/piler/manticore.conf
>
> #
> # minimal manticore configuration suited to piler
> #
>
>
> index piler1
> {
>     type = rt
>     path = /var/piler/manticore/piler1
>     rt_mem_limit = 512M
>     stored_fields =
>     min_word_len = 1
>     min_prefix_len = 5
>     charset_table  = 0..9, english, _, \
>   U+C1->U+E1, U+C4->U+E4,
>U+C5->U+E5,
> U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
> U+D8->U+F8, \
>   U+DA->U+FA, U+DC->U+FC,
> U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
> U+01E3->U+E6, U+01FC->U+E6, \
>   U+01FD->U+E6, U+1D01->U+E6,
> U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
>   U+DF, U+E1, U+E4, U+E5, U+E6,
>U+E9,
> U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
>     # See
>

Re: failed to store index data

2023-03-19 Thread Jonathan Baecker




Thank you, that was the trick! But I still have to run: reindex -a?

Am 19.03.23 um 20:44 schrieb Janos SUTO:



From your previous emails, you set real-time (rt) indexing. For such 
setup,

don't run the indexer utility, no need for it any longer.

Also be sure to update the pilersearch.service as in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service

I think you'll be fine after that, manticore will create the required
index files.

Janos

On 2023-03-19 20:36, Jonathan Baecker wrote:

This folder is empty and I also can not reindex. I recover my system
to a state where it was works. Maybe I miss a step, so here are my
steps:

1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf
4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
found in config file '/usr/local/etc/piler/manticore.conf'
6. I reboot the system to have all services running

systemctl status pilersearch.service show:

    Process: 611 ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
   Main PID: 615 (searchd)
  Tasks: 10 (limit: 4675)
 Memory: 52.2M
    CPU: 314ms
 CGroup: /system.slice/pilersearch.service
 ├─614 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf
 ├─615 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf

 └─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2

Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
permanently removed from configuration. Refer to documentation for
details.

So it still uses the old sphinx.conf

Was my steps ok?



Am 19.03.23 um 18:48 schrieb Janos SUTO:



Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.

In my test environment it looks like:

ls -la /var/piler/manticore/
total 4796
drwx--  2 piler piler    4096 Mar 19 17:43 .
drwxr-xr-x 10 root  root 4096 Mar 19 17:01 ..
-rw---  1 piler piler   8 Mar 19 17:43 binlog.001
-rw---  1 piler piler   0 Mar 19 17:03 binlog.lock
-rw---  1 piler piler  11 Mar 19 17:43 binlog.meta
-rw---  1 piler piler    2731 Mar 19 17:43 manticore.log
-rw---  1 piler piler   0 Mar 19 17:03 note1.lock
-rw---  1 piler piler    1200 Mar 19 17:03 note1.meta
-rw---  1 piler piler  20 Mar 19 17:03 note1.ram
-rw---  1 piler piler   0 Mar 19 17:03 piler1.lock
-rw---  1 piler piler    1569 Mar 19 17:43 piler1.meta
-rw---  1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw---  1 piler piler 893 Mar 19 17:01 query.log
-rw---  1 piler piler   0 Mar 19 17:03 tag1.lock
-rw---  1 piler piler    1199 Mar 19 17:03 tag1.meta
-rw---  1 piler piler  20 Mar 19 17:03 tag1.ram

Janos

On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run: 
/usr/local/etc/piler/manticore.conf


#
# minimal manticore configuration suited to piler
#


index piler1
{
    type = rt
    path = /var/piler/manticore/piler1
    rt_mem_limit = 512M
    stored_fields =
    min_word_len = 1
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    # See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages 
    # if you want to enable columnar storage

    # columnar_attrs = *
    rt_field = sender
    rt_field = rcpt
    rt_field = senderdomain
    rt_field = rcptdomain
    rt_field = subject
    rt_field = body
    rt_field = attachment_types
    rt_attr_bigint = arrived
    rt_attr_bigint = sent
    rt_attr_uint = size
    rt_attr_uint = direction
    rt_attr_uint = folder
    rt_attr_uint = attachments
}

index tag1
{
    type = rt
    path = /var/piler/manticore/tag1
    rt_mem_limit = 16M
    stored_fields = tag
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  

Re: failed to store index data

2023-03-19 Thread Janos SUTO




From your previous emails, you set real-time (rt) indexing. For such 
setup,

don't run the indexer utility, no need for it any longer.

Also be sure to update the pilersearch.service as in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service

I think you'll be fine after that, manticore will create the required
index files.

Janos

On 2023-03-19 20:36, Jonathan Baecker wrote:

This folder is empty and I also can not reindex. I recover my system
to a state where it was works. Maybe I miss a step, so here are my
steps:

1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf
4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
found in config file '/usr/local/etc/piler/manticore.conf'
6. I reboot the system to have all services running

systemctl status pilersearch.service show:

    Process: 611 ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
   Main PID: 615 (searchd)
  Tasks: 10 (limit: 4675)
 Memory: 52.2M
    CPU: 314ms
 CGroup: /system.slice/pilersearch.service
 ├─614 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf
 ├─615 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf

 └─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2

Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
permanently removed from configuration. Refer to documentation for
details.

So it still uses the old sphinx.conf

Was my steps ok?



Am 19.03.23 um 18:48 schrieb Janos SUTO:



Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.

In my test environment it looks like:

ls -la /var/piler/manticore/
total 4796
drwx--  2 piler piler    4096 Mar 19 17:43 .
drwxr-xr-x 10 root  root 4096 Mar 19 17:01 ..
-rw---  1 piler piler   8 Mar 19 17:43 binlog.001
-rw---  1 piler piler   0 Mar 19 17:03 binlog.lock
-rw---  1 piler piler  11 Mar 19 17:43 binlog.meta
-rw---  1 piler piler    2731 Mar 19 17:43 manticore.log
-rw---  1 piler piler   0 Mar 19 17:03 note1.lock
-rw---  1 piler piler    1200 Mar 19 17:03 note1.meta
-rw---  1 piler piler  20 Mar 19 17:03 note1.ram
-rw---  1 piler piler   0 Mar 19 17:03 piler1.lock
-rw---  1 piler piler    1569 Mar 19 17:43 piler1.meta
-rw---  1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw---  1 piler piler 893 Mar 19 17:01 query.log
-rw---  1 piler piler   0 Mar 19 17:03 tag1.lock
-rw---  1 piler piler    1199 Mar 19 17:03 tag1.meta
-rw---  1 piler piler  20 Mar 19 17:03 tag1.ram

Janos

On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run: 
/usr/local/etc/piler/manticore.conf


#
# minimal manticore configuration suited to piler
#


index piler1
{
    type = rt
    path = /var/piler/manticore/piler1
    rt_mem_limit = 512M
    stored_fields =
    min_word_len = 1
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    # See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages 
    # if you want to enable columnar storage

    # columnar_attrs = *
    rt_field = sender
    rt_field = rcpt
    rt_field = senderdomain
    rt_field = rcptdomain
    rt_field = subject
    rt_field = body
    rt_field = attachment_types
    rt_attr_bigint = arrived
    rt_attr_bigint = sent
    rt_attr_uint = size
    rt_attr_uint = direction
    rt_attr_uint = folder
    rt_attr_uint = attachments
}

index tag1
{
    type = rt
    path = /var/piler/manticore/tag1
    rt_mem_limit = 16M
    stored_fields = tag
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, 

Re: failed to store index data

2023-03-19 Thread Jonathan Baecker




This folder is empty and I also can not reindex. I recover my system to 
a state where it was works. Maybe I miss a step, so here are my steps:


1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist 
/usr/local/etc/piler/manticore.conf

4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config 
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables found 
in config file '/usr/local/etc/piler/manticore.conf'

6. I reboot the system to have all services running

systemctl status pilersearch.service show:

    Process: 611 ExecStart=/usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)

   Main PID: 615 (searchd)
  Tasks: 10 (limit: 4675)
 Memory: 52.2M
    CPU: 314ms
 CGroup: /system.slice/pilersearch.service
 ├─614 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf
 ├─615 /usr/bin/searchd --config 
/usr/local/etc/piler/sphinx.conf
 └─620 /usr/bin/manticore-executor -n 
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2


Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx 
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore 
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was 
permanently removed from configuration. Refer to documentation for details.


So it still uses the old sphinx.conf

Was my steps ok?



Am 19.03.23 um 18:48 schrieb Janos SUTO:



Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.

In my test environment it looks like:

ls -la /var/piler/manticore/
total 4796
drwx--  2 piler piler    4096 Mar 19 17:43 .
drwxr-xr-x 10 root  root 4096 Mar 19 17:01 ..
-rw---  1 piler piler   8 Mar 19 17:43 binlog.001
-rw---  1 piler piler   0 Mar 19 17:03 binlog.lock
-rw---  1 piler piler  11 Mar 19 17:43 binlog.meta
-rw---  1 piler piler    2731 Mar 19 17:43 manticore.log
-rw---  1 piler piler   0 Mar 19 17:03 note1.lock
-rw---  1 piler piler    1200 Mar 19 17:03 note1.meta
-rw---  1 piler piler  20 Mar 19 17:03 note1.ram
-rw---  1 piler piler   0 Mar 19 17:03 piler1.lock
-rw---  1 piler piler    1569 Mar 19 17:43 piler1.meta
-rw---  1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw---  1 piler piler 893 Mar 19 17:01 query.log
-rw---  1 piler piler   0 Mar 19 17:03 tag1.lock
-rw---  1 piler piler    1199 Mar 19 17:03 tag1.meta
-rw---  1 piler piler  20 Mar 19 17:03 tag1.ram

Janos

On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run: 
/usr/local/etc/piler/manticore.conf


#
# minimal manticore configuration suited to piler
#


index piler1
{
    type = rt
    path = /var/piler/manticore/piler1
    rt_mem_limit = 512M
    stored_fields =
    min_word_len = 1
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    # See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages 


    # if you want to enable columnar storage
    # columnar_attrs = *
    rt_field = sender
    rt_field = rcpt
    rt_field = senderdomain
    rt_field = rcptdomain
    rt_field = subject
    rt_field = body
    rt_field = attachment_types
    rt_attr_bigint = arrived
    rt_attr_bigint = sent
    rt_attr_uint = size
    rt_attr_uint = direction
    rt_attr_uint = folder
    rt_attr_uint = attachments
}

index tag1
{
    type = rt
    path = /var/piler/manticore/tag1
    rt_mem_limit = 16M
    stored_fields = tag
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, 

Re: failed to store index data

2023-03-19 Thread Janos SUTO




Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.

In my test environment it looks like:

ls -la /var/piler/manticore/
total 4796
drwx--  2 piler piler4096 Mar 19 17:43 .
drwxr-xr-x 10 root  root 4096 Mar 19 17:01 ..
-rw---  1 piler piler   8 Mar 19 17:43 binlog.001
-rw---  1 piler piler   0 Mar 19 17:03 binlog.lock
-rw---  1 piler piler  11 Mar 19 17:43 binlog.meta
-rw---  1 piler piler2731 Mar 19 17:43 manticore.log
-rw---  1 piler piler   0 Mar 19 17:03 note1.lock
-rw---  1 piler piler1200 Mar 19 17:03 note1.meta
-rw---  1 piler piler  20 Mar 19 17:03 note1.ram
-rw---  1 piler piler   0 Mar 19 17:03 piler1.lock
-rw---  1 piler piler1569 Mar 19 17:43 piler1.meta
-rw---  1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw---  1 piler piler 893 Mar 19 17:01 query.log
-rw---  1 piler piler   0 Mar 19 17:03 tag1.lock
-rw---  1 piler piler1199 Mar 19 17:03 tag1.meta
-rw---  1 piler piler  20 Mar 19 17:03 tag1.ram

Janos

On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run: 
/usr/local/etc/piler/manticore.conf


#
# minimal manticore configuration suited to piler
#


index piler1
{
    type = rt
    path = /var/piler/manticore/piler1
    rt_mem_limit = 512M
    stored_fields =
    min_word_len = 1
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    # See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
    # if you want to enable columnar storage
    # columnar_attrs = *
    rt_field = sender
    rt_field = rcpt
    rt_field = senderdomain
    rt_field = rcptdomain
    rt_field = subject
    rt_field = body
    rt_field = attachment_types
    rt_attr_bigint = arrived
    rt_attr_bigint = sent
    rt_attr_uint = size
    rt_attr_uint = direction
    rt_attr_uint = folder
    rt_attr_uint = attachments
}

index tag1
{
    type = rt
    path = /var/piler/manticore/tag1
    rt_mem_limit = 16M
    stored_fields = tag
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    rt_field = tag
    rt_attr_bigint = mid
    rt_attr_uint = uid
}

index note1
{
    type = rt
    path = /var/piler/manticore/note1
    rt_mem_limit = 16M
    stored_fields = note
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    rt_field = note
    rt_attr_bigint = mid
    rt_attr_uint = uid
}

searchd
{
    listen  = 127.0.0.1:9312
    listen  = 127.0.0.1:9306:mysql41
    log = /var/piler/manticore/manticore.log
    binlog_max_log_size = 256M
    binlog_path = /var/piler/manticore
    binlog_flush    = 2
    query_log   = /var/piler/manticore/query.log
    network_timeout = 5
    pid_file    = /var/run/piler/searchd.pid
    seamless_rotate = 1
    preopen_indexes = 1
    unlink_old  = 1
    thread_stack    = 512k
    rt_flush_period = 300

}


Am 19.03.23 um 16:35 schrieb Janos SUTO:



I meant to execute /etc/piler/manticore.conf (yes, it's executable).

Janos

On 2023-03-19 16:06, Jonathan Baecker wrote:

Am 

Re: failed to store index data

2023-03-19 Thread Jonathan Baecker




Ah sorry! Here is the output, but I run: /usr/local/etc/piler/manticore.conf

#
# minimal manticore configuration suited to piler
#


index piler1
{
    type = rt
    path = /var/piler/manticore/piler1
    rt_mem_limit = 512M
    stored_fields =
    min_word_len = 1
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5, 
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC, 
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6, 
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6, 
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9, 
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
    # See 
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages

    # if you want to enable columnar storage
    # columnar_attrs = *
    rt_field = sender
    rt_field = rcpt
    rt_field = senderdomain
    rt_field = rcptdomain
    rt_field = subject
    rt_field = body
    rt_field = attachment_types
    rt_attr_bigint = arrived
    rt_attr_bigint = sent
    rt_attr_uint = size
    rt_attr_uint = direction
    rt_attr_uint = folder
    rt_attr_uint = attachments
}

index tag1
{
    type = rt
    path = /var/piler/manticore/tag1
    rt_mem_limit = 16M
    stored_fields = tag
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5, 
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC, 
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6, 
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6, 
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9, 
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171

    rt_field = tag
    rt_attr_bigint = mid
    rt_attr_uint = uid
}

index note1
{
    type = rt
    path = /var/piler/manticore/note1
    rt_mem_limit = 16M
    stored_fields = note
    min_word_len = 2
    min_prefix_len = 5
    charset_table  = 0..9, english, _, \
  U+C1->U+E1, U+C4->U+E4, U+C5->U+E5, 
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
  U+DA->U+FA, U+DC->U+FC, 
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6, 
U+01E3->U+E6, U+01FC->U+E6, \
  U+01FD->U+E6, U+1D01->U+E6, 
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
  U+DF, U+E1, U+E4, U+E5, U+E6, U+E9, 
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171

    rt_field = note
    rt_attr_bigint = mid
    rt_attr_uint = uid
}

searchd
{
    listen  = 127.0.0.1:9312
    listen  = 127.0.0.1:9306:mysql41
    log = /var/piler/manticore/manticore.log
    binlog_max_log_size = 256M
    binlog_path = /var/piler/manticore
    binlog_flush    = 2
    query_log   = /var/piler/manticore/query.log
    network_timeout = 5
    pid_file    = /var/run/piler/searchd.pid
    seamless_rotate = 1
    preopen_indexes = 1
    unlink_old  = 1
    thread_stack    = 512k
    rt_flush_period = 300

}


Am 19.03.23 um 16:35 schrieb Janos SUTO:



I meant to execute /etc/piler/manticore.conf (yes, it's executable).

Janos

On 2023-03-19 16:06, Jonathan Baecker wrote:

Am 19.03.23 um 14:27 schrieb Janos SUTO:

Hello Jonathan,


Hello Jano, thank you for you quick response!


please tell me more about your setup. Show me the output of

pilerconf |grep -E '(sph|rtindex)'


Output is:

rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306



and

/etc/piler/manticore.conf


Content is:

define('RT', 1);



Be sure to redact any passwords.

Janos


On 2023-03-19 14:11, Jonathan Baecker wrote:

Hello,

I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check piler
service, I get this error:


Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 

Re: failed to store index data

2023-03-19 Thread Janos SUTO




I meant to execute /etc/piler/manticore.conf (yes, it's executable).

Janos

On 2023-03-19 16:06, Jonathan Baecker wrote:

Am 19.03.23 um 14:27 schrieb Janos SUTO:

Hello Jonathan,


Hello Jano, thank you for you quick response!


please tell me more about your setup. Show me the output of

pilerconf |grep -E '(sph|rtindex)'


Output is:

rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306



and

/etc/piler/manticore.conf


Content is:

define('RT', 1);



Be sure to redact any passwords.

Janos


On 2023-03-19 14:11, Jonathan Baecker wrote:

Hello,

I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check 
piler

service, I get this error:


Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb failed to store index data for
id=31270, errno=1064, append ret=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
sph_index WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
rcpt WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
metadata WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: unlinking
/var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored metadata, rc=1
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to
/var/piler/error/E07M4E0192DW6TN0
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0:
5000641708f61c491c9c0069477d77cb, size=39327/11168, 
attachments=0,

reference=,
message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>,
retention=2557, folder=0, delay=0.1183, status=error


After Update I run mysql piler < ./util/db-upgrade.sql But I think it
had done nothing.

Do you have any idea, how to fix this?


Have a good day!

jb






Re: failed to store index data

2023-03-19 Thread Jonathan Baecker




Am 19.03.23 um 14:27 schrieb Janos SUTO:

Hello Jonathan,


Hello Jano, thank you for you quick response!


please tell me more about your setup. Show me the output of

pilerconf |grep -E '(sph|rtindex)'


Output is:

rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306



and

/etc/piler/manticore.conf


Content is:

define('RT', 1);



Be sure to redact any passwords.

Janos


On 2023-03-19 14:11, Jonathan Baecker wrote:

Hello,

I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check piler
service, I get this error:


Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb failed to store index data for
id=31270, errno=1064, append ret=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
sph_index WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
rcpt WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
metadata WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: unlinking
/var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored metadata, rc=1
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to
/var/piler/error/E07M4E0192DW6TN0
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0:
5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0,
reference=,
message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>,
retention=2557, folder=0, delay=0.1183, status=error


After Update I run mysql piler < ./util/db-upgrade.sql But I think it
had done nothing.

Do you have any idea, how to fix this?


Have a good day!

jb







Re: failed to store index data

2023-03-19 Thread postfach
Hi,

are you using manticore 6.0.4?
If yes revert back to manticore 6.0.0 and it shoud work.
As far as i know piler only supports manticore 6.0.0.

Regards
BKH

> Am 19.03.2023 um 14:11 schrieb Jonathan Baecker :
> 
> 
> 
> Hello,
> 
> I just update piler from 1.3.9 to 1.4.3 and I also switched to manticore. But 
> now piler can not receive new mails. when I check piler service, I get this 
> error:
> 
> 
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> hdr_len: 3130, offset: 3
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> touch 2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK 
> (<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> stored '5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> updated meta reference for '', rc=0
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> stored 1 recipients, rc=0
> Mr 19 14:06:52 piler piler[567]: ERROR: 
> 5000641708f61c491c9c0069477d77cb failed to store index data for id=31270, 
> errno=1064, append ret=0
> Mr 19 14:06:52 piler piler[567]: ERROR: 
> 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM sph_index 
> WHERE id=31270
> Mr 19 14:06:52 piler piler[567]: ERROR: 
> 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM rcpt 
> WHERE id=31270
> Mr 19 14:06:52 piler piler[567]: ERROR: 
> 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM metadata 
> WHERE id=31270
> Mr 19 14:06:52 piler piler[567]: ERROR: 
> 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM 
> attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> unlinking /var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
> Mr 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: 
> stored metadata, rc=1
> Mr 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to 
> /var/piler/error/E07M4E0192DW6TN0
> Mr 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: 
> 5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0, 
> reference=, 
> message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>, retention=2557, 
> folder=0, delay=0.1183, status=error
> 
> 
> After Update I run mysql piler < ./util/db-upgrade.sql But I think it had 
> done nothing.
> 
> Do you have any idea, how to fix this?
> 
> 
> Have a good day!
> 
> jb
> 
> 
> 


Re: failed to store index data

2023-03-19 Thread Janos SUTO




Hello Jonathan,

please tell me more about your setup. Show me the output of

pilerconf |grep -E '(sph|rtindex)'

and

/etc/piler/manticore.conf

Be sure to redact any passwords.

Janos


On 2023-03-19 14:11, Jonathan Baecker wrote:

Hello,

I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check piler
service, I get this error:


Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb failed to store index data for
id=31270, errno=1064, append ret=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
sph_index WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
rcpt WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
metadata WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: unlinking
/var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored metadata, rc=1
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to
/var/piler/error/E07M4E0192DW6TN0
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0:
5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0,
reference=,
message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>,
retention=2557, folder=0, delay=0.1183, status=error


After Update I run mysql piler < ./util/db-upgrade.sql But I think it
had done nothing.

Do you have any idea, how to fix this?


Have a good day!

jb