Re: failed to store index data
Ok, now everything work.
Thank you very much for your advises!
Am 19.03.23 um 20:52 schrieb Janos SUTO:
Yes, please. Reindex works just as before.
Janos
On Mar 19, 2023, at 20:47, Jonathan Baecker wrote:
Thank you, that was the trick! But I still have to run: reindex -a?
Am 19.03.23 um 20:44 schrieb Janos SUTO:
From your previous emails, you set real-time (rt) indexing.
For such setup, don't run the indexer utility, no need for it
any longer. Also be sure to update the pilersearch.service as
in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
I think you'll be fine after that, manticore will create the
required index files. Janos On 2023-03-19 20:36, Jonathan
Baecker wrote:
This folder is empty and I also can not reindex. I recover
my system to a state where it was works. Maybe I miss a
step, so here are my steps: 1. piler 1.4.3 runs with
sphinx under debian 11. 2. I install manticore 6.0.x from
webpage 3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf 4. add db settings to
/usr/local/etc/piler/manticore.conf 4. apply all changes
from mailpiler doc about switching to manticore 5. when I
run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no
tables found in config file
'/usr/local/etc/piler/manticore.conf' 6. I reboot the
system to have all services running systemctl status
pilersearch.service show: Process: 611
ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited,
status=0/SUCCESS) Main PID: 615 (searchd) Tasks:
10 (limit: 4675) Memory: 52.2M CPU: 314ms
CGroup: /system.slice/pilersearch.service
├─614 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf ├─615
/usr/bin/searchd --config /usr/local/etc/piler/sphinx.conf
└─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312
--threads=2 Mär 19 20:27:40 piler searchd[611]: Copyright
(c) 2008-2016, Sphinx Technologies Inc
(http://sphinxsearch.com) Mär 19 20:27:40 piler
searchd[611]: Copyright (c) 2017-2023, Manticore Software
LTD (https://manticoresearch.com) Mär 19 20:27:40 piler
searchd[611]: WARNING: key 'docinfo' was permanently
removed from configuration. Refer to documentation for
details. So it still uses the old sphinx.conf Was my steps
ok? Am 19.03.23 um 18:48 schrieb Janos SUTO:
Your configs look fine. The errno=1064 means that no
such local index. Show me "ls -la
/var/piler/manticore/" output, too. In my test
environment it looks like: ls -la
/var/piler/manticore/ total 4796 drwx-- 2 piler
piler 4096 Mar 19 17:43 . drwxr-xr-x 10 root
root 4096 Mar 19 17:01 .. -rw--- 1 piler
piler 8 Mar 19 17:43 binlog.001 -rw--- 1
piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43
binlog.meta -rw--- 1 piler piler 2731 Mar 19
17:43 manticore.log -rw--- 1 piler piler 0
Mar 19 17:03 note1.lock -rw--- 1 piler piler
1200 Mar 19 17:03 note1.meta -rw--- 1 piler
piler 20 Mar 19 17:03 note1.ram -rw--- 1
piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler 1569 Mar 19 17:43
piler1.meta -rw--- 1 piler piler 4862221 Mar 19
17:43 piler1.ram -rw--- 1 piler piler 893 Mar
19 17:01 query.log -rw--- 1 piler piler 0
Mar 19 17:03 tag1.lock -rw--- 1 piler piler
1199 Mar 19 17:03 tag1.meta -rw--- 1 piler
piler 20 Mar 19 17:03 tag1.ram Janos On
2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf # # minimal
manticore configuration suited to piler # index
piler1 { type = rt path =
/var/piler/manticore/piler1 rt_mem_limit =
512M stored_fields = min_word_len = 1
min_prefix_len = 5 charset_table = 0..9,
english, _, \
U+C1->U+E1
Re: failed to store index data
Yes, please. Reindex works just as before.
Janos
On Mar 19, 2023, 20:47, at 20:47, Jonathan Baecker wrote:
>
>
>Thank you, that was the trick! But I still have to run: reindex -a?
>
>Am 19.03.23 um 20:44 schrieb Janos SUTO:
>>
>>
>> From your previous emails, you set real-time (rt) indexing. For such
>> setup,
>> don't run the indexer utility, no need for it any longer.
>>
>> Also be sure to update the pilersearch.service as in
>>
>https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
>>
>> I think you'll be fine after that, manticore will create the required
>> index files.
>>
>> Janos
>>
>> On 2023-03-19 20:36, Jonathan Baecker wrote:
>>> This folder is empty and I also can not reindex. I recover my system
>>> to a state where it was works. Maybe I miss a step, so here are my
>>> steps:
>>>
>>> 1. piler 1.4.3 runs with sphinx under debian 11.
>>> 2. I install manticore 6.0.x from webpage
>>> 3. cp /usr/local/etc/piler/manticore.conf.dist
>>> /usr/local/etc/piler/manticore.conf
>>> 4. add db settings to /usr/local/etc/piler/manticore.conf
>>> 4. apply all changes from mailpiler doc about switching to manticore
>>> 5. when I run as piler user: indexer --all --config
>>> /usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
>>> found in config file '/usr/local/etc/piler/manticore.conf'
>>> 6. I reboot the system to have all services running
>>>
>>> systemctl status pilersearch.service show:
>>>
>>> Process: 611 ExecStart=/usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
>>> Main PID: 615 (searchd)
>>> Tasks: 10 (limit: 4675)
>>> Memory: 52.2M
>>> CPU: 314ms
>>> CGroup: /system.slice/pilersearch.service
>>> ├─614 /usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf
>>> ├─615 /usr/bin/searchd --config
>>> /usr/local/etc/piler/sphinx.conf
>>> └─620 /usr/bin/manticore-executor -n
>>> /tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2
>>>
>>> Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
>>> Technologies Inc (http://sphinxsearch.com)
>>> Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023,
>Manticore
>>> Software LTD (https://manticoresearch.com)
>>> Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
>>> permanently removed from configuration. Refer to documentation for
>>> details.
>>>
>>> So it still uses the old sphinx.conf
>>>
>>> Was my steps ok?
>>>
>>>
>>>
>>> Am 19.03.23 um 18:48 schrieb Janos SUTO:
Your configs look fine. The errno=1064 means that no such local
>index.
Show me "ls -la /var/piler/manticore/" output, too.
In my test environment it looks like:
ls -la /var/piler/manticore/
total 4796
drwx-- 2 piler piler 4096 Mar 19 17:43 .
drwxr-xr-x 10 root root 4096 Mar 19 17:01 ..
-rw--- 1 piler piler 8 Mar 19 17:43 binlog.001
-rw--- 1 piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43 binlog.meta
-rw--- 1 piler piler 2731 Mar 19 17:43 manticore.log
-rw--- 1 piler piler 0 Mar 19 17:03 note1.lock
-rw--- 1 piler piler 1200 Mar 19 17:03 note1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 note1.ram
-rw--- 1 piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler 1569 Mar 19 17:43 piler1.meta
-rw--- 1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw--- 1 piler piler 893 Mar 19 17:01 query.log
-rw--- 1 piler piler 0 Mar 19 17:03 tag1.lock
-rw--- 1 piler piler 1199 Mar 19 17:03 tag1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 tag1.ram
Janos
On 2023-03-19 17:15, Jonathan Baecker wrote:
> Ah sorry! Here is the output, but I run:
> /usr/local/etc/piler/manticore.conf
>
> #
> # minimal manticore configuration suited to piler
> #
>
>
> index piler1
> {
> type = rt
> path = /var/piler/manticore/piler1
> rt_mem_limit = 512M
> stored_fields =
> min_word_len = 1
> min_prefix_len = 5
> charset_table = 0..9, english, _, \
> U+C1->U+E1, U+C4->U+E4,
>U+C5->U+E5,
> U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
> U+D8->U+F8, \
> U+DA->U+FA, U+DC->U+FC,
> U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
> U+01E3->U+E6, U+01FC->U+E6, \
> U+01FD->U+E6, U+1D01->U+E6,
> U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
> U+DF, U+E1, U+E4, U+E5, U+E6,
>U+E9,
> U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
> # See
>
>https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-colu
Re: failed to store index data
Thank you, that was the trick! But I still have to run: reindex -a?
Am 19.03.23 um 20:44 schrieb Janos SUTO:
From your previous emails, you set real-time (rt) indexing. For such
setup,
don't run the indexer utility, no need for it any longer.
Also be sure to update the pilersearch.service as in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
I think you'll be fine after that, manticore will create the required
index files.
Janos
On 2023-03-19 20:36, Jonathan Baecker wrote:
This folder is empty and I also can not reindex. I recover my system
to a state where it was works. Maybe I miss a step, so here are my
steps:
1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf
4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
found in config file '/usr/local/etc/piler/manticore.conf'
6. I reboot the system to have all services running
systemctl status pilersearch.service show:
Process: 611 ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
Main PID: 615 (searchd)
Tasks: 10 (limit: 4675)
Memory: 52.2M
CPU: 314ms
CGroup: /system.slice/pilersearch.service
├─614 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
├─615 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
└─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
permanently removed from configuration. Refer to documentation for
details.
So it still uses the old sphinx.conf
Was my steps ok?
Am 19.03.23 um 18:48 schrieb Janos SUTO:
Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.
In my test environment it looks like:
ls -la /var/piler/manticore/
total 4796
drwx-- 2 piler piler 4096 Mar 19 17:43 .
drwxr-xr-x 10 root root 4096 Mar 19 17:01 ..
-rw--- 1 piler piler 8 Mar 19 17:43 binlog.001
-rw--- 1 piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43 binlog.meta
-rw--- 1 piler piler 2731 Mar 19 17:43 manticore.log
-rw--- 1 piler piler 0 Mar 19 17:03 note1.lock
-rw--- 1 piler piler 1200 Mar 19 17:03 note1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 note1.ram
-rw--- 1 piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler 1569 Mar 19 17:43 piler1.meta
-rw--- 1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw--- 1 piler piler 893 Mar 19 17:01 query.log
-rw--- 1 piler piler 0 Mar 19 17:03 tag1.lock
-rw--- 1 piler piler 1199 Mar 19 17:03 tag1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 tag1.ram
Janos
On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf
#
# minimal manticore configuration suited to piler
#
index piler1
{
type = rt
path = /var/piler/manticore/piler1
rt_mem_limit = 512M
stored_fields =
min_word_len = 1
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
# See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
# if you want to enable columnar storage
# columnar_attrs = *
rt_field = sender
rt_field = rcpt
rt_field = senderdomain
rt_field = rcptdomain
rt_field = subject
rt_field = body
rt_field = attachment_types
rt_attr_bigint = arrived
rt_attr_bigint = sent
rt_attr_uint = size
rt_attr_uint = direction
rt_attr_uint = folder
rt_attr_uint = attachments
}
index tag1
{
type = rt
path = /var/piler/manticore/tag1
rt_mem_limit = 16M
stored_fields = tag
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
Re: failed to store index data
From your previous emails, you set real-time (rt) indexing. For such
setup,
don't run the indexer utility, no need for it any longer.
Also be sure to update the pilersearch.service as in
https://bitbucket.org/jsuto/piler/src/master/systemd/pilersearch.service
I think you'll be fine after that, manticore will create the required
index files.
Janos
On 2023-03-19 20:36, Jonathan Baecker wrote:
This folder is empty and I also can not reindex. I recover my system
to a state where it was works. Maybe I miss a step, so here are my
steps:
1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf
4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables
found in config file '/usr/local/etc/piler/manticore.conf'
6. I reboot the system to have all services running
systemctl status pilersearch.service show:
Process: 611 ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
Main PID: 615 (searchd)
Tasks: 10 (limit: 4675)
Memory: 52.2M
CPU: 314ms
CGroup: /system.slice/pilersearch.service
├─614 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
├─615 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
└─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
permanently removed from configuration. Refer to documentation for
details.
So it still uses the old sphinx.conf
Was my steps ok?
Am 19.03.23 um 18:48 schrieb Janos SUTO:
Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.
In my test environment it looks like:
ls -la /var/piler/manticore/
total 4796
drwx-- 2 piler piler 4096 Mar 19 17:43 .
drwxr-xr-x 10 root root 4096 Mar 19 17:01 ..
-rw--- 1 piler piler 8 Mar 19 17:43 binlog.001
-rw--- 1 piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43 binlog.meta
-rw--- 1 piler piler 2731 Mar 19 17:43 manticore.log
-rw--- 1 piler piler 0 Mar 19 17:03 note1.lock
-rw--- 1 piler piler 1200 Mar 19 17:03 note1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 note1.ram
-rw--- 1 piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler 1569 Mar 19 17:43 piler1.meta
-rw--- 1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw--- 1 piler piler 893 Mar 19 17:01 query.log
-rw--- 1 piler piler 0 Mar 19 17:03 tag1.lock
-rw--- 1 piler piler 1199 Mar 19 17:03 tag1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 tag1.ram
Janos
On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf
#
# minimal manticore configuration suited to piler
#
index piler1
{
type = rt
path = /var/piler/manticore/piler1
rt_mem_limit = 512M
stored_fields =
min_word_len = 1
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
# See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
# if you want to enable columnar storage
# columnar_attrs = *
rt_field = sender
rt_field = rcpt
rt_field = senderdomain
rt_field = rcptdomain
rt_field = subject
rt_field = body
rt_field = attachment_types
rt_attr_bigint = arrived
rt_attr_bigint = sent
rt_attr_uint = size
rt_attr_uint = direction
rt_attr_uint = folder
rt_attr_uint = attachments
}
index tag1
{
type = rt
path = /var/piler/manticore/tag1
rt_mem_limit = 16M
stored_fields = tag
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F
Re: failed to store index data
This folder is empty and I also can not reindex. I recover my system to
a state where it was works. Maybe I miss a step, so here are my steps:
1. piler 1.4.3 runs with sphinx under debian 11.
2. I install manticore 6.0.x from webpage
3. cp /usr/local/etc/piler/manticore.conf.dist
/usr/local/etc/piler/manticore.conf
4. add db settings to /usr/local/etc/piler/manticore.conf
4. apply all changes from mailpiler doc about switching to manticore
5. when I run as piler user: indexer --all --config
/usr/local/etc/piler/manticore.conf it gives me: FATAL: no tables found
in config file '/usr/local/etc/piler/manticore.conf'
6. I reboot the system to have all services running
systemctl status pilersearch.service show:
Process: 611 ExecStart=/usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf (code=exited, status=0/SUCCESS)
Main PID: 615 (searchd)
Tasks: 10 (limit: 4675)
Memory: 52.2M
CPU: 314ms
CGroup: /system.slice/pilersearch.service
├─614 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
├─615 /usr/bin/searchd --config
/usr/local/etc/piler/sphinx.conf
└─620 /usr/bin/manticore-executor -n
/tmp/manticore-buddy.phar --listen=http://127.0.0.1:9312 --threads=2
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2008-2016, Sphinx
Technologies Inc (http://sphinxsearch.com)
Mär 19 20:27:40 piler searchd[611]: Copyright (c) 2017-2023, Manticore
Software LTD (https://manticoresearch.com)
Mär 19 20:27:40 piler searchd[611]: WARNING: key 'docinfo' was
permanently removed from configuration. Refer to documentation for details.
So it still uses the old sphinx.conf
Was my steps ok?
Am 19.03.23 um 18:48 schrieb Janos SUTO:
Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.
In my test environment it looks like:
ls -la /var/piler/manticore/
total 4796
drwx-- 2 piler piler 4096 Mar 19 17:43 .
drwxr-xr-x 10 root root 4096 Mar 19 17:01 ..
-rw--- 1 piler piler 8 Mar 19 17:43 binlog.001
-rw--- 1 piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43 binlog.meta
-rw--- 1 piler piler 2731 Mar 19 17:43 manticore.log
-rw--- 1 piler piler 0 Mar 19 17:03 note1.lock
-rw--- 1 piler piler 1200 Mar 19 17:03 note1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 note1.ram
-rw--- 1 piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler 1569 Mar 19 17:43 piler1.meta
-rw--- 1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw--- 1 piler piler 893 Mar 19 17:01 query.log
-rw--- 1 piler piler 0 Mar 19 17:03 tag1.lock
-rw--- 1 piler piler 1199 Mar 19 17:03 tag1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 tag1.ram
Janos
On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf
#
# minimal manticore configuration suited to piler
#
index piler1
{
type = rt
path = /var/piler/manticore/piler1
rt_mem_limit = 512M
stored_fields =
min_word_len = 1
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
# See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
# if you want to enable columnar storage
# columnar_attrs = *
rt_field = sender
rt_field = rcpt
rt_field = senderdomain
rt_field = rcptdomain
rt_field = subject
rt_field = body
rt_field = attachment_types
rt_attr_bigint = arrived
rt_attr_bigint = sent
rt_attr_uint = size
rt_attr_uint = direction
rt_attr_uint = folder
rt_attr_uint = attachments
}
index tag1
{
type = rt
path = /var/piler/manticore/tag1
rt_mem_limit = 16M
stored_fields = tag
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA,
Re: failed to store index data
Your configs look fine. The errno=1064 means that no such local index.
Show me "ls -la /var/piler/manticore/" output, too.
In my test environment it looks like:
ls -la /var/piler/manticore/
total 4796
drwx-- 2 piler piler4096 Mar 19 17:43 .
drwxr-xr-x 10 root root 4096 Mar 19 17:01 ..
-rw--- 1 piler piler 8 Mar 19 17:43 binlog.001
-rw--- 1 piler piler 0 Mar 19 17:03 binlog.lock
-rw--- 1 piler piler 11 Mar 19 17:43 binlog.meta
-rw--- 1 piler piler2731 Mar 19 17:43 manticore.log
-rw--- 1 piler piler 0 Mar 19 17:03 note1.lock
-rw--- 1 piler piler1200 Mar 19 17:03 note1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 note1.ram
-rw--- 1 piler piler 0 Mar 19 17:03 piler1.lock
-rw--- 1 piler piler1569 Mar 19 17:43 piler1.meta
-rw--- 1 piler piler 4862221 Mar 19 17:43 piler1.ram
-rw--- 1 piler piler 893 Mar 19 17:01 query.log
-rw--- 1 piler piler 0 Mar 19 17:03 tag1.lock
-rw--- 1 piler piler1199 Mar 19 17:03 tag1.meta
-rw--- 1 piler piler 20 Mar 19 17:03 tag1.ram
Janos
On 2023-03-19 17:15, Jonathan Baecker wrote:
Ah sorry! Here is the output, but I run:
/usr/local/etc/piler/manticore.conf
#
# minimal manticore configuration suited to piler
#
index piler1
{
type = rt
path = /var/piler/manticore/piler1
rt_mem_limit = 512M
stored_fields =
min_word_len = 1
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
# See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
# if you want to enable columnar storage
# columnar_attrs = *
rt_field = sender
rt_field = rcpt
rt_field = senderdomain
rt_field = rcptdomain
rt_field = subject
rt_field = body
rt_field = attachment_types
rt_attr_bigint = arrived
rt_attr_bigint = sent
rt_attr_uint = size
rt_attr_uint = direction
rt_attr_uint = folder
rt_attr_uint = attachments
}
index tag1
{
type = rt
path = /var/piler/manticore/tag1
rt_mem_limit = 16M
stored_fields = tag
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
rt_field = tag
rt_attr_bigint = mid
rt_attr_uint = uid
}
index note1
{
type = rt
path = /var/piler/manticore/note1
rt_mem_limit = 16M
stored_fields = note
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6,
U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
rt_field = note
rt_attr_bigint = mid
rt_attr_uint = uid
}
searchd
{
listen = 127.0.0.1:9312
listen = 127.0.0.1:9306:mysql41
log = /var/piler/manticore/manticore.log
binlog_max_log_size = 256M
binlog_path = /var/piler/manticore
binlog_flush = 2
query_log = /var/piler/manticore/query.log
network_timeout = 5
pid_file = /var/run/piler/searchd.pid
seamless_rotate = 1
preopen_indexes = 1
unlink_old = 1
thread_stack = 512k
rt_flush_period = 300
}
Am 19.03.23 um 16:35 schrieb Janos SUTO:
I meant to execute /etc/piler/manticore.conf (yes, it's executable).
Janos
On 2023-03-19 16:06, Jonathan Baecker wrote:
Am 19.0
Re: failed to store index data
Ah sorry! Here is the output, but I run: /usr/local/etc/piler/manticore.conf
#
# minimal manticore configuration suited to piler
#
index piler1
{
type = rt
path = /var/piler/manticore/piler1
rt_mem_limit = 512M
stored_fields =
min_word_len = 1
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
# See
https://manual.manticoresearch.com/Creating_an_index/Data_types#Row-wise-and-columnar-attribute-storages
# if you want to enable columnar storage
# columnar_attrs = *
rt_field = sender
rt_field = rcpt
rt_field = senderdomain
rt_field = rcptdomain
rt_field = subject
rt_field = body
rt_field = attachment_types
rt_attr_bigint = arrived
rt_attr_bigint = sent
rt_attr_uint = size
rt_attr_uint = direction
rt_attr_uint = folder
rt_attr_uint = attachments
}
index tag1
{
type = rt
path = /var/piler/manticore/tag1
rt_mem_limit = 16M
stored_fields = tag
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
rt_field = tag
rt_attr_bigint = mid
rt_attr_uint = uid
}
index note1
{
type = rt
path = /var/piler/manticore/note1
rt_mem_limit = 16M
stored_fields = note
min_word_len = 2
min_prefix_len = 5
charset_table = 0..9, english, _, \
U+C1->U+E1, U+C4->U+E4, U+C5->U+E5,
U+C6->U+E6, U+C9->U+E9, U+CD->U+ED, U+D3->U+F3, U+D6->U+F6, U+D8->U+F8, \
U+DA->U+FA, U+DC->U+FC,
U+0150->U+0151, U+0152->U+0153, U+0170->U+0171, U+01E2->U+E6,
U+01E3->U+E6, U+01FC->U+E6, \
U+01FD->U+E6, U+1D01->U+E6,
U+1D02->U+E6, U+1D2D->U+E6, U+1D46->U+E6, \
U+DF, U+E1, U+E4, U+E5, U+E6, U+E9,
U+ED, U+00F3, U+F6, U+F8, U+FA, U+FC, U+0151, U+0153, U+0171
rt_field = note
rt_attr_bigint = mid
rt_attr_uint = uid
}
searchd
{
listen = 127.0.0.1:9312
listen = 127.0.0.1:9306:mysql41
log = /var/piler/manticore/manticore.log
binlog_max_log_size = 256M
binlog_path = /var/piler/manticore
binlog_flush = 2
query_log = /var/piler/manticore/query.log
network_timeout = 5
pid_file = /var/run/piler/searchd.pid
seamless_rotate = 1
preopen_indexes = 1
unlink_old = 1
thread_stack = 512k
rt_flush_period = 300
}
Am 19.03.23 um 16:35 schrieb Janos SUTO:
I meant to execute /etc/piler/manticore.conf (yes, it's executable).
Janos
On 2023-03-19 16:06, Jonathan Baecker wrote:
Am 19.03.23 um 14:27 schrieb Janos SUTO:
Hello Jonathan,
Hello Jano, thank you for you quick response!
please tell me more about your setup. Show me the output of
pilerconf |grep -E '(sph|rtindex)'
Output is:
rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306
and
/etc/piler/manticore.conf
Content is:
define('RT', 1);
Be sure to redact any passwords.
Janos
On 2023-03-19 14:11, Jonathan Baecker wrote:
Hello,
I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check piler
service, I get this error:
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 p
Re: failed to store index data
I meant to execute /etc/piler/manticore.conf (yes, it's executable).
Janos
On 2023-03-19 16:06, Jonathan Baecker wrote:
Am 19.03.23 um 14:27 schrieb Janos SUTO:
Hello Jonathan,
Hello Jano, thank you for you quick response!
please tell me more about your setup. Show me the output of
pilerconf |grep -E '(sph|rtindex)'
Output is:
rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306
and
/etc/piler/manticore.conf
Content is:
define('RT', 1);
Be sure to redact any passwords.
Janos
On 2023-03-19 14:11, Jonathan Baecker wrote:
Hello,
I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check
piler
service, I get this error:
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb failed to store index data for
id=31270, errno=1064, append ret=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
sph_index WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
rcpt WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
metadata WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: unlinking
/var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored metadata, rc=1
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to
/var/piler/error/E07M4E0192DW6TN0
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0:
5000641708f61c491c9c0069477d77cb, size=39327/11168,
attachments=0,
reference=,
message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>,
retention=2557, folder=0, delay=0.1183, status=error
After Update I run mysql piler < ./util/db-upgrade.sql But I think it
had done nothing.
Do you have any idea, how to fix this?
Have a good day!
jb
Re: failed to store index data
Am 19.03.23 um 14:27 schrieb Janos SUTO:
Hello Jonathan,
Hello Jano, thank you for you quick response!
please tell me more about your setup. Show me the output of
pilerconf |grep -E '(sph|rtindex)'
Output is:
rtindex=1
sphxdb=piler1
sphxhost=127.0.0.1
sphxport=9306
and
/etc/piler/manticore.conf
Content is:
define('RT', 1);
Be sure to redact any passwords.
Janos
On 2023-03-19 14:11, Jonathan Baecker wrote:
Hello,
I just update piler from 1.3.9 to 1.4.3 and I also switched to
manticore. But now piler can not receive new mails. when I check piler
service, I get this error:
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: touch
2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK
(<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>)
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored
'5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: updated meta reference for
'', rc=0
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb failed to store index data for
id=31270, errno=1064, append ret=0
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
sph_index WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
rcpt WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
metadata WHERE id=31270
Mär 19 14:06:52 piler piler[567]: ERROR:
5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM
attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb'
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: unlinking
/var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m
Mär 19 14:06:52 piler piler[567]:
5000641708f61c491c9c0069477d77cb: stored metadata, rc=1
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to
/var/piler/error/E07M4E0192DW6TN0
Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0:
5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0,
reference=,
message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>,
retention=2557, folder=0, delay=0.1183, status=error
After Update I run mysql piler < ./util/db-upgrade.sql But I think it
had done nothing.
Do you have any idea, how to fix this?
Have a good day!
jb
Re: failed to store index data
Hi, are you using manticore 6.0.4? If yes revert back to manticore 6.0.0 and it shoud work. As far as i know piler only supports manticore 6.0.0. Regards BKH > Am 19.03.2023 um 14:11 schrieb Jonathan Baecker : > > > > Hello, > > I just update piler from 1.3.9 to 1.4.3 and I also switched to manticore. But > now piler can not receive new mails. when I check piler service, I get this > error: > > > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > hdr_len: 3130, offset: 3 > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > touch 2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK > (<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>) > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > stored '5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > updated meta reference for '', rc=0 > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > stored 1 recipients, rc=0 > Mär 19 14:06:52 piler piler[567]: ERROR: > 5000641708f61c491c9c0069477d77cb failed to store index data for id=31270, > errno=1064, append ret=0 > Mär 19 14:06:52 piler piler[567]: ERROR: > 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM sph_index > WHERE id=31270 > Mär 19 14:06:52 piler piler[567]: ERROR: > 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM rcpt > WHERE id=31270 > Mär 19 14:06:52 piler piler[567]: ERROR: > 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM metadata > WHERE id=31270 > Mär 19 14:06:52 piler piler[567]: ERROR: > 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM > attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb' > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > unlinking /var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m > Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: > stored metadata, rc=1 > Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to > /var/piler/error/E07M4E0192DW6TN0 > Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: > 5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0, > reference=, > message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>, retention=2557, > folder=0, delay=0.1183, status=error > > > After Update I run mysql piler < ./util/db-upgrade.sql But I think it had > done nothing. > > Do you have any idea, how to fix this? > > > Have a good day! > > jb > > >
Re: failed to store index data
Hello Jonathan, please tell me more about your setup. Show me the output of pilerconf |grep -E '(sph|rtindex)' and /etc/piler/manticore.conf Be sure to redact any passwords. Janos On 2023-03-19 14:11, Jonathan Baecker wrote: Hello, I just update piler from 1.3.9 to 1.4.3 and I also switched to manticore. But now piler can not receive new mails. when I check piler service, I get this error: Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: hdr_len: 3130, offset: 3 Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: touch 2e5fa096927b9a6ac6fe82ff2b81256acfa719eb32031ca68f0d86db45415d9f OK (<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>) Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: stored '5000641708f61c491c9c0069477d77cb.m' 39327/11168 bytes Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: updated meta reference for '', rc=0 Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: stored 1 recipients, rc=0 Mär 19 14:06:52 piler piler[567]: ERROR: 5000641708f61c491c9c0069477d77cb failed to store index data for id=31270, errno=1064, append ret=0 Mär 19 14:06:52 piler piler[567]: ERROR: 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM sph_index WHERE id=31270 Mär 19 14:06:52 piler piler[567]: ERROR: 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM rcpt WHERE id=31270 Mär 19 14:06:52 piler piler[567]: ERROR: 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM metadata WHERE id=31270 Mär 19 14:06:52 piler piler[567]: ERROR: 5000641708f61c491c9c0069477d77cb: rollback sql stmt=DELETE FROM attachment WHERE piler_id='5000641708f61c491c9c0069477d77cb' Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: unlinking /var/piler/store/00/641/77/cb/5000641708f61c491c9c0069477d77cb.m Mär 19 14:06:52 piler piler[567]: 5000641708f61c491c9c0069477d77cb: stored metadata, rc=1 Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: moved to /var/piler/error/E07M4E0192DW6TN0 Mär 19 14:06:52 piler piler[567]: 1/E07M4E0192DW6TN0: 5000641708f61c491c9c0069477d77cb, size=39327/11168, attachments=0, reference=, message-id=<608c730b-8a9d-c4aa-4ebd-7f3dec012...@mail.de>, retention=2557, folder=0, delay=0.1183, status=error After Update I run mysql piler < ./util/db-upgrade.sql But I think it had done nothing. Do you have any idea, how to fix this? Have a good day! jb
