Re: MailPiler on FreeBSD

2022-03-17 Thread sj
Hello Hagen, piler in the early 1.3.x days has switched to epoll which is a Linux only method. I'm not sure if the FreeBSD Linux-compatibility mode actually has proper support to run such binaries. I'd be glad if you could try and share your experiences. Anyway, you are right, the

Re: Piler 1.3.10 issues with imap importing (Lotus Domino Server) from GUI

2021-08-21 Thread sj
Hello Hugo, I'm so sorry that the fix took quite some time to be made. Please get this commit and it solves this issue. Janos On 2021-01-27 16:35, Hugo Alvarez wrote: Hi Janos, First thanks for all.

Re: Piler auditor login error

2021-06-26 Thread sj
Hello, On 2021-06-25 21:34, Marcelo Machado wrote: I did a fresh installation of Mail Piler version 1.3.11 on Ubuntu 16.04 and when I log in with auditor user, the error message "HTTP ERROR 500" appears. The apache error log shows the error "PHP Parse error: syntax error, unexpected '=' in

Re: pilerexport where_condition query length limitation

2021-05-03 Thread sj
Hello Ryan, I've updated pilerexport.c to have the increased buffer size, also print the sphinx query to see what's going on with this commit: Janos On 2021-05-04 02:39, Ryan Blenis wrote: Follow up for

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
The main search query is equivalent in capabilities with the 'advanced' search. In fact I personally consider it the preferred way to search. See the examples at Also consider the below query how to use it: a:pdf raw: @subject test

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
OK, this commit gives you the raw: label: Whatever you enter after 'raw:', it will be inside the MATCH('') clause. Janos On 2021-05-02 09:15, Ryan Blenis wrote: Hi Janos, On Sun, May 2, 2021 at 2:24 AM

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
Hello Ryan, On 2021-05-02 01:15, Ryan Blenis wrote: 1. Is there a way to have the pilerexport dry run output the number of attachments linked to the query? Just to clarify. Let's say you have 10 matching emails with 15 attachments total, and you want pilerexport to print 15? 2. Would

Re: AW: Restore to O365 fails

2021-04-27 Thread sj
Hello Martin, On 2021-04-27 15:23, Martin Nadvornik wrote: we also have the same or at least a similar problem. However not with every mail but with most. We were so far also unable to find the root cause for this and can't see any distinctive differences between mails that fail to restore

Re: O365 - ADSync and groups

2021-04-17 Thread sj
On 2021-04-17 00:36, Alexander Noack wrote: I created a group in Piler by the name of a Public Folder and assigned the email addresses from the rcpt table for that Public Folder. Now I am trying to add the Group to the user session via CUSTOM_EMAIL_QUERY_FUNCTION but apparently the auth_data

Re: pilerexport w flag matching

2021-04-08 Thread sj
Hello Ryan, try getting the master branch, do a complete build, however, don't install it. Instead enter the src directory, use LD_LIBRARY_PATH=. to make sure ./pilerexport will use the recently built file, and try again. Also it's worth to check what's going on

Re: pilerexport w flag matching

2021-04-07 Thread sj
Hello Ryan, On 2021-04-08 01:36, Ryan Blenis wrote: Thanks, that led me to what is causing the issue / confusion. The -w switch is described as "Where condition to pass to sphinx, eg. "match('@subject: piler')" Which led me to believe the MATCH string was all that was supposed to be

Re: pilerexport w flag matching

2021-04-07 Thread sj
Hello Ryan, please apply this patch to pilerexport.c, and recompile it. It syslogs the sphinx query. Then try the following. Enter the search query on the gui, and record the sphinx query syslogged. Then

Re: Problem after Ubuntu Upgrade from 16.04 to 18.04

2021-04-06 Thread sj
Hello Frank, in openssl 1.1.x the output of the openssl command has changed. Assuming your mentioned piler installation is older than 2020-10-17, then I suggest to try updating system/helper/TrustedTimestamps.php from the master branch, and let's see how it goes. Janos On 2021-04-06

Re: - File is missing?

2021-03-07 Thread sj
Hello BKH, you are right. The postinstall created cron entries indeed have, however such script doesn't exist. The original purpose of the script would be to display a warning on the health page when the main1.* files have been grown pretty large and it's worth to

Renaming the group table

2021-02-26 Thread sj
Dear piler users, I'd like to get your help with The issue is about finding a better name for the group table. The problem is that "group" is a reserved keyword in sql, so you need to backtick it in a

piler 1.3.11 has been released

2021-02-23 Thread sj
Dear piler users, I've just released 1.3.11, a bugfix release addressing the crash of piler-smtp daemon. It occurs under certain conditions, usually when piler runs in a virtual machine, and it's suspended by a backup application while processing an email. When the VM is resumed then

Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread sj
On 2021-02-22 14:19, Wagner, Patrick wrote: We can probably get rid of the tempory debug output code, can't we? Yes. Either remove them for yourself or get the master branch, and recompile, then overwrite the piler-smtp binary. Janos On 22.02.2021 13:17, wrote: Hello,

Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread sj
Hello, thank you for both of your feedbacks. As much as I dislike systemd, it allows you to restart piler-smtp in case it crashes. But hopefully it won't happen in the future after this fix. Also I've merged it to the master branch, and I'll release a bugfix version 1.3.11, and I'll make a

Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-15 Thread sj
Hello Patrick, thank you for your feedback. I'd like you to update the smtpsegv branch, and recompile piler-smtp. I've refactored the timeout checks, and pushed the commit to the branch on bitbucket. Janos On 2021-02-15 14:34, Wagner, Patrick wrote: Hello Janos, happened Sa->So this

Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-10 Thread sj
Hello Patrick, then we need to dig deeper to understand what's going on. I created a new branch to have some extra debugging. Please check out this commit: Perhaps it's easier to get

Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-09 Thread sj
Hello Patrick, I've been reported such issues when a backup system paused or froze the virtual machine running piler. I suspect that it might be the case for you based on the time and days you mentioned. The problem in such cases is that piler-smtp is in the middle of processing an email,

Re: Piler 1.3.10 issues with imap importing (Lotus Domino Server) from GUI

2021-01-26 Thread sj
Hello Hugo, thank you for the pacthes. Have you tried to use with python3? Also can you track what happens or at what point pilerimport stucks? Anything relevant in the mail logs? I've just re-run the import test, and pilerimport has properly updated the import table.

The future of centos

2021-01-06 Thread sj
Dear piler users, I'm aware of that many of you use centos 6, 7 and 8. And some systemd un-fans even centos 5. I assume all of you have heard the recent news that centos 8 deceases at the end of this year as we know it, and Redhat suggests to move to Centos Stream:

piler 1.3.10 has been released

2021-01-03 Thread sj
Dear piler users, new year, new release. I've just released version 1.3.10. The release notes document has 3 items: - switching from Blowfish to AES-256 - obsoleted the tcp_wrappers with a postscreen style smtp acl list, see my previous email and

A new feature: smtp acl rules

2020-12-29 Thread sj
Dear piler-users, I've been using tcp_wrappers for limiting network access to several daemons, and piler-smtp also supports it. Unfortunately the redhat/centos distros have dropped tcp_wrappers support starting with version 8, and in some cases there might be a better way to do the job.

Re: 1.3.9+ and CJK support in sphinx.conf

2020-12-28 Thread sj
Hello, On 2020-12-27 08:31, d tbsky wrote: I want to upgrade our piler from "1.3.4 + sphinx 2.2" to "1.3.9/10 + sphinx 3.3.1". I notice there is a new config entry at sphinx.conf: "SPHINX_CHARSET_TABLE".I am still confused after reading the document. if I already setup "ngram_len"

Re: sphinx reindex question

2020-12-28 Thread sj
Hello, On 2020-12-28 08:56, d tbsky wrote: I was testing master commit fb9150f and upgrade from sphinx 2.2 to 3.3.1. according to piler manual, I need to reindex everything. so I install a new machine. copy /var/piler and /var/lib/mysql to new machine and do procedure below: rm

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
On 2020-12-14 15:37, jb wrote: I only send you the lines from /var/log/mail.log. Do you wanted other ones to? No. However, when the system boots and starts piler, then you usually have such lines, eg. Dec 13 16:59:17 cust1 piler-smtp[203]: reloaded config: /etc/piler/piler.conf Dec

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
On 2020-12-14 15:13, jb wrote: piler.service: [Unit] Description=Piler daemon mariadb.service ... The systemd files look fine. Dec 14 15:09:01 piler piler-smtp[392]: connected from on fd=6 (active connections: 1) Dec 14 15:09:01 piler

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
Hello Jonathan, On 2020-12-14 13:48, jb wrote: I run here the latest piler version, on debian 10 and I have the problem, that after a restart piler is not saving anymore the emails. I had this now multiple times, and I think it have to do with the file. I saw now many time in

do you use the folder feature?

2020-12-09 Thread sj
Dear piler-users, piler features the folder feature, and I got a request a few years ago to revise and fix it (check out this old branch:, and a new request recently to adjust it. Before deciding whether to revise and fix the

updates on encryption

2020-12-05 Thread sj
Dear piler-users, I'm writing to you about the encryption that piler uses. tl;dr: piler is switching from Blowfish 128 bit to AES 256 bit encryption. It's a bit long and technical to some degree, but please read it through to get the whole picture, and understand there's no need to be

healthcheck tool

2020-10-29 Thread sj
Dear piler users, while I was checking the product mailstore (an email archiving competitor) what features they offer, I found telemetry. The mailstore telemetry is an opt-in feature sends some key metrics allowing the mailstore company to better understand the usage of their product. The

Re: Piler 1.3.5 on Ubuntu 18.04 WebUI doesn't render timestamped Mails

2020-10-17 Thread sj
Hello Patrick, it seems that a few things have changed, so I've fixed the issue to make the feature work again. Please apply the following commits:

Re: Piler 1.3.5 on Ubuntu 18.04 WebUI doesn't render timestamped Mails

2020-10-16 Thread sj
Hello Patrick, for starters the DECRYPT_ATTACHMENT_BINARY should be pileraget (not pilerget). Also it might be worth to go over the steps and check if everything is setup properly:

Re: Using AD Accounts

2020-09-17 Thread sj
Hello Stefan, On 2020-09-17 10:52, Stefan Günther wrote: I have a general question abou using AD accounts in mailpiler. After configuring the AD authentication, I can successfully log into the web interface with one the AD users. My expectation was that this user should automatically be

Re: exact matching for archiving rules possible?

2020-09-10 Thread sj
On 2020-09-10 11:16, Martin Nadvornik wrote: thank you as always for your quick help. You were absoluteley right, using the two rules works perfectly. In case someone stumbles upon this in future and thinks two rules are too unwieldy, the regex "(^|(

Re: exact matching for archiving rules possible?

2020-09-09 Thread sj
Hello Martin, On 2020-09-09 14:33, Martin Nadvornik wrote: I recently discovered that archiving rules like "From:" or "To:" will also trigger for e-mail addresses like "". Is there any way to perform an exaxct matching? I

Re: Piler 1.3.9 / Sphinx 3.3.1

2020-08-29 Thread sj
Hello, get the latest master, it fixes the issue. Janos On 2020-08-29 21:49, - Postfach wrote: Hello Janos, on a completely new installation with Piler 1.3.9 / Sphinx 3.3.1 and with no imported mails i alway get this error: ERROR: index 'delta1': reserved field name 'from'.

Re: pilerimport from IMAP-server with STARTLS

2020-08-27 Thread sj
I suggest to fix Locate this part in the file, and fix the port number: if args.port == 993: conn = imaplib.IMAP4_SSL(args.server) else: conn = imaplib.IMAP4(args.server) Janos On 2020-08-27 10:36, Yann Lehmann wrote: Am 27.08.2020 um 10:09 schrieb

Re: pilerimport from IMAP-server with STARTLS

2020-08-27 Thread sj
Hello, On 2020-08-27 09:57, Yann Lehmann wrote: Due to a server dysfunction of our mail-server, our piler server could not archive mails for several weeks. As most of our users do not delete mails from their inbox very often, there is a good chance that most of them could be imported.

Release of 1.3.9, and support for sphinx-3.3.1

2020-08-17 Thread sj
Dear piler users, I've just released version 1.3.9 of piler. You may find below the changes at the end of this email. I'd like to describe the sphinx related changes in a bit more detail. Sphinx 3.3.1 introduced a strict check on the sql query for the indexer. Instead of relying on the

Re: Piler 1.35 on Ubuntu 18.04 - Web UI doesn't show mail headers / contents

2020-07-31 Thread sj
On 2020-07-31 17:16, Wagner, Patrick wrote: So that issue is fixed now, but has unearthed another - I can find and open all mails just fine as auditor@local, and logging in with my personal account works as well (I'm shown only my emails, as it should be), but another email address / account

Re: Deleting emails

2020-07-22 Thread sj
Hello Marcelo, connect to the piler mysql database, and execute the following query: update metadata set retained=10 where id > x; Then let take care of the rest. x: is the numeric id of the last email you want to keep. Make sure to double check, because after purging the

Re: Enterprise edition

2020-07-22 Thread sj
It's ok. Btw. thanks Martin reporting the website issue. The site's cache was corrupted, now it's back online. Janos On 2020-07-22 21:17, Marcelo Machado wrote: Janos, I'm sorry if I was misunderstood. I didn't know the [1] website and I accidentally entered it thinking I was

Re: Enterprise edition

2020-07-22 Thread sj
I'd like to clarify a few things. I'll use the following conventions in this email to distinguish between the open source and commercial editions of piler: - 'piler': the open source email archiving project - 'piler-ee': the commercial, enterprise version of piler I'm a huge fan of open

Re: Empty message header and body

2020-07-16 Thread sj
On 2020-07-16 21:35, Marcelo Machado wrote: Just an observation. The migration documentation on the website does not mention anything about the piler.key file. "Make sure that piler.key on NEW is the same as on OLD, and if the 'iv' parameter is set on OLD in piler.conf, it must have the

Re: Empty message header and body

2020-07-16 Thread sj
On 2020-07-16 20:31, Marcelo Machado wrote: - is there an iv parameter in the old host's piler.conf file? No. - are the piler.key files on old and new host identical? Not also. That's the problem. Legacy emails can be decrypted with old piler.key only. However, you started to encrypt

Re: Empty message header and body

2020-07-15 Thread sj
Usually I don't require any sensitive information to troubleshoot, eg. your mysql password, or even the attached encryption key. Anyway, I can see that no 'iv' parameter in piler.conf on the new host. However, - is there an iv parameter in the old host's piler.conf file? - are the piler.key

Re: Rcpt Table Question

2020-05-03 Thread sj
Hello Ryan, On 2020-05-03 00:15, Ryan Blenis wrote: Thanks for the quick reply. Yes they're all different... but very oddly formatted. I can send you a copy of the output directly if you'd like, as I don't want to expose a bunch of emails. But the gist is that many have periods, dashes, or

Re: Rcpt Table Question

2020-05-02 Thread sj
Hello Ryan, this must be definitely a bug. What piler version do you use? Try selecting the first 1000 rows for id=37, and check if the recipients are actually all different. Do you still get new rcpt rows for id=37? I suspect that piler tries to keep processing the very same email. Janos

Re: Piler 1.3.8 - config-site.php missing?

2020-04-21 Thread sj
Hello, it's in /usr/local/etc/piler. Janos On 2020-04-21 19:42, - Postfach wrote: Hello, i installed Piler 1.3.8 for testing on a new system like this: wget tar zxvf piler-1.3.8.tar.gz cd piler-1.3.8/ ./configure

procedural documentation of piler

2020-04-19 Thread sj
Dear piler users, there was a thread on GoBD compliance back in 2017. And the conclusion was that all piler needs is a procedural documentation describing what it does with an email. Finally I've made it, thanks for Adrian to persuading me.

Re: SSO Issues

2020-04-17 Thread sj
Hmm, it's odd. Anyway, I'm glad that you made it eventually. I'll check what has changed since 1.37. Btw. the mail log is usually /var/log/mail.log or /var/log/maillog. Janos On 2020-04-17 19:41, Robitaille, Cameron wrote: I have it working now. I downgraded the webui code from 1.38 to

Re: SSO Issues

2020-04-17 Thread sj
Hello, look at the mail log file. Piler syslogs all events. For starters, check config-site.php, and verify that you have enabled ldap authentication. Then check the ldap server, port, ldap helper user account settings. Also check if there's any traffic from the archive to the ldap server.

Re: SSO Issues

2020-04-16 Thread sj
Hello Cameron, based on the ntlm logs the authentication is successful, and apache also says granted. Please check out the mail log as well as apache's error log for additional clues. Also check if you can login by using ldap authentication, ie. not using sso.php but rather the usual

Re: Piler - Backup and Restore

2020-04-16 Thread sj
Hello, your scripts look fine by looking. Do the following to troubleshoot the issue: check the permissions on /var/piler, piler should be able read it, then /var/piler/sphinx dir and its contents must be read-writable for piler. When you start searchd, verify that searchd runs as user

Re: S3 Object Storage

2020-04-06 Thread sj
Hello Koby, On 2020-04-06 07:07, Koby Peleg Hen wrote: Hello all , I am currently on this , Please Janos , make your decision. Since I have looking at your project for very long time , And my client begin to ask for. It is very simple to implenent , because there is simple convertor

Re: S3 Object Storage

2020-04-06 Thread sj
Hello Ryan, On 2020-04-06 00:45, Ryan Blenis wrote: Thank you as always for your quick and in-depth response. I certainly understand the delicate balance between FOSS and enterprise paywalls and feature-sets, and I thank you for even having an open source option to begin with! I'm just

Re: S3 Object Storage

2020-04-05 Thread sj
Hello Ryan, On 2020-04-05 10:55, Ryan Blenis wrote: I see the enterprise version you offer it says one of the features piler has is S3 object storage, which looks like it was originally requested on the mailing list in 2018:

Re: Upgrade from 1.34 to 1.37

2020-02-26 Thread sj
Hello Cameron, well, for starters check out Basically you get the tarball, run configure with the same parameters as before, run make clean all, make install. And update the gui as well. Then restart piler daemons, and you should be fine. Janos

Re: Wrong dates

2020-02-04 Thread sj
The date header is malformed: Date: Thu, 23 Jan 2020 20:11:30 UT Notice the missing "C" letter. Once I appended it, the recognized timestamp was just fine. Janos On 2020-02-04 12:55, Marcelo Machado wrote: Thank you Janos. Below is the header:

Re: groups based on LDAP attribute

2020-01-07 Thread sj
Hello Martin, On 2020-01-07 17:26, Martin Nadvornik wrote: although my answer is a bit late, I still want to thank you for your explanation and example. It worked as expected for our use case. I already knew about the custom authentication function but I never thought of performing an ldap

Re: groups based on LDAP attribute

2019-11-22 Thread sj
Hello Martin, my first idea was the group feature until I saw you had ruled it out. Then the custom email query function is to the rescue, see for more. So let's say you have an ldap attribute called 'aaa' with value 'bbb' having

Comparison of piler vs google vault/office 365

2019-11-20 Thread sj
Dear piler-users, I got a request recently to compare piler with office 365 and google vault. Since both google and o365 offer a cloud based solution with some minor or perhaps not so minor differences between them, I put both them to the blue corner against piler in the red corner.

Re: Authentication against multiple IMAP servers

2019-10-31 Thread sj
Hello, I've fixed the typo in the docs. I suggest you to also set IMAP_PORT and IMAP_SSL parameters. You may run ngrep to figure out what's going on the wire. Janos On 2019-10-31 13:15, hw wrote: Hello Janos, thanks so far :-) I found the typo and it has to be like this:

Re: Authentication against multiple IMAP servers

2019-10-29 Thread sj
Hello, I've just updated the custom authentication docs at Please check out the CUSTOM_PRE_AUTH_FUNCTION feature at the end. Janos On 2019-10-29 10:12, BKH - Post wrote: Hi @all, is there a possibility to establish an

Re: Deletion / Purging of maiil - mail are shown in searchlist

2019-08-28 Thread sj
Hello, I've just redeployed my dev environment. This is how it works (and it works): I selected 3 emails, then as an auditor I removed them. On the gui they were greyed out immediately. Then I ran, and noticed in the mail logs: Aug 28 18:39:00 780405577d9b

Re: Cronjobs - change indexing interval

2019-08-25 Thread sj
Hello, On 2019-08-25 18:29, BKH wrote: unfortunately all older emails were gone in WebGUI. After checking sphinx index i found them in spinx index. I dont know how to get then back to WebGUI an so i tried to reindex. But this did not work for me. In fact that this is not a big problem -

mobile theme removal

2019-08-25 Thread sj
Dear piler users, I'm planning to remove the mobile theme unless some of you are using it actively. In this case drop me an email that I shouldn't. The deadline is 1 week from now. The mobile theme is my clumsy attempt to create a mobile friendly theme, however the default theme still looks

Re: Cronjobs - change indexing interval

2019-08-24 Thread sj
Hello, On 2019-08-24 16:11, BKH wrote: i put define('SPHINX_VERSION', 311); if a similar line wasn't there already, then your sphinx.conf version is not ready for 3.1.1. Grab this one: and

Re: Purging aged / deleted mails

2019-08-24 Thread sj
Hello, did you fix the sphinx version number in sphinx.conf? For sphinx 3.1.1 it should be define('SPHINX_VERSION', 311); Janos On 2019-08-24 15:34, BKH wrote: Hello, i made some progress in building a mail archiv with the help of piler. Now i tried to purge some aged / deleted (i know,

Re: SMTP-Port - Change / Checks vie WebGUI

2019-08-23 Thread sj
Hello, check out config.php, and find $health_smtp_servers variable at the end of it, and fix it. PS: I'll move this variable somewhere above in config.php, so it can be overridden in config-site.php in the future. Janos On 2019-08-22 10:35, BKH wrote: Hello, i changed piler

Re: Ubuntu deb download link broken

2019-06-27 Thread sj
Hello, I don't think it's broken. The link opens just fine. Janos On 2019-06-27 16:11, Yuchen Guo wrote: This link is broken, please fix. Regards YC

Re: Applying Piler for a large / deep folder-hierarchy archive.

2019-06-26 Thread sj
Hello Arnold, well, I'd say give piler a shot and see it for yourself if it works as expected for your use case. And don't let my personal opinion ("rarely used") misguide you. Janos On 2019-06-26 20:39, Arnold Opio Oree wrote: Hello to you all, I'd like to ask about my intended

Re: AW: Downloaded files corrupt

2019-04-30 Thread sj
OK, I see. I've just checked the latest build with some test emails, and I couldn't notice the problem you mentioned. Though I checked with images only as any corruption can be easily spotted. Btw. can you show me a non sensitive corrupted attachment? Perhaps via a filesharing site or

Re: Upgrade Instructions 1.3.5

2019-04-29 Thread sj
Hello Christian, the official upgrade guide mentioned how to upgrade from 1.3.0 to 1.3.4. Since 1.3.5 is a minor bugfix release, I've updated it as "from 1.3.0 to 1.3.5". Let me know if you have any questions. Janos On 2019-04-29 08:46,

Re: Timestamp Authority "disbanded", what to do now?

2019-04-14 Thread sj
Hello Frank, well, I think your only option is to re-stamp existing emails, since you can't really use them to validate without the (now disappeared) TSA authority who issued them. Janos On 2019-04-13 23:33, Frank Schmitz wrote: seems like the timestamping authority I used "disbanded"

Re: Message Failed Verification

2019-02-23 Thread sj
Hello Marcelo, check if you have copied piler.key, piler.conf from old installation. (Based on the new messages displayed properly I assume these files and the piler binaries have proper ownership and permissions.) Janos On 2019-02-23 20:02, Marcelo Machado wrote: Hello everyone. After

Re: Rentention-rules and pilerpurge

2018-11-05 Thread sj
Hello Marina, On 2018-11-05 13:35, Frau Marina Diezler wrote: I turned on periodic purge in the backend so that calling pilerpurge is allowed to delete anything at all. We created some retention rules, for example all mails sent from our gitlab-instance on another host should be deleted

Re: High CPU load of mysqld - still after upgrade to 1.3.4

2018-10-10 Thread sj
Hello Mario, it's great news :-) Janos On 2018-10-10 20:42, Mario Pastoor wrote: thank you for your're quick reply. I've checked the index last weekend and watched the behavior of the machine for the last days and I'm lad to say that CPU load is back to a normal level. (see the attached

Re: Upgrading from old piler to new

2018-10-07 Thread sj
Hello Michael, On 2018-10-07 13:03, Michael Mansour wrote: I'd like to look at exporting emails from the old and into the new, based on emails for all the domain instead of defining email addresses. well, pilerexport can do that. Go to a directory where piler has write access, and expect

Re: How to properly enable memcached ?

2018-10-07 Thread sj
On 2018-10-07 13:00, Michael Mansour wrote: I've tried to search through the documentation for this but can't find anything definitive. I have installed a new 1.3.4 Mail Piler server. I have memcached installed and running, have the PHP PECL Memcached install in PHP also. From the docs:

Re: From logout back to login

2018-10-07 Thread sj
Hello Michael, On 2018-10-07 13:32, Michael Mansour wrote: I noticed I made a small mod in your logout.php script when implementing years ago, I didn't like how it stays on the logout and you have to manually click the back link. So I modified the bottom of your logout.php to: ... }

Re: High CPU load of mysqld - still after upgrade to 1.3.4

2018-10-06 Thread sj
Hello Mario, On 2018-10-05 21:03, Mario Pastoor wrote: first of all a huge "thank you" for this piece of software, Janos! :-) you are welcome :-) Well, it's a nice troubleshooting anyway. The issue is that the select query may not use the proper index, so it takes more and more time to

Re: Upgrading from old piler to new

2018-10-06 Thread sj
Hello Michael, I recommend to upgrade to the latest stable version 1.3.4. One possible way to do it is deploying centos 7 x64 with php 7 on a new host, then exporting all emails from old archive, and import them on new archive. When you have double checked that new archive works properly,

Re: RCPT Table Issue?

2018-07-11 Thread sj
Hello Oliver, On 2018-07-11 19:19, Oliver Werner wrote: i think that i have an issue when importing mails. When using "pilerimport -e .eml" the mail is imported and found in metadata table. But when i check the table rcpt there is no record for the new message exists. In the syslog i don’t

Re: Archiving rules not applied

2018-06-01 Thread sj
Hello Carsten, have you restarted the piler daemon? It reads the rules when starting. Janos On 2018-06-01 11:17, Carsten Pohle wrote: Hi, I've defined a couple of archiving rules (so that matching e-mail would NOT be archived). When testing them with pilertest, they match as intended.

Re: yet another gdpr related email

2018-05-30 Thread sj
Hello Patrick, On 2018-05-27 21:14, Wagner, Patrick wrote: at the end of the gdpr-related-notes document you mention three specific features: delete feature / purging feature / legal hold feature. I'm aware of the documentation for pilerpurge on your website, but what about the other two

yet another gdpr related email

2018-05-27 Thread sj
Dear piler users, now that GDPR is on us, we all got tons of updated privacy policy emails from several places. I've also created the privacy policy for the piler sites, please check This link refers to which

Re: Running as a service

2018-04-25 Thread sj
Hello, if /var/piler/store/00 does not exist, then create it, and chown it to piler. Janos On 2018-04-25 16:09, John Huong wrote: Hi, I'm seeing these in the syslog. Apr 26 00:07:33 archive pilerimport[12512]: 40005ae0a7cf1d86672c005304895f97: mkdir /var/piler/store/00/5ae/5f/97:

Re: Running as a service

2018-04-21 Thread sj
Hello, well, can run in the foreground, so any service manager should be able to handle it. You should check some examples of your favourite implementation. Try this: Janos On 2018-04-19 22:16, John Huong

new feature: support for an external dashboard

2018-04-15 Thread sj
Dear piler users, I've just committed a patchset to the master branch to support an external dashboard. You may check it how it looks on the demo site:, use admin@local as username and pilerrocks as the password. The commit is actually very simple: if an url is set,

Re: Version 1.3.4

2018-03-20 Thread sj
Hello Christian, On 2018-03-20 11:23, Katterl Christian wrote: i noticed, that there's an updated version of mailpiler - version 1.3.4. Unfortunately i could not find recent release-notes or upgrading instructions? The release notes included in the archive are stopping with 1.3.0 and the

A survey on commercial services and products for piler

2018-03-15 Thread sj
Dear piler users, I'd like you to visit, and take a short (really!) survey helping me to work on some piler related commercial services, and a commercial version of piler. A small popup window opens asking whether you want to give feedback. If your first automatic

Re: AW: Problem with distribution groups

2018-02-26 Thread sj
Hello, On 2018-02-26 16:49, Katterl Christian wrote: I reindexed everything and now it’s working for some reason. ok, fine. I've tested the parser with your email, and it was almost fine: it found all the email addresses, however to recipient domain list was empty. I've fixed this, and

Re: Internal messages

2018-02-15 Thread sj
On 2018-02-15 20:09, Marcelo Machado wrote: I need to archive only messages from my domain to my domain. This is possible? it's difficult, because the tre regex doesn't support negating logic. The best would be if you could forward only emails meant to be archived to piler. Janos

Re: AW: BCC not shown

2018-02-13 Thread sj
ok, I see. Try retrieving this email from archive, eg. pilerget 40005a82074b237e7e9400cba0225cf3 > /tmp/1.eml, then check the email, especially the journaling stuff. Your email address (even if it's bcc) should be somewhere in the headers. If so, then run pilertest 1.eml, and check if your

Re: Problem with S/MIME signed mail, Piler 1.31 on Ubuntu LTS 16.04

2018-01-31 Thread sj
Hello Daniel, On 2018-01-31 17:51, Daniel Abegglen wrote: I've problems with S/MIME signed mails. There is no body visible. If I download the .eml file there is not recipient or sender, nor a subject, just header and the S/MIME-part. can you share such a signed and non sensitive email (the

Re: Sphinx sql_query_killlist not applied ?

2018-01-25 Thread sj
On 2018-01-25 19:16, Konstantin wrote: Your query return empty set I supposed that id=11 should be removed from main1... no, not at all. You have removed the message with id=11, and you wondered why you could still see it in the sphinx results? The answer is that the killlist feature

  1   2   >