Re: New Install issues

2015-11-30 Thread sj
Hello Warren, I have everything installed and my health page reports plenty of room and "plier: OK". However, I have no received messages. that's because you probably haven't configured your mail server to forward a copy of the received emails to piler. I was/am confused by the

Re: not loading retention rules dynamicaly

2017-07-11 Thread sj
Hello Uwe, On 2017-07-11 16:21, Uwe Kiewel [ML] wrote: I am interested in to understand why you decided to load the retention rules on startup and not access them dynamicaly during runtime. loading rules then releasing them when processing a given email would cause a significant

Re: AW: GOBD certification

2017-07-25 Thread sj
Hello Zyrixx, thank you for your input, I'll checkout the links you mentioned in more detail later. Just skimming through the first one, it seems that German users are not enchanted by simply showing them a certificate. Anyway, I'll create the procedural documentation. Janos On 2017-07-25

Re: GOBD certification

2017-07-25 Thread sj
Hello Frank, On 2017-07-25 14:47, Frank Schmitz wrote: a GoBD certification would surely result in a higher "visibility" for piler, since quite a lot of companies are basing their business decisions on those. But please do NOT believe that Piler needs a GoBD certification to be used in

GOBD certification

2017-07-24 Thread sj
Dear piler users (especially the German ones at this time), probably all of you have heard that German law mandates that all German businesses must archive emails starting from this year. I've been convinced that it's worth to obtain GOBD certification for piler to offer the choice of freedom

Re: Search results order

2017-07-04 Thread sj
Hello Joern, On 2017-07-04 16:37, Joern Stein wrote: Hi *, my piler (big thanks to Janos for all the development effort!) installation seems to be working quite well, but I'm having some difficulty with the search functions: I'm glad that you like it :-) I'm logged in as the auditor

1.3.0 has been released

2017-06-25 Thread sj
Dear piler users, I'm happy to announce that the final version of piler 1.3.0 has been released. You may download it from bitbucket, see the release notes for the changes. https://bitbucket.org/jsuto/piler/downloads/piler-1.3.0.tar.gz (sha256:

Re: Best Piler Backup Strategy

2017-10-13 Thread sj
Hello, I've just updated the FAQ with the backup and restore procedures. Check out http://www.mailpiler.org/wiki/faq Let me know if anything is ambiguous. Janos On 2017-10-12 19:39, Simone Vassili wrote: Hi, I want to set up a secure backup strategy for my Piler server. What should I

aftermath for a migration

2017-11-10 Thread sj
Dear piler users, I had the pleasure (so to speak) of participating in a piler migration project from hostA to hostB. Both hosts are on the same datacenter, the network bandwidth is unknown to me, but we may assume it's Gbit. There was 2+ TB data to migrate, millions of files to copy. Sftp

Re: AW: LDAP Users can see other's mails

2017-11-26 Thread sj
Hmm, it's odd. Even if a user is member of a group with other users which is totally normal a user still shouldn't see others' emails. Some of the addresses look like some distribution lists. Can you show me such a message you can see and meant for someone else? I'm interested the headers

Re: yet another gdpr related email

2018-05-30 Thread sj
Hello Patrick, On 2018-05-27 21:14, Wagner, Patrick wrote: at the end of the gdpr-related-notes document you mention three specific features: delete feature / purging feature / legal hold feature. I'm aware of the documentation for pilerpurge on your website, but what about the other two

Re: Archiving rules not applied

2018-06-01 Thread sj
Hello Carsten, have you restarted the piler daemon? It reads the rules when starting. Janos On 2018-06-01 11:17, Carsten Pohle wrote: Hi, I've defined a couple of archiving rules (so that matching e-mail would NOT be archived). When testing them with pilertest, they match as intended.

yet another gdpr related email

2018-05-27 Thread sj
Dear piler users, now that GDPR is on us, we all got tons of updated privacy policy emails from several places. I've also created the privacy policy for the piler sites, please check http://www.mailpiler.org/wiki/privacy-policy This link refers to https://mailpiler.com/privacy-policy/ which

Re: Exporting the Search Results Only

2018-01-20 Thread sj
Hello Karl, On 2018-01-18 23:12, Karl Rossing wrote: Is there a way to get a report from: to: size: and subject in text or csv format? What i'm looking for the the output results from the gui search. unfortunately there's no such feature implemented in piler. Janos

Re: Sphinx sql_query_killlist not applied ?

2018-01-24 Thread sj
Hello, On 2018-01-24 19:06, Konstantin wrote: I found that in my archive purged messages not removed from main1 index. Here are the query examples: # Get data from sphinx # mysql -h 127.0.0.1 -P 9306 mysql> show tables; +-+---+ | Index | Type |

Re: Sphinx rotation and deleted messages

2018-01-24 Thread sj
Hello, On 2018-01-24 13:30, Konstantin wrote: I have index file with size over 200Gb and want to rotate main1 to main2 according to the wiki http://www.mailpiler.org/wiki/current:administering-piler Will sphinx clean data from main1 (old index) based on killist if i make change in

Re: Sphinx sql_query_killlist not applied ?

2018-01-25 Thread sj
On 2018-01-25 19:16, Konstantin wrote: Your query return empty set I supposed that id=11 should be removed from main1... no, not at all. You have removed the message with id=11, and you wondered why you could still see it in the sphinx results? The answer is that the killlist feature

Re: Problem with S/MIME signed mail, Piler 1.31 on Ubuntu LTS 16.04

2018-01-31 Thread sj
Hello Daniel, On 2018-01-31 17:51, Daniel Abegglen wrote: I've problems with S/MIME signed mails. There is no body visible. If I download the .eml file there is not recipient or sender, nor a subject, just header and the S/MIME-part. can you share such a signed and non sensitive email (the

Re: AW: BCC not shown

2018-02-13 Thread sj
ok, I see. Try retrieving this email from archive, eg. pilerget 40005a82074b237e7e9400cba0225cf3 > /tmp/1.eml, then check the email, especially the journaling stuff. Your email address (even if it's bcc) should be somewhere in the headers. If so, then run pilertest 1.eml, and check if your

Re: Internal messages

2018-02-15 Thread sj
On 2018-02-15 20:09, Marcelo Machado wrote: I need to archive only messages from my domain to my domain. This is possible? it's difficult, because the tre regex doesn't support negating logic. The best would be if you could forward only emails meant to be archived to piler. Janos

securing piler

2018-01-03 Thread sj
Dear piler users, I got some reports of incidents when spammers had sent lots of crap to piler. The good news is that piler is not an open relay server, even though some open relay scanners tend to say so. In fact piler does NOT relay anything. The bad news is that piler happily archives

Re: RCPT Table Issue?

2018-07-11 Thread sj
Hello Oliver, On 2018-07-11 19:19, Oliver Werner wrote: i think that i have an issue when importing mails. When using "pilerimport -e .eml" the mail is imported and found in metadata table. But when i check the table rcpt there is no record for the new message exists. In the syslog i don’t

A survey on commercial services and products for piler

2018-03-15 Thread sj
Dear piler users, I'd like you to visit http://www.mailpiler.org, and take a short (really!) survey helping me to work on some piler related commercial services, and a commercial version of piler. A small popup window opens asking whether you want to give feedback. If your first automatic

Re: Running pilter.pl as a service

2018-04-21 Thread sj
Hello, well, pilter.pl can run in the foreground, so any service manager should be able to handle it. You should check some examples of your favourite implementation. Try this: https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service Janos On 2018-04-19 22:16, John Huong

new feature: support for an external dashboard

2018-04-15 Thread sj
Dear piler users, I've just committed a patchset to the master branch to support an external dashboard. You may check it how it looks on the demo site: http://demo.mailpiler.org, use admin@local as username and pilerrocks as the password. The commit is actually very simple: if an url is set,

Re: Running pilter.pl as a service

2018-04-25 Thread sj
Hello, if /var/piler/store/00 does not exist, then create it, and chown it to piler. Janos On 2018-04-25 16:09, John Huong wrote: Hi, I'm seeing these in the syslog. Apr 26 00:07:33 archive pilerimport[12512]: 40005ae0a7cf1d86672c005304895f97: mkdir /var/piler/store/00/5ae/5f/97:

Re: Version 1.3.4

2018-03-20 Thread sj
Hello Christian, On 2018-03-20 11:23, Katterl Christian wrote: i noticed, that there's an updated version of mailpiler - version 1.3.4. Unfortunately i could not find recent release-notes or upgrading instructions? The release notes included in the archive are stopping with 1.3.0 and the

Re: AW: Problem with distribution groups

2018-02-26 Thread sj
Hello, On 2018-02-26 16:49, Katterl Christian wrote: I reindexed everything and now it’s working for some reason. ok, fine. I've tested the parser with your email, and it was almost fine: it found all the email addresses, however to recipient domain list was empty. I've fixed this, and

Re: Rentention-rules and pilerpurge

2018-11-05 Thread sj
Hello Marina, On 2018-11-05 13:35, Frau Marina Diezler wrote: I turned on periodic purge in the backend so that calling pilerpurge is allowed to delete anything at all. We created some retention rules, for example all mails sent from our gitlab-instance on another host should be deleted

Re: High CPU load of mysqld - still after upgrade to 1.3.4

2018-10-10 Thread sj
Hello Mario, it's great news :-) Janos On 2018-10-10 20:42, Mario Pastoor wrote: thank you for your're quick reply. I've checked the index last weekend and watched the behavior of the machine for the last days and I'm lad to say that CPU load is back to a normal level. (see the attached

Re: Upgrading from old piler to new

2018-10-06 Thread sj
Hello Michael, I recommend to upgrade to the latest stable version 1.3.4. One possible way to do it is deploying centos 7 x64 with php 7 on a new host, then exporting all emails from old archive, and import them on new archive. When you have double checked that new archive works properly,

Re: High CPU load of mysqld - still after upgrade to 1.3.4

2018-10-06 Thread sj
Hello Mario, On 2018-10-05 21:03, Mario Pastoor wrote: first of all a huge "thank you" for this piece of software, Janos! :-) you are welcome :-) Well, it's a nice troubleshooting anyway. The issue is that the select query may not use the proper index, so it takes more and more time to

Re: From logout back to login

2018-10-07 Thread sj
Hello Michael, On 2018-10-07 13:32, Michael Mansour wrote: I noticed I made a small mod in your logout.php script when implementing years ago, I didn't like how it stays on the logout and you have to manually click the back link. So I modified the bottom of your logout.php to: ... }

Re: How to properly enable memcached ?

2018-10-07 Thread sj
On 2018-10-07 13:00, Michael Mansour wrote: I've tried to search through the documentation for this but can't find anything definitive. I have installed a new 1.3.4 Mail Piler server. I have memcached installed and running, have the PHP PECL Memcached install in PHP also. From the docs:

Re: Upgrading from old piler to new

2018-10-07 Thread sj
Hello Michael, On 2018-10-07 13:03, Michael Mansour wrote: I'd like to look at exporting emails from the old and into the new, based on emails for all the domain instead of defining email addresses. well, pilerexport can do that. Go to a directory where piler has write access, and expect

Re: Message Failed Verification

2019-02-23 Thread sj
Hello Marcelo, check if you have copied piler.key, piler.conf from old installation. (Based on the new messages displayed properly I assume these files and the piler binaries have proper ownership and permissions.) Janos On 2019-02-23 20:02, Marcelo Machado wrote: Hello everyone. After

Re: Timestamp Authority "disbanded", what to do now?

2019-04-14 Thread sj
Hello Frank, well, I think your only option is to re-stamp existing emails, since you can't really use them to validate without the (now disappeared) TSA authority who issued them. Janos On 2019-04-13 23:33, Frank Schmitz wrote: seems like the timestamping authority I used "disbanded"

sphinx 3.1.x support, mailenable support

2019-05-12 Thread sj
Dear piler users, it's unlikely that the sphinx 2.2.x branch will get any more updates. From now on, piler supports sphinx 3.1.1. For the details please check out the piler wiki: http://www.mailpiler.org/wiki/current:sphinx3 if you want to upgrade sphinx from 2.2.x to 3.1.1. If you have a

Re: AW: Downloaded files corrupt

2019-04-30 Thread sj
OK, I see. I've just checked the latest build with some test emails, and I couldn't notice the problem you mentioned. Though I checked with images only as any corruption can be easily spotted. Btw. can you show me a non sensitive corrupted attachment? Perhaps via a filesharing site or

Re: Upgrade Instructions 1.3.5

2019-04-29 Thread sj
Hello Christian, the official upgrade guide mentioned how to upgrade from 1.3.0 to 1.3.4. Since 1.3.5 is a minor bugfix release, I've updated it as "from 1.3.0 to 1.3.5". http://www.mailpiler.org/wiki/current:upgrade Let me know if you have any questions. Janos On 2019-04-29 08:46,

Re: Ubuntu deb download link broken

2019-06-27 Thread sj
Hello, I don't think it's broken. The link opens just fine. Janos On 2019-06-27 16:11, Yuchen Guo wrote: This link https://bitbucket.org/jsuto/piler/downloads/piler_1.3.5~bionic-f2e4cb1_amd64.deb is broken, please fix. Regards YC

Re: Applying Piler for a large / deep folder-hierarchy archive.

2019-06-26 Thread sj
Hello Arnold, well, I'd say give piler a shot and see it for yourself if it works as expected for your use case. And don't let my personal opinion ("rarely used") misguide you. Janos On 2019-06-26 20:39, Arnold Opio Oree wrote: Hello to you all, I'd like to ask about my intended

Re: Cronjobs - change indexing interval

2019-08-24 Thread sj
Hello, On 2019-08-24 16:11, BKH wrote: i put define('SPHINX_VERSION', 311); if a similar line wasn't there already, then your sphinx.conf version is not ready for 3.1.1. Grab this one: https://bitbucket.org/jsuto/piler/raw/c84bea95061820135cc1edcc8beb88ccb0d0f053/etc/sphinx.conf.in and

Re: Purging aged / deleted mails

2019-08-24 Thread sj
Hello, did you fix the sphinx version number in sphinx.conf? For sphinx 3.1.1 it should be define('SPHINX_VERSION', 311); Janos On 2019-08-24 15:34, BKH wrote: Hello, i made some progress in building a mail archiv with the help of piler. Now i tried to purge some aged / deleted (i know,

mobile theme removal

2019-08-25 Thread sj
Dear piler users, I'm planning to remove the mobile theme unless some of you are using it actively. In this case drop me an email that I shouldn't. The deadline is 1 week from now. The mobile theme is my clumsy attempt to create a mobile friendly theme, however the default theme still looks

Re: Deletion / Purging of maiil - mail are shown in searchlist

2019-08-28 Thread sj
Hello, I've just redeployed my dev environment. This is how it works (and it works): I selected 3 emails, then as an auditor I removed them. On the gui they were greyed out immediately. Then I ran pilerpurge.py, and noticed in the mail logs: Aug 28 18:39:00 780405577d9b

Re: Cronjobs - change indexing interval

2019-08-25 Thread sj
Hello, On 2019-08-25 18:29, BKH wrote: unfortunately all older emails were gone in WebGUI. After checking sphinx index i found them in spinx index. I dont know how to get then back to WebGUI an so i tried to reindex. But this did not work for me. In fact that this is not a big problem -

Re: SMTP-Port - Change / Checks vie WebGUI

2019-08-23 Thread sj
Hello, check out config.php, and find $health_smtp_servers variable at the end of it, and fix it. PS: I'll move this variable somewhere above in config.php, so it can be overridden in config-site.php in the future. Janos On 2019-08-22 10:35, BKH wrote: Hello, i changed piler

Re: Authentication against multiple IMAP servers

2019-10-31 Thread sj
Hello, I've fixed the typo in the docs. I suggest you to also set IMAP_PORT and IMAP_SSL parameters. You may run ngrep to figure out what's going on the wire. Janos On 2019-10-31 13:15, hw wrote: Hello Janos, thanks so far :-) I found the typo and it has to be like this:

Re: groups based on LDAP attribute

2019-11-22 Thread sj
Hello Martin, my first idea was the group feature until I saw you had ruled it out. Then the custom email query function is to the rescue, see http://www.mailpiler.org/wiki/current:custom-authentication for more. So let's say you have an ldap attribute called 'aaa' with value 'bbb' having

Re: Authentication against multiple IMAP servers

2019-10-29 Thread sj
Hello, I've just updated the custom authentication docs at http://www.mailpiler.org/wiki/current:custom-authentication Please check out the CUSTOM_PRE_AUTH_FUNCTION feature at the end. Janos On 2019-10-29 10:12, BKH - Post wrote: Hi @all, is there a possibility to establish an

Comparison of piler vs google vault/office 365

2019-11-20 Thread sj
Dear piler-users, I got a request recently to compare piler with office 365 and google vault. Since both google and o365 offer a cloud based solution with some minor or perhaps not so minor differences between them, I put both them to the blue corner against piler in the red corner.

Re: Upgrade from 1.34 to 1.37

2020-02-26 Thread sj
Hello Cameron, well, for starters check out http://www.mailpiler.org/wiki/current:upgrade Basically you get the tarball, run configure with the same parameters as before, run make clean all, make install. And update the gui as well. Then restart piler daemons, and you should be fine. Janos

Re: Wrong dates

2020-02-04 Thread sj
The date header is malformed: Date: Thu, 23 Jan 2020 20:11:30 UT Notice the missing "C" letter. Once I appended it, the recognized timestamp was just fine. Janos On 2020-02-04 12:55, Marcelo Machado wrote: Thank you Janos. Below is the header:

Re: groups based on LDAP attribute

2020-01-07 Thread sj
Hello Martin, On 2020-01-07 17:26, Martin Nadvornik wrote: although my answer is a bit late, I still want to thank you for your explanation and example. It worked as expected for our use case. I already knew about the custom authentication function but I never thought of performing an ldap

Re: Piler - Backup and Restore

2020-04-16 Thread sj
Hello, your scripts look fine by looking. Do the following to troubleshoot the issue: check the permissions on /var/piler, piler should be able read it, then /var/piler/sphinx dir and its contents must be read-writable for piler. When you start searchd, verify that searchd runs as user

Re: SSO Issues

2020-04-17 Thread sj
Hello, look at the mail log file. Piler syslogs all events. For starters, check config-site.php, and verify that you have enabled ldap authentication. Then check the ldap server, port, ldap helper user account settings. Also check if there's any traffic from the archive to the ldap server.

Re: SSO Issues

2020-04-17 Thread sj
Hmm, it's odd. Anyway, I'm glad that you made it eventually. I'll check what has changed since 1.37. Btw. the mail log is usually /var/log/mail.log or /var/log/maillog. Janos On 2020-04-17 19:41, Robitaille, Cameron wrote: I have it working now. I downgraded the webui code from 1.38 to

Re: SSO Issues

2020-04-16 Thread sj
Hello Cameron, based on the ntlm logs the authentication is successful, and apache also says granted. Please check out the mail log as well as apache's error log for additional clues. Also check if you can login by using ldap authentication, ie. not using sso.php but rather the usual

procedural documentation of piler

2020-04-19 Thread sj
Dear piler users, there was a thread on GoBD compliance back in 2017. And the conclusion was that all piler needs is a procedural documentation describing what it does with an email. Finally I've made it, thanks for Adrian to persuading me.

Re: S3 Object Storage

2020-04-05 Thread sj
Hello Ryan, On 2020-04-05 10:55, Ryan Blenis wrote: I see the enterprise version you offer it says one of the features piler has is S3 object storage, which looks like it was originally requested on the mailing list in 2018: https://www.mail-archive.com/piler-user@list.acts.hu/msg01335.html

Re: S3 Object Storage

2020-04-06 Thread sj
Hello Ryan, On 2020-04-06 00:45, Ryan Blenis wrote: Thank you as always for your quick and in-depth response. I certainly understand the delicate balance between FOSS and enterprise paywalls and feature-sets, and I thank you for even having an open source option to begin with! I'm just

Re: S3 Object Storage

2020-04-06 Thread sj
Hello Koby, On 2020-04-06 07:07, Koby Peleg Hen wrote: Hello all , I am currently on this , Please Janos , make your decision. Since I have looking at your project for very long time , And my client begin to ask for. It is very simple to implenent , because there is simple convertor

Re: Piler 1.3.8 - config-site.php missing?

2020-04-21 Thread sj
Hello, it's in /usr/local/etc/piler. Janos On 2020-04-21 19:42, BKH-Netz.de - Postfach wrote: Hello, i installed Piler 1.3.8 for testing on a new system like this: wget https://bitbucket.org/jsuto/piler/downloads/piler-1.3.8.tar.gz tar zxvf piler-1.3.8.tar.gz cd piler-1.3.8/ ./configure

Re: Rcpt Table Question

2020-05-02 Thread sj
Hello Ryan, this must be definitely a bug. What piler version do you use? Try selecting the first 1000 rows for id=37, and check if the recipients are actually all different. Do you still get new rcpt rows for id=37? I suspect that piler tries to keep processing the very same email. Janos

Re: Rcpt Table Question

2020-05-03 Thread sj
Hello Ryan, On 2020-05-03 00:15, Ryan Blenis wrote: Thanks for the quick reply. Yes they're all different... but very oddly formatted. I can send you a copy of the output directly if you'd like, as I don't want to expose a bunch of emails. But the gist is that many have periods, dashes, or

Re: exact matching for archiving rules possible?

2020-09-10 Thread sj
On 2020-09-10 11:16, Martin Nadvornik wrote: thank you as always for your quick help. You were absoluteley right, using the two rules works perfectly. In case someone stumbles upon this in future and thinks two rules are too unwieldy, the regex "(^someth...@example.com)|(

Re: exact matching for archiving rules possible?

2020-09-09 Thread sj
Hello Martin, On 2020-09-09 14:33, Martin Nadvornik wrote: I recently discovered that archiving rules like "From: someth...@example.com" or "To: someth...@example.com" will also trigger for e-mail addresses like "justsometh...@example.com". Is there any way to perform an exaxct matching? I

Re: Piler 1.3.5 on Ubuntu 18.04 WebUI doesn't render timestamped Mails

2020-10-16 Thread sj
Hello Patrick, for starters the DECRYPT_ATTACHMENT_BINARY should be pileraget (not pilerget). Also it might be worth to go over the steps and check if everything is setup properly: https://bitbucket.org/jsuto/piler/issues/480/support-rfc3161-trusted-timestamps

Re: Piler 1.3.5 on Ubuntu 18.04 WebUI doesn't render timestamped Mails

2020-10-17 Thread sj
Hello Patrick, it seems that a few things have changed, so I've fixed the issue to make the feature work again. Please apply the following commits: https://bitbucket.org/jsuto/piler/commits/4a131f3058766ecdeb3021f5478746f58938c2c8

Re: Piler 1.3.9 / Sphinx 3.3.1

2020-08-29 Thread sj
Hello, get the latest master, it fixes the issue. Janos On 2020-08-29 21:49, BKH-Netz.de - Postfach wrote: Hello Janos, on a completely new installation with Piler 1.3.9 / Sphinx 3.3.1 and with no imported mails i alway get this error: ERROR: index 'delta1': reserved field name 'from'.

Re: pilerimport from IMAP-server with STARTLS

2020-08-27 Thread sj
I suggest to fix imapfetch.py. Locate this part in the file, and fix the port number: if args.port == 993: conn = imaplib.IMAP4_SSL(args.server) else: conn = imaplib.IMAP4(args.server) Janos On 2020-08-27 10:36, Yann Lehmann wrote: Am 27.08.2020 um 10:09 schrieb

Re: pilerimport from IMAP-server with STARTLS

2020-08-27 Thread sj
Hello, On 2020-08-27 09:57, Yann Lehmann wrote: Due to a server dysfunction of our mail-server, our piler server could not archive mails for several weeks. As most of our users do not delete mails from their inbox very often, there is a good chance that most of them could be imported.

Release of 1.3.9, and support for sphinx-3.3.1

2020-08-17 Thread sj
Dear piler users, I've just released version 1.3.9 of piler. You may find below the changes at the end of this email. I'd like to describe the sphinx related changes in a bit more detail. Sphinx 3.3.1 introduced a strict check on the sql query for the indexer. Instead of relying on the

Re: Using AD Accounts

2020-09-17 Thread sj
Hello Stefan, On 2020-09-17 10:52, Stefan Günther wrote: I have a general question abou using AD accounts in mailpiler. After configuring the AD authentication, I can successfully log into the web interface with one the AD users. My expectation was that this user should automatically be

Re: Piler 1.35 on Ubuntu 18.04 - Web UI doesn't show mail headers / contents

2020-07-31 Thread sj
On 2020-07-31 17:16, Wagner, Patrick wrote: So that issue is fixed now, but has unearthed another - I can find and open all mails just fine as auditor@local, and logging in with my personal account works as well (I'm shown only my emails, as it should be), but another email address / account

Re: Empty message header and body

2020-07-15 Thread sj
Usually I don't require any sensitive information to troubleshoot, eg. your mysql password, or even the attached encryption key. Anyway, I can see that no 'iv' parameter in piler.conf on the new host. However, - is there an iv parameter in the old host's piler.conf file? - are the piler.key

Re: Empty message header and body

2020-07-16 Thread sj
On 2020-07-16 20:31, Marcelo Machado wrote: - is there an iv parameter in the old host's piler.conf file? No. - are the piler.key files on old and new host identical? Not also. That's the problem. Legacy emails can be decrypted with old piler.key only. However, you started to encrypt

Re: Enterprise edition

2020-07-22 Thread sj
I'd like to clarify a few things. I'll use the following conventions in this email to distinguish between the open source and commercial editions of piler: - 'piler': the open source email archiving project - 'piler-ee': the commercial, enterprise version of piler I'm a huge fan of open

Re: Enterprise edition

2020-07-22 Thread sj
It's ok. Btw. thanks Martin reporting the website issue. The site's cache was corrupted, now it's back online. Janos On 2020-07-22 21:17, Marcelo Machado wrote: Janos, I'm sorry if I was misunderstood. I didn't know the piler.com [1] website and I accidentally entered it thinking I was

Re: Deleting emails

2020-07-22 Thread sj
Hello Marcelo, connect to the piler mysql database, and execute the following query: update metadata set retained=10 where id > x; Then let pilerpurge.py take care of the rest. x: is the numeric id of the last email you want to keep. Make sure to double check, because after purging the

Re: Empty message header and body

2020-07-16 Thread sj
On 2020-07-16 21:35, Marcelo Machado wrote: Just an observation. The migration documentation on the website does not mention anything about the piler.key file. "Make sure that piler.key on NEW is the same as on OLD, and if the 'iv' parameter is set on OLD in piler.conf, it must have the

A new feature: smtp acl rules

2020-12-29 Thread sj
Dear piler-users, I've been using tcp_wrappers for limiting network access to several daemons, and piler-smtp also supports it. Unfortunately the redhat/centos distros have dropped tcp_wrappers support starting with version 8, and in some cases there might be a better way to do the job.

The future of centos

2021-01-06 Thread sj
Dear piler users, I'm aware of that many of you use centos 6, 7 and 8. And some systemd un-fans even centos 5. I assume all of you have heard the recent news that centos 8 deceases at the end of this year as we know it, and Redhat suggests to move to Centos Stream:

updates on encryption

2020-12-05 Thread sj
Dear piler-users, I'm writing to you about the encryption that piler uses. tl;dr: piler is switching from Blowfish 128 bit to AES 256 bit encryption. It's a bit long and technical to some degree, but please read it through to get the whole picture, and understand there's no need to be

do you use the folder feature?

2020-12-09 Thread sj
Dear piler-users, piler features the folder feature, and I got a request a few years ago to revise and fix it (check out this old branch: https://bitbucket.org/jsuto/piler/branch/per_user_folder2), and a new request recently to adjust it. Before deciding whether to revise and fix the

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
Hello Jonathan, On 2020-12-14 13:48, jb wrote: I run here the latest piler version, on debian 10 and I have the problem, that after a restart piler is not saving anymore the emails. I had this now multiple times, and I think it have to do with the piler.pid file. I saw now many time in

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
On 2020-12-14 15:37, jb wrote: I only send you the lines from /var/log/mail.log. Do you wanted other ones to? No. However, when the system boots and starts piler, then you usually have such lines, eg. Dec 13 16:59:17 cust1 piler-smtp[203]: reloaded config: /etc/piler/piler.conf Dec

Re: Piler is not saving the incoming emails

2020-12-14 Thread sj
On 2020-12-14 15:13, jb wrote: piler.service: [Unit] Description=Piler daemon After=network.target mariadb.service ... The systemd files look fine. Dec 14 15:09:01 piler piler-smtp[392]: connected from 1.2.3.4:38359 on fd=6 (active connections: 1) Dec 14 15:09:01 piler

healthcheck tool

2020-10-29 Thread sj
Dear piler users, while I was checking the product mailstore (an email archiving competitor) what features they offer, I found telemetry. The mailstore telemetry is an opt-in feature sends some key metrics allowing the mailstore company to better understand the usage of their product. The

piler 1.3.10 has been released

2021-01-03 Thread sj
Dear piler users, new year, new release. I've just released version 1.3.10. The release notes document has 3 items: - switching from Blowfish to AES-256 - obsoleted the tcp_wrappers with a postscreen style smtp acl list, see my previous email and

Re: sphinx reindex question

2020-12-28 Thread sj
Hello, On 2020-12-28 08:56, d tbsky wrote: I was testing master commit fb9150f and upgrade from sphinx 2.2 to 3.3.1. according to piler manual, I need to reindex everything. so I install a new machine. copy /var/piler and /var/lib/mysql to new machine and do procedure below: rm

Re: 1.3.9+ and CJK support in sphinx.conf

2020-12-28 Thread sj
Hello, On 2020-12-27 08:31, d tbsky wrote: I want to upgrade our piler from "1.3.4 + sphinx 2.2" to "1.3.9/10 + sphinx 3.3.1". I notice there is a new config entry at sphinx.conf: "SPHINX_CHARSET_TABLE".I am still confused after reading the document. if I already setup "ngram_len"

Re: Piler 1.3.10 issues with imap importing (Lotus Domino Server) from GUI

2021-01-26 Thread sj
Hello Hugo, thank you for the pacthes. Have you tried to use imapfetch.py with python3? Also can you track what happens or at what point pilerimport stucks? Anything relevant in the mail logs? I've just re-run the import test, and pilerimport has properly updated the import table.

Re: Piler auditor login error

2021-06-26 Thread sj
Hello, On 2021-06-25 21:34, Marcelo Machado wrote: I did a fresh installation of Mail Piler version 1.3.11 on Ubuntu 16.04 and when I log in with auditor user, the error message "HTTP ERROR 500" appears. The apache error log shows the error "PHP Parse error: syntax error, unexpected '=' in

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
Hello Ryan, On 2021-05-02 01:15, Ryan Blenis wrote: 1. Is there a way to have the pilerexport dry run output the number of attachments linked to the query? Just to clarify. Let's say you have 10 matching emails with 15 attachments total, and you want pilerexport to print 15? 2. Would

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
On 2021-05-02 09:15, Ryan Blenis wrote: Ideally, in the dry run, I'd like to have it print "attachment: [id]" much like the emails print "id: [id]" so I can get a count of emails and associated attachment numbers, which is often required in legal queries as a the "number of items" found for

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
OK, this commit gives you the raw: label: https://bitbucket.org/jsuto/piler/commits/7b47ce3ca20f9f4ab3234afd6641fe364eaedbc6 Whatever you enter after 'raw:', it will be inside the MATCH('') clause. Janos On 2021-05-02 09:15, Ryan Blenis wrote: Hi Janos, On Sun, May 2, 2021 at 2:24 AM

Re: Pilerexport attachment numbers plus advanced querying

2021-05-02 Thread sj
The main search query is equivalent in capabilities with the 'advanced' search. In fact I personally consider it the preferred way to search. See the examples at https://www.mailpiler.org/wiki/current:using-the-gui Also consider the below query how to use it: a:pdf raw: @subject test

Re: pilerexport where_condition query length limitation

2021-05-03 Thread sj
Hello Ryan, I've updated pilerexport.c to have the increased buffer size, also print the sphinx query to see what's going on with this commit: https://bitbucket.org/jsuto/piler/commits/66a8f60d9d1ced70fe46d6e76041989e7b779f0f Janos On 2021-05-04 02:39, Ryan Blenis wrote: Follow up for

  1   2   >