Hello, Nice solution here and we're really looking forward to its scaling and stability in our environment.
Fairly new install and not sure if this a bug or just configuration errors on my part. piler 1.2.0-master, build 944, Janos SUTO <s...@acts.hu> Build Date: Mon May 23 11:15:26 CDT 2016 ldd version: ldd (Debian GLIBC 2.22-9) 2.22 gcc version: gcc version 5.3.1 20160509 (Debian 5.3.1-19) Configure command: ./configure --localstatedir=/var --with-database=mysql --enable-tcpwrappers --enable-memcached Extractors: /usr/bin/pdftotext /usr/bin/catdoc /usr/bin/catppt /usr/bin/xls2csv /usr/local/bin/ppthtml /usr/bin/unrtf /usr/bin/tnef VM instance Single / ext4 system with default mount options (rw,relatime,errors=remount-ro,data=ordered) New mount point /archive added just today to store older emails, also ext4 (cp -rp the folders over) Our mail server journal function forwards a lot of duplicates which are discarded, but this particular email (and possibly others?) was stored twice. The other 4-5 copies were discarded still. Jun 30 14:34:43 piler piler[5496]: 400000005775745c3a12ff2c00bea223869f: discarding: duplicate message, id: 0, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5496]: 400000005775745c3a12ff2c00bea223869f: from=a...@123.com, size=17740/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.08, delays=0.08/0.00/0.00/0.00/0.00/0.00, status=duplicate Jun 30 14:34:43 piler piler[5521]: 400000005775745c3a04880c004488d1162a: from=a...@123.com, size=17740/5952, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=2557, folder=0, delay=0.06, delays=0.06/0.00/0.00/0.00/0.00/0.00, *status=stored* Jun 30 14:34:43 piler piler[5496]: 400000005775745d03c3247400d50de6959d: from=a...@123.com, size=17744/5952, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=2557, folder=0, delay=0.02, delays=0.01/0.00/0.00/0.00/0.00/0.00, *status=stored* Jun 30 14:34:43 piler piler[5521]: 400000005775745d18b49b9c00dff284b1c3: discarding: duplicate message, id: 1412062, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5521]: 400000005775745d18b49b9c00dff284b1c3: from=a...@123.com, size=19403/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.42, delays=0.41/0.00/0.00/0.00/0.00/0.00, status=duplicate Jun 30 14:34:43 piler piler[5496]: 400000005775745d1b9e696400a0cee54fa1: discarding: duplicate message, id: 1412062, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5496]: 400000005775745d1b9e696400a0cee54fa1: from=a...@123.com, size=17742/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.42, delays=0.41/0.00/0.00/0.00/0.00/0.00, status=duplicate Jun 30 14:34:43 piler piler[5521]: 400000005775745d1c806cc40021a8f31116: discarding: duplicate message, id: 1412062, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5521]: 400000005775745d1c806cc40021a8f31116: from=a...@123.com, size=18455/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.06, delays=0.06/0.00/0.00/0.00/0.00/0.00, status=duplicate Jun 30 14:34:43 piler piler[5496]: 400000005775745d1d34f78400f5597a458a: discarding: duplicate message, id: 1412062, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5496]: 400000005775745d1d34f78400f5597a458a: from=a...@123.com, size=18638/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.05, delays=0.04/0.00/0.00/0.00/0.00/0.00, status=duplicate Jun 30 14:34:43 piler piler[5521]: 400000005775745d1fa130dc0000eb508f1a: discarding: duplicate message, id: 1412062, message-id: < tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com > Jun 30 14:34:43 piler piler[5521]: 400000005775745d1fa130dc0000eb508f1a: from=a...@123.com, size=18751/0, attachments=0, reference=, message-id=< tu4pr84mb02706789c23acd8cf79588f7e4...@tu4pr84mb0270.namprd84.prod.outlook.com>, retention=0, folder=0, delay=0.06, delays=0.06/0.00/0.00/0.00/0.00/0.00, status=duplicate About 2 hours earlier, I stopped piler and searchd to remove older email folders (/var/piler/store/00/* except latest) to create symlinks to their new destination, but don't think that would cause this problem? Also, there was a similar issue reported last year and was resolved. Should I apply that fix? https://bitbucket.org/jsuto/piler/issues/543/dupilcate-mails-show-up-in-gui Any help would be greatly appreciated and hope I'm not leaving out any necessary info/logs. Thanks in advance!
