AW: Indexation of Excel files newer than 2007

[Katterl Christian]

In at least my case, this does not seem to work.

BR, Christian



Von: Janos SUTO 
Gesendet: Montag, 6. Mai 2019 11:33
An: Piler User 
Betreff: Re: Indexation of Excel files newer than 2007

Newer office files, eg. xlsx, etc should be handled internally by the parser, 
provided that you have libzip package installed as well as the header files, 
libzip-dev or similar.
Janos


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


From: Katterl Christian
Sent: Mon May 06 10:19:07 GMT+02:00 2019
To: Piler User
Subject: AW: Indexation of Excel files newer than 2007


Hello again,


for docx, there would be: https://github.com/ankushshah89/python-docx2txt


Unfortunately, I am not a software-developer to make the adoptions by myself.


BR Christian




Von: Martin Nadvornik 
mailto:martin.nadvor...@diakonie.at>>
Gesendet: Montag, 6. Mai 2019 09:46
An: Piler User mailto:piler-user@list.acts.hu>>
Betreff: Re: Indexation of Excel files newer than 2007


Hello Christian,

catdoc is not capable of processing new office formats. As far as I know there 
is no intention for catdoc to implement this in a foreseeable future. The same 
problem exists for xls2csv. You could theoretically try to call unoconv 
(https://github.com/unoconv/unoconv) before catdoc, but it will probably have a 
big performance impact since it launches libre office / open office for the 
conversion. But if you try this I would be interested in your results since 
being limited to index only old office formats is also something we would like 
to overcome. Alternatively if you can find an open source software which is 
capable of efficiently extracting plain text from current office formats it 
should be easily implementable into piler (basically a few lines in extract.c 
as far as I can tell). For excel there is https://github.com/xevo/xls2csv and 
https://github.com/nagirrab/xls2csv which claim to be cabable of proccessing 
xlsx files. But I haven't looked into them yet.

Kind Regards
Martin
Am 06.05.2019 um 06:45 schrieb Katterl Christian:
Hello,

Indexation of Excel files newer than Excel 2007 fails in my installation.
I am using catdoc 0.95 and it tells:

This file looks like ZIP archive or Office 2007 or later file.
Not supported by catdoc

The Excel-File has been created using Excel 2010.

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:image001.png@01D503F5.230293E0]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>

This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: Indexation of Excel files newer than 2007

[Katterl Christian]

Hi,

I will try that.
I had libzip installed, but not libzip-dev as I could not see a hint in the  
installation-manual (or did i overlook it?) that it’s needed.

I will try now with libzip-dev installed.

BR, Christian

Von: Janos SUTO 
Gesendet: Montag, 6. Mai 2019 11:33
An: Piler User 
Betreff: Re: Indexation of Excel files newer than 2007

Newer office files, eg. xlsx, etc should be handled internally by the parser, 
provided that you have libzip package installed as well as the header files, 
libzip-dev or similar.
Janos


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


From: Katterl Christian
Sent: Mon May 06 10:19:07 GMT+02:00 2019
To: Piler User
Subject: AW: Indexation of Excel files newer than 2007


Hello again,


for docx, there would be: https://github.com/ankushshah89/python-docx2txt


Unfortunately, I am not a software-developer to make the adoptions by myself.


BR Christian




Von: Martin Nadvornik 
mailto:martin.nadvor...@diakonie.at>>
Gesendet: Montag, 6. Mai 2019 09:46
An: Piler User mailto:piler-user@list.acts.hu>>
Betreff: Re: Indexation of Excel files newer than 2007


Hello Christian,

catdoc is not capable of processing new office formats. As far as I know there 
is no intention for catdoc to implement this in a foreseeable future. The same 
problem exists for xls2csv. You could theoretically try to call unoconv 
(https://github.com/unoconv/unoconv) before catdoc, but it will probably have a 
big performance impact since it launches libre office / open office for the 
conversion. But if you try this I would be interested in your results since 
being limited to index only old office formats is also something we would like 
to overcome. Alternatively if you can find an open source software which is 
capable of efficiently extracting plain text from current office formats it 
should be easily implementable into piler (basically a few lines in extract.c 
as far as I can tell). For excel there is https://github.com/xevo/xls2csv and 
https://github.com/nagirrab/xls2csv which claim to be cabable of proccessing 
xlsx files. But I haven't looked into them yet.

Kind Regards
Martin
Am 06.05.2019 um 06:45 schrieb Katterl Christian:
Hello,

Indexation of Excel files newer than Excel 2007 fails in my installation.
I am using catdoc 0.95 and it tells:

This file looks like ZIP archive or Office 2007 or later file.
Not supported by catdoc

The Excel-File has been created using Excel 2010.

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:image001.png@01D503F5.230293E0]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>

This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: Indexation of Excel files newer than 2007

[Katterl Christian]

Hello again,

for docx, there would be: https://github.com/ankushshah89/python-docx2txt

Unfortunately, I am not a software-developer to make the adoptions by myself.

BR Christian


Von: Martin Nadvornik 
Gesendet: Montag, 6. Mai 2019 09:46
An: Piler User 
Betreff: Re: Indexation of Excel files newer than 2007

Hello Christian,

catdoc is not capable of processing new office formats. As far as I know there 
is no intention for catdoc to implement this in a foreseeable future. The same 
problem exists for xls2csv. You could theoretically try to call unoconv 
(https://github.com/unoconv/unoconv) before catdoc, but it will probably have a 
big performance impact since it launches libre office / open office for the 
conversion. But if you try this I would be interested in your results since 
being limited to index only old office formats is also something we would like 
to overcome. Alternatively if you can find an open source software which is 
capable of efficiently extracting plain text from current office formats it 
should be easily implementable into piler (basically a few lines in extract.c 
as far as I can tell). For excel there is https://github.com/xevo/xls2csv and 
https://github.com/nagirrab/xls2csv which claim to be cabable of proccessing 
xlsx files. But I haven't looked into them yet.

Kind Regards
Martin
Am 06.05.2019 um 06:45 schrieb Katterl Christian:
Hello,

Indexation of Excel files newer than Excel 2007 fails in my installation.
I am using catdoc 0.95 and it tells:

This file looks like ZIP archive or Office 2007 or later file.
Not supported by catdoc

The Excel-File has been created using Excel 2010.

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:image001.png@01D503F5.230293E0]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334



 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: Indexation of Excel files newer than 2007

[Katterl Christian]

Hello,

i found out, that xlsx2csv (https://pypi.org/project/xlsx2csv/#files) is able 
to read the contents of xlsx-files. It's python-based.
For Implementation into piler, I am probably the wrong one, but i think that 
could be possible?

BR, Christian


Von: Martin Nadvornik 
Gesendet: Montag, 6. Mai 2019 09:46
An: Piler User 
Betreff: Re: Indexation of Excel files newer than 2007

Hello Christian,

catdoc is not capable of processing new office formats. As far as I know there 
is no intention for catdoc to implement this in a foreseeable future. The same 
problem exists for xls2csv. You could theoretically try to call unoconv 
(https://github.com/unoconv/unoconv) before catdoc, but it will probably have a 
big performance impact since it launches libre office / open office for the 
conversion. But if you try this I would be interested in your results since 
being limited to index only old office formats is also something we would like 
to overcome. Alternatively if you can find an open source software which is 
capable of efficiently extracting plain text from current office formats it 
should be easily implementable into piler (basically a few lines in extract.c 
as far as I can tell). For excel there is https://github.com/xevo/xls2csv and 
https://github.com/nagirrab/xls2csv which claim to be cabable of proccessing 
xlsx files. But I haven't looked into them yet.

Kind Regards
Martin
Am 06.05.2019 um 06:45 schrieb Katterl Christian:
Hello,

Indexation of Excel files newer than Excel 2007 fails in my installation.
I am using catdoc 0.95 and it tells:

This file looks like ZIP archive or Office 2007 or later file.
Not supported by catdoc

The Excel-File has been created using Excel 2010.

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:image001.png@01D503F1.C9E2E6F0]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334



 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Indexation of Excel files newer than 2007

[Katterl Christian]

Hello,

Indexation of Excel files newer than Excel 2007 fails in my installation.
I am using catdoc 0.95 and it tells:

This file looks like ZIP archive or Office 2007 or later file.
Not supported by catdoc

The Excel-File has been created using Excel 2010.

BR, Christian


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: Downloaded files corrupt

[Katterl Christian]

Hello,

in config-site.php:
$config['DEFAULT_LANG'] = 'en';

Therefore, it should be english already.

BR, Christian

Von: Janos SUTO 
Gesendet: Dienstag, 30. April 2019 11:41
An: Piler User 
Betreff: Re: Downloaded files corrupt

Hello,
what language file do you use?
Can reproduce the issue using English?
Janos


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


From: Katterl Christian
Sent: Tue Apr 30 05:45:59 GMT+02:00 2019
To: "piler-user@list.acts.hu<mailto:piler-user@list.acts.hu>"
Subject: Downloaded files corrupt


Hello,


when I try to download archived files (attachments), I noticed, that the files 
are corrupted after download.
They are 1 byte larger than the original.


I found this here:
https://bitbucket.org/jsuto/piler/issues/949/corrupted-files-are-downloaded-from-web-ui


I even tried the language-files of the current master-tree, where I assume, the 
issue is fixed?


BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:012f-0001@01d4ff07.3a88f9d1]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Downloaded files corrupt

[Katterl Christian]

Hello,

when I try to download archived files (attachments), I noticed, that the files 
are corrupted after download.
They are 1 byte larger than the original.

I found this here:
https://bitbucket.org/jsuto/piler/issues/949/corrupted-files-are-downloaded-from-web-ui

I even tried the language-files of the current master-tree, where I assume, the 
issue is fixed?

BR, Christian


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Upgrade Instructions 1.3.5

[Katterl Christian]

Hello,

is there any special upgrading instructions for 1.3.x to 1.3.5?
On the website, I could not find info for this?

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:0033-0001@01d4fe57.3644c3a6]

Asamer Baustoffe AG
Unterthalham Stra?e 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at
www.abag.at



This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Version 1.3.4

[Katterl Christian]

Hello,

i noticed, that there's an updated version of mailpiler - version 1.3.4.
Unfortunately i could not find recent release-notes or upgrading instructions?

The release notes included in the archive are stopping with 1.3.0 and the 
upgrade instructions (http://www.mailpiler.org/wiki/current:upgrade) are 
stopping with upgrade 1.3.0 to 1.3.2.

Where can i find the proper information?

BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:0056-0001@01d3c03d.f09f91b6]

Asamer Baustoffe AG
Unterthalham Stra?e 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at
www.abag.at



This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Problem with distribution groups

[Katterl Christian]

Hello,

i have a very strange issue with an exchange-distribution group.

When I am sending an email to a distribution group (all users, including me are 
members; the option that users who can send mails to this group have to be 
authenticated is ticked), I can see it arriving on mailpiler - see log:

Feb 23 06:59:43 aohmailarchive01 piler[2808]: 
40005a8fadd91a5683fc0029ba0ab6a0: from=me.mys...@mydomain.tld, 
size=17775/4288, attachments=0, reference=, 
message-id=,
 retention=3, folder=0, delay=0.36, delays=0.36/0.00/0.00/0.00/0.00/0.00, 
status=stored

When I log in to mailpiler as user 
me.mys...@mydomain.tld I cannot find this mail. 
Even other users who are member of this group cannot find this mail.

Other groups are working

Users are authenticated against ldap (2 ldap's configured; 
$config['ENABLE_SAAS'] = 1; and $config['ENABLE_LDAP_AUTH'] = 1; enabled.

LDAP_MAIL_ATTR is set to mail
LDAP_ACCOUNT_OBJECTCLASS is set to user
LDAP_DISTRIBUTIONLIST_ATTR is set to member
LDAP_DISTRIBUTIONLIST_OBJECTCLASS is set to user

What can be wrong?

BR, Christian





Christian Katterl
Teamleader Technical IT

[cid:00ac-0001@01d3ac9c.1fdf1e20]

Asamer Baustoffe AG
Unterthalham Stra?e 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at
www.abag.at



This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: AW: LDAP Users can see other's mails

[Katterl Christian]

Update:
By modifying the parameter from $config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 
'group'; to $config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'user'; it seems to 
accomplish the same without changing code in /var/www/piler/model/user/auth.php



Christian Katterl
Teamleader Technical IT

[cid:0139-0001@01d3681d.1f8ac597]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>



This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Von: Janos SUTO [mailto:s...@acts.hu]
Gesendet: Dienstag, 28. November 2017 08:11
An: Piler User
Betreff: Re: AW: LDAP Users can see other's mails

OK, if it gives you a proper result, then case is solved. Be sure to save your 
fix in case of a future upgrade. Or I may introduce a configure option to apply 
your fix.
Janos
____
From: Katterl Christian
Sent: Tue Nov 28 06:35:25 GMT+01:00 2017
To: Piler User
Subject: AW: AW: LDAP Users can see other's mails



Hello,

maybe I have found a solution for this issue.

In /var/www/piler/model/user/auth.php

I changed the line 217, which originally looked like this:

$query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username))(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr=$username_prefix$username)"
 . 
")(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr="
 . $a['dn'] . ")))", array());

To only:
  $query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username)))",
 array());

I mean - I removed all the group- and distribution-list things.
I am not sure, what this else will/could cause (I am not a programmer)?

But from what I saw in a very quick test, now only my personal emails are shown.

BR, Christian


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<http://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


-Ursprüngliche Nachricht-
Von: s...@acts.hu<mailto:s...@acts.hu> [mailto:s...@acts.hu]
Gesendet: Sonntag, 26. November 2017 17:56
An: Piler User
Betreff: Re: AW: LDAP Users can see other's mails



Hmm, it's odd. Even if a user is member of a group with other users which is 
totally normal a user still shouldn't see others' emails.

Some of the addresses look like some distribution lists. Can you show me such a 
message you can see and meant for someone else?
I'm interested the headers only. (You may send it privately to my address). The 
selected messages should not belong to any distribution list you are on.

Janos

On 2017-11-23 12:09, Katterl Christian wrote:

 It seems that i can see all messages of members of the same ad-groups.


 In my case, piler would not need to take care of groups…..

 VON: Janos SUTO [mailto:s...@acts.hu]
 GESENDET: Donnerstag, 23. November 2017 09:45
 AN: Piler User
 BETREFF: Re: LDAP Users can see other's mails

 Show me the sphinx query from the mail log related to the given user.

 Janos

 -

 FROM: Katterl Christian
 SENT: Thu Nov 23 07:35:19 GMT+01:00 2017
 TO: "piler-user@list.acts.hu<mailto:piler-user@list.acts.hu>"
 SUBJECT: LDAP Users can see other's mails

 Dear all,

 i configured piler (1.3.1) on Debian (9) using LDAP authentication
 against Active Directory.

 Basically, authentication works.

 BUT:

 Successfully logged in users cannot only see their own mails, but also
 mails of other users?

 My ldap-config from config-site.php looks like this:

 $config['ENABLE_LDAP_AUTH'] = 1;

 $config['LDAP_HOST'] = 'mydomaincontroller.mydomain.myforest.tld';

 $config['LDAP_HELPER_DN'] =
 'CN=pilerldap,OU=ServicesAccounts,DC=mydomain,DC=myforest,DC=tld';

 $config['LDAP_HELPER_PASSWORD'] = 'highpressurecompressor';

 $config['LDAP_MAIL_ATTR'] = 'mail';

 $config['LDAP_ACCOUNT_OBJECTCLASS'] = 'user';

 $config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'group';

 $config['LDAP_DISTRIBUTIONLIST_ATTR'] = 'member';

 $config['LDAP_BASE_DN'] = DC=mydomain,DC=myforest,DC=tld;

 $config['LDAP_AUDITOR_MEMBER_DN'] = '';

 $config['LDAP_ADMIN_MEMBER_DN'] = '';

 Any ideas?

 BR, Christian

 CHRISTIAN KATTERL
 Teamleader Technical IT

 ASAMER BAUSTOFFE AG
 U

AW: AW: LDAP Users can see other's mails

[Katterl Christian]

I will save my fix – but i think it would be useful for others too.
I wonder, that no one came across this issue before?

BR and thanks for your help and support,

Christian



Christian Katterl
Teamleader Technical IT

[cid:0076-0001@01d36818.3d87f6d7]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>



This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

Von: Janos SUTO [mailto:s...@acts.hu]
Gesendet: Dienstag, 28. November 2017 08:11
An: Piler User
Betreff: Re: AW: LDAP Users can see other's mails

OK, if it gives you a proper result, then case is solved. Be sure to save your 
fix in case of a future upgrade. Or I may introduce a configure option to apply 
your fix.
Janos
____
From: Katterl Christian
Sent: Tue Nov 28 06:35:25 GMT+01:00 2017
To: Piler User
Subject: AW: AW: LDAP Users can see other's mails



Hello,

maybe I have found a solution for this issue.

In /var/www/piler/model/user/auth.php

I changed the line 217, which originally looked like this:

$query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username))(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr=$username_prefix$username)"
 . 
")(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr="
 . $a['dn'] . ")))", array());

To only:
  $query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username)))",
 array());

I mean - I removed all the group- and distribution-list things.
I am not sure, what this else will/could cause (I am not a programmer)?

But from what I saw in a very quick test, now only my personal emails are shown.

BR, Christian


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<http://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


-Ursprüngliche Nachricht-
Von: s...@acts.hu<mailto:s...@acts.hu> [mailto:s...@acts.hu]
Gesendet: Sonntag, 26. November 2017 17:56
An: Piler User
Betreff: Re: AW: LDAP Users can see other's mails



Hmm, it's odd. Even if a user is member of a group with other users which is 
totally normal a user still shouldn't see others' emails.

Some of the addresses look like some distribution lists. Can you show me such a 
message you can see and meant for someone else?
I'm interested the headers only. (You may send it privately to my address). The 
selected messages should not belong to any distribution list you are on.

Janos

On 2017-11-23 12:09, Katterl Christian wrote:

 It seems that i can see all messages of members of the same ad-groups.


 In my case, piler would not need to take care of groups…..

 VON: Janos SUTO [mailto:s...@acts.hu]
 GESENDET: Donnerstag, 23. November 2017 09:45
 AN: Piler User
 BETREFF: Re: LDAP Users can see other's mails

 Show me the sphinx query from the mail log related to the given user.

 Janos

 -

 FROM: Katterl Christian
 SENT: Thu Nov 23 07:35:19 GMT+01:00 2017
 TO: "piler-user@list.acts.hu<mailto:piler-user@list.acts.hu>"
 SUBJECT: LDAP Users can see other's mails

 Dear all,

 i configured piler (1.3.1) on Debian (9) using LDAP authentication
 against Active Directory.

 Basically, authentication works.

 BUT:

 Successfully logged in users cannot only see their own mails, but also
 mails of other users?

 My ldap-config from config-site.php looks like this:

 $config['ENABLE_LDAP_AUTH'] = 1;

 $config['LDAP_HOST'] = 'mydomaincontroller.mydomain.myforest.tld';

 $config['LDAP_HELPER_DN'] =
 'CN=pilerldap,OU=ServicesAccounts,DC=mydomain,DC=myforest,DC=tld';

 $config['LDAP_HELPER_PASSWORD'] = 'highpressurecompressor';

 $config['LDAP_MAIL_ATTR'] = 'mail';

 $config['LDAP_ACCOUNT_OBJECTCLASS'] = 'user';

 $config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'group';

 $config['LDAP_DISTRIBUTIONLIST_ATTR'] = 'member';

 $config['LDAP_BASE_DN'] = DC=mydomain,DC=myforest,DC=tld;

 $config['LDAP_AUDITOR_MEMBER_DN'] = '';

 $config['LDAP_ADMIN_MEMBER_DN'] = '';

 Any ideas?

 BR, Christian

 CHRISTIAN KATTERL
 Teamleader Technical IT

 ASAMER BAUSTOFFE AG
 Unterthalham Straße 2
 4694 Ohlsdorf
 Austria
 TEL  +43 50 799 - 2511
 MOBILE 

AW: AW: LDAP Users can see other's mails

[Katterl Christian]

Hello,

maybe I have found a solution for this issue.

In /var/www/piler/model/user/auth.php

I changed the line 217, which originally looked like this:

$query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username))(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr=$username_prefix$username)"
 . 
")(&(objectClass=$ldap_distributionlist_objectclass)($ldap_distributionlist_attr="
 . $a['dn'] . ")))", array());

To only:
  $query = $ldap->query($ldap_base_dn, 
"(|(&(objectClass=$ldap_account_objectclass)($ldap_mail_attr=$username_prefix$username)))",
 array());

I mean - I removed all the group- and distribution-list things.
I am not sure, what this else will/could cause (I am not a programmer)?

But from what I saw in a very quick test, now only my personal emails are shown.

BR, Christian


 Christian Katterl
Teamleader Technical IT

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel +43 50 799 - 2511

mobile  +43 664 811 54 99
c.katt...@asamer.at
www.abag.at


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this
message by mistake, please advise the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334


-Ursprüngliche Nachricht-
Von: s...@acts.hu [mailto:s...@acts.hu]
Gesendet: Sonntag, 26. November 2017 17:56
An: Piler User
Betreff: Re: AW: LDAP Users can see other's mails



Hmm, it's odd. Even if a user is member of a group with other users which is 
totally normal a user still shouldn't see others' emails.

Some of the addresses look like some distribution lists. Can you show me such a 
message you can see and meant for someone else?
I'm interested the headers only. (You may send it privately to my address). The 
selected messages should not belong to any distribution list you are on.

Janos

On 2017-11-23 12:09, Katterl Christian wrote:
> It seems that i can see all messages of members of the same ad-groups.
>
>
> In my case, piler would not need to take care of groups…..
>
> VON: Janos SUTO [mailto:s...@acts.hu]
> GESENDET: Donnerstag, 23. November 2017 09:45
> AN: Piler User
> BETREFF: Re: LDAP Users can see other's mails
>
> Show me the sphinx query from the mail log related to the given user.
>
> Janos
>
> -
>
> FROM: Katterl Christian
> SENT: Thu Nov 23 07:35:19 GMT+01:00 2017
> TO: "piler-user@list.acts.hu"
> SUBJECT: LDAP Users can see other's mails
>
> Dear all,
>
> i configured piler (1.3.1) on Debian (9) using LDAP authentication
> against Active Directory.
>
> Basically, authentication works.
>
> BUT:
>
> Successfully logged in users cannot only see their own mails, but also
> mails of other users?
>
> My ldap-config from config-site.php looks like this:
>
> $config['ENABLE_LDAP_AUTH'] = 1;
>
> $config['LDAP_HOST'] = 'mydomaincontroller.mydomain.myforest.tld';
>
> $config['LDAP_HELPER_DN'] =
> 'CN=pilerldap,OU=ServicesAccounts,DC=mydomain,DC=myforest,DC=tld';
>
> $config['LDAP_HELPER_PASSWORD'] = 'highpressurecompressor';
>
> $config['LDAP_MAIL_ATTR'] = 'mail';
>
> $config['LDAP_ACCOUNT_OBJECTCLASS'] = 'user';
>
> $config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'group';
>
> $config['LDAP_DISTRIBUTIONLIST_ATTR'] = 'member';
>
> $config['LDAP_BASE_DN'] = DC=mydomain,DC=myforest,DC=tld;
>
> $config['LDAP_AUDITOR_MEMBER_DN'] = '';
>
> $config['LDAP_ADMIN_MEMBER_DN'] = '';
>
> Any ideas?
>
> BR, Christian
>
> CHRISTIAN KATTERL
> Teamleader Technical IT
>
> ASAMER BAUSTOFFE AG
> Unterthalham Straße 2
> 4694 Ohlsdorf
> Austria
> TEL  +43 50 799 - 2511
> MOBILE +43 664 811 54 99
> EMAIL c.katt...@asamer.at
> WWW.ABAG.AT [1]
>
> This message is confidential. It may not be disclosed to, or used by,
> anyone other than the addressee. If you receive this message by
> mistake, please advise the sender.
> Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334
>
>
>
> Links:
> --
> [1] https://www.abag.at

AW: LDAP Users can see other's mails

[Katterl Christian]

It seems that i can see all messages of members of the same ad-groups.
In my case, piler would not need to take care of groups…..

Von: Janos SUTO [mailto:s...@acts.hu]
Gesendet: Donnerstag, 23. November 2017 09:45
An: Piler User
Betreff: Re: LDAP Users can see other's mails

Show me the sphinx query from the mail log related to the given user.
Janos

From: Katterl Christian
Sent: Thu Nov 23 07:35:19 GMT+01:00 2017
To: "piler-user@list.acts.hu<mailto:piler-user@list.acts.hu>"
Subject: LDAP Users can see other's mails


Dear all,


i configured piler (1.3.1) on Debian (9) using LDAP authentication against 
Active Directory.
Basically, authentication works.


BUT:
Successfully logged in users cannot only see their own mails, but also mails of 
other users?


My ldap-config from config-site.php looks like this:


$config['ENABLE_LDAP_AUTH'] = 1;
$config['LDAP_HOST'] = 'mydomaincontroller.mydomain.myforest.tld';
$config['LDAP_HELPER_DN'] = 
'CN=pilerldap,OU=ServicesAccounts,DC=mydomain,DC=myforest,DC=tld';
$config['LDAP_HELPER_PASSWORD'] = 'highpressurecompressor';
$config['LDAP_MAIL_ATTR'] = 'mail';
$config['LDAP_ACCOUNT_OBJECTCLASS'] = 'user';
$config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'group';
$config['LDAP_DISTRIBUTIONLIST_ATTR'] = 'member';
$config['LDAP_BASE_DN'] = DC=mydomain,DC=myforest,DC=tld;
$config['LDAP_AUDITOR_MEMBER_DN'] = '';
$config['LDAP_ADMIN_MEMBER_DN'] = '';


Any ideas?


BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:00d9-0001@01d36425.3b18d2bf]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334

AW: LDAP Users can see other's mails

[Katterl Christian]

The query looks strange to me:

Nov 23 09:46:20 aohmailarchive01 piler-webui[6828]: sphinx query: 'SELECT id 
FROM main1,dailydelta1,delta1 WHEREMATCH(' (@from 
gXsignXasamerXbaustoffeXagXasamerXat| gXsignXasamerXbaustoffeXagXalasXba| 
allXabagXasamerXat| cXkatterlXasamerXat| eXscheiblXasamerXat| katterlXasamerXat 
| @to gXsignXasamerXbaustoffeXagXasamerXat| gXsignXasamerXbaustoffeXagXalasXba| 
allXabagXasamerXat| cXkatterlXasamerXat| eXscheiblXasamerXat| 
katterlXasamerXat) ') ORDER BY `sent` DESC LIMIT 0,20 OPTION max_matches=1000' 
in 0.00 s, 5 hits, 5 total found

There are a lot of groups inside…

BR, Christian

Von: Janos SUTO [mailto:s...@acts.hu]
Gesendet: Donnerstag, 23. November 2017 09:45
An: Piler User
Betreff: Re: LDAP Users can see other's mails

Show me the sphinx query from the mail log related to the given user.
Janos

From: Katterl Christian
Sent: Thu Nov 23 07:35:19 GMT+01:00 2017
To: "piler-user@list.acts.hu<mailto:piler-user@list.acts.hu>"
Subject: LDAP Users can see other's mails


Dear all,


i configured piler (1.3.1) on Debian (9) using LDAP authentication against 
Active Directory.
Basically, authentication works.


BUT:
Successfully logged in users cannot only see their own mails, but also mails of 
other users?


My ldap-config from config-site.php looks like this:


$config['ENABLE_LDAP_AUTH'] = 1;
$config['LDAP_HOST'] = 'mydomaincontroller.mydomain.myforest.tld';
$config['LDAP_HELPER_DN'] = 
'CN=pilerldap,OU=ServicesAccounts,DC=mydomain,DC=myforest,DC=tld';
$config['LDAP_HELPER_PASSWORD'] = 'highpressurecompressor';
$config['LDAP_MAIL_ATTR'] = 'mail';
$config['LDAP_ACCOUNT_OBJECTCLASS'] = 'user';
$config['LDAP_DISTRIBUTIONLIST_OBJECTCLASS'] = 'group';
$config['LDAP_DISTRIBUTIONLIST_ATTR'] = 'member';
$config['LDAP_BASE_DN'] = DC=mydomain,DC=myforest,DC=tld;
$config['LDAP_AUDITOR_MEMBER_DN'] = '';
$config['LDAP_ADMIN_MEMBER_DN'] = '';


Any ideas?


BR, Christian


Christian Katterl
Teamleader Technical IT

[cid:00d9-0001@01d36425.3b18d2bf]

Asamer Baustoffe AG
Unterthalham Straße 2
4694 Ohlsdorf
Austria
tel  +43 50 799 - 2511
mobile +43 664 811 54 99
email c.katt...@asamer.at<mailto:c.katt...@asamer.at>
www.abag.at<https://www.abag.at>


This message is confidential. It may not be disclosed to, or used by, anyone 
other than the addressee. If you receive this message by mistake, please advise 
the sender.
Firmenbuch: Landesgericht Wels, FN: 407726y, ATU 68646334