RE: piler and public folders
Hi Janos, Thanks for your response. To clarify, I think what the customer is looking for, is to be able to search the archive for e-mails that have been placed in the public store. The e-mail may have been placed in the public store by a different user, therefore the searching user should be able to see other users' e-mails that have been made public - but not other users' private e-mails. I appreciate that this is a tricky one, they are used to the Folder View in Outlook, so that is how they are currently envisaging an archive working. Would it be possible, for instance, to target a specific folder with the pilerimport utility, and then tag all the e-mails imported in this way, as belonging to a certain e-mail address (in this case, a distribution list maybe) in order that everyone can view them? I know ultimately the e-mails will be archived, and therefore safe, as all inbound e-mails will be archived - however the trick here is going to be allowing access to the messages. Thanks Adam -Original Message- From: Janos SUTO [mailto:s...@acts.hu] Sent: 03 June 2014 12:17 To: piler-user@list.acts.hu Subject: Re: piler and public folders Hello Adam, On 2014-06-03 12:54, Adam Camp wrote: --snip-- Therefore, I'm asking, how would we go about archiving the messages in the public store? It's possible that some of the sub-folders have restrictions, but I believe these are just write restrictions, not read restrictions (which obviously won't affect archiving). I'm guessing that perhaps this would take the form of an IMAP import targeting the public store, run as a cron job? And let the original copies of the e-mails stay in the users archives as deduplication will step in here? well, piler knows nothing about folders, it knows only email addresses. So no matter what permissions a user has on the shared folder with his mail application (let's assume Outlook for now) piler gives him access to only those emails he sent or received based on the email address in the email headers, eg. From, To and Cc. If your customer had Exchange for instance, then the piler gui could assemble a list of emails that the given user is associated with including distribution lists, then apply this as a filter to restrict him to his own emails only. With Exchange I think you may not need to handle the shared folder in regard of email archiving, since Exchange can pass a copy of each received email to piler no matter how it will process it later. Janos
RE: New install - no search results / User Login issue.
The package is installed. To clarify, I mean the accounting page (not
statistics, statistics displays correctly, sorry!) shows no e-mails,
although all other areas say otherwise.
I see. Please check piler's cron jobs whether it includes something
like
30 6 * * * /usr/local/libexec/piler/generate_stats.php
/srv/www/webui.yourdomain.com http://www/webui.yourdomain.com
this script populates the accounting table which is used by the gui.
Note that you should have admin role/rights to see it.
I have added this to piler's crontab - when I run the command manually (as the
piler user) I get the following output:
/usr/local/libexec/piler/generate_stats.php: line 1: ?php: No such file or
directory
/usr/local/libexec/piler/generate_stats.php: line 2: //: is a directory
/usr/local/libexec/piler/generate_stats.php: line 3: =: command not found
/usr/local/libexec/piler/generate_stats.php: line 4: =: command not found
/usr/local/libexec/piler/generate_stats.php: line 5: =: command not found
/usr/local/libexec/piler/generate_stats.php: line 6: =: command not found
/usr/local/libexec/piler/generate_stats.php: line 7: syntax error near
unexpected token `('
/usr/local/libexec/piler/generate_stats.php: line 7: `$timestart =
microtime(true);'
I was about to say that I still get no results on the search page,
however upon checking again, I can see 2 e-mails for my user account
(funnily enough the confirmation e-mails for this mailing list!)
although there were other e-mails processed earlier for the same user
account which haven't shown up. Any thoughts?
try to login as an auditor user and check if you can see more emails
(actually any of your previously imported emails).
For regular users the gui applies a filter on the email address. You
may
check it by enabling syslog in config-site.php, and looking your
maillog.
Also note that by default your received emails are shown. You have to
explicitly specify with from: your@email.address if you want to see
your
sent emails.
So I suspect that the gui was unable to determine all your addresses.
Please
check whether you can see all your email addresses on the settings
page.
Interesting. On the settings page my e-mail address is shown correctly. I still
only see two e-mails in my archive. However I have now also logged in as an
auditor, and can see all the e-mails. Including one or two to my address that
haven't shown up in my own archive yet??? I'm wondering if this is the same
e-mail address detection issue (re: LDAP - in this case Active Directory) that
was experienced by another user on the mailing list?
Running a query against sphinxql main1 shows no results. I have
tried
re-indexing. Any pointers would be greatly appreciated.
check your cron jobs to have similar like
5,35 * * * ** /usr/local/bin/indexer --quiet delta1 --rotate sleep 2
\
/usr/local/bin/indexer --quiet --merge main1 delta1
--merge-dst-range deleted 0 0 --rotate
you may su to piler, and run manually (make sure you don't run this at
the
same time when it's run from crontab).
This is in my crontab, and I have now run manually. I receive no output,
however when running the SphinxQL query against main1 again I get the following:
mysql select * from main1;
+--++++---++-+
| id | arrived| sent | size | direction | folder | attachments |
+--++++---++-+
| 10 | 1369319294 | 1369319294 | 3 | 0 | 0 | 0 |
| 11 | 1369319525 | 1369319525 | 33350 | 0 | 0 | 0 |
| 12 | 1369321735 | 1369321735 | 13342 | 0 | 0 | 0 |
| 13 | 1369322151 | 1369322151 | 38124 | 0 | 0 | 0 |
| 14 | 1369322470 | 1369322470 | 14972 | 0 | 0 | 0 |
| 15 | 1369323367 | 1369323367 | 110394 | 0 | 0 | 6 |
| 16 | 1369328262 | 1369328262 | 18099 | 0 | 0 | 0 |
| 17 | 1369328622 | 1369328622 | 36915 | 0 | 0 | 0 |
| 18 | 1369328622 | 1369328622 | 25832 | 0 | 0 | 0 |
| 19 | 1369329126 | 1369329126 | 82211 | 0 | 0 | 0 |
| 20 | 1369331731 | 1369331731 | 20804 | 0 | 0 | 0 |
| 21 | 1369332101 | 1369332101 | 45866 | 0 | 0 | 0 |
| 22 | 1369332242 | 1369332242 | 61537 | 0 | 0 | 0 |
| 23 | 1369333672 | 1369333672 | 45606 | 0 | 0 | 0 |
| 24 | 1369333843 | 1369333843 | 10989 | 0 | 0 | 0 |
| 25 | 1369335071 | 1369335071 | 1852 | 0 | 0 | 0 |
| 26 | 1369335168 | 1369335168 | 1347 | 0 | 0 | 0 |
| 27 | 1369337552 | 1369337552 | 38537 | 0 | 0 | 0 |
| 28 | 1369337837 |
RE: New install - no search results / User Login issue.
I have added this to piler's crontab - when I run the command manually (as the piler user) I get the following output: sorry, it should be: 30 6 * * * /usr/bin/php /usr/local/libexec/piler/generate_stats.php /srv/www/webui.yourdomain.com http://www/webui.yourdomain.com I have now corrected this, thanks! :-) Interesting. On the settings page my e-mail address is shown correctly. I still only see two e-mails in my archive. However I have can you see all your email addresses (that present in AD)? I could see all my email addresses (only have one) from AD. I have now installed the webui (I think master branch, but downloaded from the bitbucket page - https://bitbucket.org/jsuto/piler/get/b6eb3b13ba11.zip) and now when I login with my e-mail address, my full name is correctly detected, however email addresses shows none. I assume this is an issue pulling details from AD? Search Results is now empty. Hope this makes sense. now also logged in as an auditor, and can see all the e-mails. Including one or two to my address that haven't shown up in my own archive yet??? I'm wondering if this is the same e-mail address detection issue (re: LDAP - in this case Active Directory) that was experienced by another user on the mailing list? I'm not sure how piler can see an address that hasn't archived yet... Sorry I meant when logging on as an auditor I could see messages to my personal e-mail address, that weren't rendered when logged on as my own user. Btw. could you grab the latest master branch, and try the gui on another virtualhost to see if it's any better? I think that I have the master branch now (as detailed above - but could be the dev branch?) Seems to be a problem detecting addresses correctly from AD? This is in my crontab, and I have now run manually. I receive no output, however when running the SphinxQL query against main1 again I get the following: mysql select * from main1; +--++++---++-+ | id | arrived | sent | size | direction | folder | attachments | +--++++---++-+ | 10 | 1369319294 | 1369319294 | 3 | 0 | 0 | 0 | | 11 | 1369319525 | 1369319525 | 33350 | 0 | 0 | 0 | | 12 | 1369321735 | 1369321735 | 13342 | 0 | 0 | 0 | | 13 | 1369322151 | 1369322151 | 38124 | 0 | 0 | 0 | | 14 | 1369322470 | 1369322470 | 14972 | 0 | 0 | 0 | | 15 | 1369323367 | 1369323367 | 110394 | 0 | 0 | 6 | | 16 | 1369328262 | 1369328262 | 18099 | 0 | 0 | 0 | | 17 | 1369328622 | 1369328622 | 36915 | 0 | 0 | 0 | | 18 | 1369328622 | 1369328622 | 25832 | 0 | 0 | 0 | | 19 | 1369329126 | 1369329126 | 82211 | 0 | 0 | 0 | | 20 | 1369331731 | 1369331731 | 20804 | 0 | 0 | 0 | | 21 | 1369332101 | 1369332101 | 45866 | 0 | 0 | 0 | | 22 | 1369332242 | 1369332242 | 61537 | 0 | 0 | 0 | | 23 | 1369333672 | 1369333672 | 45606 | 0 | 0 | 0 | | 24 | 1369333843 | 1369333843 | 10989 | 0 | 0 | 0 | | 25 | 1369335071 | 1369335071 | 1852 | 0 | 0 | 0 | | 26 | 1369335168 | 1369335168 | 1347 | 0 | 0 | 0 | | 27 | 1369337552 | 1369337552 | 38537 | 0 | 0 | 0 | | 28 | 1369337837 | 1369337837 | 5754 | 2 | 0 | 0 | | 29 | 1369340211 | 1369340211 | 3977 | 0 | 0 | 0 | +--++++---++-+ 20 rows in set (0.00 sec) Does this look about right? The Admin Dashboard stats say 69 e-mails received, 14 duplicates, 55 processed. yes, it looks right. Note that I have to leave my computer now, we can continue in the evening, sorry. Janos Again, thanks so much for your help, it's appreciated.
New install - no search results / User Login issue.
Hi, hoping someone can help... Just carried out a new installation on CentOS 5.9 x64. (VMWare VM). I've run into a couple of issues. Firstly, I've been directing mail at the installation, and it shows that it has processed a number of messages. The metadata shows up in the v_messages table, the messages are stored in my store directory, and can be retrieved with pilerget and ID. Unfortunately, a search in the user interface yields no results. When logged in as admin, although on the dashboard the number of messages processed is accurately reported, the statistics page shows none. Running a query against sphinxql main1 shows no results. I have tried re-indexing. Any pointers would be greatly appreciated. Next, I created a new admin account and was then unable to login with admin@local. I have resolved this thanks to the mailing list (char(128) in the database for passwords). However, in production I am using LDAP for authentication (e-mail address shows up in settings - re: issue above) and when LDAP is enabled I am unable to authenticate as either my new admin account or admin@local. Is there a group I can use in my directory for admins? I will also likely be using IMAP authentication on another site, and am wondering if I will run into a similar issue? I created the LDAP group for auditors, however my user account didn't appear any different when I logged back in. Not sure if that is potentially related to my first issue? Many thanks in advance for any help you can render. Adam
RE: New install - no search results / User Login issue.
Hello Adam,
On 2013-05-23 21:36, Adam Camp wrote:
Hi, hoping someone can help...
Just carried out a new installation on CentOS 5.9 x64. (VMWare VM).
ok, I assume, it's 0.1.23
Yes, it is.
I've run into a couple of issues.
Firstly, I've been directing mail at the installation, and it shows
that it has processed a number of messages. The metadata shows up in
the v_messages table, the messages are stored in my store directory,
and can be retrieved with pilerget and ID.
so far, so good
Unfortunately, a search in the user interface yields no results. When
logged in as admin, although on the dashboard the number of messages
processed is accurately reported, the statistics page shows none.
do you have any php error messages? Please check if you have the php-gd
package installed.
The package is installed. To clarify, I mean the accounting page (not
statistics, statistics displays correctly, sorry!) shows no e-mails, although
all other areas say otherwise.
I was about to say that I still get no results on the search page, however upon
checking again, I can see 2 e-mails for my user account (funnily enough the
confirmation e-mails for this mailing list!) although there were other e-mails
processed earlier for the same user account which haven't shown up. Any
thoughts?
Running a query against sphinxql main1 shows no results. I have tried
re-indexing. Any pointers would be greatly appreciated.
Are you an admin or an auditor? Admins shouldn't see the messages, it's
a role for auditor (=to see every messages).
I've tried as a couple of different users, both are end users with valid e-mail
addresses. Still no joy.
Next, I created a new admin account and was then unable to login with
admin@local. I have resolved this thanks to the mailing list
(char(128) in the database for passwords). However, in production I am
using LDAP for authentication (e-mail address shows up in settings -
re: issue above) and when LDAP is enabled I am unable to authenticate
as either my new admin account or admin@local. Is there a group I can
edit model/user/auth.php and replace the 71th line:
if(isset($query-row)) {
with this:
if(isset($query-row['dn'])) {
then try to login again.
Or you may download the latest master branch, and use the webui of it.
Great, thanks for that!
use in my directory for admins? I will also likely be using IMAP
no, by design admins should be in the local sql database (ie. you can
add more admins manually by the Administration / Users menu.
authentication on another site, and am wondering if I will run into a
it should work, the bug above is ldap related only. Anyway if you
encounter
a problem, just ask.
similar issue? I created the LDAP group for auditors, however my user
account didn't appear any different when I logged back in. Not sure if
that is potentially related to my first issue?
it's not supported by the stock 0.1.23, you should use the latest webui
from the master branch, and set the $config['LDAP_AUDITOR_MEMBER_DN']
parameter (case sensitive!)
I'll try that, thanks!
