I can see why people would want to use the WEBUI to export email, however Janos 
is right, for a huge amount of messages it is better to use the pilerexport 
command.

Janos, perhaps to bridge the gap we could look at a dedicated pilerexport 
feature in the WEBUI? 

Maybe a pilerexport form which auditors/admins have access to, they input 
variables for pilerexport, once submitted it then runs an export in the 
background, upon completion piler emails them back with a link to download the 
zip?

This approach would allow people to batch exports, thoughts?

Regards,

John Kenyon


> -----Original Message-----
> From: Janos SUTO [mailto:[email protected]]
> Sent: Thursday, 28 August 2014 6:34 AM
> To: Piler User
> Subject: Re: Download all count
> 
> 
> Hello,
> 
> recent versions of the gui show you the total number of emails the search
> terms can be found. However sphinx poses a limit on the returned hits, so
> you may get the following response in the middle status bar:
> 
> 1-50, total: 1000 (27271)
> 
> meaning that sphinx found 27271 messages matching the search query,
> however sphinx itself returned you 1000 hits only, because of the sphinx
> internal (though configurable) limits, see Q6 in the FAQ.
> 
> Also note that downloading 40000 emails in a single zip file requires huge
> amount of resources, not to mention what if the http client times out, or the
> php interpreter decides to end the script for excessing time limits.
> 
> Janos
> 
> 
> On 2014-08-27 18:46, Konstantin wrote:
> > Hi
> >
> > When i make a search in my piler ui i see ~40 000 results for my
> > request.
> > I used 'download all' button to download them in zip file.
> >
> > The problem is that inside zip file i see only 5 000 - 6 000 eml file.
> > Count is different for the same search request. The same problem for
> > another search.
> >  piler 0.1.25-master-branch, build 869.
> > I do not see any errors in syslog, maillog, nginx log.
> >
> > Is there any limits or known issues?
> >
> > Thanks.
> >
> > --
> >
> > THIS MESSAGE WAS DELIVERED USING 100% RECYCLED ELECTRONS.
> 
> 
> !DSPAM:5,53fe40c1155447497421850!

Reply via email to