On 2015-07-21 03:10, James Macdonell wrote:
On 07/20/2015 02:47 AM, Janos SUTO wrote:
So we have to either limit the download button's
scope to the current page. Or tie the first 1000 hits to the button no
matter how many hits you have.

It will be very helpful to have a more powerful bulk download button
:-)   I have run into cases where I've need to package up several
thousand emails.  For the end product, typically legal wants either a
PDF or a PST.

I picture using the search GUI to refine the query until I get what I
expect in the sample results.   I'd then use that query with a
modified pilerexport and let it page through all the search results
taking all the time it needs, something like:
    pilerexport --query 'to: [email protected], body: "ice cream" |
yogurt , subject: !party'

Alternatively, the GUI could be expanded to something like the
Exchange ediscovery tool.  Fill out the wizard with your various
search parameters, hit submit, and it runs quietly the background
somewhere.  When it's ready, it sends you an (optional) email.

I also see needing to enforce a hard limit somewhere.  We'd have a
button to download the first 1,000 as you describe and and it's up to
the auditor to write queries that get in under that limit.

I've fixed the gui search to use the method recommended sphinx, ie.
retrieve only so many hits you want to display on the given page.
You can also page further and further using the navigation feature.

One caveat, however: you can't just hit the search button, and page
through 2 million hits, because sphinx (=searchd) poses a limit at
max_searches (1000 by default).

One option is to increase this value, but you should keep it to a
sane value.

A feature allowing to gather a huge number of emails is still missing.
I'll make that tool soon. Stay tuned!

Btw. James, would you share your modified pilerexport program? I mean
the source code.

Janos

Reply via email to