[GitHub] asfgit closed issue #449: Bug: archiver ignores failures if dumponfail is not defined

2018-05-14 Thread GitBox
asfgit closed issue #449: Bug: archiver ignores failures if dumponfail is not defined URL: https://github.com/apache/incubator-ponymail/issues/449 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] sebbASF commented on issue #449: Bug: archiver ignores failures if dumponfail is not defined

2018-05-14 Thread GitBox
sebbASF commented on issue #449: Bug: archiver ignores failures if dumponfail is not defined URL: https://github.com/apache/incubator-ponymail/issues/449#issuecomment-388808124 The code catches Exception, but does nothing unless dumponfail is defined: https://github.com/apache/incu

[GitHub] sebbASF commented on issue #423: Dump documents to disk on ES failure

2018-05-14 Thread GitBox
sebbASF commented on issue #423: Dump documents to disk on ES failure URL: https://github.com/apache/incubator-ponymail/issues/423#issuecomment-388807388 Created new bug #449 This is an automated message from the Apache Git S

[GitHub] sebbASF closed issue #423: Dump documents to disk on ES failure

2018-05-14 Thread GitBox
sebbASF closed issue #423: Dump documents to disk on ES failure URL: https://github.com/apache/incubator-ponymail/issues/423 This is an automated message from the Apache Git Service. To respond to the message, please log on G

[GitHub] sebbASF opened a new issue #449: Bug: archiver ignores failures if dumponfail is not defined

2018-05-14 Thread GitBox
sebbASF opened a new issue #449: Bug: archiver ignores failures if dumponfail is not defined URL: https://github.com/apache/incubator-ponymail/issues/449 See #423 This is an automated message from the Apache Git Service. To

[GitHub] sebbASF commented on issue #423: Dump documents to disk on ES failure

2018-05-14 Thread GitBox
sebbASF commented on issue #423: Dump documents to disk on ES failure URL: https://github.com/apache/incubator-ponymail/issues/423#issuecomment-388805578 Code causes archiver to ignore failures if dumponfail is not defined Th

[GitHub] Humbedooh opened a new issue #423: Dump documents to disk on ES failure

2018-05-14 Thread GitBox
Humbedooh opened a new issue #423: Dump documents to disk on ES failure URL: https://github.com/apache/incubator-ponymail/issues/423 Currently, when PM fails to archive to ES for whatever reason (typically because the DB is unavailable), it just breaks and emails are in risk of ending up n

[GitHub] sebbASF commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
sebbASF commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388792467 No; it does not work like that. There is not a simple JSON interface that can be exposed externally. Whilst the JSON format can be captu

[GitHub] dimidd commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
dimidd commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388775302 I see, instead, would it be possible somehow to infer it from the existing code automagically? E.g. add an optional flag `--dump-json` to `im

[GitHub] dimidd commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
dimidd commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388775302 I see, would it be possible somehow to infer it from the existing code automagically? E.g. add an optional flag `--dump-json` to `import-mbox.

[GitHub] sebbASF commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
sebbASF commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388774425 As I noted earlier, the JSON format depends on ES and the schema (and possibly other aspects of how PonyMail uses ES). It's not guaranteed stab

[GitHub] dimidd commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
dimidd commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388771950 Nothing, I just don't know what should be the exact format of the JSON. E.g. how to set the list-id that the emails belong to. 2018-05-

[GitHub] sebbASF commented on issue #448: edit-list: handle config consistently

2018-05-14 Thread GitBox
sebbASF commented on issue #448: edit-list: handle config consistently URL: https://github.com/apache/incubator-ponymail/pull/448#issuecomment-388771339 elastic.py was an attempt to extract some of the common processing into a separate module. However perhaps it should be split further.

[GitHub] Humbedooh commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
Humbedooh commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388769182 What's preventing you from using the JSON format archiver.py pushes to ES? You should be able to just push documents manually --

[GitHub] dimidd commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
dimidd commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388768756 In my use case, I load a PST file, convert to json, do some processing, and would love to have an option to load a json directly. 2018-

[GitHub] dimidd commented on issue #448: edit-list: handle config consistently

2018-05-14 Thread GitBox
dimidd commented on issue #448: edit-list: handle config consistently URL: https://github.com/apache/incubator-ponymail/pull/448#issuecomment-388767700 Then perhaps we should abstract it into its own module? 2018-05-14 13:04 GMT+03:00 sebbASF : > I've had a look at how the oth

[GitHub] sebbASF commented on issue #447: Import from a local json file

2018-05-14 Thread GitBox
sebbASF commented on issue #447: Import from a local json file URL: https://github.com/apache/incubator-ponymail/issues/447#issuecomment-388767750 ElasticSearch (ES) requires JSON for its API. The JSON format is based on the requirements of ES and the database schema. Both may change.

[GitHub] sebbASF commented on issue #448: edit-list: handle config consistently

2018-05-14 Thread GitBox
sebbASF commented on issue #448: edit-list: handle config consistently URL: https://github.com/apache/incubator-ponymail/pull/448#issuecomment-388764527 I've had a look at how the other tools behave. Currently, archiver.py and import-mbox.py both read ponymail.cfg from the parent di

[GitHub] sebbASF commented on issue #430: Enh: Add option to search all lists in the domain (project) in Advanced Search

2018-05-14 Thread GitBox
sebbASF commented on issue #430: Enh: Add option to search all lists in the domain (project) in Advanced Search URL: https://github.com/apache/incubator-ponymail/issues/430#issuecomment-388759343 This is a duplicate of #131

[GitHub] sebbASF closed issue #430: Enh: Add option to search all lists in the domain (project) in Advanced Search

2018-05-14 Thread GitBox
sebbASF closed issue #430: Enh: Add option to search all lists in the domain (project) in Advanced Search URL: https://github.com/apache/incubator-ponymail/issues/430 This is an automated message from the Apache Git Service.