[rfc patch v3 6/6] lib: index message files with duplicate message-ids

2017-04-03 Thread David Bremner
The corresponding xapian document just gets more terms added to it, but this doesn't seem to break anything. --- lib/database.cc| 3 +++ test/T670-duplicate-mid.sh | 22 +++--- 2 files changed, 22 insertions(+), 3 deletions(-) diff --git a/lib/database.cc

[rfc patch v3 2/6] lib: add _notmuch_message_remove_indexed_terms

2017-04-03 Thread David Bremner
Testing will be provided via use in notmuch_message_reindex --- lib/message.cc| 44 lib/notmuch-private.h | 2 ++ lib/notmuch.h | 4 3 files changed, 50 insertions(+) diff --git a/lib/message.cc b/lib/message.cc index

[rfc patch v3 4/6] add "notmuch reindex" subcommand

2017-04-03 Thread David Bremner
From: Daniel Kahn Gillmor This new subcommand takes a set of search terms, and re-indexes the list of matching messages. --- Makefile.local| 1 + doc/conf.py | 4 ++ doc/index.rst | 1 +

[rfc patch v3 1/6] lib: add definitions for notmuch_param_t

2017-04-03 Thread David Bremner
This is not an opaque struct because we envision using static initialization much like the command-line-options.h structures. --- lib/notmuch.h | 17 + 1 file changed, 17 insertions(+) diff --git a/lib/notmuch.h b/lib/notmuch.h index d374dc96..fc00f96d 100644 --- a/lib/notmuch.h

[rfc patch v3 3/6] added notmuch_message_reindex

2017-04-03 Thread David Bremner
From: Daniel Kahn Gillmor This new function asks the database to reindex a given message. The parameter `indexopts` is currently ignored, but is intended to provide an extensible API to support e.g. changing the encryption or filtering status (e.g. whether and how certain

[rfc patch v3 5/6] test: add known broken test for duplicate message id

2017-04-03 Thread David Bremner
There are many other problems that could be tested, but this one we have some hope of fixing because it doesn't require UI changes, just indexing changes. --- test/T670-duplicate-mid.sh | 17 + 1 file changed, 17 insertions(+) create mode 100755 test/T670-duplicate-mid.sh diff

third round of indexing all files

2017-04-03 Thread David Bremner
It seems noticeably faster (on the order of 30-50% faster) and the code is quite a bit simpler to adapt the approach in [1] to only delete the terms we are going to re-add via indexing. This obsoletes the previous series at [2]. It still has all of the issues mentioned there UI-wise, and the

Re: [gmailieer] fast fetch and two-way tag synchronization between notmuch and GMail

2017-04-03 Thread Gaute Hope
Rafael Avila de Espindola writes on april 3, 2017 16:35: After a few issues with the initial sync this is working perfectly. Thanks a lot, it is a big improvement over mbsync. Great, thanks for the patches! This made inital sync much more robust. I have a non-user-api-key version working

Re: [gmailieer] fast fetch and two-way tag synchronization between notmuch and GMail

2017-04-03 Thread Rafael Avila de Espindola
After a few issues with the initial sync this is working perfectly. Thanks a lot, it is a big improvement over mbsync. Cheers, Rafael Gaute Hope writes: > Hi, > > 'gmailieer' (or 'gmi') is a small program that can pull email and labels > (and changes to labels) from