Re: maildir and nmh/mh

[Lauren Weinstein]

I've got "alot" working well enough for my purposes now ("good enough
for jazz!"). Thanks all!

L



On 07/06 11:54, Lauren Weinstein wrote:
> 
> I'll have to see what I can dig out, but it's not immediately clear
> that I can separate out individual folders that will trigger the problems.
> 
> But this does suggest another possibility. Assuming notmuch is
> actually accurately indexing the two massive mh hierarchies, is there
> some other simple front end I could use for the (occasional) searches
> I'd like to do on the mh mail archive? Mutt is working fine for the
> more recent maildir messages. If I need to keep the mh messages
> separate (e.g., under some other username and a separate notmuch db)
> and use a different front end to search and view them, that will work.
> I won't need this every day! In fact, keeping the mh messages separate
> from the maildir messages is probably good for other reasons. Thanks.
> 
> 
> 
> On 07/06 15:47, David Bremner wrote:
> > Lauren Weinstein  writes:
> > 
> > > After fixing the find syntax I got mh2maildir working. However, it does 
> > > not
> > > appear practical in my situation, since I'm dealing with more than 25 
> > > years of archived
> > > mh messages! The conversion would take ages with too many manual 
> > > exceptions.
> > > So unless there's some way to correctly index these natively with 
> > > notmuch, I guess
> > > this is a dead end. But thanks.
> > 
> > For what it's worth, I suspect the problem is not with notmuch proper
> > but with the notmuch-mutt script.  Unfortunatately zack (in copy) is
> > really the only one who knows very much about the script.  If you could
> > make a small tar ball of an MH directory that causes problems for
> > notmuch-mutt, zack could probably be tricked into looking at it.
> > 
> > d
> 
> 
> 
> 
> 
> ___
> notmuch mailing list
> notmuch@notmuchmail.org
> https://notmuchmail.org/mailman/listinfo/notmuch
> 





___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[David Bremner]

Lauren Weinstein  writes:

> OK, it looks like using neomutt on a different machine would solve
> the problem. It isn't immediately clear to me (after digging around
> the docs for a bit) where the repo is that will install neomutt as
> opposed to standard mutt, or how the neomutt .muttrc should be configured
> to simply search and view messages from the notmuch db. Thanks.
>
> L

I'm not really a neomutt expert, but for packages, see

https://www.neomutt.org/distro.html

and for configuration

https://www.neomutt.org/feature/notmuch

I know there's a pretty active/friendly IRC channel #neomutt on
irc.freenode.net

d
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[Lauren Weinstein]

OK, it looks like using neomutt on a different machine would solve
the problem. It isn't immediately clear to me (after digging around
the docs for a bit) where the repo is that will install neomutt as
opposed to standard mutt, or how the neomutt .muttrc should be configured
to simply search and view messages from the notmuch db. Thanks.

L


On 07/06 16:03, David Bremner wrote:
> Lauren Weinstein  writes:
> 
> > I'll have to see what I can dig out, but it's not immediately clear
> > that I can separate out individual folders that will trigger the problems.
> >
> > But this does suggest another possibility. Assuming notmuch is
> > actually accurately indexing the two massive mh hierarchies, is there
> > some other simple front end I could use for the (occasional) searches
> > I'd like to do on the mh mail archive? Mutt is working fine for the
> > more recent maildir messages. If I need to keep the mh messages
> > separate (e.g., under some other username and a separate notmuch db)
> > and use a different front end to search and view them, that will work.
> > I won't need this every day! In fact, keeping the mh messages separate
> > from the maildir messages is probably good for other reasons. Thanks.
> >
> 
> There are a few possibilities (see [1] for a more complete list),
> depending on what sort of front end you are looking for.
> 
> - There's a command line interface accessible via "notmuch"
> 
> - There's an emacs interface (which is probably the most used by the
>   notmuch developers)
> 
> - There's alot, which is a curses based front end
> 
> - There's astroid which is a gtk based front end.
> 
> - There's the already mentioned neomutt (which might work somehow in a
>   secondary account, or something).
> 
> 
> [1]: https://notmuchmail.org/frontends/


___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[David Bremner]

Lauren Weinstein  writes:

> I'll have to see what I can dig out, but it's not immediately clear
> that I can separate out individual folders that will trigger the problems.
>
> But this does suggest another possibility. Assuming notmuch is
> actually accurately indexing the two massive mh hierarchies, is there
> some other simple front end I could use for the (occasional) searches
> I'd like to do on the mh mail archive? Mutt is working fine for the
> more recent maildir messages. If I need to keep the mh messages
> separate (e.g., under some other username and a separate notmuch db)
> and use a different front end to search and view them, that will work.
> I won't need this every day! In fact, keeping the mh messages separate
> from the maildir messages is probably good for other reasons. Thanks.
>

There are a few possibilities (see [1] for a more complete list),
depending on what sort of front end you are looking for.

- There's a command line interface accessible via "notmuch"

- There's an emacs interface (which is probably the most used by the
  notmuch developers)

- There's alot, which is a curses based front end

- There's astroid which is a gtk based front end.

- There's the already mentioned neomutt (which might work somehow in a
  secondary account, or something).


[1]: https://notmuchmail.org/frontends/
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[Lauren Weinstein]

I'll have to see what I can dig out, but it's not immediately clear
that I can separate out individual folders that will trigger the problems.

But this does suggest another possibility. Assuming notmuch is
actually accurately indexing the two massive mh hierarchies, is there
some other simple front end I could use for the (occasional) searches
I'd like to do on the mh mail archive? Mutt is working fine for the
more recent maildir messages. If I need to keep the mh messages
separate (e.g., under some other username and a separate notmuch db)
and use a different front end to search and view them, that will work.
I won't need this every day! In fact, keeping the mh messages separate
from the maildir messages is probably good for other reasons. Thanks.



On 07/06 15:47, David Bremner wrote:
> Lauren Weinstein  writes:
> 
> > After fixing the find syntax I got mh2maildir working. However, it does not
> > appear practical in my situation, since I'm dealing with more than 25 years 
> > of archived
> > mh messages! The conversion would take ages with too many manual exceptions.
> > So unless there's some way to correctly index these natively with notmuch, 
> > I guess
> > this is a dead end. But thanks.
> 
> For what it's worth, I suspect the problem is not with notmuch proper
> but with the notmuch-mutt script.  Unfortunatately zack (in copy) is
> really the only one who knows very much about the script.  If you could
> make a small tar ball of an MH directory that causes problems for
> notmuch-mutt, zack could probably be tricked into looking at it.
> 
> d





___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[David Bremner]

Lauren Weinstein  writes:

> After fixing the find syntax I got mh2maildir working. However, it does not
> appear practical in my situation, since I'm dealing with more than 25 years 
> of archived
> mh messages! The conversion would take ages with too many manual exceptions.
> So unless there's some way to correctly index these natively with notmuch, I 
> guess
> this is a dead end. But thanks.

For what it's worth, I suspect the problem is not with notmuch proper
but with the notmuch-mutt script.  Unfortunatately zack (in copy) is
really the only one who knows very much about the script.  If you could
make a small tar ball of an MH directory that causes problems for
notmuch-mutt, zack could probably be tricked into looking at it.

d
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[Lauren Weinstein]

After fixing the find syntax I got mh2maildir working. However, it does not
appear practical in my situation, since I'm dealing with more than 25 years of 
archived
mh messages! The conversion would take ages with too many manual exceptions.
So unless there's some way to correctly index these natively with notmuch, I 
guess
this is a dead end. But thanks.

L

On 07/06 09:28, cesar mena wrote:
> Lauren Weinstein  writes:
> 
> > Greetings. I've just installed notmuch and notmuch-mutt, obviously
> > for use with mutt. Notmuch was initially setup pointing at my
> > home Maildir directory, and setup ran fine. My testing within mutt using
> > notmuch-mutt macros also worked OK. So far, nifty. Great work!
> >
> > Then (this has now been purged and reverted to Maildir only!) I tried
> > linking into Maildir a pair of very old mh/nmh hierachies, which share
> > many duplicated messages (but always with the same message numbers,
> > I believe).
> >
> > I then let notmuch churn for several hours to index. This seemed
> > to work.
> >
> > Not really though.
> >
> > Attempts to search with the same notmuch-mutt macro after the mh
> > hierachies are added in are totally confused. There are many
> > link errors during the serach ("file already exists" references mh mail
> > message file numbers), and the resulting messages list in mutt is
> > hopeless -- wrong messages, headers displayed don't match the
> > actual message contents, etc.
> >
> > So, maildir - 1, mh - 0.
> >
> > As noted above, I purged and rebuilt just for Maildir -- and
> > again that part is working fine.
> >
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[Lauren Weinstein]

Hi. No, the local mutt is sufficiently customized that switching
to another version is a no-op. I also have been trying the mh2maildir
script (though I had hoped to avoid this, and don't know if I'd
still have the same problems with duplicate messages in the mh 
hierarchies causing apparent notmuch errors). However, the script
as is fails under 16.04, apparently due to changes in the find
command syntax. An error regarding the position of the -maxdepth
option was trivial to fix, but I'm not having any luck so far
avoiding the "paths must precede expression" error from find. Thanks.

L


On 07/06 11:18, David Bremner wrote:
> Lauren Weinstein  writes:
> 
> >
> > Attempts to search with the same notmuch-mutt macro after the mh
> > hierachies are added in are totally confused. There are many
> > link errors during the serach ("file already exists" references mh mail
> > message file numbers), and the resulting messages list in mutt is
> > hopeless -- wrong messages, headers displayed don't match the
> > actual message contents, etc.
> >
> > So, maildir - 1, mh - 0.
> >
> > As noted above, I purged and rebuilt just for Maildir -- and
> > again that part is working fine.
> >
> 
> Is trying neomutt (with built in notmuch support) an option for you?
> 
> d


--Lauren--
Lauren Weinstein (lau...@vortex.com): https://www.vortex.com/lauren 
Lauren's Blog: https://lauren.vortex.com
Google Issues Mailing List: https://vortex.com/google-issues
Founder: Network Neutrality Squad: https://www.nnsquad.org 
 PRIVACY Forum: https://www.vortex.com/privacy-info
Co-Founder: People For Internet Responsibility: https://www.pfir.org/pfir-info
Member: ACM Committee on Computers and Public Policy
Google+: https://google.com/+LaurenWeinstein
Twitter: https://twitter.com/laurenweinstein
Tel: +1 (818) 225-2800

___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[David Bremner]

Lauren Weinstein  writes:

>
> Attempts to search with the same notmuch-mutt macro after the mh
> hierachies are added in are totally confused. There are many
> link errors during the serach ("file already exists" references mh mail
> message file numbers), and the resulting messages list in mutt is
> hopeless -- wrong messages, headers displayed don't match the
> actual message contents, etc.
>
> So, maildir - 1, mh - 0.
>
> As noted above, I purged and rebuilt just for Maildir -- and
> again that part is working fine.
>

Is trying neomutt (with built in notmuch support) an option for you?

d
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: [PATCH 07/23] test/crypto: mark extra space in userid as a bug in gmime-2.6

[Daniel Kahn Gillmor]

On Wed 2017-07-05 23:26:18 +0300, Tomi Ollila wrote:
> On Sat, Jun 03 2017, David Bremner wrote:
>
>> I can't see the space in the output of gpg -K --with-colons
 [...]
> You could add a variable which is set to ' ' when gmime_2 is used and ''
> when gmime_3 is used and insert that just like '"$FINGERPRINT"' is added
> -- that change would not need to live there forever -- just couple of
> years until we drop support for gmime_2... ( ;) )
>
> e.e. "userid: "'"$GM2SPC"'Notmuch Test Suite..."
>
> (if nimed as such, T350-crypto.sh -local variable)

I think this would be a mistake.  This is clearly a bug in gmime 2.6,
and we should be marking it as such.  the User ID does not have a
leading space (see test/gnupg-secret-key.NOTE for how it was generated).

--dkg


signature.asc
Description: PGP signature
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: maildir and nmh/mh

[cesar mena]

Lauren Weinstein  writes:

> Greetings. I've just installed notmuch and notmuch-mutt, obviously
> for use with mutt. Notmuch was initially setup pointing at my
> home Maildir directory, and setup ran fine. My testing within mutt using
> notmuch-mutt macros also worked OK. So far, nifty. Great work!
>
> Then (this has now been purged and reverted to Maildir only!) I tried
> linking into Maildir a pair of very old mh/nmh hierachies, which share
> many duplicated messages (but always with the same message numbers,
> I believe).
>
> I then let notmuch churn for several hours to index. This seemed
> to work.
>
> Not really though.
>
> Attempts to search with the same notmuch-mutt macro after the mh
> hierachies are added in are totally confused. There are many
> link errors during the serach ("file already exists" references mh mail
> message file numbers), and the resulting messages list in mutt is
> hopeless -- wrong messages, headers displayed don't match the
> actual message contents, etc.
>
> So, maildir - 1, mh - 0.
>
> As noted above, I purged and rebuilt just for Maildir -- and
> again that part is working fine.
>
> Any suggestions? Thanks!
>
> --Lauren--
> Lauren Weinstein (lau...@vortex.com): https://www.vortex.com/lauren 
> Lauren's Blog: https://lauren.vortex.com
> Google Issues Mailing List: https://vortex.com/google-issues
> Founder: Network Neutrality Squad: https://www.nnsquad.org 
>  PRIVACY Forum: https://www.vortex.com/privacy-info
> Co-Founder: People For Internet Responsibility: https://www.pfir.org/pfir-info
> Member: ACM Committee on Computers and Public Policy
> Google+: https://google.com/+LaurenWeinstein
> Twitter: https://twitter.com/laurenweinstein
> Tel: +1 (818) 225-2800
>
> ___
> notmuch mailing list
> notmuch@notmuchmail.org
> https://notmuchmail.org/mailman/listinfo/notmuch

hello,

maybe this will help convert your mh hierarchy into maildir?

  http://www.informatik-vollmer.de/software/mh2maildir.php

cheers,
-cm
___
notmuch mailing list
notmuch@notmuchmail.org
https://notmuchmail.org/mailman/listinfo/notmuch

Re: Bug: fatal error with notmuch new, second run starts indexing all over again

[Gregor Zattler]

Hi David, notmuch developers,
* David Bremner  [03. Jul. 2017]:
> Try setting a break in _notmuch_database_log (b _notmuch_database_log)
> and run "bt" at that break point. It might (or might not) be worth
> continuing after the first breakpoint to inspect other errors.

I did so with newest notmuch:

0 (master *) grfz@len:~/tmp$ notmuch --version
notmuch 0.24.2+84~g1ec6344
0 (master *) grfz@len:~/tmp$

0 (master=) grfz@len:~/src/notmuch$ gdb --args /home/grfz/src/notmuch/notmuch 
new
GNU gdb (Debian 7.12-6) 7.12.0.20161007-git
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
.
Find the GDB manual and other documentation resources online at:
.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/grfz/src/notmuch/notmuch...done.
(gdb) b _notmuch_database_log
Breakpoint 1 at 0x1f6e0: file lib/database.cc, line 426.
(gdb) run
Starting program: /home/grfz/src/notmuch/notmuch new
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Found 941498 total files (that's not much mail).
q
Breakpoint 1, _notmuch_database_log (notmuch=0x55825dd0, 
format=0x5558d258 "A Xapian exception occurred adding message: %s.\n") at 
lib/database.cc:426
426 {
(gdb) bt
#0  _notmuch_database_log (notmuch=0x55825dd0, format=0x5558d258 "A 
Xapian exception occurred adding message: %s.\n") at lib/database.cc:426
#1  0x55577f58 in notmuch_database_add_message 
(notmuch=notmuch@entry=0x55825dd0, filename=filename@entry=0x7b204400 
"/home/grfz/Mail/~ml/emacs-orgm...@gnu.org/cur/1488666048.R6065357166258349555.len:2,",
message_ret=message_ret@entry=0x7fffd048) at lib/database.cc:2597
#2  0x5556802f in add_file (state=0x7fffd540, 
filename=0x7b204400 
"/home/grfz/Mail/~ml/emacs-orgm...@gnu.org/cur/1488666048.R6065357166258349555.len:2,",
 notmuch=0x55825dd0) at notmuch-new.c:264
#3  add_files (notmuch=notmuch@entry=0x55825dd0, 
path=path@entry=0x74a15b80 "/home/grfz/Mail/~ml/emacs-orgm...@gnu.org/cur", 
state=state@entry=0x7fffd540) at notmuch-new.c:599
#4  0x55567b44 in add_files (notmuch=notmuch@entry=0x55825dd0, 
path=path@entry=0x8520f1b0 "/home/grfz/Mail/~ml/emacs-orgm...@gnu.org", 
state=state@entry=0x7fffd540) at notmuch-new.c:483
#5  0x55567b44 in add_files (notmuch=notmuch@entry=0x55825dd0, 
path=path@entry=0x638993b0 "/home/grfz/Mail/~ml", 
state=state@entry=0x7fffd540) at notmuch-new.c:483
#6  0x55567b44 in add_files (notmuch=0x55825dd0, 
path=path@entry=0x557cf710 "/home/grfz/Mail", 
state=state@entry=0x7fffd540) at notmuch-new.c:483
#7  0x555689ed in notmuch_new_command (config=0x557ce1d0, 
argc=, argv=) at notmuch-new.c:1099
#8  0x55561a27 in main (argc=, argv=0x7fffda68) at 
notmuch.c:456
(gdb) continue
Continuing.
Error: A Xapian exception occurred. Halting processing.
Processed 660118 total files in 8h 59m 43s (20 files/sec.).
Added 584749 new messages to the database.
Note: A fatal error was encountered: A Xapian exception occurred
[Inferior 1 (process 14593) exited with code 01]
(gdb) continue
The program is not being run.
(gdb)



Since the gdb output shows a filename I looked at its contents:
There is a second "Content-Length:" -Header which does not make
sense but otherwise should not be a problem.  

Since its an email from an open mailing list I attach it to
this very email.

I then configured notmuch to scan the whole mail folder
/home/grfz/Mail/~ml/emacs-orgm...@gnu.org: 

0 (master=) grfz@len:~/src/notmuch$ gdb --args /home/grfz/src/notmuch/notmuch 
new
GNU gdb (Debian 7.12-6) 7.12.0.20161007-git
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
.
Find the GDB manual and other documentation resources online at:
.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/grfz/src/notmuch/notmuch...done.
(gdb) b _notmuch_database