Re: [Evolution] Migrating from Thunderbird via import without duplicates
On 2020-10-27 at 17:29 +0100, Milan Crha wrote: > On Wed, 2020-10-28 at 00:31 +0900, christopher wrote: > > Are there details on this process (warnings heeded) anywhere? > > No, there are not, because nobody did it yet and should not do that. > > I can think of only a single workaround: > (...) Maybe he could set up an IMAP server on localhost pointing to that local copy, configure evolution to use that server, copying it to the local cache (thus transferring the 100 GB on localhost interface), then change the server configuration to the real server. I would expect the folders.db to have important(?) differences (for instance the message UIDs would all be different), but seems like it should be slightly more compatible. Any opinion on that? Best regards ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
On Tue, 2020-10-27 at 17:50 +0100, Patrick O'Callaghan wrote: > I don't download All > Mail anyway (in fact I don't sync locally at all). You can even > unsubscribe it if you like. Hi, for what it's worth, I have the All Mails disabled on the Gmail side for IMAP synchronization (otherwise I'd have twice more messages). Otherwise it's true, the messages are "duplicated" (it's in double quotes, because Gmail de-duplicates by Message-ID) in IMAP folders (labels) they are located in. Bye, Milan ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
On Tue, 2020-10-27 at 10:36 -0600, Zan Lynx wrote: > On 10/27/2020 10:29 AM, Milan Crha via evolution-list wrote: > > That feels like a lot of mails, or just few movies as attachments (just > > kidding). Do you know how many mails this is? My largest IMAP account > > has 498.162 messages at the moment, which is surely less than that > > yours. I do not download all of the history locally, only the last > > month is stored for the offline use, and even that not in all folders. > > I cannot speak for him but I saw he was using Gmail. Their IMAP system > duplicates messages and if you have a large number of folders, some of > which include the same messages plus "All Mail", you can easily end up > with a 5 or 6 times multiplier on message size. I use Gmail via IMAP and although what you say is true, I haven't noticed any real-world impact. The vast majority of messages have only one label (i.e. are in only one IMAP folder) and I don't download All Mail anyway (in fact I don't sync locally at all). You can even unsubscribe it if you like. poc ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
On 10/27/2020 10:29 AM, Milan Crha via evolution-list wrote: That feels like a lot of mails, or just few movies as attachments (just kidding). Do you know how many mails this is? My largest IMAP account has 498.162 messages at the moment, which is surely less than that yours. I do not download all of the history locally, only the last month is stored for the offline use, and even that not in all folders. I cannot speak for him but I saw he was using Gmail. Their IMAP system duplicates messages and if you have a large number of folders, some of which include the same messages plus "All Mail", you can easily end up with a 5 or 6 times multiplier on message size. This bothers me less since I tend to turn off local storage of IMAP and limit it to the most basic caching of messages I intentionally read. I can wait for a short message fetch. That helps a lot on Gmail too since I rarely read the "All Mail" folder. -- Knowledge is Power -- Power Corrupts Study Hard -- Be Evil ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
On Wed, 2020-10-28 at 00:31 +0900, christopher wrote: > Then what exactly is the use case for importing from Thunderbird as > per [the manual] Hi, I do not think Thunderbird import imports also local caches, it imports local accounts only (from the Mail part). > As I have between 50 - 100 GB of mail to sync, with it all backed up > locally, I'm happy to try to break things in an effort to avoid days > if not weeks of re-syncing. That feels like a lot of mails, or just few movies as attachments (just kidding). Do you know how many mails this is? My largest IMAP account has 498.162 messages at the moment, which is surely less than that yours. I do not download all of the history locally, only the last month is stored for the offline use, and even that not in all folders. Note the initial synchronization doesn't download the messages, it only downloads the headers (it depends also on the "Copy for offline operations" option for the account and respective folders), thus it should be significantly less data to be downloaded. Still, it takes time and bandwidth. > Are there details on this process (warnings heeded) anywhere? No, there are not, because nobody did it yet and should not do that. I can think of only a single workaround: a) mimic exact folder structure under On This Computer b) import the respective .mbox files from Thunderbird to those folders c) add an IMAP account d) close Evolution while it is synchronizing the data e) copy ~/.local/share/evolution/mail/local/folders.db file into the IMAP's directory ~/.cache/evolution/mail//; it will overwrite the existing file f) run Evolution This only *tries to* not download the folder summary data, but the format of the On This Computer and of the IMAP is not exactly the same, there will be missing parts, which may or may not cause trouble. It does not restore respective messages, the cache format is different. I cannot tell whether it'll work or not. I cannot tell whether it'll have any side effects or not. I cannot tell... It's all up to you. I would not do this myself. I'd rather "waste" the bandwidth to have things as they are supposed to be. Note that the IMAP (and any other remote account) has the data stored in ~/.cache/, which is a disposable place. When anything happens to the data there, the mail provider will re-download it from the server. Bye, Milan ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
> Then what exactly is the use case for importing from Thunderbird as per > [the > manual](https://help.gnome.org/users/evolution/stable/import-apps-mozilla.html.en)? > > That is surely for importing to local folders, not IMAP folders > > As I have between 50 - 100 GB of mail to sync, with it all backed up > locally, I'm happy to try to break things in an effort to avoid days if > not weeks of re-syncing. Are there details on this process (warnings > heeded) anywhere? A serious question: if you are using IMAP, why do you need to "sync" all your mail? Evolution keeps a copy of any mail you read as a local cache, there's no permanent store of the mail, it's not a duplicate of your IMAP account. > > I have access to both the mail server and local machine for all but my > gmail accounts. I'll test the process on less important demo accounts as > well. If you need a local store of *all* your mail, then you might like to look at something like Offline IMAP - this will drag down all your mail and keep it locally, then you point Evolution at that store rather than the actual IMAP account. You may be better looking at that to pre- populate with your extant local copy. > > I guess I could copy my local backups to the evolution maildir, ssh into > my mail server and rsync the maildirs. I'd hope it'd recognize there to > be no need to resync and duplicate everything at that point, but maybe > others have tried this with failure? The good thing about standards is that there's so many to choose from. I would strongly advise that you don't go fiddling around with the internal Evolution data stores. Yes, it is Maildir, but the encoding of the filenames and flags may not be consistent with what Evolution thinks it wants. Besides, the Maildir store is only for local accounts - the cache of remote/IMAP accounts is not Maildir and is certainly not meant to be an archival copy of the mail. P. ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
Re: [Evolution] Migrating from Thunderbird via import without duplicates
Then what exactly is the use case for importing from Thunderbird as per [the manual](https://help.gnome.org/users/evolution/stable/import-apps-mozilla.html.en)? As I have between 50 - 100 GB of mail to sync, with it all backed up locally, I'm happy to try to break things in an effort to avoid days if not weeks of re-syncing. Are there details on this process (warnings heeded) anywhere? I have access to both the mail server and local machine for all but my gmail accounts. I'll test the process on less important demo accounts as well. I guess I could copy my local backups to the evolution maildir, ssh into my mail server and rsync the maildirs. I'd hope it'd recognize there to be no need to resync and duplicate everything at that point, but maybe others have tried this with failure? I have no idea how I'd approach this for the gmail accounts though as I can't rsync or ssh into the gmail server. Any hints in the right direction and I'm happy to tinker and break things! Thats why I have backups! :) Best regards, Christopher On 10/27/20 01:29, Milan Crha via evolution-list wrote: On Tue, 2020-10-27 at 00:37 +0900, christopher via evolution-list wrote: Is there any way of doing the above? Hi, there basically isn't. Or it is, but it requires a lot of work, with which it would be too easy to break internal things. I suppose your server account is IMAP or any such, nothing stored locally. Evolution (or better libcamel) stores a local copy of the summary information (basically what you see in the message list) for each folder of that account in some format, plus it stores also already downloaded copies of the messages. Constructing the summary file from an .mbox file is possible, but it's really complicated process and it can break things. After all, those are private application data. You'll be much safer letting Evolution to create the summary on its own. Just add the remote account and that's all. Bye, Milan ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list ___ evolution-list mailing list evolution-list@gnome.org To change your list options or unsubscribe, visit ... https://mail.gnome.org/mailman/listinfo/evolution-list
