Re: Migration of kwallet failed
Michael Schwartzkopff posted on Tue, 03 Apr 2018 21:00:23 +0200 as excerpted: > Thanks for all the hints, but nothing really helped. I tried all (!) > existing and reasonable command line tools, I tried all reasonable > tricks from the internet and from this list. But still I am not aable to > decrypt my kwallet file. > > I also did not find a good descriptions of the format kwallet stores its > data ,so I'd be able to write the decrypt program myself. I do not have > the time to reverse engineer the file format. > > Since I need my paswords, I am willing to sponsor a command line tool > that takes the wallet, the salt file and the password as input and dumps > the contents of the password store. Yes, I am ready to pay money for > this tool. Finally it has to work on my computer and decrypt my wallet. > I'd like to see this tool beeing available as open source. As Martin S. I'm inclined to believe that the wallet files you have must be corrupt. Because otherwise /something/ would work with them. So restoring from a known-good backup looks to be your best bet. Meanwhile, there remains another suggestion I've not seen made yet, tho honestly if nothing else has worked I'm guessing this won't either, but... Back in the middle of the kde4 era I switched from konqueror and kmail using kwallet to firefox and claws-mail.[1] So these days I don't use kwallet for anything and only have the framework installed because it's a non-optional dep of various other kde packages I have installed, including the plasma-desktop and plasma-workspace packages themselves. But in the switch from konqueror to firefox I did use a firefox extension that integrated with kwallet for a time. Presumably it's still available, at least for older pre-webext/pre-e10s firefox as you may still be running with an old 2014-era Ubuntu, tho I rather doubt it made the switch to webext and thus is likely incompatible with current firefox. But I really do doubt it'd work in any case, because as I said, chances are /something/ you tried would have worked by now, if the kwallet files themselves weren't corrupt, which I suspect to be your real problem. --- [1] It became very clear to me after some potentially security-critical konqueror bugs weren't fixed in the timely manner befitting security- critical bugs on an app accessing untrusted content, and based on various kde dev comments, that they considered konqueror little more than a toy, not a daily-driver browser kept sufficiently security-updated to use it for untrusted content AND for online banking and other security-critical tasks, and while I don't always agree with mozilla's decisions, unlike google's chromium which is developed primarily has an open base for the proprietary chrome, at least mozilla's firefox has always been freedomware as the primary product. And kmail jumped the shark with the akonadi integration -- email isn't rocket science and should "just work", without me having to reset the database to recover lost mail, and without a bunch of feature-bloat and dependencies I don't need or want in the first place. -- Duncan - List replies preferred. No HTML msgs. "Every nonfree program has a lord, a master -- and if you use the program, he is your master." Richard Stallman
Re: Migration of kwallet failed
Michael Schwartzkopff - 03.04.18, 21:00: > Am 03.04.2018 um 10:03 schrieb Martin Steigerwald: > > Michael Schwartzkopff - 03.04.18, 07:19: > >> Am 02.04.2018 um 10:11 schrieb Martin Steigerwald: […] > Thanks for all the hints, but nothing really helped. I tried all (!) > existing and reasonable command line tools, I tried all reasonable > tricks from the internet and from this list. But still I am not aable to > decrypt my kwallet file. Okay, still a short answer, before I go to bed. That is really strange. Are you sure the file is intact? Did you compare it with a known good backup? You have been able to use it before on Ubuntu 14.04, haven´t you? So in this case I would dig out an older version of the file that works. The one directly before the first attempt to migrate anything. This one should really still work with an KDE SC 4 based distro, cause you used it before like that. Heck, if nothing else works, why not restore your Ubuntu 14.04 completely (system + userdata, at least what is needed for KWallet) in order to access your passwords. > I also did not find a good descriptions of the format kwallet stores its > data ,so I'd be able to write the decrypt program myself. I do not have > the time to reverse engineer the file format. You could look in kwallet sourcecode. > Since I need my paswords, I am willing to sponsor a command line tool > that takes the wallet, the salt file and the password as input and dumps > the contents of the password store. Yes, I am ready to pay money for > this tool. Finally it has to work on my computer and decrypt my wallet. > I'd like to see this tool beeing available as open source. > > > Any developers willing to take on that task, please contact me via mail. I´d ask this in IRC, in kde-devel / frameworks-devel mailinglists. I do not have the impression that many KDE developers read this mailinglist regularily. Good luck. -- Martin
Re: Migration of kwallet failed
Am 03.04.2018 um 10:03 schrieb Martin Steigerwald: > Michael Schwartzkopff - 03.04.18, 07:19: >> Am 02.04.2018 um 10:11 schrieb Martin Steigerwald: > […] >>> Michael Schwartzkopff - 02.04.18, 07:44: I did an upgrade of ubuntu 14.04 to 16.04 and now my kwallet is empty. The version of kwalletmanager on the old system was 4:4.13.2. The version on the new system is 4:15.12.3-0ubuntu1. The new kwalletmanager just says: "Error -9". Now I installed an other machine with the old ubuntu 14.04 to open the kwallet there and export it to XML. But opening the kdewallet.kwl there also fails with "Error 42". >>> This should work. >>> >>> Which one did you use? You need to use the old one in ~/.kde/share/apps/ >>> kwalletd, not the new one in ~/.config/kwalletd. >>> Any idea how I can retrieve my passwords? It really would be urgent. >>> You can retry the migration: >>> >>> Set alreadyMigrated to false again: >>> >>> %> cat .config/kwalletrc >>> [Migration] >>> alreadyMigrated=true >>> >>> Restart kwalletd. One way is to log out and log in. There is another way >>> which works during a session, but I am not sure how it worked. Maybe you >>> can just quit kwalletd5 process and start it again. >>> >>> Also see: >>> >>> https://wiki.gentoo.org/wiki/KDE/ >>> Troubleshooting#Recover_KWallet_passwords_after_failed_migration > […] >> thanks for your hint. But setting Migration flag to false did not help. >> Since I did set up an old ubuntu version already I have little hope that >> an old gentoo would help. >> >> >> But it seems a last hope if nothing elase works. > No, I was not suggesting you setup a Gentoo. I don´t think it matters whether > its kwallet(d|manager) 4 from Ubuntu or Gentoo. > >> Any other ideas to recover my passwords? Since I know my master password >> and I have the salt and the kwl files, is there a cli tool just to >> decrypt the contents and dump it? Or is there a description of the data >> format of the kwl file, so I could write it myself? > There was a tool. Oh and it appears there still is: At least Debian still has > the package kwalletcli. It depends on KF5 stuff already, so I am not sure > whether it would be able to read old files. But AFAIR there has been a KDE SC > 4 version as well. Unfortunately it can only access specified entries and not > dump the whole contents of it. But well, you may ask its author Thorsten > Glaser for help to recover your kwallet, as I think he may know quite a bit > more about it than me. You can find mail address with apt-cache show > kwalletcli. There are also language bindings¹ including a Python example, so > maybe something is scriptable. kwalletcli itself can only read the standard > wallet. > > [1] https://www.mirbsd.org/kwalletcli.htm > > In addition to that there is also a kwallet-query tool². It can also list > entries. And you give it the name of the wallet to use. It is from one of the > maintainers of it Valentin Rusu. And its part of kwallet distribution since > some time. Listing my standard wallet works like this: > > kwallet-query -l kdewallet > > But just gives a list of entries, without passwords. You then need a script > which reads password of every item. > > [2] (was not able to access it, timeout, but maybe you can, or archive.org > can > help) https://barlog.rusu.info/valentin/blog/?p=386 > > Well as I bet you can speak German you can also skim through my article from > 2011 about password managers³. Maybe some of them or one of their successors > (latest keepass(2|x) for example) can *import* kwallet files. Hmmm, does not > seem like keepass2 can directly import them[4]. > > [3] http://www.linux-community.de/Internal/Artikel/Print-Artikel/LinuxUser/ > 2011/01/Passwortmanager-im-Vergleich > > [4] https://keepass.info/help/base/importexport.html > > Also in case you still have that old Ubuntu: At least with Debian for some > release there have been kwalletd4 and kwalletd from KF5 running in parallel, > but only one kwalletmanager, the one of KF5. So in case you can get any KDE > SC > 4 based CLI tool or kwalletmanager from KDE SC 4 for work, you should be able > to access your old wallet, but well, haven´t you already been able to access > the old contents as XML or so? > >> Now I installed an other machine with the old ubuntu 14.04 to open the >> kwallet there and export it to XML. But opening the kdewallet.kwl there >> also fails with "Error 42". > Ok, nope. I however don´t get why. The old kwalletd should be able to open > those. Maybe you need to go back another Ubuntu release for so, to have both > old kwalletd and kwalletmanager from KDE SC 4. As the kwalletmanager5 will > only access kwalletd5. And you need to make sure that you use the KDE SC 4 > wallets in ~/.kde/share/apps/kwallet, not the new ones in ~/.config/kwallet. > > > Another crazy idea of mine: I remember loosely that I may have done something > unconventional back then in
Re: Migration of kwallet failed
Hi,
So you still have a working Ubuntu 14.04 install? I missed that in your
original post. In that case I have some PPAs that may be useful for you, on
launchpad, in particular ppa:rjvbertin/qt4 and ppa:rjvbertin/kde-git which
contains newer versions of Qt (4.8.7) and a number of KDE packages (you may
also need rjvbertin/misc). The KDE-Runtime stuff in there is from June 2016 so
must already be aware of its KF5 counterparts.
But as Martin said, make backups first. Or clone that 14.04 install to a VM and
work in there. Apply any Ubuntu updates before cloning, but if you decide to
use my PPAs, add them in the VM first, in case something goes wrong with those.
I'd also suggest to copy the old kdewallet.{kwl,salt} files from a virtual
console or something like that, i.e. without any KDE or other GUI stuff
running. I just hope for you that those files are unaltered.
If kwallet-manager4 continues to fail to start, check with a regular client
application if your passwords are there. If they are, the failure is in
kwallet-manager and there's a bit more hope.
The kwallet protocol isn't super well documented but not rocket science either
- in particular the synchronous API. I rewrote the Mac Keychain backend as one
of my very first KDE contributions, mostly thanks to the self-explanatory code.
It should be possible to write a non-gui utility that opens a given wallet
without going through the kwalletd and which dumps the whole thing. It'll be
tedious, but you should be able to take inspiration from
kdeui/tests/kwallettest.cpp in the kdelibs sources.
FWIW, I ran kwalletd4 + kwallet-manager4 on my Plasma4 desktop, with self-built
KF5 stuff in a separate prefix. Kwallet-manager5 either connected just fine to
kwalletd4 or the 2 daemons didn't bite each other. I noticed at some point that
in practice I was using only the KF5 kwallet so I'm now only running kwalletd5.
I recall that I did a manual migration via an XML dump, but it's possible that
was on my Mac where the KDE4 kwallet uses the host's Keychain backend (a
synchronous mechanism without kwalletd). Probably TMI...
R.
Re: Migration of kwallet failed
Michael Schwartzkopff - 03.04.18, 07:19: > Am 02.04.2018 um 10:11 schrieb Martin Steigerwald: […] > > Michael Schwartzkopff - 02.04.18, 07:44: > >> I did an upgrade of ubuntu 14.04 to 16.04 and now my kwallet is empty. > >> > >> > >> The version of kwalletmanager on the old system was 4:4.13.2. > >> > >> The version on the new system is 4:15.12.3-0ubuntu1. > >> > >> > >> The new kwalletmanager just says: "Error -9". > >> > >> Now I installed an other machine with the old ubuntu 14.04 to open the > >> kwallet there and export it to XML. But opening the kdewallet.kwl there > >> also fails with "Error 42". > > > > This should work. > > > > Which one did you use? You need to use the old one in ~/.kde/share/apps/ > > kwalletd, not the new one in ~/.config/kwalletd. > > > >> Any idea how I can retrieve my passwords? It really would be urgent. > > > > You can retry the migration: > > > > Set alreadyMigrated to false again: > > > > %> cat .config/kwalletrc > > [Migration] > > alreadyMigrated=true > > > > Restart kwalletd. One way is to log out and log in. There is another way > > which works during a session, but I am not sure how it worked. Maybe you > > can just quit kwalletd5 process and start it again. > > > > Also see: > > > > https://wiki.gentoo.org/wiki/KDE/ > > Troubleshooting#Recover_KWallet_passwords_after_failed_migration […] > thanks for your hint. But setting Migration flag to false did not help. > Since I did set up an old ubuntu version already I have little hope that > an old gentoo would help. > > > But it seems a last hope if nothing elase works. No, I was not suggesting you setup a Gentoo. I don´t think it matters whether its kwallet(d|manager) 4 from Ubuntu or Gentoo. > Any other ideas to recover my passwords? Since I know my master password > and I have the salt and the kwl files, is there a cli tool just to > decrypt the contents and dump it? Or is there a description of the data > format of the kwl file, so I could write it myself? There was a tool. Oh and it appears there still is: At least Debian still has the package kwalletcli. It depends on KF5 stuff already, so I am not sure whether it would be able to read old files. But AFAIR there has been a KDE SC 4 version as well. Unfortunately it can only access specified entries and not dump the whole contents of it. But well, you may ask its author Thorsten Glaser for help to recover your kwallet, as I think he may know quite a bit more about it than me. You can find mail address with apt-cache show kwalletcli. There are also language bindings¹ including a Python example, so maybe something is scriptable. kwalletcli itself can only read the standard wallet. [1] https://www.mirbsd.org/kwalletcli.htm In addition to that there is also a kwallet-query tool². It can also list entries. And you give it the name of the wallet to use. It is from one of the maintainers of it Valentin Rusu. And its part of kwallet distribution since some time. Listing my standard wallet works like this: kwallet-query -l kdewallet But just gives a list of entries, without passwords. You then need a script which reads password of every item. [2] (was not able to access it, timeout, but maybe you can, or archive.org can help) https://barlog.rusu.info/valentin/blog/?p=386 Well as I bet you can speak German you can also skim through my article from 2011 about password managers³. Maybe some of them or one of their successors (latest keepass(2|x) for example) can *import* kwallet files. Hmmm, does not seem like keepass2 can directly import them[4]. [3] http://www.linux-community.de/Internal/Artikel/Print-Artikel/LinuxUser/ 2011/01/Passwortmanager-im-Vergleich [4] https://keepass.info/help/base/importexport.html Also in case you still have that old Ubuntu: At least with Debian for some release there have been kwalletd4 and kwalletd from KF5 running in parallel, but only one kwalletmanager, the one of KF5. So in case you can get any KDE SC 4 based CLI tool or kwalletmanager from KDE SC 4 for work, you should be able to access your old wallet, but well, haven´t you already been able to access the old contents as XML or so? > Now I installed an other machine with the old ubuntu 14.04 to open the > kwallet there and export it to XML. But opening the kdewallet.kwl there > also fails with "Error 42". Ok, nope. I however don´t get why. The old kwalletd should be able to open those. Maybe you need to go back another Ubuntu release for so, to have both old kwalletd and kwalletmanager from KDE SC 4. As the kwalletmanager5 will only access kwalletd5. And you need to make sure that you use the KDE SC 4 wallets in ~/.kde/share/apps/kwallet, not the new ones in ~/.config/kwallet. Another crazy idea of mine: I remember loosely that I may have done something unconventional back then in order to migrate the wallets. I am still not sure whether there is any significant difference between old and new files. So maybe if you just move
Re: Migration of kwallet failed
Am 02.04.2018 um 10:11 schrieb Martin Steigerwald: > Hello Michael. > > Initial mail might have landed in moderation queue or something like that, at > least it didn´t get through yet, thus CC´ing to you as well. > > Michael Schwartzkopff - 02.04.18, 07:44: >> I did an upgrade of ubuntu 14.04 to 16.04 and now my kwallet is empty. >> >> >> The version of kwalletmanager on the old system was 4:4.13.2. >> >> The version on the new system is 4:15.12.3-0ubuntu1. >> >> >> The new kwalletmanager just says: "Error -9". >> >> Now I installed an other machine with the old ubuntu 14.04 to open the >> kwallet there and export it to XML. But opening the kdewallet.kwl there >> also fails with "Error 42". > This should work. > > Which one did you use? You need to use the old one in ~/.kde/share/apps/ > kwalletd, not the new one in ~/.config/kwalletd. > >> Any idea how I can retrieve my passwords? It really would be urgent. > You can retry the migration: > > Set alreadyMigrated to false again: > > %> cat .config/kwalletrc > [Migration] > alreadyMigrated=true > > Restart kwalletd. One way is to log out and log in. There is another way > which > works during a session, but I am not sure how it worked. Maybe you can just > quit kwalletd5 process and start it again. > > Also see: > > https://wiki.gentoo.org/wiki/KDE/ > Troubleshooting#Recover_KWallet_passwords_after_failed_migration > > Thanks, Hi, thanks for your hint. But setting Migration flag to false did not help. Since I did set up an old ubuntu version already I have little hope that an old gentoo would help. But it seems a last hope if nothing elase works. Any other ideas to recover my passwords? Since I know my master password and I have the salt and the kwl files, is there a cli tool just to decrypt the contents and dump it? Or is there a description of the data format of the kwl file, so I could write it myself? Michael. Mit freundlichen Grüßen, -- [*] sys4 AG https://sys4.de, +49 (89) 30 90 46 64 Schleißheimer Straße 26/MG,80333 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer, Wolfgang Stief Aufsichtsratsvorsitzender: Florian Kirstein signature.asc Description: OpenPGP digital signature
Re: Migration of kwallet failed
Hello Michael. Initial mail might have landed in moderation queue or something like that, at least it didn´t get through yet, thus CC´ing to you as well. Michael Schwartzkopff - 02.04.18, 07:44: > I did an upgrade of ubuntu 14.04 to 16.04 and now my kwallet is empty. > > > The version of kwalletmanager on the old system was 4:4.13.2. > > The version on the new system is 4:15.12.3-0ubuntu1. > > > The new kwalletmanager just says: "Error -9". > > Now I installed an other machine with the old ubuntu 14.04 to open the > kwallet there and export it to XML. But opening the kdewallet.kwl there > also fails with "Error 42". This should work. Which one did you use? You need to use the old one in ~/.kde/share/apps/ kwalletd, not the new one in ~/.config/kwalletd. > Any idea how I can retrieve my passwords? It really would be urgent. You can retry the migration: Set alreadyMigrated to false again: %> cat .config/kwalletrc [Migration] alreadyMigrated=true Restart kwalletd. One way is to log out and log in. There is another way which works during a session, but I am not sure how it worked. Maybe you can just quit kwalletd5 process and start it again. Also see: https://wiki.gentoo.org/wiki/KDE/ Troubleshooting#Recover_KWallet_passwords_after_failed_migration Thanks, -- Martin
Re: Migration of kwallet failed
Hello Michael. Michael Schwartzkopff - 02.04.18, 07:44: > I did an upgrade of ubuntu 14.04 to 16.04 and now my kwallet is empty. > > > The version of kwalletmanager on the old system was 4:4.13.2. > > The version on the new system is 4:15.12.3-0ubuntu1. > > > The new kwalletmanager just says: "Error -9". > > Now I installed an other machine with the old ubuntu 14.04 to open the > kwallet there and export it to XML. But opening the kdewallet.kwl there > also fails with "Error 42". This should work. Which one did you use? You need to use the old one in ~/.kde/share/apps/ kwalletd, not the new one in ~/.config/kwalletd. > Any idea how I can retrieve my passwords? It really would be urgent. You can retry the migration: Set alreadyMigrated to false again: %> cat .config/kwalletrc [Migration] alreadyMigrated=true Restart kwalletd. One way is to log out and log in. There is another way which works during a session, but I am not sure how it worked. Maybe you can just quit kwalletd5 process and start it again. Also see: https://wiki.gentoo.org/wiki/KDE/ Troubleshooting#Recover_KWallet_passwords_after_failed_migration Thanks, -- Martin
