Update to earlier post 'Imported a lot of files, now indexing is taking
forever' -
I've been trying to get the balance right in notebook size v
performance, but still have major issues. In its current form my
notebook is unusable bc the PC freezes for a few seconds after typing
just a few letters... it seems to be saving/indexing/? every x seconds
even if I am typing.
I will reduce my notebook size again until it behaves normally. But
perhaps you could consider reducing background activity during text
entry? or allow the user to pause re-indexing?
My notebook is currently 4532 items, 14.7MB, the breakdown of file types
is -
Due to my importing of files, some 'dodgy' files made it through - Is
the presence of these filetypes likely to pose a problem for Zim? In a
perfect world, I would like Zim to be completely integrated with my
folder organisation, to avoid having one tree for Zim and another for
(say) PDFs.
(I did follow the Help file protocols to ensure filenames had no spaces
and the Zim txt headers were applied. Indexing on first import using the
external script you provided took only a few minutes).
Thanks
Jon
On 01/04/2022 10:41, jon wrote:
Hi again,
I did cut the notebook size down back to close to how it was before.
But despite that, Zim has become a real slug: When typing a line in
any page it freezes after a few seconds - and sometimes the entire PC
is unresponsive until Zim has finished doing something...sometimes the
PC fan comes on... then after a few seconds the text I typed appears
all at once.
Any ideas? I feel I should reduce the size of the notebook again but I
don't want to as it would defeat the point to a degree.
If you want me to post on the forum let me know, it's just that I
assumed you are the only person who has a direct interest in these
issues...
Thanks,
Jon
PS it may be 1 April but this is not a joke!!
On 27/03/2022 09:39, jon wrote:
Update 2 - It turns out my new giant notebook is fragile. On top of
the wait to load on startup, it frequently hangs (Win10 error
dialogue 'your app is not responding blah blah'). I'm telling you for
info, but anyway I plan to split the notebook up so each one is more
like the size it was before (~ from 7k down to ~3k items).
Not really intending to complain - bc I absolutely love Zim - but
another downside of enormous notebooks is that backing up via usb
takes a long time (many tiny files).
More random info - my pc has bitlocker running, idk if that has a
performance hit?
Thanks,
Jon
On 21/03/2022 12:49, jon wrote:
Update - Actually, I got that wrong, sorry - the earlier version is
not helping. I forgot I needed to run the indexer on that too but it
is responding with an error when I try to run the batch command -
Failed to execute script zim_launch. (Not clear why that is
happening but I have to do other things now).
So the current version takes 3-4m to load, then the processor keeps
churning for another ~2m after the window appears.
Total memory used settles at ~100mb, I mention that although I have
a lot of memory, it would not surprise me that Win10 has something
to do with this.
Thanks
Jon
On 21/03/2022 12:01, jon wrote:
Jaap,
The short conclusion is - there is nothing wrong with indexing
apparently but the version 0.74.3 may have a problem...
Following your advice I ran a .bat with the command -
"C:\Program Files\Zim Desktop Wiki\zim.exe" --index --verbose
C:\TP\ZIM(c)\ALL
(The help page
https://zim-wiki.org/manual/Help/Commandline_Options.html suggested
the keyword order matters?)
It completed within a couple of minutes. No messages.
But then when opening Zim 0.74.3 normally I now get a delay of
~3-4mins before the window appears... I quit Zim and tried again,
no change.
During this time the memory usage is ramping up slowly from ~50mb
to ~100mb while processor is at ~12pc.
Once the window appears everything in Zim works normally I think.
The tree looks as expected (with all my newly imported pages).
(Yesterday the processor assigned to Zim stayed at ~12pc for an
hour until I stopped it.)
I then opened the notebook with the earlier Zim version (0.73.2)
and it opened normally i.e. quickly...
So thanks for your help, it fixed my main problem - but the
remaining lagging issue seems to be related to some change in the
latest version.
Regards,
Jon
On 20/03/2022 18:59, Jaap Karssenberg wrote:
Hi Jon,
Based on my benchmarks [1] this should run within minutes. But not
sure what version of zim you are using and what platform, if it is
an older version, the benchmark might not be valid.
To troubleshoot best way is to run "zim -V --index
path/to/notebook" from a terminal, it will give some insight in
what is going on and hopefully show some errors that give a hint
to what is wrong.
Hope this helps,
Jaap
[1]
https://github.com/zim-desktop-wiki/zim-desktop-wiki/wiki/Performance-large-notebook
On Sat, Mar 19, 2022 at 7:58 PM jon <[email protected]> wrote:
Hi,
Loving Zim but got a problem -
I just updated to the latest Zim version (on PC), and followed
the help instructions to process a bunch of text files to be
valid for Zim to read, and restarted Zim - immediately it
started reindexing, but doesn't seem to end.
I terminated Zim after an hour and restarted, and the
processor (fan) is grinding on again with the indexer window
open - the progress bar gets stuck then seems to show
activity, but no idea how much progress has been made.
I have 7k files and about 30mb (almost all text).
Any advice how to overcome this, or how long to wait? e.g. if
some of the files are invalid (e.g. title characters illegal)
would that just get skipped or cause a bigger problem?
Also it's possible that some files now have two headers due to
batch processing the conversion in np++, is this likely to be
a problem?
Thanks,
Jon
_______________________________________________
Mailing list: https://launchpad.net/~zim-wiki
Post to : [email protected]
Unsubscribe : https://launchpad.net/~zim-wiki
More help : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list: https://launchpad.net/~zim-wiki
Post to : [email protected]
Unsubscribe : https://launchpad.net/~zim-wiki
More help : https://help.launchpad.net/ListHelp
