[tw5] optimising performance (searching vs saving tiddlers)

2019-07-19 Thread Watt
Hi haroulito
If you haven't already seen it there is another useful discussion here;

https://groups.google.com/forum/m/#!topic/tiddlywiki/Aheyeybfydg

Bimlas and others comments towards the end offer some good tips.
Good luck!

-- 
You received this message because you are subscribed to the Google Groups 
"TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to tiddlywiki+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/tiddlywiki/b6f45ae4-8107-47e4-b2b9-7938ad73766a%40googlegroups.com.


[tw5] optimising performance (searching vs saving tiddlers)

2019-07-18 Thread haroulito
Hi all,

I've been pondering on the best approach for maintaining TW performance as 
the size of single-file wikis grows. This has been bothering me for a while 
so I thought to share my thoughts and get any insights / advice.

I have considered to go the node.js or TiddlyServer way but have not taken 
the plunge yet. (I have only done some early tests with TiddlyServer.)

I primarily use 3-4 wikis. The main TW I use is between 7 and 8 mb and when 
it reaches around 8mb I start to export/archive some content to maintain 
the performance. (I only store text, no images or embedded files). I use 
this wiki for my workflow (GTD-style) and for quick entry of content in my 
inbox. 

So performance is crucial as I am creating, editing and tagging many small 
tiddlers in succession and often on occcasions where there is time pressure.

What I need to improve is the delay when clicking to save a tiddler. For my 
8mb wiki it takes about 4 seconds to save each tiddler. On a blank TW with 
all the plugins I need installed it takes ~2 seconds. This difference is 
really noticeable under time pressure and big volumes of work.

(I use TiddlyDesktop with backups enabled. Disabling backups does not 
produce much noticeable difference but I do disable when I bulk-edit 
tiddlers to speed things up)

*Searching*
Searching is fast for the size of wikis I use. If I start splitting my 
content into more wikis then my problem would be searching all the wikis. 

Obviously single-file wikis have various advantages and I also heard Jeremy 
say in one of the hangouts that not all the plugins would work well in a 
node.js implementation.

If I decide to stick to single-file wikis, I've been thinking to merge all 
my wikis just for the purposes of searching. E.g. export all tiddlers from 
all wikis using "[!is[system]]" and import to a single wiki. I would then 
search the single wiki if I can't tell which of the individual wikis I 
should search. Obviously not an elegant way to do things even if the  
process of merging all my wikis could be automated.
 
Any ideas on improving performance of saving tiddlers after editing and 
also ways to search content across multiple single-file wikis?

Many thanks 
H.

p.s.1 My computer setup:
Win7
intel i7, 8gb of ram, magnetic HDD
TW 5.1.19
TiddlyDesktop with backups enabled

p.s.2 I have found this post useful. It seems that there will be 
improvements in indexing but the issue I am facing is about saving tiddlers 
after editing rather than fast searching.
https://groups.google.com/forum/#!topic/tiddlywiki/BXQNiAoJQSE

-- 
You received this message because you are subscribed to the Google Groups 
"TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to tiddlywiki+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/tiddlywiki/b37f34ae-6411-480e-83a4-2a20d8ab75e0%40googlegroups.com.