Recently over on the DesignWriteStudio <https://groups.google.com/forum/#!forum/designwrite> Google Group I witnessed very clearly the issue around limits of TW scalability (read below).
Its kinda depressing in that TW offers all the tools for innovative organisation but often fails once the volume of Tiddlers goes beyond modest numbers (a few thousand). That said, wardjh's 85K Tiddler wiki does function, albeit at the speed of a snail with a heavy stone on its back. Such performance is unviable for anything public online. BUT its perhaps okay for using TW to PREPARE content for transport to another system that will do the final publish. I don't see much discussion, well, any, discussion of TW as a very useful PREPARATION tool. Its flexibility seems to me ideal for positioning between inputs for re-arrangement and outputs optimally structured for other systems. I thought some of the comments by Mark S. about performance (from another thread) in general were interesting & worth noting too. Best wishes Josiah wardjh wrote ... > Since my original project of 85,000 tweet records ran too slow to make it > pretty much worthless I scaled down the project. 8-( > Still have some work to do in it. > > You can find the new project - http://wardjhtweets.tiddlyspot.com/ (2,800 > Tiddlers) > > Old project can be found - http://wardjhtrumptweets.tiddlyspot.com/ > <http://www.google.com/url?q=http%3A%2F%2Fwardjhtrumptweets.tiddlyspot.com%2F&sa=D&sntz=1&usg=AFQjCNGzmCrscVnX4X3bbS5VawLkXZVwjg> > > (85,000 Tiddlers) > Mark S. wrote ... > There's no indexing system in TW, and thus no scalability. Indexed > databases were able to handle hundreds of thousands of records even with > 1980s hardware. > > There's a way to send empty tiddlers via the server that only get > populated on demand. The problem then is that your search will only see the > titles and tags (fields ??) for searching. But if what you wanted was link > and tag based (without depending on text searches) then it should work OK. > You would need a separate (or enhanced) search box to fetch tiddlers from > the server directly. > > Or, maybe someone could write a system that would store an index to the > current TW's text context. Then a special search would look through the > index and use that for creating a list of links of tiddlers. The tiddlers > would become populated when clicked on. The index would be updated on > saving (harder) or on demand. -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at https://groups.google.com/group/tiddlywiki. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/bbca81d5-1f81-4f9f-8f06-0c55d2668812%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
