maybe there is a problem with the logging...

you can turn off the logs from the syncer in startup.js

$tw.syncer = new $tw.Syncer({wiki: $tw.wiki, syncadaptor: $tw.syncadaptor, 
logging : false});


On Monday, June 3, 2019 at 3:13:04 PM UTC+2, solex wrote:
>
> Hi Jeremy,
>
> It didn't occur to me to tweak the Node's memory usage, because I didn't 
> think it was the cause of the problem, and I still doubt that processing 
> 2000 one-line tiddlers consumes all of the default 1GB memory - something 
> else must be the problem. But I'll try to experiment with the parameters to 
> see if that at least increases the number.
> I did try to close most of the other apps/processes on my machine just in 
> case, to no avail.
>
> My test wiki doesn't use any recursive templates - or anything besides the 
> built-in functionality - because I created a fresh server wiki just to 
> investigate the problem. All I am doing is generating 2000 simple tiddlers 
> with an external script (I described a sequence of steps in my original 
> post).
>
> Yes, the same error occurs when I am trying to build a static version with:
> tiddlywiki tw-benchmark --build index
>
> -
> Thanks,
> solex
>
>
> On Mon, Jun 3, 2019 at 3:39 PM Jeremy Ruston <[email protected] 
> <javascript:>> wrote:
>
>> Hi Solex
>>
>> I run many wikis with over 2,000 tiddlers, so I think there maybe 
>> something else going on here.
>>
>> Firstly, Node.js is by default conservative about memory usage, using 
>> only a maximum of 512MB of 32-bit systems and 1GB on 64-bit systems. You 
>> can manually specify the total amount of memory in MB to be used with the 
>> "max-old-space-size" flag. For example:
>>
>> node --max-old-space-size=16384 <path-to-tiddlywiki.js> <tiddlywiki 
>> arguments>
>>
>> Secondly, the easiest way to cause out-of-memory errors is to try to 
>> render a template that includes recursive elements. Are you using a custom 
>> raw markup tiddlers? Do you get the same error if you try to build the wiki 
>> as a single file? 
>>
>> Best wishes
>>
>> Jeremy
>>
>>
>>
>> On Monday, June 3, 2019 at 1:04:51 PM UTC+1, solex wrote:
>>>
>>> Hi mario,
>>>
>>> My tiddlers only have title as an attribute, and the corresponding file 
>>> name.
>>> e.g.
>>>
>>> tiddlers/test-tiddler-1.tid
>>>
>>> title: test-tiddler-1
>>>
>>> Initially they had other fields as well (including content-type), but I 
>>> reduced them to a minimum while investigating, and the particular set of 
>>> fields didn't seem to make any difference. 
>>> Also, when the total number is lower (e.g. <1500), the wiki is 
>>> functioning as expected, so I'm sure the problem is not in the tiddler 
>>> generation.
>>> The browser doesn't matter too (as expected).
>>>
>>> Apparently the only difference is environment (Node version + OS), so 
>>> perhaps I will try later on a different machine.
>>>
>>> Thanks,
>>> solex
>>>
>>>
>>>
>>> On Monday, June 3, 2019 at 1:03:41 PM UTC+3, PMario wrote:
>>>>
>>>> Hi solex, 
>>>>
>>>> I did create 10'000 tiddlers. They all look similar to this one and are 
>>>> about 800 bytes in size. 
>>>>
>>>> created: 20190603094535523
>>>> modified: 20190603094535523
>>>> tags: t-0
>>>> title: a-0-0
>>>> type: text/vnd.tiddlywiki
>>>>
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 123456789 123456789 123456789 123456789 
>>>> 123456789 123456789 123456789 
>>>>
>>>>
>>>> There is no problem for me. 
>>>>  - I use node v10.16.0 LTS. 
>>>>  - FF latest 
>>>>  - TW 5.1.19
>>>>  - win 10
>>>>
>>>> The tw server side needs about 20 seconds to start. 
>>>> It transferes about 12MByte to the browser, which needs about 4 
>>>> seconds. 
>>>>
>>>> So how do you create your files?
>>>>
>>>> -mario
>>>>
>>>>
>>>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "TiddlyWiki" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to [email protected] <javascript:>.
>> To post to this group, send email to [email protected] 
>> <javascript:>.
>> Visit this group at https://groups.google.com/group/tiddlywiki.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/tiddlywiki/cdbfa07c-80bd-4ed9-b378-242ab9180f02%40googlegroups.com
>>  
>> <https://groups.google.com/d/msgid/tiddlywiki/cdbfa07c-80bd-4ed9-b378-242ab9180f02%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/tiddlywiki.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/tiddlywiki/b642861b-85a8-445b-89d9-72fd480854f8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to