[NTG-context] Re: Memory consumption in new upload

2024-02-17 Thread Hans Hagen 

On 2/17/2024 10:50 PM, Shiv Shankar Dayal wrote:
I assume you would have created typescripts for those fonts. Can you 
please add them to

ConTeXt distribution, at least for the popular fonts?


Many of those are covered by typescripts. Those that are not, are on my 
machine because we needed them (often long ago) for a project (these are 
commercial fonts, in most cases typeone and of such a collection 
actually a few were used then). There are also some commercial fonts 
that I got for free. Then there are fonts that I have to check because 
users had an issue (public ones, of different quality and useability). 
Of those 'trying to cover all of unicode with  different fonts of the 
same design' I tested subsets. And of course the fonts that come with 
the operating system (basically all fonts that context can access during 
a run).


We're not going to make typescripts for every combination as in practice 
for most documents one needs a single setup and therefore only a handful 
of lines of code (and likely use some typescript file for a math font). 
There's also the selectfont mechanism that uses heuristics to do the 
same. There are plenty of examples in the distribution and for a 
specific style that demands certain fonts one can also put the 
definitions in the style.


On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal 
mailto:shivshankar.da...@gmail.com>> wrote:


The only change I made was that I started using a 9pt modern font
than a 10 pt modern font.

My document decreased from 580+ pages to 500 pages after that.

About your document, I assume you had a lot of Graphics because text
only 180MB is too high.
I have only few diagrams and my file size is only 3MB.

On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen mailto:j.ha...@xs4all.nl>> wrote:

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
 > Thanks for new upload. I see that memory consumption is much
less than
 > previous version. So
 > once again, thanks a lot.
 >
 > I am curious about what has changed in recent upload, that
memory
 > consumption is about 60% of earlier versions.
it's hard to tell what exact consumpiton is becaue for instance
when lua
creates tables, they grow by factors two when then have to
(maybe 5.5 is
a bit less consuming)

on the one hand luametatex is more efficient than luatex due to
all kind
of ímprovements' but some nodes are larger so that takes more
memory,
which is only noticed when one has lots of text on a page (or keeps
boxes stuff around)

anyway, not that much changed since the previous upload, so
maybe you
just stay below a threshold

I recently generated a 180MB document with 2500 fonts + metapost
outlines of them and that could bump mem usage (with empty
cache) to 30
GB (less after fonts were cached) but normally we stay around
125 MB for
a document. Anyway, tex mem consumption can often be neglected
compared
to other applications.

Hans


-
                                            Hans Hagen | PRAGMA ADE
                Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
         tel: 038 477 53 69 | www.pragma-ade.nl
 | www.pragma-pod.nl

-


___
If your question is of interest to others as well, please add an
entry to the Wiki!

maillist : ntg-context@ntg.nl  /
https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl

webpage  : https://www.pragma-ade.nl 
/ https://context.aanhet.net  (mirror)
archive  : https://github.com/contextgarden/context

wiki     : https://wiki.contextgarden.net


___



-- 
Respect,

Shiv Shankar Dayal



--
Respect,
Shiv Shankar Dayal

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / 
https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki : https://wiki.contextgarden.net

[NTG-context] Re: Memory consumption in new upload

2024-02-17 Thread Shiv Shankar Dayal 
I assume you would have created typescripts for those fonts. Can you please
add them to
ConTeXt distribution, at least for the popular fonts?

On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal <
shivshankar.da...@gmail.com> wrote:

> The only change I made was that I started using a 9pt modern font than a
> 10 pt modern font.
>
> My document decreased from 580+ pages to 500 pages after that.
>
> About your document, I assume you had a lot of Graphics because text only
> 180MB is too high.
> I have only few diagrams and my file size is only 3MB.
>
> On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen  wrote:
>
>> On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
>> > Thanks for new upload. I see that memory consumption is much less than
>> > previous version. So
>> > once again, thanks a lot.
>> >
>> > I am curious about what has changed in recent upload, that memory
>> > consumption is about 60% of earlier versions.
>> it's hard to tell what exact consumpiton is becaue for instance when lua
>> creates tables, they grow by factors two when then have to (maybe 5.5 is
>> a bit less consuming)
>>
>> on the one hand luametatex is more efficient than luatex due to all kind
>> of ímprovements' but some nodes are larger so that takes more memory,
>> which is only noticed when one has lots of text on a page (or keeps
>> boxes stuff around)
>>
>> anyway, not that much changed since the previous upload, so maybe you
>> just stay below a threshold
>>
>> I recently generated a 180MB document with 2500 fonts + metapost
>> outlines of them and that could bump mem usage (with empty cache) to 30
>> GB (less after fonts were cached) but normally we stay around 125 MB for
>> a document. Anyway, tex mem consumption can often be neglected compared
>> to other applications.
>>
>> Hans
>>
>>
>> -
>>Hans Hagen | PRAGMA ADE
>>Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>> tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
>> -
>>
>>
>> ___
>> If your question is of interest to others as well, please add an entry to
>> the Wiki!
>>
>> maillist : ntg-context@ntg.nl /
>> https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
>> webpage  : https://www.pragma-ade.nl / https://context.aanhet.net
>> (mirror)
>> archive  : https://github.com/contextgarden/context
>> wiki : https://wiki.contextgarden.net
>>
>> ___
>>
>
>
> --
> Respect,
> Shiv Shankar Dayal
>


-- 
Respect,
Shiv Shankar Dayal
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / 
https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki : https://wiki.contextgarden.net
___

[NTG-context] Re: Memory consumption in new upload

2024-02-17 Thread Shiv Shankar Dayal 
The only change I made was that I started using a 9pt modern font than a 10
pt modern font.

My document decreased from 580+ pages to 500 pages after that.

About your document, I assume you had a lot of Graphics because text only
180MB is too high.
I have only few diagrams and my file size is only 3MB.

On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen  wrote:

> On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
> > Thanks for new upload. I see that memory consumption is much less than
> > previous version. So
> > once again, thanks a lot.
> >
> > I am curious about what has changed in recent upload, that memory
> > consumption is about 60% of earlier versions.
> it's hard to tell what exact consumpiton is becaue for instance when lua
> creates tables, they grow by factors two when then have to (maybe 5.5 is
> a bit less consuming)
>
> on the one hand luametatex is more efficient than luatex due to all kind
> of ímprovements' but some nodes are larger so that takes more memory,
> which is only noticed when one has lots of text on a page (or keeps
> boxes stuff around)
>
> anyway, not that much changed since the previous upload, so maybe you
> just stay below a threshold
>
> I recently generated a 180MB document with 2500 fonts + metapost
> outlines of them and that could bump mem usage (with empty cache) to 30
> GB (less after fonts were cached) but normally we stay around 125 MB for
> a document. Anyway, tex mem consumption can often be neglected compared
> to other applications.
>
> Hans
>
>
> -
>Hans Hagen | PRAGMA ADE
>Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
> tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -
>
>
> ___
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
> webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
> archive  : https://github.com/contextgarden/context
> wiki : https://wiki.contextgarden.net
>
> ___
>


-- 
Respect,
Shiv Shankar Dayal
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / 
https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki : https://wiki.contextgarden.net
___

[NTG-context] Re: Memory consumption in new upload

2024-02-17 Thread Hans Hagen 

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
Thanks for new upload. I see that memory consumption is much less than 
previous version. So

once again, thanks a lot.

I am curious about what has changed in recent upload, that memory 
consumption is about 60% of earlier versions.
it's hard to tell what exact consumpiton is becaue for instance when lua 
creates tables, they grow by factors two when then have to (maybe 5.5 is 
a bit less consuming)


on the one hand luametatex is more efficient than luatex due to all kind 
of ímprovements' but some nodes are larger so that takes more memory, 
which is only noticed when one has lots of text on a page (or keeps 
boxes stuff around)


anyway, not that much changed since the previous upload, so maybe you 
just stay below a threshold


I recently generated a 180MB document with 2500 fonts + metapost 
outlines of them and that could bump mem usage (with empty cache) to 30 
GB (less after fonts were cached) but normally we stay around 125 MB for 
a document. Anyway, tex mem consumption can often be neglected compared 
to other applications.


Hans


-
  Hans Hagen | PRAGMA ADE
  Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
   tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / 
https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki : https://wiki.contextgarden.net
___