Re: LilyPond can't engrave 16 pages of music
Il giorno sab 22 dic 2018 alle 16:58, Thomas Morley
ha scritto:
Am Sa., 22. Dez. 2018 um 12:10 Uhr schrieb David Kastrup
:
Thomas Morley writes:
> Am Sa., 22. Dez. 2018 um 02:46 Uhr schrieb Ben
:
>> Did you experience the same wait times?
>
> It lasted ~40minutes (I didn't observed the time exactly)
>
> I think:
> most of the time is spend in calculating
spacing/line-/page-breaks.
Recently Werner committed a few fixes of typos with possibly ugly
consequences in the area of page breaking, so it might be worthwhile
crosschecking with current master.
I've redone testings with the OP's original code, i.e.
{
\time 4/4
\repeat unfold 1000 { c4 d e f } % TEN PAGES of music
\repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
\repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES,
fail NOW
}
Using 2.19.82 (from the installer) and 2.21.0 out of 915799cad7
musicexp.py: Use python 2.4 syntax.
Always restarting the computer after each test.
For 2.19.82 it's finished after 28m4,740s
For 2.21.0 after 24m50,214s
Memory-usage seems to be similar.
I didn't oberve a difference in the final pdfs
Well, for me current master (not installed but run from the out/
directory in the build dir) is slightly slower.
Intel Core processor i7-3537U
lilypond 2.19.82 (lilypond.org package)
real2m50,737s (first run)
real2m41,112s (second run)
2.6 GiB RAM used
lilypond 2.21.0 (self compiled)
real3m2,222s (first run)
real2m45,579s (second run)
2.6 GiB RAM used
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Running on CentOS (aka RHEL) 7.6:
%<
bash-4.2$ cat X.ly
\version "2.19.82"
{
\time 4/4
\repeat unfold 1000 { c4 d e f } % TEN PAGES of music
\repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
\repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
}
bash-4.2$ time lilypond X.ly
GNU LilyPond 2.19.80
Processing `X.ly'
Parsing...
error: program too old: 2.19.80 (file requires: 2.19.82)
Interpreting
music...[8][16][24][32][40][48][56][64][72][80][88][96][104][112][120][128][136][144][152][160][168][176][184][192]
...
[2896][2904][2912][2920][2928][2936][2944][2952][2960][2968][2976][2984][2992][3000]
Preprocessing graphical objects...
Finding the ideal number of pages...
Fitting music on 24 or 25 pages...
Drawing systems...
Layout output to `/tmp/lilypond-TOucyH'...
Converting to `X.pdf'...
Deleting `/tmp/lilypond-TOucyH'...
fatal error: failed files: "X.ly"
real2m10.159s
user2m7.242s
sys 0m1.472s
bash-4.2$ inxi
CPU: Dual Core Intel Core i3-4150 (-MT MCP-)
speed/min/max: 3500/800/3500 MHz Kernel: 3.10.0-957.1.3.el7.x86_64 x86_64
Up: 47m Mem: 1790.0/7691.8 MiB (23.3%) Storage: 3.64 TiB (3.5% used)
Procs: 267 Shell: bash 4.2.46 inxi: 3.0.26
---%<
Regardless of the "fatal error" message, 3,000 bars of music were
written over 25 pages. I suspect the message refers to the version
mismatch.
Peak memory usage according to Ganglia was 5.5GiB, no swap space consumed.
HTH,
--
J Martin Rushton MBCS
signature.asc
Description: OpenPGP digital signature
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Thomas Morley writes:
> Am Sa., 22. Dez. 2018 um 12:10 Uhr schrieb David Kastrup :
>>
>> Thomas Morley writes:
>>
>> > Am Sa., 22. Dez. 2018 um 02:46 Uhr schrieb Ben :
>> >> Did you experience the same wait times?
>> >
>> > It lasted ~40minutes (I didn't observed the time exactly)
>> >
>> > I think:
>> > most of the time is spend in calculating spacing/line-/page-breaks.
>>
>> Recently Werner committed a few fixes of typos with possibly ugly
>> consequences in the area of page breaking, so it might be worthwhile
>> crosschecking with current master.
>
> I've redone testings with the OP's original code, i.e.
>
> {
> \time 4/4
> \repeat unfold 1000 { c4 d e f } % TEN PAGES of music
> \repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
> \repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
> }
>
> Using 2.19.82 (from the installer) and 2.21.0 out of 915799cad7
> musicexp.py: Use python 2.4 syntax.
>
> Always restarting the computer after each test.
>
> For 2.19.82 it's finished after 28m4,740s
> For 2.21.0 after 24m50,214s
>
> Memory-usage seems to be similar.
> I didn't oberve a difference in the final pdfs
Well, good to know anyway.
--
David Kastrup
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Am Sa., 22. Dez. 2018 um 12:10 Uhr schrieb David Kastrup :
>
> Thomas Morley writes:
>
> > Am Sa., 22. Dez. 2018 um 02:46 Uhr schrieb Ben :
> >> Did you experience the same wait times?
> >
> > It lasted ~40minutes (I didn't observed the time exactly)
> >
> > I think:
> > most of the time is spend in calculating spacing/line-/page-breaks.
>
> Recently Werner committed a few fixes of typos with possibly ugly
> consequences in the area of page breaking, so it might be worthwhile
> crosschecking with current master.
I've redone testings with the OP's original code, i.e.
{
\time 4/4
\repeat unfold 1000 { c4 d e f } % TEN PAGES of music
\repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
\repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
}
Using 2.19.82 (from the installer) and 2.21.0 out of 915799cad7
musicexp.py: Use python 2.4 syntax.
Always restarting the computer after each test.
For 2.19.82 it's finished after 28m4,740s
For 2.21.0 after 24m50,214s
Memory-usage seems to be similar.
I didn't oberve a difference in the final pdfs
Cheers,
Harm
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
On 22-12-2018 12:43, Werner LEMBERG wrote: Recently Werner committed a few fixes of typos with possibly ugly consequences in the area of page breaking, so it might be worthwhile crosschecking with current master. Yeah, it would be great if we eventually get testcases for those typos! Werner It crashes on the windows-version of Lilypond I compiled from master in August (it does so after a few seconds). It still crashes on the windows-version I compiled from master three days ago (again within a few seconds). The error message is the same in both cases: Preprocessing graphical objects...terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Exited with return code 3 My desktop runs WIndows 10. On the same machine I have a VM with Linux Mint 18.2, 64-bit (which is what I use to run GUB and compile a windows-version of Lilypond). In the VM the file compiles in 1'15'' (with the lilypond compiled in August). Auke ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Adding more data: works fine on Debian 9 in Virtualbox 5.22 running under Windows 10. 4'25". Compiles fine. Intel Core i7-6700 CPU @ 3.40 GHz. Andrew ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
> Recently Werner committed a few fixes of typos with possibly ugly > consequences in the area of page breaking, so it might be worthwhile > crosschecking with current master. Yeah, it would be great if we eventually get testcases for those typos! Werner ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Thomas Morley writes: > Am Sa., 22. Dez. 2018 um 02:46 Uhr schrieb Ben : > >> What are your system specs? I can compile the file on my Linux Mint >> x64 laptop with 16GB of RAM, rockin' an 8th gen i7 but it took about >> 10 minutes almost. That seems very very slow. > > Well, I have a weak laptop. In the past I had some fast and powerfull > laptops. All died after far too short time, with broken motherboard. I > was told it makes no sense to repair. > So I was very upset and decided not to buy such an expensive machine > again. I now have one which was offered as a machine for starters. LOL > The lifetime of this laptop already beats the ones from all previous > powerful machines together. > > That said, I've two processors behaving like four > Intel(R) Pentium(R) CPU N3510 @ 1.99GHz > and > 4 GB RAM > > Using LilyPond-2.19.82 on Ubuntu 18.04 64-bit > >> Did you experience the same wait times? > > It lasted ~40minutes (I didn't observed the time exactly) > > I think: > most of the time is spend in calculating spacing/line-/page-breaks. Recently Werner committed a few fixes of typos with possibly ugly consequences in the area of page breaking, so it might be worthwhile crosschecking with current master. -- David Kastrup ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Am Sa., 22. Dez. 2018 um 02:46 Uhr schrieb Ben :
> What are your system specs? I can compile the file on my Linux Mint x64
> laptop with 16GB of RAM, rockin' an 8th gen i7 but it took about 10 minutes
> almost. That seems very very slow.
Well, I have a weak laptop. In the past I had some fast and powerfull
laptops. All died after far too short time, with broken motherboard. I
was told it makes no sense to repair.
So I was very upset and decided not to buy such an expensive machine
again. I now have one which was offered as a machine for starters. LOL
The lifetime of this laptop already beats the ones from all previous
powerful machines together.
That said, I've two processors behaving like four
Intel(R) Pentium(R) CPU N3510 @ 1.99GHz
and
4 GB RAM
Using LilyPond-2.19.82 on Ubuntu 18.04 64-bit
> Did you experience the same wait times?
It lasted ~40minutes (I didn't observed the time exactly)
I think:
most of the time is spend in calculating spacing/line-/page-breaks.
The OP's examples contains most simple 4th and whole notes, nothing
else. So LilyPond has no hints and only a few limitations while
calculating spacing/line-/page-breaks.
Afaict, the only limitation is: no (page)break mid-measure.
But in real life scores there are usually a lot of limitations,
because bars contain more notes (making it impossible to put too many
of them in one line) or all sorts of spanners (Beams, Hairpins, etc),
all influence the penalties for line/page-breaks.
In the current example close to all is equal. So LilyPond calculates
the best option and calculates and calculates and ...
So our very powerful engine draws circles.
To verify my guess, I excluded automatic breaks and did them all
manually (breaks are not really optimal, now 26 pages with a lonely
system on last page is retunred. It makes no sense to do the needed
fine tuning for such an example)
\layout {
\autoBreaksOff
}
\new Staff
<<
{
\time 4/4
\repeat unfold 1000 { c4 d e f } % TEN PAGES of music
\repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
\repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
}
{
\repeat unfold 25
{ \repeat unfold 12 { \repeat unfold 8 { s1 } \break } \pageBreak }
}
>>
Finished in 1m15,290s
With very little memory usage.
Cheers,
Harm
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
> On 21 Dec 2018, at 23:47, Reggie wrote:
>
> \version "2.19.82"
> {
> \time 4/4
> \repeat unfold 1000 { c4 d e f } % TEN PAGES of music
> \repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
> \repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
> }
Starting lilypond 2.18.2 [Untitled]...
Processing
`/var/folders/7z/6v5y7dgj181bb5j44lt_6d2wgn/T/frescobaldi-9fyh03j4/tmptvcd5c1g/document.ly'
Parsing...
Interpreting
music...[8][16][24][32][40][48][56][64][72][80][88][96][104][112][120][128][136][144][152][160][168][176][184][192][200][208][216][224][232][240][248][256][264][272][280][288][296][304][312][320][328][336][344][352][360][368][376][384][392][400][408][416][424][432][440][448][456][464][472][480][488][496][504][512][520][528][536][544][552][560][568][576][584][592][600][608][616][624][632][640][648][656][664][672][680][688][696][704][712][720][728][736][744][752][760][768][776][784][792][800][808][816][824][832][840][848][856][864][872][880][888][896][904][912][920][928][936][944][952][960][968][976][984][992][1000][1008][1016][1024][1032][1040][1048][1056][1064][1072][1080][1088][1096][1104][1112][1120][1128][1136][1144][1152][1160][1168][1176][1184][1192][1200][1208][1216][1224][1232][1240][1248][1256][1264][1272][1280][1288][1296][1304][1312][1320][1328][1336][1344][1352][1360][1368][1376][1384][1392][1400][1408][1416][1424][1432][1440][1448][1456][1464][1472][1480][1488][1496][1504][1512][1520][1528][1536][1544][1552][1560][1568][1576][1584][1592][1600][1608][1616][1624][1632][1640][1648][1656][1664][1672][1680][1688][1696][1704][1712][1720][1728][1736][1744][1752][1760][1768][1776][1784][1792][1800][1808][1816][1824][1832][1840][1848][1856][1864][1872][1880][1888][1896][1904][1912][1920][1928][1936][1944][1952][1960][1968][1976][1984][1992][2000][2008][2016][2024][2032][2040][2048][2056][2064][2072][2080][2088][2096][2104][2112][2120][2128][2136][2144][2152][2160][2168][2176][2184][2192][2200][2208][2216][2224][2232][2240][2248][2256][2264][2272][2280][2288][2296][2304][2312][2320][2328][2336][2344][2352][2360][2368][2376][2384][2392][2400][2408][2416][2424][2432][2440][2448][2456][2464][2472][2480][2488][2496][2504][2512][2520][2528][2536][2544][2552][2560][2568][2576][2584][2592][2600][2608][2616][2624][2632][2640][2648][2656][2664][2672][2680][2688][2696][2704][2712][2720][2728][2736][2744][2752][2760][2768][2776][2784][2792][2800][2808][2816][2824][2832][2840][2848][2856][2864][2872][2880][2888][2896][2904][2912][2920][2928][2936][2944][2952][2960][2968][2976][2984][2992][3000]
Preprocessing graphical objects...lilypond(18145,0xa986a1c0) malloc: ***
mach_vm_map(size=1873248256) failed (error code=3)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
libc++abi.dylib: terminating with uncaught exception of type std::bad_alloc:
std::bad_alloc
Exited with exit status 1.
As run via Frescobaldi on my iMac:
Hardware Overview:
Model Name: iMac
Model Identifier: iMac13,2
Processor Name: Intel Core i5
Processor Speed: 2.9 GHz
Number of Processors: 1
Total Number of Cores:4
L2 Cache (per Core): 256 KB
L3 Cache: 6 MB
Memory: 8 GB
Boot ROM Version: 281.0.0.0.0
SMC Version (system): 2.11f14
Serial Number (system): C02K14M3DNCV
Hardware UUID:35691FE9-0B28-5AFF-ABC3-97B5CBAA44CE
Michael
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
SoundsFromSound wrote > What are your system specs? I can compile the file on my Linux Mint x64 > laptop with 16GB of RAM, rockin' an 8th gen i7 but it took about 10 > minutes almost. That seems very very slow. > > Did you experience the same wait times? Not Harm obviously but here's my data: CPU: i5-5200u (2-core, 4-thread mobile processor) Ram: 8gb Ubuntu 18.10 64-bit LilyPond 2.19.80 Page count: 25 LP-reported compile time: 3'57" Second run: 3'13" -- Sent from: http://lilypond.1069038.n5.nabble.com/User-f3.html ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
On 12/21/2018 7:46 PM, Thomas Morley wrote:
Am Sa., 22. Dez. 2018 um 00:48 Uhr schrieb Reggie :
I am trying to understand theoretically why this is failing. It's only 16
pages. I am a minimalist composer so as a test I tried this extreme
situation. But yet I don't quite agree rather that it's that extreme. It's
only 16 pages and LilyPond crashes.
\version "2.19.82"
{
\time 4/4
\repeat unfold 1000 { c4 d e f } % TEN PAGES of music
\repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
\repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
}
wHY?
Preprocessing graphical objects...terminate called after throwing an
instance of 'std::bad_alloc'
what(): std::bad_alloc
Exited with return code 6.
Works here, returning a 25-pages pdf.
I'm on Ubuntu-18.04 64-bit
Cheers,
Harm
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Harm,
What are your system specs? I can compile the file on my Linux Mint x64
laptop with 16GB of RAM, rockin' an 8th gen i7 but it took about 10
minutes almost. That seems very very slow.
Did you experience the same wait times?
On Windows 10 x64 it flat out crashed, with a different error code
number but the same family of crash I believe...
Preprocessing graphical objects...terminate called after throwing an
instance of 'std::bad_alloc'
what(): std::bad_alloc
Exited with return code 3.
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
On 2018-12-21 4:53 pm, Aaron Hill wrote:
I tried the following approach to break up the piece into three scores:
\score {
{ \time 4/4 \repeat unfold 1000 { c4 d e f } }
}
\score {
{ \set Score.currentBarNumber = #1001 \bar ""
\time 4/4 \repeat unfold 1000 { f1 } }
\layout { indent = 0 }
}
\score {
{ \set Score.currentBarNumber = #2001 \bar ""
\time 4/4 \repeat unfold 1000 { c4 d e f } }
\layout { indent = 0 }
}
This only took 42 seconds to complete and I believe it peaked under
2GiB.
I reran my multi-score version using time -v:
Command being timed: "lilypond allocbug.ly"
User time (seconds): 32.29
System time (seconds): 9.48
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:42.05
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 1978288
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 1003509
Voluntary context switches: 0
Involuntary context switches: 0
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Providing this is accurate, I suspect this approach may still be too
much for a 32-bit process, given the overhead of the program executable,
DLLs and the like.
-- Aaron Hill
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Am Sa., 22. Dez. 2018 um 00:48 Uhr schrieb Reggie :
>
> I am trying to understand theoretically why this is failing. It's only 16
> pages. I am a minimalist composer so as a test I tried this extreme
> situation. But yet I don't quite agree rather that it's that extreme. It's
> only 16 pages and LilyPond crashes.
>
> \version "2.19.82"
> {
> \time 4/4
> \repeat unfold 1000 { c4 d e f } % TEN PAGES of music
> \repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
> \repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
> }
>
> wHY?
>
> Preprocessing graphical objects...terminate called after throwing an
> instance of 'std::bad_alloc'
> what(): std::bad_alloc
> Exited with return code 6.
Works here, returning a 25-pages pdf.
I'm on Ubuntu-18.04 64-bit
Cheers,
Harm
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Hi Reggie,
What OS are you on?
Andrew
On Sat, 22 Dec 2018 at 10:48, Reggie wrote:
> I am trying to understand theoretically why this is failing. It's only 16
> pages. I am a minimalist composer so as a test I tried this extreme
> situation. But yet I don't quite agree rather that it's that extreme. It's
> only 16 pages and LilyPond crashes.
>
> \version "2.19.82"
> {
> \time 4/4
> \repeat unfold 1000 { c4 d e f } % TEN PAGES of music
> \repeat unfold 1000 { f1 } % + SIX MORE PAGES of music
> \repeat unfold 1000 { c4 d e f } % BUT WHEN ADDING MORE PAGES, fail NOW
> }
>
> wHY?
>
> Preprocessing graphical objects...terminate called after throwing an
> instance of 'std::bad_alloc'
> what(): std::bad_alloc
> Exited with return code 6.
>
>
>
> --
> Sent from: http://lilypond.1069038.n5.nabble.com/User-f3.html
>
> ___
> lilypond-user mailing list
> lilypond-user@gnu.org
> https://lists.gnu.org/mailman/listinfo/lilypond-user
>
___
lilypond-user mailing list
lilypond-user@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
On 12/21/2018 5:56 PM, Kieren MacMillan wrote: It's only 16 pages and LilyPond crashes. That looks like a [serious] bug to me. I’ve cc'ed the bug list. Reproduced crash on LilyPond 2.19.80, Windows 7 Pro 64-bit SP1, Intel Core i5-3450, 24GB RAM. At crash, lilypond-windows.exe in Task Manager as showing 1,080,744K of Memory (Private Working Set.) Perhaps this problem is similar to other large-memory-use crashes reported lately on Windows? -- Karlin High Missouri, USA ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
Re: LilyPond can't engrave 16 pages of music
Hi Reggie, > I am trying to understand theoretically why this is failing. It's only 16 > pages. I am a minimalist composer so as a test I tried this extreme > situation. But yet I don't quite agree rather that it's that extreme. It's > only 16 pages and LilyPond crashes. That looks like a [serious] bug to me. I’ve cc'ed the bug list. Thanks! Kieren. Kieren MacMillan, composer ‣ website: www.kierenmacmillan.info ‣ email: i...@kierenmacmillan.info ___ lilypond-user mailing list lilypond-user@gnu.org https://lists.gnu.org/mailman/listinfo/lilypond-user
