Re: Release issues?

2017-03-20 Thread Graham Percival
Proposed fix: https://codereview.appspot.com/316350043

In order to test it, I did upload website.make to the server and
build the website, and that version is still in use for the hourly
cronjob.  I figured that since the previous one wasn't doing
anything, there was no point waiting.

Cheers,
- Graham

On Tue, Mar 21, 2017 at 12:16:05AM +, Graham Percival wrote:
> Sorry, my bad.  For some reason it didn't twig with me that this
> would be release-blocking.  I'll upload a fix in 4-6 hours for
> discussion.
> 
> - Graham
> 
> On Mon, Mar 20, 2017 at 11:17:29AM +0100, Federico Bruni wrote:
> > I think that it's due to the "make website" problem described here:
> > http://lists.gnu.org/archive/html/bug-lilypond/2017-03/msg00034.html
> > 
> > 
> > 
> > Il giorno lun 20 mar 2017 alle 10:19, Urs Liska  ha
> > scritto:
> > >Hi,
> > >
> > >are there any issues with the releases? The version bump commit to
> > >2.19.57 is over a week old, but the website still claime 2.19.56.
> > >
> > >Urs
> > >
> > >
> > >--
> > >u...@openlilylib.org
> > >https://openlilylib.org
> > >http://lilypondblog.org
> > >
> > >
> > >___
> > >lilypond-devel mailing list
> > >lilypond-devel@gnu.org
> > >https://lists.gnu.org/mailman/listinfo/lilypond-devel
> > 
> > 
> > ___
> > lilypond-devel mailing list
> > lilypond-devel@gnu.org
> > https://lists.gnu.org/mailman/listinfo/lilypond-devel
> 
> ___
> lilypond-devel mailing list
> lilypond-devel@gnu.org
> https://lists.gnu.org/mailman/listinfo/lilypond-devel

___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Re: Degenerate file access patterns

2017-03-20 Thread Werner LEMBERG

>> "The culprit is that the lilypond binary has a bit sub-optimal file
>> access pattern (opening the same file thousands of times and
>> reading it byte by byte, causing a syscall flood - nearly 500K
>> lseek and read operations).  On a local machine, because of this
>> issue, it will spend about 1s in I/O syscalls, which is half of the
>> total execution time. This currently does not play nice with our
>> systems, getting it from 1s to over half a minute."

Interesting, I don't get this behaviour on my openSuSE GNU/Linux box.

> The font support is reading the same section of some font file over
> and over again.
>
> $ cat f.ly
> { c }
> $ strace -e trace=open,read lilypond f.ly  >& log ; grep OTTO log|wc
> 9925953   90234

On my box this is

  1   6  88

> $ grep OTTO log|head -10
> read(6, "OTTO\0\r\0\200\0\3\0PCFF
> \364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096
> read(6, "OTTO\0\r\0\200\0\3\0PCFF
> \364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096
> read(6, "OTTO\0\r\0\200\0\3\0PCFF
> \364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096
>
> the number of calls is apparently proportional to the number of glyphs
> in the file:
>
> $ cat f.ly
> \repeat unfold 100 { c }
>
> $ strace -e trace=open,read lilypond f.ly  >& log ; grep OTTO log|wc
> 40929  245575 3724501

For me, it is again

  1   6  88

> Werner may have better hunches than I which code is really
> responsible for this.

Maybe a problem with fontconfig?  Where is the location of
fontconfig's database of available fonts on your system?  This must be
created in advance so that lilypond can access it.  If it is missing,
fontconfig tries to build it (which makes e.g. the first invocation of
lilypond very slow on a Windows box since there is no global
fontconfig database).

Is it possible that fontconfig always fails so that it tries again and
again?


Werner

___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Re: Degenerate file access patterns

2017-03-20 Thread Han-Wen Nienhuys
On Thu, Mar 16, 2017 at 9:36 PM, Trevor  wrote:
> I'm trying to run LilyPond in Google Cloud Functions
> , and execution is ridiculously slow
> (like 40 seconds compilation vs. 2 seconds on my laptop). A Google Cloud
> engineer tested it and reported the following:
>
> "The culprit is that the lilypond binary has a bit sub-optimal file access
> pattern (opening the same file thousands of times and reading it byte by
> byte, causing a syscall flood - nearly 500K lseek and read operations). On
> a local machine, because of this issue, it will spend about 1s in I/O
> syscalls, which is half of the total execution time. This currently does
> not play nice with our systems, getting it from 1s to over half a minute."
>
> Anybody know why this behavior is exhibited? Is this something that might
> be within the power of a programmer new to LilyPond development to fix?

The font support is reading the same section of some font file over
and over again.

$ cat f.ly
{ c }
$ strace -e trace=open,read lilypond f.ly  >& log ; grep OTTO log|wc
9925953   90234
$ grep OTTO log|head -10
read(6, "OTTO\0\r\0\200\0\3\0PCFF
\364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096
read(6, "OTTO\0\r\0\200\0\3\0PCFF
\364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096
read(6, "OTTO\0\r\0\200\0\3\0PCFF
\364\24\241\262\0\0\t\334\0\0\373PFFTM"..., 4096) = 4096

the number of calls is apparently proportional to the number of glyphs
in the file:

$ cat f.ly
\repeat unfold 100 { c }

$ strace -e trace=open,read lilypond f.ly  >& log ; grep OTTO log|wc
40929  245575 3724501

Werner may have better hunches than I which code is really responsible for this.


-- 
Han-Wen Nienhuys - hanw...@gmail.com - http://www.xs4all.nl/~hanwen

___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Re: Release issues?

2017-03-20 Thread Graham Percival
Sorry, my bad.  For some reason it didn't twig with me that this
would be release-blocking.  I'll upload a fix in 4-6 hours for
discussion.

- Graham

On Mon, Mar 20, 2017 at 11:17:29AM +0100, Federico Bruni wrote:
> I think that it's due to the "make website" problem described here:
> http://lists.gnu.org/archive/html/bug-lilypond/2017-03/msg00034.html
> 
> 
> 
> Il giorno lun 20 mar 2017 alle 10:19, Urs Liska  ha
> scritto:
> >Hi,
> >
> >are there any issues with the releases? The version bump commit to
> >2.19.57 is over a week old, but the website still claime 2.19.56.
> >
> >Urs
> >
> >
> >--
> >u...@openlilylib.org
> >https://openlilylib.org
> >http://lilypondblog.org
> >
> >
> >___
> >lilypond-devel mailing list
> >lilypond-devel@gnu.org
> >https://lists.gnu.org/mailman/listinfo/lilypond-devel
> 
> 
> ___
> lilypond-devel mailing list
> lilypond-devel@gnu.org
> https://lists.gnu.org/mailman/listinfo/lilypond-devel

___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Compiling on Archlinux

2017-03-20 Thread Michael Käppler

Hi all,

I wrote a small article about compiling LilyPond on a recent Archlinux 
distribution.:


http://blog.michaelkaeppler.de/?p=35

Maybe this is of interest for contributors struggling with the 
guile1.8/2 issues and the sometimes slightly different naming of 
dependency packages.


Kind regards,

Michael


___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Re: Release issues?

2017-03-20 Thread Federico Bruni

I think that it's due to the "make website" problem described here:
http://lists.gnu.org/archive/html/bug-lilypond/2017-03/msg00034.html



Il giorno lun 20 mar 2017 alle 10:19, Urs Liska  ha 
scritto:

Hi,

are there any issues with the releases? The version bump commit to
2.19.57 is over a week old, but the website still claime 2.19.56.

Urs


--
u...@openlilylib.org
https://openlilylib.org
http://lilypondblog.org


___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel



___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Re: Fix regtest scheme-engraver.ly wrt to guile-2.2 (issue 322720043 by thomasmorle...@gmail.com)

2017-03-20 Thread dak

LGTM

https://codereview.appspot.com/322720043/

___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel


Release issues?

2017-03-20 Thread Urs Liska
Hi,

are there any issues with the releases? The version bump commit to
2.19.57 is over a week old, but the website still claime 2.19.56.

Urs


-- 
u...@openlilylib.org
https://openlilylib.org
http://lilypondblog.org


___
lilypond-devel mailing list
lilypond-devel@gnu.org
https://lists.gnu.org/mailman/listinfo/lilypond-devel