Re: lyx errors with lualatex and non-tex fonts

[Scott Kostyshak]

> > export/export/latex/languagenesting2_pdf5_systemF (Failed)

This one is being discussed in a separate thread. I think the plan is to
invert and possibly (we have no volunteer) report a bug

> > UNRELIABLE.WRONG_OUTPUT_export/examples/es/linguistics_pdf4_texF (Failed)

I just started a new thread for this one. I think the inversion status
was changed at d319976, but I think there is a bug that causes the
failure that hopefully we can fix.

Scott


signature.asc
Description: PGP signature

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 28. Februar 2017 um 13:13:28, schrieb Scott Kostyshak 

> On Tue, Feb 28, 2017 at 11:06:06AM +0100, Kornel Benko wrote:
> 
> > Failed 20, out of 3973. Tested '-L export -E "xhtml|lyx16|lyx21|lyx22"'
> > 317 - export/export/latex/languagenesting2_pdf5_systemF (Failed)
> > 2450 - export/doc/he/Intro_dvi (Failed)
> > 2453 - export/doc/he/Intro_pdf (Failed)
> > 2454 - export/doc/he/Intro_pdf2 (Failed)
> > 2455 - export/doc/he/Intro_pdf3 (Failed)
> > 2466 - export/doc/he/Tutorial_dvi (Failed)
> > 2469 - export/doc/he/Tutorial_pdf (Failed)
> > 2470 - export/doc/he/Tutorial_pdf2 (Failed)
> > 2471 - export/doc/he/Tutorial_pdf3 (Failed)
> > 5049 - export/examples/he/example_lyxified_dvi (Failed)
> > 5052 - export/examples/he/example_lyxified_pdf (Failed)
> > 5053 - export/examples/he/example_lyxified_pdf2 (Failed)
> > 5054 - export/examples/he/example_lyxified_pdf3 (Failed)
> > 5065 - export/examples/he/example_raw_dvi (Failed)
> > 5068 - export/examples/he/example_raw_pdf (Failed)
> > 5069 - export/examples/he/example_raw_pdf2 (Failed)
> > 5070 - export/examples/he/example_raw_pdf3 (Failed)
> > 5084 - export/examples/he/splash_pdf (Failed)
> > 5085 - export/examples/he/splash_pdf2 (Failed)
> > 5086 - export/examples/he/splash_pdf3 (Failed)
> > 
> > Not one was unreliable. Here modernCV now compiles. Font awesome is from 
> > TL2016.
> > (It was my error using awesome installed from the ubuntu packages)
> 
> I get the following on a1faa41c:
> 
> 2 tests failed out of 6418:
> 
> export/export/latex/languagenesting2_pdf5_systemF (Failed)
> UNRELIABLE.WRONG_OUTPUT_export/examples/es/linguistics_pdf4_texF (Failed)

Confirmed with actual TL2016 and actual lyx.

> Scott

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Scott Kostyshak]

On Tue, Feb 28, 2017 at 11:06:06AM +0100, Kornel Benko wrote:

> Failed 20, out of 3973. Tested '-L export -E "xhtml|lyx16|lyx21|lyx22"'
>   317 - export/export/latex/languagenesting2_pdf5_systemF (Failed)
>   2450 - export/doc/he/Intro_dvi (Failed)
>   2453 - export/doc/he/Intro_pdf (Failed)
>   2454 - export/doc/he/Intro_pdf2 (Failed)
>   2455 - export/doc/he/Intro_pdf3 (Failed)
>   2466 - export/doc/he/Tutorial_dvi (Failed)
>   2469 - export/doc/he/Tutorial_pdf (Failed)
>   2470 - export/doc/he/Tutorial_pdf2 (Failed)
>   2471 - export/doc/he/Tutorial_pdf3 (Failed)
>   5049 - export/examples/he/example_lyxified_dvi (Failed)
>   5052 - export/examples/he/example_lyxified_pdf (Failed)
>   5053 - export/examples/he/example_lyxified_pdf2 (Failed)
>   5054 - export/examples/he/example_lyxified_pdf3 (Failed)
>   5065 - export/examples/he/example_raw_dvi (Failed)
>   5068 - export/examples/he/example_raw_pdf (Failed)
>   5069 - export/examples/he/example_raw_pdf2 (Failed)
>   5070 - export/examples/he/example_raw_pdf3 (Failed)
>   5084 - export/examples/he/splash_pdf (Failed)
>   5085 - export/examples/he/splash_pdf2 (Failed)
>   5086 - export/examples/he/splash_pdf3 (Failed)
> 
> Not one was unreliable. Here modernCV now compiles. Font awesome is from 
> TL2016.
> (It was my error using awesome installed from the ubuntu packages)

I get the following on a1faa41c:

2 tests failed out of 6418:

export/export/latex/languagenesting2_pdf5_systemF (Failed)
UNRELIABLE.WRONG_OUTPUT_export/examples/es/linguistics_pdf4_texF (Failed)

Scott


signature.asc
Description: PGP signature

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 28. Februar 2017 um 08:11:58, schrieb Guenter Milde 

> On 2017-02-15, Kornel Benko wrote:
> 
> > [-- Type: text/plain, Encoding: quoted-printable --]
> 
> > Am Mittwoch, 15. Februar 2017 um 08:37:46, schrieb Jürgen Spitzmüller 
> > 
> >> Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:
> >> > Apart from this there are still 72 messages with
> >> > ! LaTeX Error: Command \textquotedbl unavailable in encoding
> >> > TU.
> >> > in
> >> > export/examples/modernCV_dvi3_texF
> >> > export/examples/es/modernCV_pdf4_texF
> >> > export/examples/es/modernCV_pdf5_texF
> 
> >> Should be fixed now.
> 
> > It is.
> 
> >> Jürgen
> 
> > Still failing for instance export/examples/modernCV_pdf4_texF
> > Missing character: There is no  in font FontAwesome/OT!
> 
> > Now only 5 failed tests remain.
> 
> They pass here with the newest texlive in Debian/testing providing
> 
>  \ProvidesClass{moderncv}[2015/07/28 v2.0.0 modern curriculum vitae and 
> letter document class]
> 
> It seems a new version added another new "awesome" character and your
> awsome font is not as up to date as the document class.
> (We had this already one time with the last update and the "mobile" icon.)
> 
> I recommend adding modernCV to the unreliable:varying-versions tests -- it
> seems to have a quite strict version dependency on the awesome fonts.
> 
> How many *reliable* failing test remain?
> 
> Günter

Failed 20, out of 3973. Tested '-L export -E "xhtml|lyx16|lyx21|lyx22"'
317 - export/export/latex/languagenesting2_pdf5_systemF (Failed)
2450 - export/doc/he/Intro_dvi (Failed)
2453 - export/doc/he/Intro_pdf (Failed)
2454 - export/doc/he/Intro_pdf2 (Failed)
2455 - export/doc/he/Intro_pdf3 (Failed)
2466 - export/doc/he/Tutorial_dvi (Failed)
2469 - export/doc/he/Tutorial_pdf (Failed)
2470 - export/doc/he/Tutorial_pdf2 (Failed)
2471 - export/doc/he/Tutorial_pdf3 (Failed)
5049 - export/examples/he/example_lyxified_dvi (Failed)
5052 - export/examples/he/example_lyxified_pdf (Failed)
5053 - export/examples/he/example_lyxified_pdf2 (Failed)
5054 - export/examples/he/example_lyxified_pdf3 (Failed)
5065 - export/examples/he/example_raw_dvi (Failed)
5068 - export/examples/he/example_raw_pdf (Failed)
5069 - export/examples/he/example_raw_pdf2 (Failed)
5070 - export/examples/he/example_raw_pdf3 (Failed)
5084 - export/examples/he/splash_pdf (Failed)
5085 - export/examples/he/splash_pdf2 (Failed)
5086 - export/examples/he/splash_pdf3 (Failed)

Not one was unreliable. Here modernCV now compiles. Font awesome is from TL2016.
(It was my error using awesome installed from the ubuntu packages)

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-15, Kornel Benko wrote:

> [-- Type: text/plain, Encoding: quoted-printable --]

> Am Mittwoch, 15. Februar 2017 um 08:37:46, schrieb Jürgen Spitzmüller 
> 
>> Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:
>> > Apart from this there are still 72 messages with
>> > ! LaTeX Error: Command \textquotedbl unavailable in encoding
>> > TU.
>> > in
>> > export/examples/modernCV_dvi3_texF
>> > export/examples/es/modernCV_pdf4_texF
>> > export/examples/es/modernCV_pdf5_texF

>> Should be fixed now.

> It is.

>> Jürgen

> Still failing for instance export/examples/modernCV_pdf4_texF
>   Missing character: There is no  in font FontAwesome/OT!

> Now only 5 failed tests remain.

They pass here with the newest texlive in Debian/testing providing

 \ProvidesClass{moderncv}[2015/07/28 v2.0.0 modern curriculum vitae and letter 
document class]

It seems a new version added another new "awesome" character and your
awsome font is not as up to date as the document class.
(We had this already one time with the last update and the "mobile" icon.)

I recommend adding modernCV to the unreliable:varying-versions tests -- it
seems to have a quite strict version dependency on the awesome fonts.

How many *reliable* failing test remain?

Günter

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-26, Jürgen Spitzmüller wrote:
> Am Sonntag, den 26.02.2017, 13:58 + schrieb Guenter Milde:

>> Mind, that the latexSpecialT1 is named wrong: it actually cares for
>> the special character macros present for all standard LaTeX font
>> encodings (T1, T2A, T2B, ... , TU).

> No it doesn't. We explicitly check for bparams.font_encoding() == "T1"

We actually check for

 if (!runparams.inIPA 
 && !running_font.language()->internalFontEncoding()
 && !runparams.isFullUnicode() 
 && bparams.main_font_encoding() == "T1"
 && latexSpecialT1(c, os, i, column))
return;

which is also true if the font encoding (set by
the current language) is not T1 but compatible (T2A, QX, L7x, ...).

The test for the document default font encoding
 && bparams.main_font_encoding() == "T1"
might be relaxed to all font encodings providing the standard LICR macros
used in latexSpecialT1.



>> As TU is a standard LaTeX font encoding, there is no need for a
>> special
>> handling. Instead, I propose to rename latexSpecialT1 to something
>> like
>> "latexStandardMacros".

> No. As said, it is semantically cleaner to differentiate the font
> encodings (as we recently saw, these encodings differ in what they
> support).

But it is cleaner to differentiate between standard and non-standard font
encodings, not between T1, TU and everything else.

Günter

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Sonntag, den 26.02.2017, 13:58 + schrieb Guenter Milde:
> Mind, that the latexSpecialT1 is named wrong: it actually cares for
> the
> special character macros present for all standard LaTeX font
> encodings
> (T1, T2A, T2B, ... , TU).

No it doesn't. We explicitly check for bparams.font_encoding() == "T1"

> As TU is a standard LaTeX font encoding, there is no need for a
> special
> handling. Instead, I propose to rename latexSpecialT1 to something
> like
> "latexStandardMacros".

No. As said, it is semantically cleaner to differentiate the font
encodings (as we recently saw, these encodings differ in what they
support).

Jürgen

signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-22, Jürgen Spitzmüller wrote:
> Am Dienstag, den 14.02.2017, 15:05 +0100 schrieb Jürgen Spitzmüller:

>> I think the reason is that LaTeX actually switched to TU font
>> encoding

> Tonight's update of latex-base brings back \textquotebdl and
> \textquotesingle to TU encodings.

> I will handle that in a few days (when the update has settled on the
> mirrors), but I suggest not just to revert to the old behavior, but
> introduce a new latexSpecialTU method, even if this is currently just
> linking to latexSpecialT1 (this might change later, and it is also
> semantically clearer).

Mind, that the latexSpecialT1 is named wrong: it actually cares for the
special character macros present for all standard LaTeX font encodings
(T1, T2A, T2B, ... , TU).

As TU is a standard LaTeX font encoding, there is no need for a special
handling. Instead, I propose to rename latexSpecialT1 to something like
"latexStandardMacros".

The test for T1 default font encoding 

>   && !runparams.isFullUnicode() && bparams.font_encoding() == "T1"

could also be changed to either "not OT1" or "in T1, T2A, T4, T5, T7".


Günter

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-21, Scott Kostyshak wrote:
> On Tue, Feb 14, 2017 at 09:34:38PM +, Guenter Milde wrote:

>> >2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
>> >2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)

>> These two have the known problem to produce wrong output, e.g.

>>   ÃŊndice alfabÃľtico

...

> Are you sure that you tested with system fonts?

You are right, I mixed up the texF and systemF tests.

> The attached patch fixes things for me. OK to go in?

Removing the "tipa" inset is defintely right.


I still see the error with LuaTeX and tex fonts. However, if you don't see
it, removing from invertedTests is OK, too as it is still in unreliableTests.

Thanks,
Günter

Re: lyx errors with lualatex and non-tex fonts

[Scott Kostyshak]

On Tue, Feb 21, 2017 at 01:16:52AM -0500, Scott Kostyshak wrote:
> On Tue, Feb 14, 2017 at 09:34:38PM +, Guenter Milde wrote:
> 
> > >   2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
> > >   2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)
> > 
> > These two have the known problem to produce wrong output, e.g.
> > 
> >   ÃŊndice alfabÃľtico
> 
> Can you send me the PDF that you get and tell me which page you see this
> problem? I do not see it on the latest TeX Live.
> 
> > From unreliableTests:
> > 
> > # Babel-Spanish uses Babel's "strings" feature to define
> > # separate auto-strings using UTF-8 literals.
> > # Babel uses the "unicode" strings if it detects XeTeX or LuaTeX.
> > # This is wrong for Xe/Lua with 8-bit TeX-fonts.
> > # set inputenc to utf8?
> > # (Changing the default in lib/languages requires more tests for utf8 
> > first.)
> > export/examples/es/linguistics_pdf4_texF
> > export/doc/es/.*_(pdf[45]|dvi3)_texF
> 
> Yes, I do get an error with TeX fonts.
> 
> > With the latest TeXLive update, this also leads to:
> > 
> > ! Undefined control sequence.
> >  ...art {link}{\Hy@tocdestname }{\nonumberline Í
> >   ndice 
> > alfabético}\hyper...
> > l.393 ... Índice alfabético}{175}{chapter*.10}
> > 
> > Inverting.
> 
> I do not get that error with the latest TeX Live.
> 
> Are you sure that you tested with system fonts?

I committed the patch that removes the empty \textipa inset. we should
remove the above comment if it doesn't apply to the systemF tests.

Scott


signature.asc
Description: PGP signature

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 15:05 +0100 schrieb Jürgen Spitzmüller:
> I think the reason is that LaTeX actually switched to TU font
> encoding

Tonight's update of latex-base brings back \textquotebdl and
\textquotesingle to TU encodings.

I will handle that in a few days (when the update has settled on the
mirrors), but I suggest not just to revert to the old behavior, but
introduce a new latexSpecialTU method, even if this is currently just
linking to latexSpecialT1 (this might change later, and it is also
semantically clearer).

See attached patch (does not work yet here since the latex-base update
is not yet in my mirror).

Jürgendiff --git a/src/Paragraph.cpp b/src/Paragraph.cpp
index e2ead40938..c06799a23f 100644
--- a/src/Paragraph.cpp
+++ b/src/Paragraph.cpp
@@ -363,6 +363,12 @@ public:
 		pos_type i,
 		unsigned int & column);
 	///
+	bool latexSpecialTU(
+		char_type const c,
+		otexstream & os,
+		pos_type i,
+		unsigned int & column);
+	///
 	bool latexSpecialT3(
 		char_type const c,
 		otexstream & os,
@@ -1187,11 +1193,14 @@ void Paragraph::Private::latexSpecialChar(otexstream & os,
 	// NOTE: Some languages reset the font encoding internally to a
 	//   non-standard font encoding. If we are using such a language,
 	//   we do not output special T1 chars.
-	// NOTE: XeTeX and LuaTeX use OT1 (pre 2017) or TU (as of 2017) encoding
 	if (!runparams.inIPA && !running_font.language()->internalFontEncoding()
 	&& !runparams.isFullUnicode() && bparams.font_encoding() == "T1"
 	&& latexSpecialT1(c, os, i, column))
 		return;
+	// NOTE: XeTeX and LuaTeX use EU1/2 (pre 2017) or TU (as of 2017) encoding
+	else if (!runparams.inIPA && !running_font.language()->internalFontEncoding()
+		 && runparams.isFullUnicode() && latexSpecialTU(c, os, i, column))
+		 return;
 
 	// Otherwise, we use what LaTeX provides us.
 	switch (c) {
@@ -1358,6 +1367,14 @@ bool Paragraph::Private::latexSpecialT1(char_type const c, otexstream & os,
 }
 
 
+bool Paragraph::Private::latexSpecialTU(char_type const c, otexstream & os,
+	pos_type i, unsigned int & column)
+{
+	// TU encoding is currently on par with T1.
+	return latexSpecialT1(c, os, i, column);
+}
+
+
 bool Paragraph::Private::latexSpecialT3(char_type const c, otexstream & os,
 	pos_type /*i*/, unsigned int & column)
 {


signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Scott Kostyshak]

On Tue, Feb 14, 2017 at 09:34:38PM +, Guenter Milde wrote:

> > 2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
> > 2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)
> 
> These two have the known problem to produce wrong output, e.g.
> 
>   ÃŊndice alfabÃľtico

Can you send me the PDF that you get and tell me which page you see this
problem? I do not see it on the latest TeX Live.

> From unreliableTests:
> 
> # Babel-Spanish uses Babel's "strings" feature to define
> # separate auto-strings using UTF-8 literals.
> # Babel uses the "unicode" strings if it detects XeTeX or LuaTeX.
> # This is wrong for Xe/Lua with 8-bit TeX-fonts.
> # set inputenc to utf8?
> # (Changing the default in lib/languages requires more tests for utf8 first.)
> export/examples/es/linguistics_pdf4_texF
> export/doc/es/.*_(pdf[45]|dvi3)_texF

Yes, I do get an error with TeX fonts.

> With the latest TeXLive update, this also leads to:
> 
> ! Undefined control sequence.
>  ...art {link}{\Hy@tocdestname }{\nonumberline Í
>   ndice alfabético}\hyper...
> l.393 ... Índice alfabético}{175}{chapter*.10}
> 
> Inverting.

I do not get that error with the latest TeX Live.

Are you sure that you tested with system fonts?

The attached patch fixes things for me. OK to go in?

Scott
From c814a1d7840505c2b1bd0d378e5f7fcecf5f Mon Sep 17 00:00:00 2001
From: Scott Kostyshak 
Date: Tue, 21 Feb 2017 00:46:20 -0500
Subject: [PATCH] Fix es/UserGuide.lyx LuaTeX + sysfonts on TL

Remove a \textipa that snuck into es/UserGuide.lyx. This empty inset
caused problems only on the newest TeX Live (see b863fb07).
---
 development/autotests/invertedTests | 11 ---
 lib/doc/es/UserGuide.lyx|  6 +-
 2 files changed, 1 insertion(+), 16 deletions(-)

diff --git a/development/autotests/invertedTests 
b/development/autotests/invertedTests
index b02b0a8..9b43523 100644
--- a/development/autotests/invertedTests
+++ b/development/autotests/invertedTests
@@ -185,17 +185,6 @@ export/.*/he/.*pdf4_texF
 export/doc/ru/(Intro|Tutorial)_(dvi3|pdf[45])_texF
 export/examples/ru/splash_(dvi3|pdf[45])_texF
 
-# Babel-Spanish uses  UTF-8 for auto-strings if it detects Xe/LuaTeX.
-# This leads to wrong output (see unreliableTests) and fails in some cases
-# unless the inputencoding is set to utf-8, too.
-#
-# ! Undefined control sequence.
-#  ...art {link}{\Hy@tocdestname }{\nonumberline Í
-#   ndice alfabético}\hyper...
-# l.393 ... Índice alfabético}{175}{chapter*.10}
-export/doc/es/UserGuide_(dvi3|pdf5)_systemF
-
-
 # Gives the following error:
 # # ! Package hpstatement Error: H or P statement "H251"
 # # (hpstatement)is not defined.
diff --git a/lib/doc/es/UserGuide.lyx b/lib/doc/es/UserGuide.lyx
index 64a4857..6424627 100644
--- a/lib/doc/es/UserGuide.lyx
+++ b/lib/doc/es/UserGuide.lyx
@@ -37044,11 +37044,7 @@ article (Elsevier)
 \begin_inset Quotes frd
 \end_inset
 
- con tres recuadros
-\begin_inset Formula $\text{\textipa{}}$
-\end_inset
-
- personalizados.
+ con tres recuadros personalizados.
  La sección 
 \emph on
 Recuadros flexibles y formato del recuadro
-- 
2.7.4



signature.asc
Description: PGP signature

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Mittwoch, 15. Februar 2017 um 18:19:55, schrieb Jürgen Spitzmüller 

> Am Mittwoch, den 15.02.2017, 17:43 +0100 schrieb Kornel Benko:
> > Here they fail both.
> 
> FWIW both XeTeX with and without TeX Fonts works without problems here.
> This is up to date TeXLive 2016.
> 
> *File List*

I have the same. But I found a reason:

Besides texlive from CTAN I also had installed font awesome as a ubuntu-package.
Somehow xelatex takes this font, while lualatex is OK with the one from ctan.
De-installing this package, lualatex still compiles the file while xelatex is 
complaining:

!
! fontspec error: "font-not-found"
! 
! The font "FontAwesome" cannot be found.
! 
! See the fontspec documentation for further information.
! 
! For immediate help type H .
!...  

Making symbolic link of `kpsewhich --var-value 
TEXMFSYSVAR`/fonts/conf/texlive-fontconfig.conf to ~/.fonts.conf
and rerunning 'fc-cache -fv' cured it for me.

Now it compiles.

> Jürgen

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Mittwoch, den 15.02.2017, 17:43 +0100 schrieb Kornel Benko:
> Here they fail both.

FWIW both XeTeX with and without TeX Fonts works without problems here.
This is up to date TeXLive 2016.

*File List*
moderncv.cls2015/07/28 v2.0.0 modern curriculum vitae and letter
document class
  size12.clo2014/09/29 v1.4h Standard LaTeX file (size option)
etoolbox.sty2017/01/02 v2.4 e-TeX tools for LaTeX (JAW)
  ifthen.sty2014/09/29 v1.1c Standard LaTeX ifthen package (DPC)
  xcolor.sty2016/05/11 v2.12 LaTeX color extensions (UK)
   color.cfg2016/01/02 v1.6 sample color configuration
   xetex.def2016/07/11 v4.10 LaTeX color/graphics driver for XeTeX 
(L3/RRM/JK)
colortbl.sty2012/02/13 v1.0a Color table columns (DPC)
   array.sty2016/10/06 v2.4d Tabular extension package (FMi)
 ifxetex.sty2010/09/12 v0.6 Provides ifxetex conditional
ifluatex.sty2016/05/16 v1.4 Provides the ifluatex switch (HO)
   t1enc.def2017/01/24 v2.0c Standard LaTeX file
   t1lmr.fd2009/10/30 v1.6 Font defs for Latin Modern
 lmodern.sty2009/10/30 v1.6 Latin Modern Fonts
 url.sty2013/09/16  ver 3.4  Verb mode for urls, etc.
graphicx.sty2014/10/28 v1.0g Enhanced LaTeX Graphics (DPC,SPQR)
  keyval.sty2014/10/28 v1.15 key=value parser (DPC)
graphics.sty2016/10/09 v1.0u Standard LaTeX Graphics (DPC,SPQR)
trig.sty2016/01/03 v1.10 sin cos tan (DPC)
graphics.cfg2016/06/04 v1.11 sample graphics configuration
fancyhdr.sty2016/09/06 3.8 Extensive control of page headers and 
footers
tweaklist.sty
calc.sty2014/10/28 v4.3 Infix arithmetic (KKT,FJ)
  xparse.sty2017/02/10 v6878 L3 Experimental document command 
parser
   expl3.sty2017/02/10 v6878 L3 programming layer (loader) 
expl3-code.tex2017/02/10 v6878 L3 programming layer 
l3xdvipdfmx.def
microtype.sty2016/05/14 v2.6a Micro-typographical refinements (RS)
microtype-xetex.def2016/05/14 v2.6a Definitions specific to xetex 
(RS)
microtype.cfg2016/05/14 v2.6a microtype main configuration file 
(RS)
moderncvcollection.sty2015/07/28 v2.0.0 moderncv collections
moderncvcompatibility.sty2015/07/28 v2.0.0 modern curriculum vitae 
and letter compatibility patches
fontspec.sty2017/02/12 v2.6 Font selection for XeLaTeX and LuaLaTeX
fontspec-xetex.sty2017/02/12 v2.6 Font selection for XeLaTeX and 
LuaLaTeX
   tuenc.def2017/01/24 v2.0c Standard LaTeX file
fontspec.cfg
geometry.sty2010/09/12 v5.6 Page Geometry
   ifpdf.sty2016/05/14 v3.1 Provides the ifpdf switch
  ifvtex.sty2016/05/16 v1.6 Detect VTeX and its facilities (HO)
moderncvstylecasual.sty2015/07/28 v2.0.0 modern curriculum vitae 
and letter style scheme: casual
moderncviconsawesome.sty2015/07/28 v2.0.0 modern curriculum vitae 
and letter icons: awesome
fontawesome.sty2016/05/15 v4.6.3.1 font awesome icons
fontawesomesymbols-generic.tex
fontawesomesymbols-xeluatex.tex
moderncvheadii.sty2015/07/28 v2.0.0 modern curriculum vitae and 
letter header variant: 2
moderncvbodyi.sty2015/07/28 v2.0.0 modern curriculum vitae and 
letter body variant: 1
moderncvfooti.sty2015/07/28 v2.0.0 modern curriculum vitae and 
letter footer variant: 1
moderncvcolorblue.sty2015/07/28 v2.0.0 modern curriculum vitae and 
letter color scheme: blue
xunicode.sty2011/09/09 v0.981 provides access to latin accents and 
many other characters in Unicode lower plane
polyglossia.sty2015/03/25 v1.42.4 Alternative to Babel for XeLaTeX 
and LuaLaTeX
makecmds.sty2009/09/03 v1.0a extra command making commands
 xkeyval.sty2014/12/03 v2.7a package option processing (HA)
 xkeyval.tex2014/12/03 v2.7a key=value parser (HA)
gloss-english.ldfpolyglossia: module for english
hyperref.sty2016/06/24 v6.83q Hypertext links for LaTeX
hobsub-hyperref.sty2016/05/16 v1.14 Bundle oberdiek, subset 
hyperref (HO)
hobsub-generic.sty2016/05/16 v1.14 Bundle oberdiek, subset generic 
(HO)
  hobsub.sty2016/05/16 v1.14 Construct package bundles (HO)
infwarerr.sty2016/05/16 v1.4 Providing info/warning/error messages 
(HO)
 ltxcmds.sty2016/05/16 v1.23 LaTeX kernel commands for general use 
(HO)
 intcalc.sty2016/05/16 v1.2 Expandable calculations with integers 
(HO)
etexcmds.sty2016/05/16 v1.6 Avoid name clashes with e-TeX commands 
(HO)
kvsetkeys.sty2016/05/16 v1.17 Key value parser (HO)
kvdefinekeys.sty2016/05/16 v1.4 Define keys (HO)
pdftexcmds.sty2016/05/21 v0.22 Utility functions of pdfTeX for 
LuaTeX (HO)
pdfescape.sty2016/05/16 v1.14 Implements pdfTeX's escape features 
(HO)
bigintcalc.sty

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Mittwoch, 15. Februar 2017 um 13:59:02, schrieb Guenter Milde 

> On 2017-02-15, Kornel Benko wrote:
> > Am Mittwoch, 15. Februar 2017 um 08:37:46, schrieb Jürgen Spitzmüller 
> > 
> >> Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:
>
> >> > Apart from this there are still 72 messages with
> >> > ! LaTeX Error: Command \textquotedbl unavailable in encoding
> >> > TU.
> >> > in
> >> > export/examples/modernCV_dvi3_texF
> >> > export/examples/es/modernCV_pdf4_texF
> >> > export/examples/es/modernCV_pdf5_texF
>
> >> Should be fixed now.
>
> > It is.
>
> >> Jürgen
>
> > Still failing for instance export/examples/modernCV_pdf4_texF
> > Missing character: There is no  in font FontAwesome/OT!
>
> It works here. Can you have a look at the output, maybe you can spot a
> missing character. FontAwesome is used for the icons like seen in the
> bottomlines:
>
> Paul Testman
> Teststreet 17 -- 0 Nicecity -- Switzerland
>  +43(0)999 888 •  +43(0)999  •  +43(0)999 
>  test...@testman.xx •  www.johndoe.com •  ptestman
>  ptestman •  ptestman • www.lyx.org
> 6/6
>
> Also I wonder how modernCV_pdf4_texF can fail when
> modernCV_pdf4_systemF compiles -- both use the same Unicode fonts!

Here they fail both. The above was only an example. (I did not say that 
modernCV_pdf4_systemF compiles)
OTOH, lualatex uses the same font and output is OK.

> Maybe updating texlive-fonts-extra (or whereever you get your FontAwesome
> from) or the modernCV document class helps.

It is directly from CTAN here.
Comparing with correct output (e.g. lualatex) it is the glyph for mobile.
(Wrong output attached)
Looking into log:
(/usr9/local/texlive/2016/texmf-dist/tex/latex/fontawesome/fontawesome.sty
Package: fontawesome 2016/05/15 v4.6.3.1 font awesome icons

(/usr9/local/texlive/2016/texmf-dist/tex/latex/fontawesome/fontawesomesymbols-g
eneric.tex) (/usr9/local/texlive/2016/texmf-dist/tex/latex/fontspec/fontspec.sty
Package: fontspec 2017/02/12 v2.6 Font selection for XeLaTeX and LuaLaTeX
(/usr9/local/texlive/2016/texmf-dist/tex/latex/fontspec/fontspec-xetex.sty
Package: fontspec-xetex 2017/02/12 v2.6 Font selection for XeLaTeX and LuaLaTeX
...
But I have also many messages like:
Package microtype Info: Character `A' is missing
(microtype) in font `\TU/FontAwesome(0)/m/n/6'.
(microtype) Ignoring protrusion settings for this character.
Package microtype Info: Character `F' is missing
(microtype) in font `\TU/FontAwesome(0)/m/n/6'.
(microtype) Ignoring protrusion settings for this character.

> Otherwise, we can add
>
>export/examples/es/modernCV_pdf4_texF
>export/examples/es/modernCV_pdf5_texF
>
> to unreliableTests.
>
> > Now only 5 failed tests remain.
>
> Which?

1771 - export/doc/ar/Intro_pdf4_systemF (Failed)
3492 - export/examples/modernCV_pdf4_texF (Failed)
3493 - export/examples/modernCV_pdf4_systemF (Failed)
4649 - export/examples/es/modernCV_pdf4_texF (Failed)
4650 - export/examples/es/modernCV_pdf4_systemF (Failed)

> Günter

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-15, Kornel Benko wrote:
> Am Mittwoch, 15. Februar 2017 um 08:37:46, schrieb Jürgen Spitzmüller 
> 
>> Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:

>> > Apart from this there are still 72 messages with
>> > ! LaTeX Error: Command \textquotedbl unavailable in encoding
>> > TU.
>> > in
>> > export/examples/modernCV_dvi3_texF
>> > export/examples/es/modernCV_pdf4_texF
>> > export/examples/es/modernCV_pdf5_texF

>> Should be fixed now.

> It is.

>> Jürgen

> Still failing for instance export/examples/modernCV_pdf4_texF
>   Missing character: There is no  in font FontAwesome/OT!

It works here. Can you have a look at the output, maybe you can spot a
missing character. FontAwesome is used for the icons like seen in the
bottomlines:

Paul Testman
Teststreet 17 -- 0 Nicecity -- Switzerland
 +43(0)999 888 •  +43(0)999  •  +43(0)999 
 test...@testman.xx •  www.johndoe.com •  ptestman
 ptestman •  ptestman • www.lyx.org
6/6

Also I wonder how modernCV_pdf4_texF can fail when
modernCV_pdf4_systemF compiles -- both use the same Unicode fonts!

Maybe updating texlive-fonts-extra (or whereever you get your FontAwesome
from) or the modernCV document class helps. 

Otherwise, we can add

   export/examples/es/modernCV_pdf4_texF
   export/examples/es/modernCV_pdf5_texF

to unreliableTests.

> Now only 5 failed tests remain.

Which?

Günter

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Mittwoch, 15. Februar 2017 um 09:39:57, schrieb Guenter Milde 

> On 2017-02-14, Kornel Benko wrote:
> 
> >> BTW: was does the Sublabel: RESET mean?
> 
> > RESET means 'Reset the set of active sublabels'. Ergo from now on no
> > sublabel is defined.
> 
> Thank you for the explanation. So, instead of sublabel RESET, we can also
> move the patterns to the top of the file.

Yes, same effect.

> However, I'd prefer if every clause in invertedTests were sorted under some
> sublabel - either one of the existing ones (including TODO for cases where
> the reason is not yet known) or a new one like "unreliable-fail").

OK.
 Note 1: You can assign more than one label at the same 'Sublabel:'-line.
 Note 2: Each 'Sublabel:'-line implies RESET as the first entry.

Also note that there are hardcoded labels. They are not affected by RESET. They 
are assigned because of
 1.) path of the lyx-file (e.g. lib/examples --> label examples, lib/doc --> 
manuals, ...)
 2.) file in which the test is determined (e.g. unreliableTests --> label 
unreliable, ...)
 3.) kind of a test (e.g. lyx2lyx, load)

> Günter

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Mittwoch, 15. Februar 2017 um 08:37:46, schrieb Jürgen Spitzmüller 

> Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:
> > Apart from this there are still 72 messages with
> > ! LaTeX Error: Command \textquotedbl unavailable in encoding
> > TU.
> > in
> > export/examples/modernCV_dvi3_texF
> > export/examples/es/modernCV_pdf4_texF
> > export/examples/es/modernCV_pdf5_texF
> 
> Should be fixed now.

It is.

> Jürgen

Still failing for instance export/examples/modernCV_pdf4_texF
Missing character: There is no  in font FontAwesome/OT!

Now only 5 failed tests remain.

Kornel


signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-14, Kornel Benko wrote:

>> BTW: was does the Sublabel: RESET mean?

> RESET means 'Reset the set of active sublabels'. Ergo from now on no
> sublabel is defined.

Thank you for the explanation. So, instead of sublabel RESET, we can also
move the patterns to the top of the file.

However, I'd prefer if every clause in invertedTests were sorted under some
sublabel - either one of the existing ones (including TODO for cases where
the reason is not yet known) or a new one like "unreliable-fail").

Günter

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 20:51 +0100 schrieb Kornel Benko:
> Apart from this there are still 72 messages with
> ! LaTeX Error: Command \textquotedbl unavailable in encoding
> TU.
> in
> export/examples/modernCV_dvi3_texF
> export/examples/es/modernCV_pdf4_texF
> export/examples/es/modernCV_pdf5_texF

Should be fixed now.

Jürgen

signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 14. Februar 2017 um 21:34:38, schrieb Guenter Milde 

> On 2017-02-14, Kornel Benko wrote:
> 
> > [-- Type: text/plain, Encoding: quoted-printable --]
> 
> > Am Dienstag, 14. Februar 2017 um 18:19:17, schrieb Jürgen Spitzmüller 
> > 
> >> Am Dienstag, den 14.02.2017, 17:50 +0100 schrieb Kornel Benko:
> >> > Perfect. Prior to this patch I had 104 bad export tests. With applied
> >> > patch there are now
> >> > only 27, all of them either with lualatex or xelatex.
> 
> >> Can you collect and post these?
> 
> > The following tests FAILED:
> > 1771 - export/doc/ar/Intro_pdf4_systemF (Failed)
> 
> Cannot test Arabic here (not installed).
> 
> > 2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
> > 2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)
> 
> These two have the known problem to produce wrong output, e.g.
> 
>   ÃŊndice alfabÃľtico
> 
> From unreliableTests:
> 
> # Babel-Spanish uses Babel's "strings" feature to define
> # separate auto-strings using UTF-8 literals.
> # Babel uses the "unicode" strings if it detects XeTeX or LuaTeX.
> # This is wrong for Xe/Lua with 8-bit TeX-fonts.
> # set inputenc to utf8?
> # (Changing the default in lib/languages requires more tests for utf8 first.)
> export/examples/es/linguistics_pdf4_texF
> export/doc/es/.*_(pdf[45]|dvi3)_texF
> 
> 
> With the latest TeXLive update, this also leads to:
> 
> ! Undefined control sequence.
>  ...art {link}{\Hy@tocdestname }{\nonumberline Í
>   ndice alfabético}\hyper...
> l.393 ... Índice alfabético}{175}{chapter*.10}
> 
> Inverting.
> 
> 
> > 3487 - export/examples/modernCV_dvi3_texF (Failed)
> > 3492 - export/examples/modernCV_pdf4_texF (Failed)
> > 3493 - export/examples/modernCV_pdf4_systemF (Failed)
> > 3494 - export/examples/modernCV_pdf5_texF (Failed)
> 
> > 4644 - export/examples/es/modernCV_dvi3_texF (Failed)
> > 4649 - export/examples/es/modernCV_pdf4_texF (Failed)
> > 4650 - export/examples/es/modernCV_pdf4_systemF (Failed)
> > 4651 - export/examples/es/modernCV_pdf5_texF (Failed)
> 
> There are two literal straight double-quotes in:
> 
>   "You only live twice." (an optional quote)
> 
> that lead to 
> 
>   ! LaTeX Error: Command \textquotedbl unavailable in encoding TU.
> 
> In this case, I believe the fix should be to use curly quotes.
> 
> Q: Why does this happen although the test uses 8-bit TeX fonts?
> 
> A: The moderncv class checks for the TeX engine and selects non-TeX
>fonts with Xe/LuaTeX automatically.
> 
> > 3443 - export/examples/linguistics_dvi3_systemF (Failed)
> > 3450 - export/examples/linguistics_pdf5_systemF (Failed)
> > 4446 - export/examples/de/linguistics_dvi3_systemF (Failed)
> > 4453 - export/examples/de/linguistics_pdf5_systemF (Failed)
> > 4629 - export/examples/es/linguistics_dvi3_systemF (Failed)
> > 4636 - export/examples/es/linguistics_pdf5_systemF (Failed)
> > 4923 - export/examples/fr/linguistics_dvi3_systemF (Failed)
> > 4930 - export/examples/fr/linguistics_pdf5_systemF (Failed)
> 
> The command \textipa is not defined with LuaTeX and Unicode (non-TeX) fonts.
> 
> Inverting.
> 
> > 2831 - INVERTED.TEXISSUES_export/doc/ru/Intro_dvi3_systemF (Failed)
> > 2838 - INVERTED.TEXISSUES_export/doc/ru/Intro_pdf5_systemF (Failed)
> > 2975 - INVERTED.TEXISSUES_export/doc/uk/Intro_dvi3_systemF (Failed)
> > 2982 - INVERTED.TEXISSUES_export/doc/uk/Intro_pdf5_systemF (Failed)
> 
> > 5471 - INVERTED.TEXISSUES_export/examples/ru/splash_dvi3_systemF 
> > (Failed)
> > 5478 - INVERTED.TEXISSUES_export/examples/ru/splash_pdf5_systemF 
> > (Failed)
> > 5599 - INVERTED.TEXISSUES_export/examples/uk/splash_dvi3_systemF 
> > (Failed)
> > 5606 - INVERTED.TEXISSUES_export/examples/uk/splash_pdf5_systemF 
> > (Failed)
> 
> > The 8 INVERTED are actually OK, but for completeness included here.
> 
> Yes, it seems the polyglossia bug:
> 
> # Polyglossia + LuaTeX + \verb bug with Cyrillic and Greek:
> # when compiling with LuaTeX, the "verb" and "url" macros trigger a false
> # error (also with fonts supporting Cyrillic!) and spurious output
> # See https://github.com/reutenauer/polyglossia/issues/160
> 
> is fixed.
> 
> I removed the lines:
> 
> export/examples/(ru|uk)/splash_(dvi3|pdf5)_systemF
> export/doc/(ru|uk)/Intro_(dvi3|pdf5)_systemF
> 
> from inverteTests.
> 

Thanks.

> BTW: was does the Sublabel: RESET mean?
> 

RESET means 'Reset the set of active sublabels'. Ergo from now on no sublabel 
is defined.

> Günter

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-14, Kornel Benko wrote:

> [-- Type: text/plain, Encoding: quoted-printable --]

> Am Dienstag, 14. Februar 2017 um 18:19:17, schrieb Jürgen Spitzmüller 
> 
>> Am Dienstag, den 14.02.2017, 17:50 +0100 schrieb Kornel Benko:
>> > Perfect. Prior to this patch I had 104 bad export tests. With applied
>> > patch there are now
>> > only 27, all of them either with lualatex or xelatex.

>> Can you collect and post these?

> The following tests FAILED:
>   1771 - export/doc/ar/Intro_pdf4_systemF (Failed)

Cannot test Arabic here (not installed).

>   2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
>   2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)

These two have the known problem to produce wrong output, e.g.

  ÃŊndice alfabÃľtico

>From unreliableTests:

# Babel-Spanish uses Babel's "strings" feature to define
# separate auto-strings using UTF-8 literals.
# Babel uses the "unicode" strings if it detects XeTeX or LuaTeX.
# This is wrong for Xe/Lua with 8-bit TeX-fonts.
# set inputenc to utf8?
# (Changing the default in lib/languages requires more tests for utf8 first.)
export/examples/es/linguistics_pdf4_texF
export/doc/es/.*_(pdf[45]|dvi3)_texF


With the latest TeXLive update, this also leads to:

! Undefined control sequence.
 ...art {link}{\Hy@tocdestname }{\nonumberline Í
  ndice alfabético}\hyper...
l.393 ... Índice alfabético}{175}{chapter*.10}

Inverting.


>   3487 - export/examples/modernCV_dvi3_texF (Failed)
>   3492 - export/examples/modernCV_pdf4_texF (Failed)
>   3493 - export/examples/modernCV_pdf4_systemF (Failed)
>   3494 - export/examples/modernCV_pdf5_texF (Failed)

>   4644 - export/examples/es/modernCV_dvi3_texF (Failed)
>   4649 - export/examples/es/modernCV_pdf4_texF (Failed)
>   4650 - export/examples/es/modernCV_pdf4_systemF (Failed)
>   4651 - export/examples/es/modernCV_pdf5_texF (Failed)

There are two literal straight double-quotes in:

  "You only live twice." (an optional quote)

that lead to 

  ! LaTeX Error: Command \textquotedbl unavailable in encoding TU.

In this case, I believe the fix should be to use curly quotes.

Q: Why does this happen although the test uses 8-bit TeX fonts?

A: The moderncv class checks for the TeX engine and selects non-TeX
   fonts with Xe/LuaTeX automatically.

>   3443 - export/examples/linguistics_dvi3_systemF (Failed)
>   3450 - export/examples/linguistics_pdf5_systemF (Failed)
>   4446 - export/examples/de/linguistics_dvi3_systemF (Failed)
>   4453 - export/examples/de/linguistics_pdf5_systemF (Failed)
>   4629 - export/examples/es/linguistics_dvi3_systemF (Failed)
>   4636 - export/examples/es/linguistics_pdf5_systemF (Failed)
>   4923 - export/examples/fr/linguistics_dvi3_systemF (Failed)
>   4930 - export/examples/fr/linguistics_pdf5_systemF (Failed)

The command \textipa is not defined with LuaTeX and Unicode (non-TeX) fonts.

Inverting.

>   2831 - INVERTED.TEXISSUES_export/doc/ru/Intro_dvi3_systemF (Failed)
>   2838 - INVERTED.TEXISSUES_export/doc/ru/Intro_pdf5_systemF (Failed)
>   2975 - INVERTED.TEXISSUES_export/doc/uk/Intro_dvi3_systemF (Failed)
>   2982 - INVERTED.TEXISSUES_export/doc/uk/Intro_pdf5_systemF (Failed)

>   5471 - INVERTED.TEXISSUES_export/examples/ru/splash_dvi3_systemF 
> (Failed)
>   5478 - INVERTED.TEXISSUES_export/examples/ru/splash_pdf5_systemF 
> (Failed)
>   5599 - INVERTED.TEXISSUES_export/examples/uk/splash_dvi3_systemF 
> (Failed)
>   5606 - INVERTED.TEXISSUES_export/examples/uk/splash_pdf5_systemF 
> (Failed)

> The 8 INVERTED are actually OK, but for completeness included here.

Yes, it seems the polyglossia bug:

# Polyglossia + LuaTeX + \verb bug with Cyrillic and Greek:
# when compiling with LuaTeX, the "verb" and "url" macros trigger a false
# error (also with fonts supporting Cyrillic!) and spurious output
# See https://github.com/reutenauer/polyglossia/issues/160

is fixed.

I removed the lines:

export/examples/(ru|uk)/splash_(dvi3|pdf5)_systemF
export/doc/(ru|uk)/Intro_(dvi3|pdf5)_systemF

from inverteTests.


BTW: was does the Sublabel: RESET mean?


Günter

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 14. Februar 2017 um 20:01:28, schrieb Kornel Benko 
> Am Dienstag, 14. Februar 2017 um 19:28:41, schrieb Jürgen Spitzmüller 
> 
> > Am Dienstag, den 14.02.2017, 18:46 +0100 schrieb Kornel Benko:
> > > Sure:
> > > 
> > > The following tests FAILED:
> > 
> > Thanks. Actually, I thought you could post the error messages.
> > 
> > Jürgen
> 
> Will do. But the resulting file will be huge.
> 
> In progress now...
> 
>   Kornel

There are 196 messages like
Missing character: There is no  in font FontAwesome/OT!
or (in export/doc/ar/Intro_pdf4_systemF)
Missing character: There is no   in font 
Scheherazade/OT:script=arab;language=DFLT;mapping=tex-text;!

Apart from this there are still 72 messages with
! LaTeX Error: Command \textquotedbl unavailable in encoding TU.
in
export/examples/modernCV_dvi3_texF
export/examples/es/modernCV_pdf4_texF
export/examples/es/modernCV_pdf5_texF

That's for now. The whole log file is 17MB big, mostly 'uninteresting' latex 
info.

Kornel


signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 14. Februar 2017 um 19:28:41, schrieb Jürgen Spitzmüller 

> Am Dienstag, den 14.02.2017, 18:46 +0100 schrieb Kornel Benko:
> > Sure:
> > 
> > The following tests FAILED:
> 
> Thanks. Actually, I thought you could post the error messages.
> 
> Jürgen

Will do. But the resulting file will be huge.

In progress now...

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 18:46 +0100 schrieb Kornel Benko:
> Sure:
> 
> The following tests FAILED:

Thanks. Actually, I thought you could post the error messages.

Jürgen

signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 14. Februar 2017 um 18:19:17, schrieb Jürgen Spitzmüller 

> Am Dienstag, den 14.02.2017, 17:50 +0100 schrieb Kornel Benko:
> > Perfect. Prior to this patch I had 104 bad export tests. With applied
> > patch there are now
> > only 27, all of them either with lualatex or xelatex.
> 
> Can you collect and post these?
> 
> Jürgen
> 

Sure:

The following tests FAILED:
1771 - export/doc/ar/Intro_pdf4_systemF (Failed)
2196 - export/doc/es/UserGuide_dvi3_systemF (Failed)
2203 - export/doc/es/UserGuide_pdf5_systemF (Failed)
2831 - INVERTED.TEXISSUES_export/doc/ru/Intro_dvi3_systemF (Failed)
2838 - INVERTED.TEXISSUES_export/doc/ru/Intro_pdf5_systemF (Failed)
2975 - INVERTED.TEXISSUES_export/doc/uk/Intro_dvi3_systemF (Failed)
2982 - INVERTED.TEXISSUES_export/doc/uk/Intro_pdf5_systemF (Failed)
3443 - export/examples/linguistics_dvi3_systemF (Failed)
3450 - export/examples/linguistics_pdf5_systemF (Failed)
3487 - export/examples/modernCV_dvi3_texF (Failed)
3492 - export/examples/modernCV_pdf4_texF (Failed)
3493 - export/examples/modernCV_pdf4_systemF (Failed)
3494 - export/examples/modernCV_pdf5_texF (Failed)
4446 - export/examples/de/linguistics_dvi3_systemF (Failed)
4453 - export/examples/de/linguistics_pdf5_systemF (Failed)
4629 - export/examples/es/linguistics_dvi3_systemF (Failed)
4636 - export/examples/es/linguistics_pdf5_systemF (Failed)
4644 - export/examples/es/modernCV_dvi3_texF (Failed)
4649 - export/examples/es/modernCV_pdf4_texF (Failed)
4650 - export/examples/es/modernCV_pdf4_systemF (Failed)
4651 - export/examples/es/modernCV_pdf5_texF (Failed)
4923 - export/examples/fr/linguistics_dvi3_systemF (Failed)
4930 - export/examples/fr/linguistics_pdf5_systemF (Failed)
5471 - INVERTED.TEXISSUES_export/examples/ru/splash_dvi3_systemF 
(Failed)
5478 - INVERTED.TEXISSUES_export/examples/ru/splash_pdf5_systemF 
(Failed)
5599 - INVERTED.TEXISSUES_export/examples/uk/splash_dvi3_systemF 
(Failed)
5606 - INVERTED.TEXISSUES_export/examples/uk/splash_pdf5_systemF 
(Failed)

The 8 INVERTED are actually OK, but for completeness included here.

Kornel


signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 17:50 +0100 schrieb Kornel Benko:
> Perfect. Prior to this patch I had 104 bad export tests. With applied
> patch there are now
> only 27, all of them either with lualatex or xelatex.

Can you collect and post these?

Jürgen

> 
>   Kornel

signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Kornel Benko]

Am Dienstag, 14. Februar 2017 um 15:38:22, schrieb Jürgen Spitzmüller 

> Am Dienstag, den 14.02.2017, 15:05 +0100 schrieb Jürgen Spitzmüller:
> > > It seems we need to define \textquotedbl until the issue is fixed
> > > upstream.
> > 
> > Yes.
> 
> No, we can do without. Patch attached.
> 
> Jürgen

Perfect. Prior to this patch I had 104 bad export tests. With applied patch 
there are now
only 27, all of them either with lualatex or xelatex.

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 15:05 +0100 schrieb Jürgen Spitzmüller:
> > It seems we need to define \textquotedbl until the issue is fixed
> > upstream.
> 
> Yes.

No, we can do without. Patch attached.

Jürgendiff --git a/src/LaTeXFeatures.cpp b/src/LaTeXFeatures.cpp
index b4de991828..f94351f100 100644
--- a/src/LaTeXFeatures.cpp
+++ b/src/LaTeXFeatures.cpp
@@ -123,19 +123,19 @@ static docstring const textquotedbl_def = from_ascii(
 
 static docstring const textquotedblp_xetex_def = from_ascii(
 	"\\providecommand\\textquotedblplain{%\n"
-	"  \\bgroup\\addfontfeatures{Mapping=}\\textquotedbl\\egroup}");
+	"  \\bgroup\\addfontfeatures{Mapping=}\\char`\\\"\\egroup}");
 
 static docstring const textquotedblp_luatex_def = from_ascii(
 	"\\providecommand\\textquotedblplain{%\n"
-	"  \\bgroup\\addfontfeatures{RawFeature=-tlig}\\textquotedbl\\egroup}");
+	"  \\bgroup\\addfontfeatures{RawFeature=-tlig}\\char`\\\"\\egroup}");
 
 static docstring const textquotesinglep_xetex_def = from_ascii(
 	"\\providecommand\\textquotesingleplain{%\n"
-	"  \\bgroup\\addfontfeatures{Mapping=}\\textquotesingle\\egroup}");
+	"  \\bgroup\\addfontfeatures{Mapping=}\\char`\\\'\\egroup}");
 
 static docstring const textquotesinglep_luatex_def = from_ascii(
 	"\\providecommand\\textquotesingleplain{%\n"
-	"  \\bgroup\\addfontfeatures{RawFeature=-tlig}\\textquotesingle\\egroup}");
+	"  \\bgroup\\addfontfeatures{RawFeature=-tlig}\\char`\\\'\\egroup}");
 
 static docstring const paragraphleftindent_def = from_ascii(
 	"\\newenvironment{LyXParagraphLeftIndent}[1]%\n"
diff --git a/src/Paragraph.cpp b/src/Paragraph.cpp
index c1aa2b9162..7b330d3950 100644
--- a/src/Paragraph.cpp
+++ b/src/Paragraph.cpp
@@ -1188,7 +1188,8 @@ void Paragraph::Private::latexSpecialChar(otexstream & os,
 	//   non-standard font encoding. If we are using such a language,
 	//   we do not output special T1 chars.
 	if (!runparams.inIPA && !running_font.language()->internalFontEncoding()
-	&& bparams.font_encoding() == "T1" && latexSpecialT1(c, os, i, column))
+	&& !bparams.useNonTeXFonts && bparams.font_encoding() == "T1"
+	&& latexSpecialT1(c, os, i, column))
 		return;
 
 	// Otherwise, we use what LaTeX provides us.


signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Jürgen Spitzmüller]

Am Dienstag, den 14.02.2017, 12:33 + schrieb Guenter Milde:
> On 2017-02-14, Kornel Benko wrote:
> 
> > [-- Type: text/plain, Encoding: 7bit --]
> > To reproduce (with lyx2.3)
> > 1.) Open 'autotests/export/latex/languagenesting2.lyx'
> > 2.) Document->Settings...->Fonts->Use non-Tex fonts
> > 3.) View other formats->View PDF(luatex)
> 
> 
> > Plenty errors with
> > ! LaTeX Error: Command \textquotedbl unavailable in encoding TU.
> 
> I had a similar problem with XeTeX.
> 
> It seems that since a recent TeXLive update, \textquotedbl is no
> longer
> supported with the TU font encoding (Xe/LuaTeX and Unicode fonts).

I think the reason is that LaTeX actually switched to TU font encoding
(from OT1) for XeTeX/LuaTeX. See ltnews Issue 26, January 2017:

"The default encoding in LATEX has always been the original 128-
character encoding OT1. For Unicode based TEX engines, this is not
really suitable, and is especially problematic with XELATEX as in the
major distributions this is built with Unicode based hyphenation
patterns in the format. In practice this has not been a major
problem as documents use the contributed fontspec package in order to
switch to a Unicode encoded font.
In this release we are adding TU as a new supported encoding in
addition to the previously supported encodings such as OT1 and T1. This
denotes a Unicode based font encoding. It is essentially the same as
the TU encoding that has been on trial with the experimental
tuenc option to fontspec for the past year.
The XELATEX and LuaLATEX formats will now default to TU encoding and
lmr (Latin Modern) family. In the case of LuaLATEX the contributed
luaotfload Lua module will be loaded at the start of each run to enable
the loading of OpenType fonts."

> It seems we need to define \textquotedbl until the issue is fixed
> upstream.

Yes. And probably file a bug report at latex-project.org.

Jürgen

> 
> Currently, it seems not widely recognized, at least a Google search
> did not
> show any occurences of "\textquotedbl unavailable in encoding TU."
> 
> Günter
> 
> 

signature.asc
Description: This is a digitally signed message part

Re: lyx errors with lualatex and non-tex fonts

[Guenter Milde]

On 2017-02-14, Kornel Benko wrote:

> [-- Type: text/plain, Encoding: 7bit --]

> To reproduce (with lyx2.3)
> 1.) Open 'autotests/export/latex/languagenesting2.lyx'
> 2.) Document->Settings...->Fonts->Use non-Tex fonts
> 3.) View other formats->View PDF(luatex)


> Plenty errors with
> ! LaTeX Error: Command \textquotedbl unavailable in encoding TU.

I had a similar problem with XeTeX.

It seems that since a recent TeXLive update, \textquotedbl is no longer
supported with the TU font encoding (Xe/LuaTeX and Unicode fonts).

Test

from autotests/export/latex/languagenesting2.lyx:

• No problem with normal text: (literal Unicode) 

  “push” citations to LyX.

• problem with LyX-code: 
  Character '"' (0x22) QUOTATION MARK) converted to \textquotedbl 

  LYXPIPE="/path/to/lyxpipe"

• problem with Character '"' QUOTATION MARK
  if inserted via copy-paste: converted to \textquotedbl.
  
We convert " to \textquotedbl also for Unicode fonts, as it is active with
babel-shortcuts.

It seems we need to define \textquotedbl until the issue is fixed upstream.

Currently, it seems not widely recognized, at least a Google search did not
show any occurences of "\textquotedbl unavailable in encoding TU."

Günter