Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-12-07 Thread Thomas A. Schmitz

On 11/25/2011 09:09 PM, Hans Hagen wrote:

It makes me wonder how Thomas gets his greek etc done in bibtex.


To be quite honest: I rarely have more than a few words of Greek, and I 
wrap them up in \localgreek{} markup in my bibtex files, so I assume 
that's why I have never run into this problem. But it's another example 
to show that bibtex has huge problems outside of English (ASCII) range. 
It would be great if we could get rid of it ASAP...


Thomas
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___


Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-12-07 Thread Alexandre Krispin
Thank you for your answer !

Finally I am back to Latex until this problem is fixed. Though I have no
knowledge about it, it seemed to me that the problem I got was more related
to hanzi script than to bibtex, since the final problem of misplaced dots I
had appeared only with hanzi script.

Hans Hagen did not replied to it. That's why I suppose that one day if this
problem related to hanzi script becomes a problem of general interest,
maybe it will be fixed...

Cheers,
Alexandre Krispin

2011/12/7 Thomas A. Schmitz thomas.schm...@uni-bonn.de

 On 11/25/2011 09:09 PM, Hans Hagen wrote:

 It makes me wonder how Thomas gets his greek etc done in bibtex.


 To be quite honest: I rarely have more than a few words of Greek, and I
 wrap them up in \localgreek{} markup in my bibtex files, so I assume that's
 why I have never run into this problem. But it's another example to show
 that bibtex has huge problems outside of English (ASCII) range. It would be
 great if we could get rid of it ASAP...

 Thomas

 __**__**
 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/**
 listinfo/ntg-context http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : 
 http://foundry.supelec.fr/**projects/contextrev/http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net
 __**__**
 ___




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-12-07 Thread Hans Hagen

On 7-12-2011 17:37, Alexandre Krispin wrote:

Thank you for your answer !

Finally I am back to Latex until this problem is fixed. Though I have no
knowledge about it, it seemed to me that the problem I got was more related
to hanzi script than to bibtex, since the final problem of misplaced dots I
had appeared only with hanzi script.

Hans Hagen did not replied to it. That's why I suppose that one day if this
problem related to hanzi script becomes a problem of general interest,
maybe it will be fixed...


As mentioned on this list using a unicode (utf) engine with bibtex is 
somewhat tricky. Interesting is that a similar problem occurred with 
url's: bibtex has hard coded line lengths and if I'm right there has 
been a fix that made lines wrap on spaces. However that does not help 
with scripts that have no spaces. Somewhat strange is that bibtex was 
not made compliant to other tex related programs in the sense that one 
can configure the line length (which we would then set to 1000 or so).


In spite of repeated announcements of bibtex 1.0 (which would probably 
not fix this issue anyway) it looks like the program is deep frozen. 
Unfortunately it also has frozen some conventions that make it hard to 
replace it.


Fixing it is probably something that an able programmer can do while 
watching a movie at the same time were it not that touching bibtex seems 
to be some kind of sacrilege.


I can imagine that someone makes a copy of bibtex, say ctxbibtex, 
patches it to accept long lines and that we ship that one with context.


Hans

-
  Hans Hagen | PRAGMA ADE
  Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
 | www.pragma-pod.nl
-
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___


Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-30 Thread Alexandre Krispin
 or external command,
  operable program or batch file.
 
  mtx-epub| epub archive: test.tree/test.epubExit code: 0
 
  %%End Script Output
 
  I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19
  int: english/english on a Windows 7 machine and the test.tex file is the
  |export-example.tex file renamed from the Minimals distribution|.
 
  Thanks
  Keith McKay
 
  -- next part --
  An HTML attachment was scrubbed...
  URL: 
 http://www.ntg.nl/pipermail/ntg-context/attachments/2027/f306eade/attachment-0001.html
 
 
  --
 
  Message: 5
  Date: Sun, 27 Nov 2011 14:33:32 +0100
  From: Mojca Miklavec mojca.miklavec.li...@gmail.com
  To: mailing list for ConTeXt users ntg-context@ntg.nl
  Subject: Re: [NTG-context] Error while compiling : ! String contains
an invalid utf-8 sequence.
  Message-ID:
CALBOmsYJRQenBGJdBKtv85RY=
 zud_g7oybmyw7hxxoxc6zz...@mail.gmail.com
  Content-Type: text/plain; charset=UTF-8
 
  2011/11/26 Alexandre Krispin wrote:
  Now that japanese display correctly, there is still another problem.
  Japanese sentences (long titles in bibliography) don't break at the
 end of
  line. I have tested the behavior of japanese with entire paragraphs,
 and I
  get the same problem as in the bibliography, lines don't break and go
  through the page.
 
  Though I have looked to documentation about chinese on the wiki, none
 helped
  me to solve this problem. Does someone have any idea ?
 
  My first guess is that ConTeXt doesn't know how to hyphenate / split
  words or sentences without space. I don't know what the Japanese
  typesetting rules are, but if nothing is implemented yet, it cannot
  work.
 
  Mojca

 I'm interested in Japanese to work as well... Should be easy - no
 hyphenation, just split the word when the line is full and continue on
 the next one. There are some more subtle rules for vertical typesetting
 (e.g. full stops 。 and commas 、 hang over), but for horizontal
 typesetting you'd just want to split the line anywhere...

 Can that be done?

 Severin


 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl /
 http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net

 ___




 --

 --
 Alexandre KRISPIN
 41 rue Guynemer  |  93200 Saint-Denis  |  France
 tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

 




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-28 Thread Alexandre Krispin
, 27 Nov 2011 14:33:32 +0100
  From: Mojca Miklavec mojca.miklavec.li...@gmail.com
  To: mailing list for ConTeXt users ntg-context@ntg.nl
  Subject: Re: [NTG-context] Error while compiling : ! String contains
an invalid utf-8 sequence.
  Message-ID:
CALBOmsYJRQenBGJdBKtv85RY=
 zud_g7oybmyw7hxxoxc6zz...@mail.gmail.com
  Content-Type: text/plain; charset=UTF-8
 
  2011/11/26 Alexandre Krispin wrote:
  Now that japanese display correctly, there is still another problem.
  Japanese sentences (long titles in bibliography) don't break at the end
 of
  line. I have tested the behavior of japanese with entire paragraphs,
 and I
  get the same problem as in the bibliography, lines don't break and go
  through the page.
 
  Though I have looked to documentation about chinese on the wiki, none
 helped
  me to solve this problem. Does someone have any idea ?
 
  My first guess is that ConTeXt doesn't know how to hyphenate / split
  words or sentences without space. I don't know what the Japanese
  typesetting rules are, but if nothing is implemented yet, it cannot
  work.
 
  Mojca

 I'm interested in Japanese to work as well... Should be easy - no
 hyphenation, just split the word when the line is full and continue on
 the next one. There are some more subtle rules for vertical typesetting
 (e.g. full stops 。 and commas 、 hang over), but for horizontal
 typesetting you'd just want to split the line anywhere...

 Can that be done?

 Severin


 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl /
 http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net

 ___




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-28 Thread Wolfgang Schuster

Am 26.11.2011 um 00:56 schrieb Alexandre Krispin:

 Now that japanese display correctly, there is still another problem. Japanese 
 sentences (long titles in bibliography) don't break at the end of line. I 
 have tested the behavior of japanese with entire paragraphs, and I get the 
 same problem as in the bibliography, lines don't break and go through the 
 page.

As I already told you need “\setscript[hanzi]” to enable linbreaks for chinese 
and japanese.

Instead of a global setting you can also write

\startscript[hanzi]
…
\stopscript

to enable linebreaking for a area.

Another valid form for \setscript[hanzi] is the command \hanzi which is a 
shortcut for the longer definition.

 Though I have looked to documentation about chinese on the wiki, none helped 
 me to solve this problem. Does someone have any idea ?
 
 Here is a minimal example with a paragraph sample in japanese :
 %beginning of file%%
 \usemodule[simplefonts]
 \setmainfont[HeiseiMinStd-W3]
 \definesimplefonttypeface[jpn][HeiseiMinStd-W3]
 \setupbodyfont[12pt]
 \setuptolerance[\v!verytolerant,\v!stretch]

Don’t use the “\v!” prefix for settings in your document, in this case it’s 
harmless but there can be cases
where you don’t get the expected result of this because in normal text “\v” is 
a command to place a accent
over the next character (here the “!”).

 \enableregime[utf]

This is not necessary because MkIV use UTF-8 by default.

 \usemodule[typearea]
 \setupTypeArea[bcor=30mm,alphabets=2.6,oneside]

You can’t mix keywords and assignments in the same argument of a setup command,
to use the onside option you have to write “oneside=yes”.

Wolfgang
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___


Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-27 Thread Mojca Miklavec
2011/11/26 Alexandre Krispin wrote:
 Now that japanese display correctly, there is still another problem.
 Japanese sentences (long titles in bibliography) don't break at the end of
 line. I have tested the behavior of japanese with entire paragraphs, and I
 get the same problem as in the bibliography, lines don't break and go
 through the page.

 Though I have looked to documentation about chinese on the wiki, none helped
 me to solve this problem. Does someone have any idea ?

My first guess is that ConTeXt doesn't know how to hyphenate / split
words or sentences without space. I don't know what the Japanese
typesetting rules are, but if nothing is implemented yet, it cannot
work.

Mojca
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___


Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-27 Thread Alexandre Krispin
Thank you !

But with the scripts for chinese characters, I got the expected result :)

Cheers,
Alexandre Krispin

2011/11/27 Mojca Miklavec mojca.miklavec.li...@gmail.com

 2011/11/26 Alexandre Krispin wrote:
  Now that japanese display correctly, there is still another problem.
  Japanese sentences (long titles in bibliography) don't break at the end
 of
  line. I have tested the behavior of japanese with entire paragraphs, and
 I
  get the same problem as in the bibliography, lines don't break and go
  through the page.
 
  Though I have looked to documentation about chinese on the wiki, none
 helped
  me to solve this problem. Does someone have any idea ?

 My first guess is that ConTeXt doesn't know how to hyphenate / split
 words or sentences without space. I don't know what the Japanese
 typesetting rules are, but if nothing is implemented yet, it cannot
 work.

 Mojca

 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl /
 http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net

 ___




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-27 Thread S Barmeier
-context] error with \showlayout and export
 Message-ID: 0bce3119-7d79-43b9-a159-62bc07980...@googlemail.com
 Content-Type: text/plain; charset=us-ascii
 
 
 Am 27.11.2011 um 12:11 schrieb Henning Hraban Ramm:
 
 Hi wizards,

 if I use \showlayout in a project where I setup export=yes, ConTeXt stops 
 with a fatal error.

 Minimal failing example:

 \setupbackend[export=yes]
 \starttext
 \showlayout
 \stoptext
 
 I think this change in back-exp.lua should work (runs at least without an 
 error message):
 
 function extras.tabulate(result,element,detail,n,fulltag,di)
 local data = di.data
 for i=1,#data do
 local di = data[i]
 if di.tg == tabulaterow then
 local did = di.data
 local content = false
 for i=1,#did do
 local d = did[i].data
 --  local c = d and c.content
 local c = d and d.content
 if c and #c  0 then
 content = true
 break
 end
 end
 if not content then
 di.element =  -- or simply remove
 end
 end
 end
 end
 
 Wolfgang
 
 --
 
 Message: 3
 Date: Sun, 27 Nov 2011 13:40:51 +0100
 From: Henning Hraban Ramm hra...@fiee.net
 To: mailing list for ConTeXt users ntg-context@ntg.nl
 Subject: [NTG-context] page number in margin
 Message-ID: 90a69805-bcec-4a6c-bc89-5fa243c9c...@fiee.net
 Content-Type: text/plain; charset=WINDOWS-1252; format=flowed;
   delsp=yes
 
 Hi again,
 
 I?d like to get my page numbers in the margin.
 This works:
 \setuppagenumbering[alternative=doublesided,location=margin]
 
 But that way it?s on the bottom of the footer margin; I'd like it on  
 the top.
 
 Second variant: Even better, I?d like my page number at the bottom of  
 the text margin. How can I achieve that?
 
 location option marginedge doesn?t seem to do anything, as far as i  
 can tell, and inright is the same as margin.
 
 Greetlings from Lake Constance!
 Hraban
 ---
 http://www.fiee.net/texnique/
 http://wiki.contextgarden.net
 https://www.cacert.org (I'm an assurer)
 
 
 
 --
 
 Message: 4
 Date: Sun, 27 Nov 2011 13:03:28 +
 From: Keith McKay mckaymeis...@gmail.com
 To: Ntg-Context ntg-context@ntg.nl
 Subject: [NTG-context] Export to epub
 Message-ID: 4ed23520.2070...@gmail.com
 Content-Type: text/plain; charset=iso-8859-1; Format=flowed
 
 Hi
 
 I've been playing about with Export in Context with a view to producing 
 ePubs.
 
 When I run the script:
 
 /mtxrun --script epub --make test.specification
 
 /the test.tree is prepared but no epub file.  The output shown below has 
 a couple or 'error' messages which are probably due to the way my text 
 editor is set up (Scite Version 2.02).  If anyone is using Scite and 
 producing ePubs I be grateful for some hints on how to set this up so 
 that inkscape and zip works.
 
 %%Script Output
 
 mtx-epub| creating paths in tree test.tree
 mtx-epub| copying toc.ncx to test.tree/OPS/toc.ncx
 mtx-epub| copying test-styles.css to test.tree/OPS/test-styles.css
 mtx-epub| copying test-images.css to test.tree/OPS/test-images.css
 mtx-epub| copying test.css to test.tree/OPS/test.css
 mtx-epub| copying test.xhtml to test.tree/OPS/test.xhtml
 mtx-epub| running command 'inkscape --export-plain-svg=cow.svg 
 cow.pdf'
 
 'inkscape' is not recognized as an internal or external command,
 operable program or batch file.
 
 mtx-epub| copying cow.svg to test.tree/OPS/cow.svg
 mtx-epub| copying hacker.jpg to test.tree/OPS/hacker.jpg
 mtx-epub| copying mill.png to test.tree/OPS/mill.png
 mtx-epub| creating archive
 
 'zip' is not recognized as an internal or external command,
 operable program or batch file.
 'zip' is not recognized as an internal or external command,
 operable program or batch file.
 'zip' is not recognized as an internal or external command,
 operable program or batch file.
 
 mtx-epub| epub archive: test.tree/test.epubExit code: 0
 
 %%End Script Output
 
 I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19  
 int: english/english on a Windows 7 machine and the test.tex file is the 
 |export-example.tex file renamed from the Minimals distribution|.
 
 Thanks
 Keith McKay
 
 -- next part --
 An HTML attachment was scrubbed...
 URL: 
 http://www.ntg.nl/pipermail/ntg-context/attachments/2027/f306eade/attachment-0001.html
 
 --
 
 Message: 5
 Date: Sun, 27 Nov 2011 14:33:32 +0100
 From: Mojca Miklavec mojca.miklavec.li...@gmail.com
 To: mailing list for ConTeXt users ntg-context@ntg.nl
 Subject: Re: [NTG-context] Error while compiling : ! String contains
   an invalid utf-8 sequence.
 Message-ID:
   CALBOmsYJRQenBGJdBKtv85RY=zud_g7oybmyw7hxxoxc6zz...@mail.gmail.com
 Content-Type: text/plain

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-26 Thread Alexandre Krispin
Hello,

Thanks to all for your answers !

Finally, thanks to an article dealing about Xelatex, bibtex files and utf-8
problem (see
http://skalldan.wordpress.com/2011/08/01/%E3%82%A4%E3%83%B3%E3%83%89%E5%AD%A6%E4%BB%8F%E6%95%99%E5%AD%A6%E3%81%AB%E3%81%8A%E3%81%91%E3%82%8B-utf-8-%E3%81%AB%E3%82%88%E3%82%8B-tex-%E6%96%87%E6%9B%B8%E4%BD%9C%E6%88%90-4/)
I got the idea how to solve my problem.

In the bib file I have surrounded all japanese words by {\jpn }, like in
this minimal example :
%beginning of the example%%%
@article{uzawa2011tpp,
author = Hirofumi Uzawa {\jpn 宇沢弘文}, Uchihashi Katsuto {\jpn 内橋克人},
journal = Sekai {\jpn 世界},
title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
{\jpn 対談TPPは社会的共通資本を破壊する},
year = 2011,
month = april,
publisher = Iwanami shoten {\jpn 岩波書店},
pages = 62-72,
url = http://ci.nii.ac.jp/naid/40018706510/;,
note = test
}
end of file%%

Then, thanks to the documentation for simplefonts I have introduced a
typeface definition, like in this minimal example :

%%beginning of file%
\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn][hiraginokakugothicpro]
\enableregime[utf8]

\setupbibtex[database=biblio]

\starttext
test
\completepublications[criterium=all]
{\jpn 知らない  金 11月 25, 2011  10:21午後}
\stoptext

%%end of file%%%

And everything works well when compiling the whole with context *tex.

The only question remaining in my mind is : is there another way ? Just out
of curiosity, since Hans Hagen mentioned Thomas who use greek.


2011/11/25 Hans Hagen pra...@wxs.nl

 On 25-11-2011 20:03, Christian wrote:

  Same here. It messes up when converting .bib to .bbl. Maybe check your
 bbl file, too. Mine looks like this, for example:
 a={{Hirofumi Uzawa~宇沢弘文}}

 You could try to write the .bbl file directly yourself, although that is
 not a comfortable option, if you have many Japanese entries.
 Apart from that there's not much coming to mind.


 It makes me wonder how Thomas gets his greek etc done in bibtex.

 Hans


 --**--**-
  Hans Hagen | PRAGMA ADE
  Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
 | www.pragma-pod.nl
 --**--**-

 __**__**
 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/**
 listinfo/ntg-context http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : 
 http://foundry.supelec.fr/**projects/contextrev/http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net
 __**__**
 ___




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-26 Thread Ulrike Fischer
Am Fri, 25 Nov 2011 19:50:52 +0100 schrieb Alexandre Krispin:

 Hello,
 
 I am trying to get japanese displayed in bibliography. But I get the error
 ! String contains an invalid utf-8 sequence. while compiling with the
 command context *tex.

 And here is the bib file :
 
 %%%beginning of file%%%
 @article{uzawa2011tpp,
 author = Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人,
 journal = Sekai 世界,
 title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
 対談TPPは社会的共通資本を破壊する,
 year = 2011,
 month = april,
 publisher = Iwanami shoten 岩波書店,
 pages = 62-72,
 url = http://ci.nii.ac.jp/naid/40018706510/;,
 }
 %%%end of file%%
 
 Do someone know how to get ride of utf-8 errors ? Or is this a problem with
 bibtex, 

Yes. bibtex is an 8-bit application. Your japanese characters
consist of three or four 8-bit-blocks. As bibtex has no knowledge
that these blocks should be keeped together it can happen that
bibtex breaks them in pieces e.g. at line ends and so you end with
invalid utf8. You could try to move the blocks a bit around e.g.
with braces or spaces so that bibtex finds a break point between the
utf8-chars and not in the middle of one of them. 


 and then should I use anything else to replace it ?
 (does something like Biber work ?)

Well in latex with biblatex it works and is the recommended
solution. But I don't know if context supports biber. 


-- 
Ulrike Fischer 

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-26 Thread Alexandre Krispin
Thanks Ulrike ! It seems the 2 messages I sent yesterday have been lost (I
have received a mail which might point out a delivery failure from the
mailing list) though it is written I don't need to send again the message,
in case, here is the copy of mails I sent. Now the only problem remaining
is that japanese sentences are not wrapped (long titles of books go through
the page). And though I took a look to documentation about chinese, I don't
know what I am missing.

***Beginning of first
mail

Hello,

Thanks to all for your answers !

Finally, thanks to an article dealing about Xelatex, bibtex files and utf-8
problem (see
http://skalldan.wordpress.com/2011/08/01/%E3%82%A4%E3%83%B3%E3%83%89%E5%AD%A6%E4%BB%8F%E6%95%99%E5%AD%A6%E3%81%AB%E3%81%8A%E3%81%91%E3%82%8B-utf-8-%E3%81%AB%E3%82%88%E3%82%8B-tex-%E6%96%87%E6%9B%B8%E4%BD%9C%E6%88%90-4/)
I got the idea how to solve my problem.

In the bib file I have surrounded all japanese words by {\jpn }, like in
this minimal example :
%beginning of the example%%%
@article{uzawa2011tpp,
author = Hirofumi Uzawa {\jpn 宇沢弘文}, Uchihashi Katsuto {\jpn 内橋克人},
journal = Sekai {\jpn 世界},

title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru

{\jpn 対談TPPは社会的共通資本を破壊する},

year = 2011,
month = april,

publisher = Iwanami shoten {\jpn 岩波書店},

pages = 62-72,
url = http://ci.nii.ac.jp/naid/40018706510/;,

note = test
}
end of file%%

Then, thanks to the documentation for simplefonts I have introduced a
typeface definition, like in this minimal example :

%%beginning of file%
\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn]
[hiraginokakugothicpro]

\enableregime[utf8]

\setupbibtex[database=biblio]

\starttext

test
\completepublications[criterium=all]
{\jpn 知らない  金 11月 25, 2011  10:21午後}
\stoptext

%%end of file%%%

And everything works well when compiling the whole with context *tex.

The only question remaining in my mind is : is there another way ? Just out
of curiosity, since Hans Hagen mentioned Thomas who use greek.

***End of first
mail

And the second mail :

***Beginning of second
mail
Now that japanese display correctly, there is still another problem.
Japanese sentences (long titles in bibliography) don't break at the end of
line. I have tested the behavior of japanese with entire paragraphs, and I
get the same problem as in the bibliography, lines don't break and go
through the page.

Though I have looked to documentation about chinese on the wiki, none
helped me to solve this problem. Does someone have any idea ?

Here is a minimal example with a paragraph sample in japanese :
%beginning of file%%
\usemodule[simplefonts]
\setmainfont[HeiseiMinStd-W3]
\definesimplefonttypeface[jpn]
[HeiseiMinStd-W3]
\setupbodyfont[12pt]
\setuptolerance[\v!verytolerant,\v!stretch]
\enableregime[utf]

\usemodule[typearea]
\setupTypeArea[bcor=30mm,alphabets=2.6,oneside]
%*
\starttext

そしてディズニー原理主義で考えた場合、「一秒24コマの絵」で作るフルアニメが至上。そのルールに照らした場合、「電脳コイル」より「らき☆すた(ハルヒ)」の方が優れている。
ニョロニョロと滑らかに動く。つまりそれだけ動画枚数を多く使ってる。よりフルアニメに近い。よって「電脳コイル<らき☆すた」となる。

コレに作画マニアは反論する。アニメは「アニメーターのスキル」こそが最も重要。「スキル>作画枚数」、だから優れたアニメーターである磯光雄の手掛けた電脳コイルのほうが偉い。
じゃあ磯光雄がフルアニメにしたら?今の2コマ3コマ打ちの磯光雄より偉いの?より優れてるの?

>フルアニメの磯光雄の方が優れている。
この場合、「リミテッドアニメという制約の中で独自の進化をした日本アニメのアイデンティティ」というのが無くなってしまう。「らき☆すた」には勝てるがファンタジアには負ける。
>2、3コマ打ちのリミテッドの磯光雄の方が優れている。
質としては等価(磯光雄の原画)でより量のあるフルアニメよりもリミテッドアニメの方が優れてる、その理由を言語化する必要がある。

じゃあ、そのリミテッドで手に入れた価値とは何?
例えば「フルアニメと同じ価値をリミテッド(より少ない動画枚数=コスト)で作れるという『省エネ』の部分にある」ってこと?ソレだと新たな創作的価値を別に産み出してないよね。
そうでないのなら動きの質がディズニーとはどう違うの?
\stoptext
%end of file%

I attach the corresponding pdf file I obtain after compilation.

***End of second
mail


2011/11/26 Ulrike Fischer ne...@nililand.de

 Am Fri, 25 Nov 2011 19:50:52 +0100 schrieb Alexandre Krispin:

  Hello,
 
  I am trying to get japanese displayed in bibliography. But I get the
 error
  ! String contains an invalid utf-8 sequence. while compiling with the
  command context *tex.

  And here is the bib file :
 
  %%%beginning of file%%%
  @article{uzawa2011tpp,
  author = Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人,
  journal = Sekai 世界,
  title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
  対談TPPは社会的共通資本を破壊する,
  year = 2011,
  month = april,
  publisher = Iwanami shoten 岩波書店,
  pages = 62-72,
  url = http://ci.nii.ac.jp/naid/40018706510/;,
  }
  %%%end of file%%
 
  Do someone know how to get ride of utf-8 errors ? Or is this a problem
 with
  bibtex,

 Yes. bibtex is an 8-bit 

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-26 Thread Wolfgang Schuster

Am 26.11.2011 um 11:44 schrieb Alexandre Krispin:

 Now that japanese display correctly, there is still another problem. Japanese 
 sentences (long titles in bibliography) don't break at the end of line. I 
 have tested the behavior of japanese with entire paragraphs, and I get the 
 same problem as in the bibliography, lines don't break and go through the 
 page.
 
 Though I have looked to documentation about chinese on the wiki, none helped 
 me to solve this problem. Does someone have any idea ?

Add “\setscript[hanzi]” to your document.

Wolfgang

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___


Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-26 Thread Alexandre Krispin
Thanks ! It worked perfectly !

Cheers,
Alexandre Krispin

2011/11/26 Wolfgang Schuster schuster.wolfg...@googlemail.com


 Am 26.11.2011 um 11:44 schrieb Alexandre Krispin:

  Now that japanese display correctly, there is still another problem.
 Japanese sentences (long titles in bibliography) don't break at the end of
 line. I have tested the behavior of japanese with entire paragraphs, and I
 get the same problem as in the bibliography, lines don't break and go
 through the page.
 
  Though I have looked to documentation about chinese on the wiki, none
 helped me to solve this problem. Does someone have any idea ?

 Add “\setscript[hanzi]” to your document.

 Wolfgang


 ___
 If your question is of interest to others as well, please add an entry to
 the Wiki!

 maillist : ntg-context@ntg.nl /
 http://www.ntg.nl/mailman/listinfo/ntg-context
 webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
 archive  : http://foundry.supelec.fr/projects/contextrev/
 wiki : http://contextgarden.net

 ___




-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

[NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-25 Thread Alexandre Krispin
Hello,

I am trying to get japanese displayed in bibliography. But I get the error
! String contains an invalid utf-8 sequence. while compiling with the
command context *tex.

Here is the tex file :

%%%beginning of file%%
\usemodule[simplefonts]
\setmainfont[hiraginokakugothicpro] %a japanese font
\enableregime[utf8]
\setupbibtex[database=biblio]

\starttext
\completepublications
\stoptext
%end of file

And here is the bib file :

%%%beginning of file%%%
@article{uzawa2011tpp,
author = Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人,
journal = Sekai 世界,
title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
対談TPPは社会的共通資本を破壊する,
year = 2011,
month = april,
publisher = Iwanami shoten 岩波書店,
pages = 62-72,
url = http://ci.nii.ac.jp/naid/40018706510/;,
}
%%%end of file%%

Do someone know how to get ride of utf-8 errors ? Or is this a problem with
bibtex, and then should I use anything else to replace it ? (does something
like Biber work ?)

Thanks for your help.

Cheers,
Alexandre Krispin

-- 
--
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-25 Thread Christian
 I am trying to get japanese displayed in bibliography. But I get the error !
 String contains an invalid utf-8 sequence. while compiling with the command
 context *tex.
 
 Here is the tex file :
 
 %%%beginning of file%%
 \usemodule[simplefonts]
 \setmainfont[hiraginokakugothicpro] %a japanese font \enableregime[utf8]
 \setupbibtex[database=biblio]
 
 \starttext
 \completepublications
 \stoptext
 %end of file
 
 And here is the bib file :
 
 %%%beginning of file%%%
 @article{uzawa2011tpp,
 author = Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人,
 journal = Sekai 世界,
 title = Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
 対談TPPは社会的共通資本を破壊する,
 year = 2011,
 month = april,
 publisher = Iwanami shoten 岩波書店,
 pages = 62-72,
 url = http://ci.nii.ac.jp/naid/40018706510/;,
 }
 %%%end of file%%
 
 Do someone know how to get ride of utf-8 errors ? Or is this a problem with
 bibtex, and then should I use anything else to replace it ? (does something
 like Biber work ?)
 

Same here. It messes up when converting .bib to .bbl. Maybe check your bbl 
file, too. Mine looks like this, for example:
a={{Hirofumi Uzawa~宇沢弘文}}

You could try to write the .bbl file directly yourself, although that is not a 
comfortable option, if you have many Japanese entries.
Apart from that there's not much coming to mind.

___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___

Re: [NTG-context] Error while compiling : ! String contains an invalid utf-8 sequence.

2011-11-25 Thread Hans Hagen

On 25-11-2011 20:03, Christian wrote:


Same here. It messes up when converting .bib to .bbl. Maybe check your bbl 
file, too. Mine looks like this, for example:
a={{Hirofumi Uzawa~宇沢弘文}}

You could try to write the .bbl file directly yourself, although that is not a 
comfortable option, if you have many Japanese entries.
Apart from that there's not much coming to mind.


It makes me wonder how Thomas gets his greek etc done in bibtex.

Hans


-
  Hans Hagen | PRAGMA ADE
  Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
 | www.pragma-pod.nl
-
___
If your question is of interest to others as well, please add an entry to the 
Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___