Re: Importing a text file with German accented characters

2006-03-13 Thread Helge Hafting

Jon Riding wrote:

First of all I should like to add my thanks to the LyX developers for 
such a useful program. I'm still on 1.3 but I'm guessing the problem 
below applies to 1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my 
documents taken from data in Bantu and Nilotic group languages. Some 
of these include accented vowels and other characters that are not 
present in the European character sets (yes, the world really is 
bigger that N America and Europe).


It sure is.  And it is the responsibility of people who want support for 
their

favourite writing system to help add it. :-)



My data is all in UTF-8 and I'm guessing that LyX simply won't handle 
this unless I convert it all to ASCII and bodge the missing characters 
into a font below 255. I would then need to find a way of getting LyX 
to use this font at the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are 
plans to fix this?


Yes, there is a plan.  Unicode support is planned for lyx 1.5. 
Development of lyx 1.5 started at the same time lyx 1.4.0 was released.


Until this is done, you have to use one of the encodings lyx support.
Note that there are quite a few accented vowels in the various latin
encodings. Take a look at the user guide, section 6.8.3 Character Tables.
There you see everything lyx 1.3 and 1.4 can display today.

Switching to a special font can be done with ERT commands.  That
will be cumbersome.  If you have lots of this, consider making a small 
program

that converts from UTF-8 to whatever commands you need.

Helge Hafting



Re: Importing a text file with German accented characters

2006-03-13 Thread Helge Hafting

Jon Riding wrote:

First of all I should like to add my thanks to the LyX developers for 
such a useful program. I'm still on 1.3 but I'm guessing the problem 
below applies to 1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my 
documents taken from data in Bantu and Nilotic group languages. Some 
of these include accented vowels and other characters that are not 
present in the European character sets (yes, the world really is 
bigger that N America and Europe).


It sure is.  And it is the responsibility of people who want support for 
their

favourite writing system to help add it. :-)



My data is all in UTF-8 and I'm guessing that LyX simply won't handle 
this unless I convert it all to ASCII and bodge the missing characters 
into a font below 255. I would then need to find a way of getting LyX 
to use this font at the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are 
plans to fix this?


Yes, there is a plan.  Unicode support is planned for lyx 1.5. 
Development of lyx 1.5 started at the same time lyx 1.4.0 was released.


Until this is done, you have to use one of the encodings lyx support.
Note that there are quite a few accented vowels in the various latin
encodings. Take a look at the user guide, section 6.8.3 Character Tables.
There you see everything lyx 1.3 and 1.4 can display today.

Switching to a special font can be done with ERT commands.  That
will be cumbersome.  If you have lots of this, consider making a small 
program

that converts from UTF-8 to whatever commands you need.

Helge Hafting



Re: Importing a text file with German accented characters

2006-03-13 Thread Helge Hafting

Jon Riding wrote:

First of all I should like to add my thanks to the LyX developers for 
such a useful program. I'm still on 1.3 but I'm guessing the problem 
below applies to 1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my 
documents taken from data in Bantu and Nilotic group languages. Some 
of these include accented vowels and other characters that are not 
present in the European character sets (yes, the world really is 
bigger that N America and Europe).


It sure is.  And it is the responsibility of people who want support for 
their

favourite writing system to help add it. :-)



My data is all in UTF-8 and I'm guessing that LyX simply won't handle 
this unless I convert it all to ASCII and bodge the missing characters 
into a font below 255. I would then need to find a way of getting LyX 
to use this font at the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are 
plans to fix this?


Yes, there is a plan.  Unicode support is planned for lyx 1.5. 
Development of lyx 1.5 started at the same time lyx 1.4.0 was released.


Until this is done, you have to use one of the encodings lyx support.
Note that there are quite a few accented vowels in the various latin
encodings. Take a look at the user guide, section 6.8.3 "Character Tables".
There you see everything lyx 1.3 and 1.4 can display today.

Switching to a special font can be done with ERT commands.  That
will be cumbersome.  If you have lots of this, consider making a small 
program

that converts from UTF-8 to whatever commands you need.

Helge Hafting



Re: Importing a text file with German accented characters

2006-03-12 Thread Paul Smith
On 3/11/06, Nicholas Allen [EMAIL PROTECTED] wrote:
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters. However, I can type the characters on the
 keyboard and they are displayed no problem. I just don't feel like
 typing in a 100 page German document by hand! There must be a way to get
 this text file into Lyx isn't there?

Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul


Re: Importing a text file with German accented characters

2006-03-12 Thread Juergen Spitzmueller
Nicholas Allen wrote:
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters. However, I can type the characters on the
 keyboard and they are displayed no problem. I just don't feel like
 typing in a 100 page German document by hand! There must be a way to get
 this text file into Lyx isn't there?

You probably have to convert the text file from UTF-8 to latin1 first.

Jürgen


Re: Importing a text file with German accented characters

2006-03-12 Thread BEJ

Nicholas Allen wrote:

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters.


Can you do a find and replace for the junk characters? Or find and 
replace the accented characters in the source document with your own 
junk string, then find and replace with accented e in the document once 
it's been imported to LyX? Or open the document in another word 
processor and change the encoding?


Those are awkward work-arounds but until LyX is supporting UTF-8 those 
are the only options I know.


regards,
Beth
--
Friends don't let friends write junk.
http://slobbit.livejournal.com


Re: Importing a text file with German accented characters

2006-03-12 Thread Enrico Forestieri
Juergen Spitzmueller [EMAIL PROTECTED] writes:
 
 Nicholas Allen wrote:
  I hope someone can help me. I am trying to import a text file that
  contains German accented characters. The file is saved in UTF-8 format.
  How do I do this? If I use the import ASCII the accented characters
  appear as two junk characters. However, I can type the characters on the
  keyboard and they are displayed no problem. I just don't feel like
  typing in a 100 page German document by hand! There must be a way to get
  this text file into Lyx isn't there?
 
 You probably have to convert the text file from UTF-8 to latin1 first.

On Windows, this can be done by using type:

 type file.utf8  file.txt

will give you the latin1 version of file.utf8 in file.txt.

-- 
Enrico





Re: Importing a text file with German accented characters

2006-03-12 Thread Nicholas Allen

I did try this as well but got the same problem.
I just upgraded to 1.4 and the copy/paste seems to work better (the 
quotes come in as \u2013) but the accented characters are now imported ok.

Paul Smith wrote:


On 3/11/06, Nicholas Allen [EMAIL PROTECTED] wrote:
 


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters. However, I can type the characters on the
keyboard and they are displayed no problem. I just don't feel like
typing in a 100 page German document by hand! There must be a way to get
this text file into Lyx isn't there?
   



Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul

 





Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
BEJ wrote:

 Nicholas Allen wrote:
 
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters.
 

Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles
-- 
http://www.kde-france.org



Re: Importing a text file with German accented characters

2006-03-12 Thread Jon Riding
First of all I should like to add my thanks to the LyX developers for such a 
useful program. I'm still on 1.3 but I'm guessing the problem below applies to 
1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my documents 
taken from data in Bantu and Nilotic group languages. Some of these include 
accented vowels and other characters that are not present in the European 
character sets (yes, the world really is bigger that N America and Europe).


My data is all in UTF-8 and I'm guessing that LyX simply won't handle this 
unless I convert it all to ASCII and bodge the missing characters into a font 
below 255. I would then need to find a way of getting LyX to use this font at 
the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are plans to 
fix this?


Jon Riding
British  Foreign Bible Society
Machine Assisted Translation Team


Charles de Miramon wrote:

BEJ wrote:


Nicholas Allen wrote:


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters.


Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles


Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
Jon Riding wrote:
 
 I have a related problem with UTF-8 characters which judging from this
 discussion may not be achievable in LyX. I need to include text in my
 documents taken from data in Bantu and Nilotic group languages. Some of
 these include accented vowels and other characters that are not present in
 the European character sets (yes, the world really is bigger that N
 America and Europe).
 

Could you show some examples of these special vowels and characters.

Cheers,
Charles
-- 
http://www.kde-france.org



Re: Importing a text file with German accented characters

2006-03-12 Thread Paul Smith
On 3/11/06, Nicholas Allen [EMAIL PROTECTED] wrote:
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters. However, I can type the characters on the
 keyboard and they are displayed no problem. I just don't feel like
 typing in a 100 page German document by hand! There must be a way to get
 this text file into Lyx isn't there?

Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul


Re: Importing a text file with German accented characters

2006-03-12 Thread Juergen Spitzmueller
Nicholas Allen wrote:
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters. However, I can type the characters on the
 keyboard and they are displayed no problem. I just don't feel like
 typing in a 100 page German document by hand! There must be a way to get
 this text file into Lyx isn't there?

You probably have to convert the text file from UTF-8 to latin1 first.

Jürgen


Re: Importing a text file with German accented characters

2006-03-12 Thread BEJ

Nicholas Allen wrote:

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters.


Can you do a find and replace for the junk characters? Or find and 
replace the accented characters in the source document with your own 
junk string, then find and replace with accented e in the document once 
it's been imported to LyX? Or open the document in another word 
processor and change the encoding?


Those are awkward work-arounds but until LyX is supporting UTF-8 those 
are the only options I know.


regards,
Beth
--
Friends don't let friends write junk.
http://slobbit.livejournal.com


Re: Importing a text file with German accented characters

2006-03-12 Thread Enrico Forestieri
Juergen Spitzmueller [EMAIL PROTECTED] writes:
 
 Nicholas Allen wrote:
  I hope someone can help me. I am trying to import a text file that
  contains German accented characters. The file is saved in UTF-8 format.
  How do I do this? If I use the import ASCII the accented characters
  appear as two junk characters. However, I can type the characters on the
  keyboard and they are displayed no problem. I just don't feel like
  typing in a 100 page German document by hand! There must be a way to get
  this text file into Lyx isn't there?
 
 You probably have to convert the text file from UTF-8 to latin1 first.

On Windows, this can be done by using type:

 type file.utf8  file.txt

will give you the latin1 version of file.utf8 in file.txt.

-- 
Enrico





Re: Importing a text file with German accented characters

2006-03-12 Thread Nicholas Allen

I did try this as well but got the same problem.
I just upgraded to 1.4 and the copy/paste seems to work better (the 
quotes come in as \u2013) but the accented characters are now imported ok.

Paul Smith wrote:


On 3/11/06, Nicholas Allen [EMAIL PROTECTED] wrote:
 


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters. However, I can type the characters on the
keyboard and they are displayed no problem. I just don't feel like
typing in a 100 page German document by hand! There must be a way to get
this text file into Lyx isn't there?
   



Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul

 





Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
BEJ wrote:

 Nicholas Allen wrote:
 
 I hope someone can help me. I am trying to import a text file that
 contains German accented characters. The file is saved in UTF-8 format.
 How do I do this? If I use the import ASCII the accented characters
 appear as two junk characters.
 

Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles
-- 
http://www.kde-france.org



Re: Importing a text file with German accented characters

2006-03-12 Thread Jon Riding
First of all I should like to add my thanks to the LyX developers for such a 
useful program. I'm still on 1.3 but I'm guessing the problem below applies to 
1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my documents 
taken from data in Bantu and Nilotic group languages. Some of these include 
accented vowels and other characters that are not present in the European 
character sets (yes, the world really is bigger that N America and Europe).


My data is all in UTF-8 and I'm guessing that LyX simply won't handle this 
unless I convert it all to ASCII and bodge the missing characters into a font 
below 255. I would then need to find a way of getting LyX to use this font at 
the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are plans to 
fix this?


Jon Riding
British  Foreign Bible Society
Machine Assisted Translation Team


Charles de Miramon wrote:

BEJ wrote:


Nicholas Allen wrote:


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters.


Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles


Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
Jon Riding wrote:
 
 I have a related problem with UTF-8 characters which judging from this
 discussion may not be achievable in LyX. I need to include text in my
 documents taken from data in Bantu and Nilotic group languages. Some of
 these include accented vowels and other characters that are not present in
 the European character sets (yes, the world really is bigger that N
 America and Europe).
 

Could you show some examples of these special vowels and characters.

Cheers,
Charles
-- 
http://www.kde-france.org



Re: Importing a text file with German accented characters

2006-03-12 Thread Paul Smith
On 3/11/06, Nicholas Allen <[EMAIL PROTECTED]> wrote:
> I hope someone can help me. I am trying to import a text file that
> contains German accented characters. The file is saved in UTF-8 format.
> How do I do this? If I use the import ASCII the accented characters
> appear as two junk characters. However, I can type the characters on the
> keyboard and they are displayed no problem. I just don't feel like
> typing in a 100 page German document by hand! There must be a way to get
> this text file into Lyx isn't there?

Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul


Re: Importing a text file with German accented characters

2006-03-12 Thread Juergen Spitzmueller
Nicholas Allen wrote:
> I hope someone can help me. I am trying to import a text file that
> contains German accented characters. The file is saved in UTF-8 format.
> How do I do this? If I use the import ASCII the accented characters
> appear as two junk characters. However, I can type the characters on the
> keyboard and they are displayed no problem. I just don't feel like
> typing in a 100 page German document by hand! There must be a way to get
> this text file into Lyx isn't there?

You probably have to convert the text file from UTF-8 to latin1 first.

Jürgen


Re: Importing a text file with German accented characters

2006-03-12 Thread BEJ

Nicholas Allen wrote:

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters.


Can you do a find and replace for the junk characters? Or find and 
replace the accented characters in the source document with your own 
junk string, then find and replace with accented e in the document once 
it's been imported to LyX? Or open the document in another word 
processor and change the encoding?


Those are awkward work-arounds but until LyX is supporting UTF-8 those 
are the only options I know.


regards,
Beth
--
"Friends don't let friends write junk."
http://slobbit.livejournal.com


Re: Importing a text file with German accented characters

2006-03-12 Thread Enrico Forestieri
Juergen Spitzmueller <[EMAIL PROTECTED]> writes:
> 
> Nicholas Allen wrote:
> > I hope someone can help me. I am trying to import a text file that
> > contains German accented characters. The file is saved in UTF-8 format.
> > How do I do this? If I use the import ASCII the accented characters
> > appear as two junk characters. However, I can type the characters on the
> > keyboard and they are displayed no problem. I just don't feel like
> > typing in a 100 page German document by hand! There must be a way to get
> > this text file into Lyx isn't there?
> 
> You probably have to convert the text file from UTF-8 to latin1 first.

On Windows, this can be done by using type:

 type file.utf8 > file.txt

will give you the latin1 version of file.utf8 in file.txt.

-- 
Enrico





Re: Importing a text file with German accented characters

2006-03-12 Thread Nicholas Allen

I did try this as well but got the same problem.
I just upgraded to 1.4 and the copy/paste seems to work better (the 
quotes come in as "\u2013") but the accented characters are now imported ok.

Paul Smith wrote:


On 3/11/06, Nicholas Allen <[EMAIL PROTECTED]> wrote:
 


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters. However, I can type the characters on the
keyboard and they are displayed no problem. I just don't feel like
typing in a 100 page German document by hand! There must be a way to get
this text file into Lyx isn't there?
   



Just an idea, Nicholas: use copy and paste, previously selecting the
whole text document.

Paul

 





Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
BEJ wrote:

> Nicholas Allen wrote:
> 
>> I hope someone can help me. I am trying to import a text file that
>> contains German accented characters. The file is saved in UTF-8 format.
>> How do I do this? If I use the import ASCII the accented characters
>> appear as two junk characters.
> 

Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles
-- 
http://www.kde-france.org



Re: Importing a text file with German accented characters

2006-03-12 Thread Jon Riding
First of all I should like to add my thanks to the LyX developers for such a 
useful program. I'm still on 1.3 but I'm guessing the problem below applies to 
1.4.0 as well:


I have a related problem with UTF-8 characters which judging from this 
discussion may not be achievable in LyX. I need to include text in my documents 
taken from data in Bantu and Nilotic group languages. Some of these include 
accented vowels and other characters that are not present in the European 
character sets (yes, the world really is bigger that N America and Europe).


My data is all in UTF-8 and I'm guessing that LyX simply won't handle this 
unless I convert it all to ASCII and bodge the missing characters into a font 
below 255. I would then need to find a way of getting LyX to use this font at 
the appropriate points in the document.


Have I understood this correctly? Is there (please!) some easier way?

If LyX really can't handle Unicode data does anyone know if their are plans to 
fix this?


Jon Riding
British & Foreign Bible Society
Machine Assisted Translation Team


Charles de Miramon wrote:

BEJ wrote:


Nicholas Allen wrote:


I hope someone can help me. I am trying to import a text file that
contains German accented characters. The file is saved in UTF-8 format.
How do I do this? If I use the import ASCII the accented characters
appear as two junk characters.


Under Linux, you can use recode from the command line. It is a utility to
convert from one charset to another. You can even convert to LaTeX your
utf8 file.

Cheers,
Charles


Re: Importing a text file with German accented characters

2006-03-12 Thread Charles de Miramon
Jon Riding wrote:
 
> I have a related problem with UTF-8 characters which judging from this
> discussion may not be achievable in LyX. I need to include text in my
> documents taken from data in Bantu and Nilotic group languages. Some of
> these include accented vowels and other characters that are not present in
> the European character sets (yes, the world really is bigger that N
> America and Europe).
> 

Could you show some examples of these special vowels and characters.

Cheers,
Charles
-- 
http://www.kde-france.org



Importing a text file with German accented characters

2006-03-11 Thread Nicholas Allen

Hi,

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters. However, I can type the characters on the 
keyboard and they are displayed no problem. I just don't feel like 
typing in a 100 page German document by hand! There must be a way to get 
this text file into Lyx isn't there?


Thanks in advance for any help,

Nicholas Allen


Importing a text file with German accented characters

2006-03-11 Thread Nicholas Allen

Hi,

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters. However, I can type the characters on the 
keyboard and they are displayed no problem. I just don't feel like 
typing in a 100 page German document by hand! There must be a way to get 
this text file into Lyx isn't there?


Thanks in advance for any help,

Nicholas Allen


Importing a text file with German accented characters

2006-03-11 Thread Nicholas Allen

Hi,

I hope someone can help me. I am trying to import a text file that 
contains German accented characters. The file is saved in UTF-8 format. 
How do I do this? If I use the import ASCII the accented characters 
appear as two junk characters. However, I can type the characters on the 
keyboard and they are displayed no problem. I just don't feel like 
typing in a 100 page German document by hand! There must be a way to get 
this text file into Lyx isn't there?


Thanks in advance for any help,

Nicholas Allen