Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/02/2010 05:21 PM, Paul Rubin wrote:
 Birte Schoettker schoettbier at gmail.com writes:
 
 at  Rainer: I would love to know that, too, how to identify non-ASCII
 characters in a bibtex file.
 
 On Linux (or probably most POSIX-compatible systems), you have the iconv
 command.  So
 
 iconv -t ASCII myfile.bib | grep iconv

Tanks for pointing this out - did not know about it. Thanks a lot.

Rainer

 
 will try to convert your .bib file to ASCII and, if it fails, print the error
 message iconv generated (which includes the position of the offending
 character).  The position is a character count, not a line/column pair, so it
 might be easier to go with
 
 iconv -t ASCII myfile.bib
 
 (which writes the converted file to the display) and see where in the file 
 iconv
 died.
 
 There are ports of iconv to Windows as well (I use the MinGW port at home).
 
 /Paul
 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz4siUACgkQoYgNqgF2egrxWgCeOoIBvDny6tyGBPXZIbQn+arC
KxUAn2J7hFZ2Elx/pRJVCdLcECT0X3XE
=E2P4
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/02/2010 05:21 PM, Paul Rubin wrote:
 Birte Schoettker schoettbier at gmail.com writes:
 
 at  Rainer: I would love to know that, too, how to identify non-ASCII
 characters in a bibtex file.
 
 On Linux (or probably most POSIX-compatible systems), you have the iconv
 command.  So
 
 iconv -t ASCII myfile.bib | grep iconv

Tanks for pointing this out - did not know about it. Thanks a lot.

Rainer

 
 will try to convert your .bib file to ASCII and, if it fails, print the error
 message iconv generated (which includes the position of the offending
 character).  The position is a character count, not a line/column pair, so it
 might be easier to go with
 
 iconv -t ASCII myfile.bib
 
 (which writes the converted file to the display) and see where in the file 
 iconv
 died.
 
 There are ports of iconv to Windows as well (I use the MinGW port at home).
 
 /Paul
 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz4siUACgkQoYgNqgF2egrxWgCeOoIBvDny6tyGBPXZIbQn+arC
KxUAn2J7hFZ2Elx/pRJVCdLcECT0X3XE
=E2P4
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/02/2010 05:21 PM, Paul Rubin wrote:
> Birte Schoettker  gmail.com> writes:
> 
>   Rainer: I would love to know that, too, how to identify non-ASCII
> characters in a bibtex file.
> 
> On Linux (or probably most POSIX-compatible systems), you have the iconv
> command.  So
> 
> iconv -t ASCII myfile.bib | grep iconv

Tanks for pointing this out - did not know about it. Thanks a lot.

Rainer

> 
> will try to convert your .bib file to ASCII and, if it fails, print the error
> message iconv generated (which includes the position of the offending
> character).  The position is a character count, not a line/column pair, so it
> might be easier to go with
> 
> iconv -t ASCII myfile.bib
> 
> (which writes the converted file to the display) and see where in the file 
> iconv
> died.
> 
> There are ports of iconv to Windows as well (I use the MinGW port at home).
> 
> /Paul
> 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz4siUACgkQoYgNqgF2egrxWgCeOoIBvDny6tyGBPXZIbQn+arC
KxUAn2J7hFZ2Elx/pRJVCdLcECT0X3XE
=E2P4
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/01/2010 07:55 PM, Richard Heck wrote:
 On 12/01/2010 08:00 AM, Birte Schoettker wrote:
 Hi all,

 I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib
 file for the references I use in Lyx via InsertList/TOCBiBTex
 Bibliography'.
 That all worked fine so far for the last 2 years, gaining insights
 about coding in jabref and dabandoning endnote for good on this way so
 far.

 What confuses me these days, is that I cannot recall to have changed
 anything relevant from last week to this in my *.bib reference file. I
 might have added about 10 more references or deleted a couple.
 However, the last times I tried to use my added bibliography in Lyx
 via Insert Citation it has been missing all entries in my *.bib
 file or jabref library alphabetically onwards from Wi*** to Z.
 The number of my references in my library is 1898 (!). Is there a
 cut-off I am not aware off?

 No, there's no cutoff. What's probably happening is that you have an
 illegal character in one of your entries, probably the first one that
 doesn't appear, and LyX is aborting the read when it sees it. This is a
 pretty common problem. It often happens when people cut and paste
 material from the web into JabRef and they get a funny quote or
 something in there. If you can manage to launch LyX from a terminal,
 then you will probably see the error message, which may also help. If
 not, you can send me the file privately, and I'll figure it out.
 
 Information that might be important:
 - coding of my library: Cp1252

 I don't know if that is an issue or not, but, ideally, BibTeX files
 should always be pure ASCII. If you need non-ASCII characters, then use
 the LaTeX equivalent.

That directly leads me to a question I asked earlier, but did not find
an answer to:

How can I easily identify non-ASCII characters in the bibtex file?

I struggled with this quite a lot (as I moved from a home made ACCESS
database to Reference Manager database to bibtex), and I THINK my bibtex
is now clean, but, I am not sure.

Is there a script which I could run to identify non-ASCII characters in
the bibtex file?


I am running Linux.

Cheers,

Rainer

 
 Richard
 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz3Z9cACgkQoYgNqgF2egqHbgCfeNVuMEQkFiHOEKiP+wRfEQDr
4JcAoICYpdiUWWoguCl/2CBAxmZQZIZY
=QwTs
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Birte Schoettker]

Hi all,

thank you very much for your quick and useful responses.

1. To cut the file in two did not make a difference.
2. I found a 'dodgy' reference in my list at Wa... (alphabetical order).
After that was removed, everything worked fine:).

@ Richard: Great hints. It must have been an illegal character, which I
could not immediately identify when looking at that reference and it was not
the first one that didn't appear. I will next time rather launch LyX from a
terminal and I will try ASCII encoding, but have to see how I go with my
special characters. Thank you for the kind offer of help.

@ Uwe: I thank you very much for your relevant comment; and you are right.
My list has resulted from the merger of a five year, multi-disciplinary
project. So, yes, I won't need all of them and should have 'cleaned out
earlier' for the sake of overview at least. And I do my best not to torture
the reviewer with inadequate referencing, though I might have been quite
thorough.

@ Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.


Delighted that things have progressed thanks to you all and I learned s.th.
again.
Cheers,
Birte

On 1 December 2010 19:18, Uwe Stöhr uwesto...@web.de wrote:

 Am 01.12.2010 14:00, schrieb Birte Schoettker:


  However, the last times I tried to use my added bibliography in Lyx via
 Insert Citation it has been missing all entries in my *.bib file or
 jabref library alphabetically onwards from Wi*** to Z.
 The number of my references in my library is 1898 (!). Is there a
 cut-off I am not aware off?


 That there is a cutoff is new to me. Does it help if you split your
 bib-file into 2 files and include them both to LyX?
 If not, does it help if you are using another citation style file (not
 harvard)?

 
 Just for my curiosity:


  Any help would be highly appreciated (my thesis is due in 4 weeks...yet
 again good timing, isn't it?:)).


 Respect! 1900s citation in one document is tough. Are you sure anybody
 will/can have a look at so many citations? I mean its the duty of the
 professors reviewing/supervising your thesis to look that the citations you
 made are correct. This already a lot of work for 100 citations. How do they
 do this for more than 1000?

 regards Uwe

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[stephen's mailinglist account]

 2. I found a 'dodgy' reference in my list at Wa... (alphabetical order).
 After that was removed, everything worked fine:).

I have ended up doing this - usually more than once until all problem
characters are removed.


 @ Uwe: I thank you very much for your relevant comment; and you are right.
 My list has resulted from the merger of a five year, multi-disciplinary
 project. So, yes, I won't need all of them and should have 'cleaned out
 earlier' for the sake of overview at least. And I do my best not to torture
 the reviewer with inadequate referencing, though I might have been quite
 thorough.

I also tend to use an enormous bibtex file primarily for managing my
references, and secondarily for inserting into documents.



 @ Rainer: I would love to know that, too, how to identify non-ASCII
 characters in a bibtex file.


The main culprits I have found are 'smart-quotes' and n-and m-dashes.
Some non-english accents are easier to spot, and occasionally symbols
can cause problems too. The problem characters are often in abstracts
or review fields.
Jabref works quite happily for looking references up though even with
all the illegal characters.

-- 
Stephen

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Paul Rubin]

Birte Schoettker schoettbier at gmail.com writes:

at  Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.

On Linux (or probably most POSIX-compatible systems), you have the iconv
command.  So

iconv -t ASCII myfile.bib | grep iconv

will try to convert your .bib file to ASCII and, if it fails, print the error
message iconv generated (which includes the position of the offending
character).  The position is a character count, not a line/column pair, so it
might be easier to go with

iconv -t ASCII myfile.bib

(which writes the converted file to the display) and see where in the file iconv
died.

There are ports of iconv to Windows as well (I use the MinGW port at home).

/Paul

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/01/2010 07:55 PM, Richard Heck wrote:
 On 12/01/2010 08:00 AM, Birte Schoettker wrote:
 Hi all,

 I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib
 file for the references I use in Lyx via InsertList/TOCBiBTex
 Bibliography'.
 That all worked fine so far for the last 2 years, gaining insights
 about coding in jabref and dabandoning endnote for good on this way so
 far.

 What confuses me these days, is that I cannot recall to have changed
 anything relevant from last week to this in my *.bib reference file. I
 might have added about 10 more references or deleted a couple.
 However, the last times I tried to use my added bibliography in Lyx
 via Insert Citation it has been missing all entries in my *.bib
 file or jabref library alphabetically onwards from Wi*** to Z.
 The number of my references in my library is 1898 (!). Is there a
 cut-off I am not aware off?

 No, there's no cutoff. What's probably happening is that you have an
 illegal character in one of your entries, probably the first one that
 doesn't appear, and LyX is aborting the read when it sees it. This is a
 pretty common problem. It often happens when people cut and paste
 material from the web into JabRef and they get a funny quote or
 something in there. If you can manage to launch LyX from a terminal,
 then you will probably see the error message, which may also help. If
 not, you can send me the file privately, and I'll figure it out.
 
 Information that might be important:
 - coding of my library: Cp1252

 I don't know if that is an issue or not, but, ideally, BibTeX files
 should always be pure ASCII. If you need non-ASCII characters, then use
 the LaTeX equivalent.

That directly leads me to a question I asked earlier, but did not find
an answer to:

How can I easily identify non-ASCII characters in the bibtex file?

I struggled with this quite a lot (as I moved from a home made ACCESS
database to Reference Manager database to bibtex), and I THINK my bibtex
is now clean, but, I am not sure.

Is there a script which I could run to identify non-ASCII characters in
the bibtex file?


I am running Linux.

Cheers,

Rainer

 
 Richard
 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz3Z9cACgkQoYgNqgF2egqHbgCfeNVuMEQkFiHOEKiP+wRfEQDr
4JcAoICYpdiUWWoguCl/2CBAxmZQZIZY
=QwTs
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Birte Schoettker]

Hi all,

thank you very much for your quick and useful responses.

1. To cut the file in two did not make a difference.
2. I found a 'dodgy' reference in my list at Wa... (alphabetical order).
After that was removed, everything worked fine:).

@ Richard: Great hints. It must have been an illegal character, which I
could not immediately identify when looking at that reference and it was not
the first one that didn't appear. I will next time rather launch LyX from a
terminal and I will try ASCII encoding, but have to see how I go with my
special characters. Thank you for the kind offer of help.

@ Uwe: I thank you very much for your relevant comment; and you are right.
My list has resulted from the merger of a five year, multi-disciplinary
project. So, yes, I won't need all of them and should have 'cleaned out
earlier' for the sake of overview at least. And I do my best not to torture
the reviewer with inadequate referencing, though I might have been quite
thorough.

@ Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.


Delighted that things have progressed thanks to you all and I learned s.th.
again.
Cheers,
Birte

On 1 December 2010 19:18, Uwe Stöhr uwesto...@web.de wrote:

 Am 01.12.2010 14:00, schrieb Birte Schoettker:


  However, the last times I tried to use my added bibliography in Lyx via
 Insert Citation it has been missing all entries in my *.bib file or
 jabref library alphabetically onwards from Wi*** to Z.
 The number of my references in my library is 1898 (!). Is there a
 cut-off I am not aware off?


 That there is a cutoff is new to me. Does it help if you split your
 bib-file into 2 files and include them both to LyX?
 If not, does it help if you are using another citation style file (not
 harvard)?

 
 Just for my curiosity:


  Any help would be highly appreciated (my thesis is due in 4 weeks...yet
 again good timing, isn't it?:)).


 Respect! 1900s citation in one document is tough. Are you sure anybody
 will/can have a look at so many citations? I mean its the duty of the
 professors reviewing/supervising your thesis to look that the citations you
 made are correct. This already a lot of work for 100 citations. How do they
 do this for more than 1000?

 regards Uwe

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[stephen's mailinglist account]

 2. I found a 'dodgy' reference in my list at Wa... (alphabetical order).
 After that was removed, everything worked fine:).

I have ended up doing this - usually more than once until all problem
characters are removed.


 @ Uwe: I thank you very much for your relevant comment; and you are right.
 My list has resulted from the merger of a five year, multi-disciplinary
 project. So, yes, I won't need all of them and should have 'cleaned out
 earlier' for the sake of overview at least. And I do my best not to torture
 the reviewer with inadequate referencing, though I might have been quite
 thorough.

I also tend to use an enormous bibtex file primarily for managing my
references, and secondarily for inserting into documents.



 @ Rainer: I would love to know that, too, how to identify non-ASCII
 characters in a bibtex file.


The main culprits I have found are 'smart-quotes' and n-and m-dashes.
Some non-english accents are easier to spot, and occasionally symbols
can cause problems too. The problem characters are often in abstracts
or review fields.
Jabref works quite happily for looking references up though even with
all the illegal characters.

-- 
Stephen

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Paul Rubin]

Birte Schoettker schoettbier at gmail.com writes:

at  Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.

On Linux (or probably most POSIX-compatible systems), you have the iconv
command.  So

iconv -t ASCII myfile.bib | grep iconv

will try to convert your .bib file to ASCII and, if it fails, print the error
message iconv generated (which includes the position of the offending
character).  The position is a character count, not a line/column pair, so it
might be easier to go with

iconv -t ASCII myfile.bib

(which writes the converted file to the display) and see where in the file iconv
died.

There are ports of iconv to Windows as well (I use the MinGW port at home).

/Paul

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Rainer M Krug]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 12/01/2010 07:55 PM, Richard Heck wrote:
> On 12/01/2010 08:00 AM, Birte Schoettker wrote:
>> Hi all,
>>
>> I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib
>> file for the references I use in Lyx via Insert>List/TOC>BiBTex
>> Bibliography'.
>> That all worked fine so far for the last 2 years, gaining insights
>> about coding in jabref and dabandoning endnote for good on this way so
>> far.
>>
>> What confuses me these days, is that I cannot recall to have changed
>> anything relevant from last week to this in my *.bib reference file. I
>> might have added about 10 more references or deleted a couple.
>> However, the last times I tried to use my added bibliography in Lyx
>> via "Insert> Citation" it has been missing all entries in my *.bib
>> file or jabref library alphabetically onwards from Wi*** to Z.
>> The number of my references in my library is 1898 (!). Is there a
>> cut-off I am not aware off?
>>
> No, there's no cutoff. What's probably happening is that you have an
> illegal character in one of your entries, probably the first one that
> doesn't appear, and LyX is aborting the read when it sees it. This is a
> pretty common problem. It often happens when people cut and paste
> material from the web into JabRef and they get a funny quote or
> something in there. If you can manage to launch LyX from a terminal,
> then you will probably see the error message, which may also help. If
> not, you can send me the file privately, and I'll figure it out.
> 
>> Information that might be important:
>> - coding of my library: Cp1252
>>
> I don't know if that is an issue or not, but, ideally, BibTeX files
> should always be pure ASCII. If you need non-ASCII characters, then use
> the LaTeX equivalent.

That directly leads me to a question I asked earlier, but did not find
an answer to:

How can I easily identify non-ASCII characters in the bibtex file?

I struggled with this quite a lot (as I moved from a home made ACCESS
database to Reference Manager database to bibtex), and I THINK my bibtex
is now clean, but, I am not sure.

Is there a script which I could run to identify non-ASCII characters in
the bibtex file?


I am running Linux.

Cheers,

Rainer

> 
> Richard
> 


- -- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation
Biology, UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Natural Sciences Building
Office Suite 2039
Stellenbosch University
Main Campus, Merriman Avenue
Stellenbosch
South Africa

Tel:+33 - (0)9 53 10 27 44
Cell:   +27 - (0)8 39 47 90 42
Fax (SA):   +27 - (0)8 65 16 27 82
Fax (D) :   +49 - (0)3 21 21 25 22 44
Fax (FR):   +33 - (0)9 58 10 27 44
email:  rai...@krugs.de

Skype:  RMkrug
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz3Z9cACgkQoYgNqgF2egqHbgCfeNVuMEQkFiHOEKiP+wRfEQDr
4JcAoICYpdiUWWoguCl/2CBAxmZQZIZY
=QwTs
-END PGP SIGNATURE-

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Birte Schoettker]

Hi all,

thank you very much for your quick and useful responses.

1. To cut the file in two did not make a difference.
2. I found a 'dodgy' reference in my list at "Wa..." (alphabetical order).
After that was removed, everything worked fine:).

@ Richard: Great hints. It must have been an illegal character, which I
could not immediately identify when looking at that reference and it was not
the first one that didn't appear. I will next time rather launch LyX from a
terminal and I will try ASCII encoding, but have to see how I go with my
special characters. Thank you for the kind offer of help.

@ Uwe: I thank you very much for your relevant comment; and you are right.
My list has resulted from the merger of a five year, multi-disciplinary
project. So, yes, I won't need all of them and should have 'cleaned out
earlier' for the sake of overview at least. And I do my best not to torture
the reviewer with inadequate referencing, though I might have been quite
thorough.

@ Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.


Delighted that things have progressed thanks to you all and I learned s.th.
again.
Cheers,
Birte

On 1 December 2010 19:18, Uwe Stöhr  wrote:

> Am 01.12.2010 14:00, schrieb Birte Schoettker:
>
>
>  However, the last times I tried to use my added bibliography in Lyx via
>> "Insert> Citation" it has been missing all entries in my *.bib file or
>> jabref library alphabetically onwards from Wi*** to Z.
>> The number of my references in my library is 1898 (!). Is there a
>> cut-off I am not aware off?
>>
>
> That there is a cutoff is new to me. Does it help if you split your
> bib-file into 2 files and include them both to LyX?
> If not, does it help if you are using another citation style file (not
> harvard)?
>
> 
> Just for my curiosity:
>
>
>  Any help would be highly appreciated (my thesis is due in 4 weeks...yet
>> again good timing, isn't it?:)).
>>
>
> Respect! 1900s citation in one document is tough. Are you sure anybody
> will/can have a look at so many citations? I mean its the duty of the
> professors reviewing/supervising your thesis to look that the citations you
> made are correct. This already a lot of work for 100 citations. How do they
> do this for more than 1000?
>
> regards Uwe
>

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[stephen's mailinglist account]

>
> 2. I found a 'dodgy' reference in my list at "Wa..." (alphabetical order).
> After that was removed, everything worked fine:).

I have ended up doing this - usually more than once until all problem
characters are removed.

>
> @ Uwe: I thank you very much for your relevant comment; and you are right.
> My list has resulted from the merger of a five year, multi-disciplinary
> project. So, yes, I won't need all of them and should have 'cleaned out
> earlier' for the sake of overview at least. And I do my best not to torture
> the reviewer with inadequate referencing, though I might have been quite
> thorough.

I also tend to use an enormous bibtex file primarily for managing my
references, and secondarily for inserting into documents.


>
> @ Rainer: I would love to know that, too, how to identify non-ASCII
> characters in a bibtex file.
>

The main culprits I have found are 'smart-quotes' and n-and m-dashes.
Some non-english accents are easier to spot, and occasionally symbols
can cause problems too. The problem characters are often in abstracts
or review fields.
Jabref works quite happily for looking references up though even with
all the illegal characters.

-- 
Stephen

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Paul Rubin]

Birte Schoettker  gmail.com> writes:

  Rainer: I would love to know that, too, how to identify non-ASCII
characters in a bibtex file.

On Linux (or probably most POSIX-compatible systems), you have the iconv
command.  So

iconv -t ASCII myfile.bib | grep iconv

will try to convert your .bib file to ASCII and, if it fails, print the error
message iconv generated (which includes the position of the offending
character).  The position is a character count, not a line/column pair, so it
might be easier to go with

iconv -t ASCII myfile.bib

(which writes the converted file to the display) and see where in the file iconv
died.

There are ports of iconv to Windows as well (I use the MinGW port at home).

/Paul

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Uwe Stöhr]

Am 01.12.2010 14:00, schrieb Birte Schoettker:


However, the last times I tried to use my added bibliography in Lyx via
Insert Citation it has been missing all entries in my *.bib file or
jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a
cut-off I am not aware off?


That there is a cutoff is new to me. Does it help if you split your 
bib-file into 2 files and include them both to LyX?
If not, does it help if you are using another citation style file (not 
harvard)?



Just for my curiosity:


Any help would be highly appreciated (my thesis is due in 4 weeks...yet
again good timing, isn't it?:)).


Respect! 1900s citation in one document is tough. Are you sure anybody 
will/can have a look at so many citations? I mean its the duty of the 
professors reviewing/supervising your thesis to look that the citations 
you made are correct. This already a lot of work for 100 citations. How 
do they do this for more than 1000?


regards Uwe

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Richard Heck]

On 12/01/2010 08:00 AM, Birte Schoettker wrote:

Hi all,

I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib 
file for the references I use in Lyx via InsertList/TOCBiBTex 
Bibliography'.
That all worked fine so far for the last 2 years, gaining insights 
about coding in jabref and dabandoning endnote for good on this way so 
far.


What confuses me these days, is that I cannot recall to have changed 
anything relevant from last week to this in my *.bib reference file. I 
might have added about 10 more references or deleted a couple.
However, the last times I tried to use my added bibliography in Lyx 
via Insert Citation it has been missing all entries in my *.bib 
file or jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a 
cut-off I am not aware off?


No, there's no cutoff. What's probably happening is that you have an 
illegal character in one of your entries, probably the first one that 
doesn't appear, and LyX is aborting the read when it sees it. This is a 
pretty common problem. It often happens when people cut and paste 
material from the web into JabRef and they get a funny quote or 
something in there. If you can manage to launch LyX from a terminal, 
then you will probably see the error message, which may also help. If 
not, you can send me the file privately, and I'll figure it out.



Information that might be important:
- coding of my library: Cp1252

I don't know if that is an issue or not, but, ideally, BibTeX files 
should always be pure ASCII. If you need non-ASCII characters, then use 
the LaTeX equivalent.


Richard

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Uwe Stöhr]

Am 01.12.2010 14:00, schrieb Birte Schoettker:


However, the last times I tried to use my added bibliography in Lyx via
Insert Citation it has been missing all entries in my *.bib file or
jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a
cut-off I am not aware off?


That there is a cutoff is new to me. Does it help if you split your 
bib-file into 2 files and include them both to LyX?
If not, does it help if you are using another citation style file (not 
harvard)?



Just for my curiosity:


Any help would be highly appreciated (my thesis is due in 4 weeks...yet
again good timing, isn't it?:)).


Respect! 1900s citation in one document is tough. Are you sure anybody 
will/can have a look at so many citations? I mean its the duty of the 
professors reviewing/supervising your thesis to look that the citations 
you made are correct. This already a lot of work for 100 citations. How 
do they do this for more than 1000?


regards Uwe

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Richard Heck]

On 12/01/2010 08:00 AM, Birte Schoettker wrote:

Hi all,

I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib 
file for the references I use in Lyx via InsertList/TOCBiBTex 
Bibliography'.
That all worked fine so far for the last 2 years, gaining insights 
about coding in jabref and dabandoning endnote for good on this way so 
far.


What confuses me these days, is that I cannot recall to have changed 
anything relevant from last week to this in my *.bib reference file. I 
might have added about 10 more references or deleted a couple.
However, the last times I tried to use my added bibliography in Lyx 
via Insert Citation it has been missing all entries in my *.bib 
file or jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a 
cut-off I am not aware off?


No, there's no cutoff. What's probably happening is that you have an 
illegal character in one of your entries, probably the first one that 
doesn't appear, and LyX is aborting the read when it sees it. This is a 
pretty common problem. It often happens when people cut and paste 
material from the web into JabRef and they get a funny quote or 
something in there. If you can manage to launch LyX from a terminal, 
then you will probably see the error message, which may also help. If 
not, you can send me the file privately, and I'll figure it out.



Information that might be important:
- coding of my library: Cp1252

I don't know if that is an issue or not, but, ideally, BibTeX files 
should always be pure ASCII. If you need non-ASCII characters, then use 
the LaTeX equivalent.


Richard

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Uwe Stöhr]

Am 01.12.2010 14:00, schrieb Birte Schoettker:


However, the last times I tried to use my added bibliography in Lyx via
"Insert> Citation" it has been missing all entries in my *.bib file or
jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a
cut-off I am not aware off?


That there is a cutoff is new to me. Does it help if you split your 
bib-file into 2 files and include them both to LyX?
If not, does it help if you are using another citation style file (not 
harvard)?



Just for my curiosity:


Any help would be highly appreciated (my thesis is due in 4 weeks...yet
again good timing, isn't it?:)).


Respect! 1900s citation in one document is tough. Are you sure anybody 
will/can have a look at so many citations? I mean its the duty of the 
professors reviewing/supervising your thesis to look that the citations 
you made are correct. This already a lot of work for 100 citations. How 
do they do this for more than 1000?


regards Uwe

Re: limit in number of reference entries in *.bib coming from jabref and used in lyx ? entries in reference list are cut off

[Richard Heck]

On 12/01/2010 08:00 AM, Birte Schoettker wrote:

Hi all,

I run Lyx 1.6.6.1 under Windows and use Jabref 2.6 to create my *.bib 
file for the references I use in Lyx via Insert>List/TOC>BiBTex 
Bibliography'.
That all worked fine so far for the last 2 years, gaining insights 
about coding in jabref and dabandoning endnote for good on this way so 
far.


What confuses me these days, is that I cannot recall to have changed 
anything relevant from last week to this in my *.bib reference file. I 
might have added about 10 more references or deleted a couple.
However, the last times I tried to use my added bibliography in Lyx 
via "Insert> Citation" it has been missing all entries in my *.bib 
file or jabref library alphabetically onwards from Wi*** to Z.
The number of my references in my library is 1898 (!). Is there a 
cut-off I am not aware off?


No, there's no cutoff. What's probably happening is that you have an 
illegal character in one of your entries, probably the first one that 
doesn't appear, and LyX is aborting the read when it sees it. This is a 
pretty common problem. It often happens when people cut and paste 
material from the web into JabRef and they get a funny quote or 
something in there. If you can manage to launch LyX from a terminal, 
then you will probably see the error message, which may also help. If 
not, you can send me the file privately, and I'll figure it out.



Information that might be important:
- coding of my library: Cp1252

I don't know if that is an issue or not, but, ideally, BibTeX files 
should always be pure ASCII. If you need non-ASCII characters, then use 
the LaTeX equivalent.


Richard