[CODE4LIB] III loading module cannot handle non-English characters

2013-01-22 Thread Han, Yan
Hello, 
We have problems using III loading module to load MARC files (.mrc) to our 
catalog.  This is to use Data Exchange  Load Electronic Records (itm). 
Basically  non- English characters (French, Arabic ) will be changed to unknown 
symbols. The MARC files (.mrk and .mrc) are verified before loading to III. 
There are only two issues:
1. the III configuration might be wrong. 
2. The III loading module has a bug and it probably does not know how to deal 
with non-English characters.  

Anyone having similar experience or resolving it? 
Thanks,
Yan


Re: [CODE4LIB] III loading module cannot handle non-English characters

2013-01-22 Thread Becky Yoose
Hi Yan,

You might find some folks who've encountered similar issues on the IUG
listserv [1]. While we haven't had the same issue as you are having, we've
had other issues with encoding and diacritics with III in the past, even
though we went through the Unicode database conversion years ago.

[1] http://innovativeusers.org/iug-discussion-list

Thanks,
Becky

On Fri, Jan 18, 2013 at 6:02 PM, Han, Yan h...@u.library.arizona.eduwrote:

 Hello,
 We have problems using III loading module to load MARC files (.mrc) to our
 catalog.  This is to use Data Exchange  Load Electronic Records (itm).
 Basically  non- English characters (French, Arabic ) will be changed to
 unknown symbols. The MARC files (.mrk and .mrc) are verified before loading
 to III. There are only two issues:
 1. the III configuration might be wrong.
 2. The III loading module has a bug and it probably does not know how to
 deal with non-English characters.

 Anyone having similar experience or resolving it?
 Thanks,
 Yan



Re: [CODE4LIB] III loading module cannot handle non-English characters

2013-01-22 Thread McDonald, Stephen
It sounds like your catalog is set to use MARC-8 encoding, and you are trying 
to load records with UTF8 encoding.  You can use MarcEdit to change the 
encoding of the records to MARC-8, or you can ask III to switch your encoding 
to UTF8 (which may require a service fee).

Steve McDonald
steve.mcdon...@tufts.edu


 -Original Message-
 From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
 Han, Yan
 Sent: Friday, January 18, 2013 7:03 PM
 To: CODE4LIB@LISTSERV.ND.EDU
 Subject: [CODE4LIB] III loading module cannot handle non-English characters
 
 Hello,
 We have problems using III loading module to load MARC files (.mrc) to our
 catalog.  This is to use Data Exchange  Load Electronic Records (itm).
 Basically  non- English characters (French, Arabic ) will be changed to
 unknown symbols. The MARC files (.mrk and .mrc) are verified before
 loading to III. There are only two issues:
 1. the III configuration might be wrong.
 2. The III loading module has a bug and it probably does not know how to
 deal with non-English characters.
 
 Anyone having similar experience or resolving it?
 Thanks,
 Yan