That exactly confirms my hunch. There are typically several ways to encode a single Unicode character. That's why normalization exists:
http://unicode.org/faq/normalization.html The decomposition used in HFS+ seems to be non-standard. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette On Mon, Feb 22, 2016 at 6:24 PM, Alan Orth <[email protected]> wrote: > Mystery solved: Mac OS X's HFS+ filesystem isn't UTF-8, it's UCS-2[0] (or > something Unicode-y, but NOT UTF-8), and it has some bizarre implementation > details: it apparently store filenames as a string instead of an array of > bytes, and it stores accented characters like รณ as an "o" followed by an > accent[1]. > > I had been running SAFBuilder on Mac OS X and then transferring (via scp) > the resulting SAF bundle to Linux for import. In this scenario, SAFBuilder > had processed my CSV's filenames from the HFS+ filesystem and saved them in > the bundle's contents files. Then, when DSpace's importer tries to find the > referenced files, the Linux ext4 filesystem says it doesn't have that file. > > I've just run a successful import of a subset of my problematic data after > running the SAFBuilder step on Linux. > > [0] > http://www.cio.com/article/2868393/linus-torvalds-apples-hfs-is-probably-the-worst-file-system-ever.html > [1] https://blog.vrypan.net/2012/11/13/hfsplus-unicode-and-accented-chars/ > > Regards, > > On Mon, Feb 22, 2016 at 4:01 PM helix84 <[email protected]> wrote: > >> How are you transferring the files between systems? If it's zip, that >> can mess up encodings, too. I'm more suspicious of the Mac side >> (filesystem) as I don't have experience with it. What about case >> sensitivity? HFS+ seems to be case insensitive by default. >> >> >> Regards, >> ~~helix84 >> >> Compulsory reading: DSpace Mailing List Etiquette >> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette >> > -- > > Alan Orth > [email protected] > https://englishbulgaria.net > https://alaninkenya.org > https://mjanja.ch > -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.
