> I am having some trouble loading tiddlers with special characters (the > Danish letters æ, ø and å). > I’m using the ImportTiddlersPlugin and the Danish letters appear as > Chinese characters after importing them.
> Using the CreateTiddlersFromCSV there is no such error. Your problem arises due to some very subtle Unicode vs. UTF-8 character encoding issues related to the TW core file I/O functions that ImportTiddlersPlugin uses to open and read local files (using OS- based filesystem access) or remote files (using XMLHttpRequest). These functions seem to have some problems dealing with languages that use extended character sets. Without correct recognition of the inbound character's encoding, *implicit* conversion of the incoming text data can occur simply by mis-interpreting 1-byte vs. 2-byte character encodings. In comparison, CreateTiddlersFromCSV does not read from files... instead, you manually copy/paste the data into the multi-line text input in the form. This, of course, completely bypasses the core's encoding issues, as the data transfer into the edit field is being done via OS-based clipboard activities, rather than direct or remote file I/O functions. Of course, this is a troubling problem. TiddlyWiki is supposed to handle alternative multi-byte character sets. I'm sure it's just a small fix (like adding an explicit call to a character conversion function somewhere deep in the core code), but it's probably going to take a while to figure out where and why things are not currently working as intended. -e --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/tiddlywiki?hl=en -~----------~----~----~----~------~----~------~--~---
