On 15 September 2012 04:20, Csaba Kos <[email protected]> wrote: > I think now would be a good time to discuss the possibility of a more generic > text conversion framework, i.e. not only UTF16 to UTF8 but also SHIFT-JIS > to UTF8, and so on. Also CR+NL to NL conversion could be handled by such > framework as well. One possibility is to support calling of an external > command > which could be specified in some "...-glob" setting. >
This is not such a good idea. Converting well-formed UTF-16 into UTF-8 is lossless and fully reversible so even in the case some random binary file is mis-detected as UTF-16 text it is not clobbered by the conversion given well-formedness is a requirement for it to be detected so. As long as the resulting object is properly marked as converted or the conversion is only used for generating diffs, not storing the file this is fine. SJIS conversion and CR/LF conversion do not behave that way. CR/LF conversions are very useful for projects spanning multiple platforms, though. Thanks Michal _______________________________________________ fossil-users mailing list [email protected] http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
