On Friday, November 9, 2012 4:39:57 PM UTC-6, Jay Heyl wrote: > I have some files that came from an outside organization containing Byte > Order Marks. Looking at these files with a hex editor I can see the BOM is > that for a UTF-8 file. I don't think I configured the 'fileencodings' for > Vim, but checking the variables it is using > fileencodings=ucs-bom,utf-8,default,latin1. With this, Vim fails to read > these files properly. I've seen oddly varying behavior as I try different > things, but it usually changes the BOM to indicate UTF-16 (big-endian). This > results in improper display of many characters. > > > > > > If I change my configuration so 'encoding' is utf-8, then the file is > displayed correctly, though the BOM sometimes shows up as UTF-16 in hex (<FE > FF>) and other times as UTF-8 as normal, though funny looking, characters. > > > > > Since I don't need to send these files back out anywhere and the BOM is just > unnecessary junk to me, I've used the hex editor to get rid of them and Vim > behaves like normal. But I'm still curious what is going on with Vim and the > BOMs. Can anyone explain why Vim is apparently thinking these files are or > should be UTF-16 when the BOM clearly indicates they're UTF-8? Or perhaps > just suggest some better settings so Vim will behave in a logical manner in > regards to file encoding? >
I don't know why Vim would mis-detect the encoding, but Vim cannot display unicode text if it is not using a unicode setting for 'encoding'. The 'encoding' option tells Vim which encoding to use to internally store all text. http://vim.wikia.com/wiki/Working_with_Unicode Vim always reads files with a BOM just fine for me, with ucs-bom at the front of my own fileencodings option. Do you have trouble at all, if you set encoding to utf-8 at the very beginning of your .vimrc, and make sure fileencodings contains the ucs-bom? -- You received this message from the "vim_use" maillist. Do not top-post! Type your reply below the text you are replying to. For more information, visit http://www.vim.org/maillist.php
