It's odd that SQLite doesn't support this, since it's not uncommun to have
big Latin1 input files that can take a while to load in eg. Excel.
For others' benefit, GNUWin32's iconv is very fast:
"C:\Program Files\GnuWin32\bin\iconv.exe" -f "windows-1252" -t "UTF-8"
"input.1252txt" >
On Nov 15, 2019, at 2:15 PM, Jose Isaias Cabrera wrote:
>
> Shawn Wagner, on Friday, November 15, 2019 04:01 PM, wrote...
>>
>> If you're on Windows, which cp1252 suggests, just make sure that you don't
>> end up with a BOM at the start of the file when you convert it. Windows
>> tools that
Unlike UTF-16, which uses 2 byte code units without a fixed endianess
(meaning to be robust you need to account for both little and big endian
encodings when reading files using it), UTF-8 uses a 1 byte code unit and
thus doesn't have any endian issues or a need for a byte order mark.
On Fri, Nov
Shawn Wagner, on Friday, November 15, 2019 04:01 PM, wrote...
>
> If you're on Windows, which cp1252 suggests, just make sure that you don't
> end up with a BOM at the start of the file when you convert it. Windows
> tools that output utf-8 are sometimes prone to add one even though it's
>
If you're on Windows, which cp1252 suggests, just make sure that you don't
end up with a BOM at the start of the file when you convert it. Windows
tools that output utf-8 are sometimes prone to add one even though it's
pointless to have.
On Linux etc., you can try
.import '| iconv -f cp1252 -t
Winfried, on Friday, November 15, 2019 03:13 PM, wrote...
>
> Hello,
>
> I have a big CSV file that's encoded in Latin1 (cp1252), while SQLite stores
> strings as Unicode.
>
> Neither Google nor ".help" helped to find if SQLite offers a switch to
> convert Latin1 to UTF-8 on the fly before
On 15 Nov 2019, at 20:13, Winfried wrote:
> I have a big CSV file that's encoded in Latin1 (cp1252), while SQLite stores
> strings as Unicode.
>
> Neither Google nor ".help" helped to find if SQLite offers a switch to
> convert Latin1 to UTF-8 on the fly before running the ".import" command.
>
>
Hello,
I have a big CSV file that's encoded in Latin1 (cp1252), while SQLite stores
strings as Unicode.
Neither Google nor ".help" helped to find if SQLite offers a switch to
convert Latin1 to UTF-8 on the fly before running the ".import" command.
Should I first convert the file into UTF-8
8 matches
Mail list logo
