Good sleuthing, Bob! With Gary's modifications, the user will be able to specify the encoding of the import file, avoiding the need to translate it.
On Sat, Mar 28, 2020 at 10:31 AM Bob Atchley <[email protected]> wrote: > Hi Janne, > > I've carried out a similar import from my Youshiko weather station and > came across exactly the same issue. I'm an Emacs user and looking at the > csv file exported from the Youshiko software in hexl-mode it would appear > that the csv file is exported in UTF-16 format rather than ASCII. I can > think of no conceivable reason for doing this and assume it is a bug (of > course LibreOffice and even emacs render this perfectly, so quite difficult > to detect). If you open the file in a simpler editor such as nano it is > much clearer that something is very wrong. > > So a conversion from UTF-16 to ASCII is needed before attempting to use > the weewx import utility. > > I found 2 ways of doing this > 1) open a new file in nano. Open the the csv file in Emacs (or probably > any editor that renders it correctly) and copy the contents of the file and > paste it into the nano editor and save > 2) From the command line: > $ iconv -f UTF-16 -t ASCII//TRANSLIT input.csv -o output.csv > > I used method 1) (I expect you did something similar as well even if > accidentally). Method 2 is not perfect, and probably needs more work. > > But to be clear a CSV file would normally be expected to be ASCII, so this > is not a weewx import issue. > > Hope this helps if you need to do another import in the future > > Regards > > Bob > > -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/6c5e21fc-21e8-483d-8646-64ec2f605080%40googlegroups.com > <https://groups.google.com/d/msgid/weewx-user/6c5e21fc-21e8-483d-8646-64ec2f605080%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CAPq0zEAYtPJeYNSd_2GTnZGiLv9rGgb%3DEX_%3DbORiT-nbrpxZ8g%40mail.gmail.com.
