I'd like to assist with that contribution. Assuming someone hasn't already done it by the time I click send. :)
SDR On Thu, Sep 13, 2012 at 2:08 PM, Richard Hipp <[email protected]> wrote: > > > On Thu, Sep 13, 2012 at 3:45 PM, Richard Hipp <[email protected]> wrote: > >> >> >> On Thu, Sep 13, 2012 at 3:43 PM, Kevin Greiner <[email protected]>wrote: >> >>> >>> I'm using fossil 1.23 on Windows 7. I'm attempting to store text files >>> generated by Microsoft SQL Server 2012 in fossil so I can easily track >>> their changes over time. >>> >>> The problem is that fossil thinks these generated text files are binary >>> data which prevents me from viewing the files via the web ui and generating >>> diffs. >>> >>> When I look at these files in a hex edtor, I see this: ff fe 53 00 45 >>> 00 54 00 20 00 41 00. A text editor shows "SET A". >>> >>> I've looked in the email list archive where DRH specifies that a null >>> character or a line longer than 8192 chars. The entire file is 1074 bytes >>> so it's not the length. Is fossil reading the 00 bytes as nulls? >>> >>> Any idea why fossil thinks these files are binary? And, more >>> importantly, what encoding I can specify to prevent this? I've tried >>> various permutations of ASCII, UTF8, UTF7 to no effect. >>> >> >> The file itself appears to be in utf16le. The "diff" facilities in >> Fossil currently only know how to deal with utf8. >> > > It would be an interesting project to enhance Fossil so that it could > support UTF16 in addition to UTF8. What would be needed is an algorithm to > detect when a file was UTF16. (The BOM at the beginning of Kevin's example > ought to be a big hint.) Then automatically call a convert routine to > generate UTF8 prior to passing the content into the diff logic, or into the > wiki engine, or prior to display on the UTF8 webpage, etc. > > Basically, we need a routine that converts an in-memory buffer from UTF16 > to UTF8, and leaves anything that isn't UTF16 unchanged. Then we need to > call that routine in a few strategic places inside of Fossil > > Volunteers to write that routine? I'll help identify the places where it > needs to be called. > > >> >> >>> >>> Thanks, >>> >>> Kevin >>> >>> _______________________________________________ >>> fossil-users mailing list >>> [email protected] >>> http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users >>> >>> >> >> >> -- >> D. Richard Hipp >> [email protected] >> > > > > -- > D. Richard Hipp > [email protected] > > _______________________________________________ > fossil-users mailing list > [email protected] > http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users > >
_______________________________________________ fossil-users mailing list [email protected] http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users

