Re: BUG: control character in text input --> not well-formed

[Dirk]

Hello Ferry,

I have analyzed the problem and this is one of the cases that I don't 
know how to handle. I have removed all private information and will post 
this answer publically.

The reason is, that you have a garbaged record in your database. The 
problem is, that one of the garbaged cacharcters is 12d or 0x0c, the 
letter "FF" in the windows-1252 or ANSI codepage.This character is 
passed through unchanged since it is only a "space control character".

No the big question: How to deal with the situation?

1.) Does analyze detect this problem and fix the broken record?
2.) Shall we exclude the character from beeing outputted within "ssphys"?
3.) Shall we filter the character in vss2svn?

As a workaround you can modify the line 1105 in vss2svn.pl [1] to also 
include the "x0c" character.

>    $gSysOut =~ 
s/[\x00-\x09\x0c\x11\x12\x14-\x1F\x81\x8D\x8F\x90\x9D]/_/g; # just to be 
sure

But what is the general solution?

Best regards
Dirk


[1] 
http://www.pumacode.org/projects/vss2svn/browser/trunk/script/vss2svn.pl#L1105


This happens, when vss goes crazy. One of your records is completly
corrupted. Could you please send me also the ANPAAAAA file without any
extension? Then I will have a look, whether we can fix this.
    
While trying to convert a VSS database to subversion I encountered this:

"ssphys" info -ewindows-1252 "w:/data/A/ANPAAAAA"
WARNING: control character 0x12 in text input at character 2
WARNING: control character 0x01 in text input at character 1
WARNING: control character 0x01 in text input at character 1
WARNING: control character 0x12 in text input at character 2

not well-formed (invalid token) at line 23, column 16, byte 804 at 
/PerlApp/XML/ Parser.pm line 187

after which the conversion process stops.

anybody an idea as how to solve this?
I tried UTF-8 encoding but then the process already stops in LOADVSSNAMES
      
ssphys 0.22.0, Build 275
vss2svn-nightly-20070214.zip

debug output below

------ debug output ------
physdir: "w:/data", physfolder: "A" physname: "ANPAAAAA"
"ssphys" info -ewindows-1252 "w:/data/A/ANPAAAAA"
WARNING: control character 0x12 in text input at character 2
WARNING: control character 0x01 in text input at character 1
WARNING: control character 0x01 in text input at character 1
WARNING: control character 0x12 in text input at character 2
<?xml version="1.0" encoding="windows-1252" ?>
<File Name="w:/data/A/ANPAAAAA">
    <ItemInfo offset="52">
      
...
    </ItemInfo>
    <CheckOut offset="416">
        <Comment>&#8734;&#9496;</Comment>
        <ParentSpec>ö</ParentSpec>
        <Computer>ö</Computer>
        <Folder>&#9792;&#963;</Folder>
        <User></User>
    </CheckOut>
      

_______________________________________________
vss2svn-users mailing list
Project homepage:
http://www.pumacode.org/projects/vss2svn/
Subscribe/Unsubscribe/Admin:
http://lists.pumacode.org/mailman/listinfo/vss2svn-users-lists.pumacode.org
Mailing list web interface (with searchable archives):
http://dir.gmane.org/gmane.comp.version-control.subversion.vss2svn.user