[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.documentfoundation.org/show_bug.cgi?id=69744

Julien Nabet  changed:

   What|Removed |Added

 CC||serval2...@yahoo.fr

--- Comment #11 from Julien Nabet  ---
Following recent dBase commits (see
https://cgit.freedesktop.org/libreoffice/core/log/?qt=grep=dbase), the dbf
files open with RTL_TEXTENCODING_IBM_866 (Russian MS-DOS code page 866)
hexdump of the file shows this:
000 0d30 1809 0001  0148 0051  
010       6500 
020 808d 8287 8d80 8588  4300 0001 
030 0050 0004      
040 000d       
050        
*
140     d020 f1f3 eaf1 e9e8
150 f220 eae5 f2f1 2020 2020 2020 2020 2020
160 2020 2020 2020 2020 2020 2020 2020 2020
*
190 2020 2020 2020 2020 1a20   
19a

Let's read it in little-endian way, so first byte is 30 not 0d.
30 is version and corresponds here to VisualFoxPro file (see
http://opengrok.libreoffice.org/xref/core/connectivity/source/inc/dbase/DTable.hxx#40)
65 (in second line) indicates RTL_TEXTENCODING_IBM_866
Third line gives field name, its fieldtype and 50 from beginning "50" from line
gives indicates length field (80 in decimal).
But then lines 7 and 8 give content of the record but nothing about encoding.

So I don't know how LO could "guess" the encoding of the context except by
testing range value of charsets, eg:
d0 in https://www.ascii-codes.com/cp866.html gives "Box drawings up double and
horizontal single"
d0 in http://www.iana.org/assignments/charset-reg/PTCP154 gives "CYRILLIC
CAPITAL LETTER ER"
But even with this, a user could want some non cyrillic characters (bow
drawings) in content and the guessing would be wrong.

BTW, would be interested in dbf original with different versions (DB2, DB3,
DB4... with memo, with sql, ...FoxPro, etc.) and encodings.

-- 
You are receiving this mail because:
You are the assignee for the bug.___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.documentfoundation.org/show_bug.cgi?id=69744

QA Administrators  changed:

   What|Removed |Added

 Status|NEEDINFO|RESOLVED
 Resolution|--- |INVALID

--- Comment #10 from QA Administrators  ---
Dear Bug Submitter,

Please read this message in its entirety before proceeding.

Your bug report is being closed as INVALID due to inactivity and a lack of
information which is needed in order to accurately reproduce and confirm the
problem. We encourage you to retest your bug against the latest release. If the
issue is still present in the latest stable release, we need the following
information (please ignore any that you've already provided):

a) Provide details of your system including your operating system and the
latest version of LibreOffice that you have confirmed the bug to be present

b) Provide easy to reproduce steps – the simpler the better

c) Provide any test case(s) which will help us confirm the problem

d) Provide screenshots of the problem if you think it might help

e) Read all comments and provide any requested information

Once all of this is done, please set the bug back to UNCONFIRMED and we will
attempt to reproduce the issue. 
Please do not:
a) respond via email 
b) update the version field in the bug or any of the other details on the top
section of FDO
Message generated on: 2015-09-03

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.documentfoundation.org/show_bug.cgi?id=69744

--- Comment #9 from QA Administrators qa-ad...@libreoffice.org ---
Dear Bug Submitter,

This bug has been in NEEDINFO status with no change for at least 6 months.
Please provide the requested information as soon as possible and mark the bug
as UNCONFIRMED. Due to regular bug tracker maintenance, if the bug is still in
NEEDINFO status with no change in 30 days the QA team will close the bug as
INVALID due to lack of needed information.

For more information about our NEEDINFO policy please read the wiki located
here: 
https://wiki.documentfoundation.org/QA/FDO/NEEDINFO

If you have already provided the requested information, please mark the bug as
UNCONFIRMED so that the QA team knows that the bug is ready to be confirmed.


Thank you for helping us make LibreOffice even better for everyone!


Warm Regards,
QA Team

This NEEDINFO message was generated on: 2015-07-18

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #8 from Alex Thurgood ipla...@yahoo.co.uk ---
Adding self to CC if not already on

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

Owen Genat owen.ge...@gmail.com changed:

   What|Removed |Added

 Status|UNCONFIRMED |NEEDINFO
 Ever confirmed|0   |1

--- Comment #7 from Owen Genat owen.ge...@gmail.com ---
(In reply to comment #3)
 Seems to be a problem, because the field isn't created by the same
 character-set as the content.
 When I try to get the right field-description, I have to chose Kyrillisch
 DOS/OS2-866 in the German version of LO.
 When I try to get the right content-description, I have to use Kyrillisch
 PT154 or Kyrillisch Windows-1251.

I can confirm that opening (in Calc) the provided DBF under GNU/Linux using
v4.3.0.3 Build ID: 08ebe52789a201dd7d38ef653ef7a48925e7f9f7 this is displayed
for these character sets 

Cyrillic (DOS/OS2-866/Russian):
A1: НАЗВАНИЕ,C,80
A2: ╨єёёъшщ ЄхъёЄ

Cyrillic (PT154):
A1: ҚҖҮӮҖҚҲ…,C,80
A2: Русский текст

i.e., Using DOC/OS2-866/Russian A1 displays the field-description as NAME and
using PT154 A2 displays the content as Russian text. This would seem
consistent with what Robert has indicated under Base.

(In reply to comment #5)
 If a program works with different charsets for the content and the header in
 the same *.dbf, the program itself should present the right content. But how
 should another program recognize it.

Agreed. At the very least this would be an enhancement request to expand the
existing functionality of DBF import to offer field-by-field character set
specification or to cater for a quirk with how VFP writes these files out.

(In reply to comment #6)
 I think MS Excel screenshots give unambiguous answer whether this is an LO
 bug or not.

Given that MS Excel experiences the same import issue I am tossing this report
in the NEEDINFO bucket. It requires developer input as to what is feasible with
handling DBF files with multiple character sets.

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

Michael Stahl mst...@redhat.com changed:

   What|Removed |Added

  Attachment #86430|application/octet-stream|application/x-dbase
  mime type||

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #6 from Mike Kaganski mikekagan...@hotmail.com ---
Created attachment 86767
  -- https://bugs.freedesktop.org/attachment.cgi?id=86767action=edit
Opening the file with MS Excel 2013

I think MS Excel screenshots give unambiguous answer whether this is an LO bug
or not.

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #4 from Urmas davian...@gmail.com ---
I think VFP screenshot gives an unambiguous answer whether this is an LO bug or
not.

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #5 from rob...@familiegrosskopf.de ---
Created attachment 86654
  -- https://bugs.freedesktop.org/attachment.cgi?id=86654action=edit
Two charsets in the same *.dbf

When I open the *.dbf with different charsets I could see the field-description
in the right way and the field-content in the right way. If a program works
with different charsets for the content and the header in the same *.dbf, the
program itself should present the right content. But how should another program
recognize it.
I haven't any possibility here to open the file in the right way you show with
the screenshot of Visual FoxPro. So I can't confirm, that it is a wrong
behavior of LO/AOO/OOo.
Let us hope anybody else will read this and test it, for example, with MS Excel
...

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #3 from rob...@familiegrosskopf.de ---
Seems to be a problem, because the field isn't created by the same
character-set as the content.
When I try to get the right field-description, I have to chose Kyrillisch
DOS/OS2-866 in the German version of LO.
When I try to get the right content-description, I have to use Kyrillisch
PT154 or Kyrillisch Windows-1251.
It's the same behavior in all LO-versions and in Base and Calc. I see the same
behavior in AOO 4.0. So I don't know, if this is a bug of LO or a bug of the
program the file is created with ...

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

rob...@familiegrosskopf.de changed:

   What|Removed |Added

Version|4.2.0.0.alpha0+ Master  |Inherited From OOo

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

rob...@familiegrosskopf.de changed:

   What|Removed |Added

 CC||rob...@familiegrosskopf.de

--- Comment #1 from rob...@familiegrosskopf.de ---
Would be better to show with screenshots, how it should look. I have opened the
file with Calc and tried different filters - having no idea what I should
search for.
With which program the file is created? 
Which character-set had been chosen?
Seems Calc doesn't know the right charcater-set for the file. But Calc (and
also Base) could change the character-set in many ways.

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

--- Comment #2 from Urmas davian...@gmail.com ---
Created attachment 86493
  -- https://bugs.freedesktop.org/attachment.cgi?id=86493action=edit
Screenshot

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

[Libreoffice-bugs] [Bug 69744] Data in Visual FoxPro DBF is garbled

[bugzilla-daemon]

https://bugs.freedesktop.org/show_bug.cgi?id=69744

Urmas davian...@gmail.com changed:

   What|Removed |Added

  Attachment #86430|text/plain  |application/octet-stream
  mime type||

-- 
You are receiving this mail because:
You are the assignee for the bug.
___
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs