[Libreoffice-qa] ODF compatibility tests
Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. -- Jay Philips ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
Hi Jay, First - thanks for your work helping to test LibreOffice ! =) that's always appreciated. Of course, its -most- appreciated when the results of your work are easiest to fix - ie. as of now, testing 4.3 is rather more useful than 4.2. Nevertheless - it's some great work. On Fri, 2014-05-02 at 16:21 +0400, Jay Philips wrote: Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. ODF doesn't specify layout, so no there are no tests of that sort. Naturally we do our best to retain layout compatibility and there are a number of tweaks and compatibility options too tedious to enumerate to achieve that for LibreOffice. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. Well - I'd blame MS Word of course :-) at least if you want to fairly reflect the concern that our layout of DOCX is different to that in MS Office (DOCX also does not specify precise layout). Anyhow - thanks for your work ! hopefully it results in some good improvements over time. ATB, Michael. -- michael.me...@collabora.com , Pseudo Engineer, itinerant idiot ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
On 05/02/2014 04:46 PM, Michael Meeks wrote: Hi Jay, Hi Michael, First - I enjoyed your FOSDEM 2011 and osC14 talks (especially the german two sausage ends joke) and look forward to seeing more. :) First - thanks for your work helping to test LibreOffice ! =) that's always appreciated. Of course, its -most- appreciated when the results of your work are easiest to fix - ie. as of now, testing 4.3 is rather more useful than 4.2. Nevertheless - it's some great work. Your welcome and it has been fun. :) My tests now do include testing master (4.3). On Fri, 2014-05-02 at 16:21 +0400, Jay Philips wrote: Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. ODF doesn't specify layout, so no there are no tests of that sort. Naturally we do our best to retain layout compatibility and there are a number of tweaks and compatibility options too tedious to enumerate to achieve that for LibreOffice. Well ODF does specify page size, page orientation, image positioning on the page, etc. which ultimately is defining layout, but there has to be a means to know whether the output of software reading or writing ODF is correct, or else how would one detect that the display is correct or not. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. Well - I'd blame MS Word of course :-) at least if you want to fairly reflect the concern that our layout of DOCX is different to that in MS Office (DOCX also does not specify precise layout). I too blame MS word first, but if Calligra Words whose native format is ODF is showing it the same as MS word, where do i go from there. There was also problems opening Calligra Words files in LibO, which i have reported as bugs, but dont know whether i should blame Calligra or LibO. Anyhow - thanks for your work ! hopefully it results in some good improvements over time. Its been my pleasure. 43 bugs and counting, mainly just compatibility issues and a few crashes.Wish i could send in more enhancement suggestions, but i dont use office suits. :) ATB, Michael. Jay ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
Hi Jay, Jay Philips schrieb: Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. There exists no reference implementation for ODF. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. Please keep in mind, that LibreOffice writes ODF1.2 extended as default. That contains more than currently specified in ODF1.2. Likely not all, but the most differences are documented in https://wiki.documentfoundation.org/Development/ODF_Implementer_Notes As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. Perhaps validator http://odf-validator2.rhcloud.com/odf-validator2/ or http://officeshots.org/ might help. For MS Word you should consider the information from Microsoft as well. http://www.microsoft.com/en-us/download/details.aspx?id=20601 The normative reference is the spec itself. https://www.oasis-open.org/standards#opendocumentv1.2 If you cannot resolve it using the spec, you can write to opendocument-us...@lists.oasis-open.org, or if you can already point to the place where something is not precise enough specified write to office-comm...@lists.oasis-open.org. Or write an issue about the difference and attach a small(!) test document. Some people here are involved in the OASIS OpenDocument TC. Kind regards Regina ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
Hi Jay, Le 02/05/2014 14:21, Jay Philips a écrit : Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. If you are interested, I'm maintaining a tool for the QA team, mainly for manual regression tests, but also to tests new features. It's called MozTrap and you can find it here : http://manual-test.libreoffice.org/results/runs/ I would like to add more regression tests on import/export to Office formats, but I don't have Windows or Office so it makes it difficult for me to write accurate tests. Would you be interested to help me to write them correctly and add some samples to tests. Here is MozTrap guide: https://wiki.documentfoundation.org/MozTrap/User_Guide Kind regards Sophie -- Sophie Gautier sophie.gaut...@documentfoundation.org Tel:+33683901545 Membership Certification Committee Member - Co-founder The Document Foundation ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
Hi Sophie, If you are not already aware, you can create office documents at office.com as it is free. I have created a few tests there myself, but prefer to use ms word myself. I could definitely supply you with any sample files that you need to run the tests, but unfortunately i dont think i would have the time to manage test runs myself. Jay Philips On 05/02/2014 07:20 PM, Sophie wrote: Hi Jay, Le 02/05/2014 14:21, Jay Philips a écrit : Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. If you are interested, I'm maintaining a tool for the QA team, mainly for manual regression tests, but also to tests new features. It's called MozTrap and you can find it here : http://manual-test.libreoffice.org/results/runs/ I would like to add more regression tests on import/export to Office formats, but I don't have Windows or Office so it makes it difficult for me to write accurate tests. Would you be interested to help me to write them correctly and add some samples to tests. Here is MozTrap guide: https://wiki.documentfoundation.org/MozTrap/User_Guide Kind regards Sophie ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
Hi Jay,, Le 02/05/2014 17:40, Jay Philips a écrit : Hi Sophie, If you are not already aware, you can create office documents at office.com as it is free. I have created a few tests there myself, but prefer to use ms word myself. Yes, thanks, but it's not exactly the same as local version and I don't know what version is used online so it makes the test less trustful on a QA perspective. I could definitely supply you with any sample files that you need to run the tests, but unfortunately i dont think i would have the time to manage test runs myself. Of course, I don't want you to manage test runs :) but if you could supply me with few docs and what needs to be tested based on your experience, it would be great. Cheers Sophie Jay Philips On 05/02/2014 07:20 PM, Sophie wrote: Hi Jay, Le 02/05/2014 14:21, Jay Philips a écrit : Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. If you are interested, I'm maintaining a tool for the QA team, mainly for manual regression tests, but also to tests new features. It's called MozTrap and you can find it here : http://manual-test.libreoffice.org/results/runs/ I would like to add more regression tests on import/export to Office formats, but I don't have Windows or Office so it makes it difficult for me to write accurate tests. Would you be interested to help me to write them correctly and add some samples to tests. Here is MozTrap guide: https://wiki.documentfoundation.org/MozTrap/User_Guide Kind regards Sophie ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/ -- Sophie Gautier sophie.gaut...@documentfoundation.org Tel:+33683901545 Membership Certification Committee Member - Co-founder The Document Foundation ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] ODF compatibility tests
On 05/02/2014 07:50 PM, Sophie wrote: Hi Jay,, Le 02/05/2014 17:40, Jay Philips a écrit : Hi Sophie, If you are not already aware, you can create office documents at office.com as it is free. I have created a few tests there myself, but prefer to use ms word myself. Yes, thanks, but it's not exactly the same as local version and I don't know what version is used online so it makes the test less trustful on a QA perspective. I just confirmed that the online version is running word 2013 as i tested a document that opens one way in 2010 and another way in 2013. I could definitely supply you with any sample files that you need to run the tests, but unfortunately i dont think i would have the time to manage test runs myself. Of course, I don't want you to manage test runs :) but if you could supply me with few docs and what needs to be tested based on your experience, it would be great. Yes i could definitely supply you with a few docs, but my experience is quite limited to the tests that i'm currently doing and sending bug fixes in for. Cheers Sophie Jay Philips On 05/02/2014 07:20 PM, Sophie wrote: Hi Jay, Le 02/05/2014 14:21, Jay Philips a écrit : Hi All, I was curious what compatibility tests are being run to ensure that LibO displays ODF accurately. I had asked a similar question a few days back on the LibO QA mailing list but never got a response. Is there an archive of standard compliant odf 1.0/1.1 and 1.2 files that is available? Alternatively, is there an ODF test to validate if a ODF file outputted by an ODF compatible software complies to the ODF standard and can output the file as a pdf to show how it should be rendered, somewhat similar to the Acid test for CSS. As part of my extensive testing of .docx files in LibO, i'm currently testing ODF outputted by LibO to see how well its imported into Word 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to see how well its imported into LibO. It would be nice to have a ODF software that i could use its output as a reference to compare these results against, as i've found ODF outputted by word 2010 that doesnt open correctly in LibO but did in Calligra Words and i've also found ODF files on libreoffice.org that displayed differences in LibO 4.1 and 4.2. Currently if a .doc, .docx or .rtf loads different between LibO and ms word, i report these bugs, but if there are load differences for .odt files its difficult to know if its a LibO or ms word problem. If you are interested, I'm maintaining a tool for the QA team, mainly for manual regression tests, but also to tests new features. It's called MozTrap and you can find it here : http://manual-test.libreoffice.org/results/runs/ I would like to add more regression tests on import/export to Office formats, but I don't have Windows or Office so it makes it difficult for me to write accurate tests. Would you be interested to help me to write them correctly and add some samples to tests. Here is MozTrap guide: https://wiki.documentfoundation.org/MozTrap/User_Guide Kind regards Sophie ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/ ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
