Re: [libreoffice-projects] QA manual test Litmus session on 3.3.3Rc
Hi Sophie, Am Sonntag, den 05.06.2011, 23:36 +0300 schrieb Sophie Gautier: Hi all, *please, follow up on the projects list, thanks in advance* I would like to try to organize a first session of manual tests - release scenarios - on Litmus [1]. Mostly to see how it goes and fine tune what needs to be done to go further. We need to push our QA process further and log what is done in the language community. The first version will 3.3.3 RC. Yifan (thanks a lot! ) did upload a session for 3.4, but I guess we were a bit distracted by what happened to the OOo code. But we can use this basis for the next session. Should a test run 3.3.3 already be visable? Tests already exists in US - DE - FR, it's a first set that needs to be improved and made available for all languages. Would a additional testgroup with those bugs that occured as blockers for past releases make sense at this early stage of the process? They should be easily found in the bugzilla. Another question, would tests against the daily builds of the 3.4 series go into the libreoffice 3.4 test run or should there just be tests against beta and/or RC versions? Regards, Michael -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
Re: [libreoffice-projects] QA manual test Litmus session on 3.3.3Rc
Hi Michael, On 06/06/2011 08:57, Michael Münch wrote: Hi Sophie, Am Sonntag, den 05.06.2011, 23:36 +0300 schrieb Sophie Gautier: Hi all, *please, follow up on the projects list, thanks in advance* I would like to try to organize a first session of manual tests - release scenarios - on Litmus [1]. Mostly to see how it goes and fine tune what needs to be done to go further. We need to push our QA process further and log what is done in the language community. The first version will 3.3.3 RC. Yifan (thanks a lot! ) did upload a session for 3.4, but I guess we were a bit distracted by what happened to the OOo code. But we can use this basis for the next session. Should a test run 3.3.3 already be visable? As soon as I, or another admin, have create them :) but surely today Tests already exists in US - DE - FR, it's a first set that needs to be improved and made available for all languages. Would a additional testgroup with those bugs that occured as blockers for past releases make sense at this early stage of the process? They should be easily found in the bugzilla. Oh, yes, that's a good idea. Another question, would tests against the daily builds of the 3.4 series go into the libreoffice 3.4 test run or should there just be tests against beta and/or RC versions? all releases should be tested and have the results log in Litmus, but not everybody will be able to follow the rate. There is a trunk category that Yifan (I think) has open, may be we can put branches here? Kind regards Sophie -- Founding member of The Document Foundation -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
[libreoffice-projects] Testtool on Mac
Hi all, Following Sophie's announcement about QA testing and the use of Litmus, I thought I'd try and use the VCLTesttool. On Mac, the user/tester has to know that testtool.bin is stored in the app bundle under LibreOffice/Contents/basis-link/program/testtool.bin. There is also a symbolic link to the same binary in LibreOffice/Contents/MacOS. However, if I try to start the LO 3.3.3rc1 testtool from a terminal : /Applications/LO333.app/Contents/basis-link/program/testtool.bin ; exit; 2011-06-06 11:07:04.563 testtool.bin[7596:903] No Info.plist file in application bundle or no NSPrincipalClass in the Info.plist file, exiting 2011-06-06 11:07:04.566 testtool.bin[7596:903] *** __NSAutoreleaseNoPool(): Object 0x3906270 of class RemoteControlContainer autoreleased with no pool in place - just leaking 2011-06-06 11:07:04.566 testtool.bin[7596:903] *** __NSAutoreleaseNoPool(): Object 0x3906230 of class MultiClickRemoteBehavior autoreleased with no pool in place - just leaking and of course, the app doesn't launch the testtool. The way to get VCLTestTool to launch is to use the symbolic link via a terminal in the LibreOffice/Contents/MacOS directory. Now, where are the *.bas files for testing. Since I happen to have the source repo, I can find a collection in /git/libo/clone/testing/testautomation but are they provided anywhere else separately ? Alex -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
Re: [libreoffice-projects] QA manual test Litmus session on 3.3.3Rc
Hi, Am Montag, den 06.06.2011, 12:56 +0200 schrieb klaus-jürgen weghorn ol: Some things Christian K. mentioned on the German-ml [1]: [...] 2. The German tests are different from the English. Is there any problem with it? I do see some advantages in having tests regarding localization in all the languages. But I am not sure if there is any risk in the build process, that bugs in the logic of the program occur just in a subset of languages. If not the language does not matter and there is no need to translate und multiply the work with translating all the tests in more than 100 languages. Litmus becomes unusable and getting statistics gets much harder as you have to aggregate over all the languages. Also members that do not speak every language will have no chance to get information out of more than 80% of the tests and in the end when tests fail you have to use the english only bgzilla. But I guess the lang-projects insist on having translated tests, so whatever. Having even differing tests in all the languages just make the mess so much bigger. So even if we want translated tests please use a top down english - rest approach. Regards, Michael -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
Re: [libreoffice-projects] QA manual test Litmus session on 3.3.3Rc
Hi Klaus-Jürgen, On 06/06/2011 13:56, klaus-jürgen weghorn ol wrote: Hi Sophie, QAlies, Am 05.06.2011 22:36, schrieb Sophie Gautier: Hi all, *please, follow up on the projects list, thanks in advance* I would like to try to organize a first session of manual tests - release scenarios - on Litmus [1]. Mostly to see how it goes and fine tune what needs to be done to go further. We need to push our QA process further and log what is done in the language community. The first version will 3.3.3 RC. Yifan (thanks a lot! ) did upload a session for 3.4, but I guess we were a bit distracted by what happened to the OOo code. But we can use this basis for the next session. Tests already exists in US - DE - FR, it's a first set that needs to be improved and made available for all languages. So please, join the projects@ list and let us organize a nice and fun QA process for our future versions. For testing, you don't need technical skills, only about 3/4 hours available (for beginners, less if you have already participate) per tested version and some curiosity for the new features and the bug you will find. For translation, understanding of English will be enough, the tests and the process are simple and most of the time written by non English speakers. If you run VCLTesTool, we will also try to centralize the feedback, so don't hesitate to jump in either. Process and info on Litmus are available on the wiki [2], but don't hesitate to come on the list, I'll help and answer your questions from there, also on irc #libreoffice [1] https://tcm.documentfoundation.org/ [2] http://wiki.documentfoundation.org/Litmus Thanks in advance for your help on the organization and your participation. Some things Christian K. mentioned on the German-ml [1]: 1. Should we re-place Litmus on the Wiki-menu? Yes, why not 2. The German tests are different from the English. Is there any problem with it? Yes, because, the English one should be the master set. Frequently, when we lack of one tester (you know the OOo rule of 2 testers/plateform to validate it) I check the other language to help validate the version. If there is an issue with one test, it's easier to see if it's language dependent or not. And we want to offer the same level of quality for all the versions, so really we need to ensure the English is the master. 3. Obviously the testcases can only be changed by admins although there is an option in the menu. If only admins can do this we should give some more people admin rights especially mindst 2 persons per l10n. And it should be unlighted for the others. This will be done on demand. I can also upload tests for the other language who don't have enough resources or don't want to deal with Litmus 4. Who are the admins now? Volker Heggerman, Jean-Baptiste Faure and me. Kind regards Sophie -- Founding member of The Document Foundation -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
[libreoffice-projects] Re: marketing confcall for June
Hello, Florian Effenberger wrote on 2011-06-02 18.48: it's time to have another marketing conference call. :-) I have added some proposals to a Doodle poll - let me know when you have time, so we can pick a date: http://www.doodle.com/ydxwk7sqynvswa99 don't forget to cast your vote. :-) Florian -- Florian Effenberger flo...@documentfoundation.org Steering Committee and Founding Member of The Document Foundation Tel: +49 8341 99660880 | Mobile: +49 151 14424108 Skype: floeff | Twitter/Identi.ca: @floeff -- Unsubscribe instructions: E-mail to projects+h...@libreoffice.org Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/www/projects/ All messages sent to this list will be publicly archived and cannot be deleted
