http://bugs.meego.com/show_bug.cgi?id=2870

           Summary: nightly testing: known failures
    Classification: MeeGo Projects
           Product: SyncEvolution
           Version: unspecified
          Platform: All
        OS/Version: ---
            Status: ASSIGNED
          Severity: trivial
          Priority: Low
         Component: SyncEvolution
        AssignedTo: [email protected]
        ReportedBy: [email protected]
         QAContact: [email protected]
                CC: [email protected],
                    [email protected]
   Estimated Hours: 0.0


Tests listed in the CLIENT_TEST_FAILURES env variable are run despite knowing
that they'll fail. In the output they are marked as *** failure ignored ***
instead of *** failed ***.

A recent example is Funambol:

CLIENT_TEST_FAILURES=Client::Sync::vcard21::testTwinning,Client::Sync::vcard21_ica
l20_itodo20_text::testTwinning,Client::Sync::text_itodo20_ical20_vcard21::testTwinning

Client_Sync_vcard21_testTwinning.A.test.dat |
Client_Sync_vcard21_testTwinning.B.test.dat
                     only in left file <
                                       > only in right file
-------------------------------------------------------------------------------
BEGIN:VCARD                              BEGIN:VCARD                           
N:Doe;John                               N:Doe;John                            
ADR:Test Box #3;;Test Drive 3;Test Me    ADR:Test Box #3;;Test Drive 3;Test Me 
 gacity;Test County;12347;New Testonia    gacity;Test County;12347;New Testonia
ADR;TYPE=HOME:Test Box #1;;Test Drive    ADR;TYPE=HOME:Test Box #1;;Test Drive 
  1;Test Village;Lower Test County;123     1;Test Village;Lower Test County;123
 45;Testovia                              45;Testovia                          
ADR;TYPE=WORK:Test Box #2;;Test Drive    ADR;TYPE=WORK:Test Box #2;;Test Drive 
  2;Test Town;Upper Test County;12346;     2;Test Town;Upper Test County;12346;
 Old Testovia                             Old Testovia                         
BDAY:20060108                            BDAY:20060108                         
CATEGORIES:TEST                          CATEGORIES:TEST                       
EMAIL:[email protected]               EMAIL:[email protected]            
EMAIL;TYPE=HOME:[email protected]       EMAIL;TYPE=HOME:[email protected]    
EMAIL;TYPE=WORK:[email protected]        EMAIL;TYPE=WORK:[email protected]     
FN:John Doe                              FN:John Doe                           
NICKNAME:user1                           NICKNAME:user1                        
NOTE:This is a test case which uses a    NOTE:This is a test case which uses a 
 lmost all Evolution fields.              lmost all Evolution fields.          
ORG:Test Inc.;Testing                    ORG:Test Inc.;Testing                 
ROLE:professional test case              ROLE:professional test case           
TEL:primary 8                            TEL:primary 8                         
TEL:primary 8                          <
TEL;TYPE=CAR:car 7                       TEL;TYPE=CAR:car 7                    
TEL;TYPE=CELL:mobile 3                   TEL;TYPE=CELL:mobile 3                
TEL;TYPE=FAX;TYPE=HOME:homefax 5         TEL;TYPE=FAX;TYPE=HOME:homefax 5      
TEL;TYPE=FAX;TYPE=WORK:businessfax 4     TEL;TYPE=FAX;TYPE=WORK:businessfax 4  
TEL;TYPE=HOME:home 2                     TEL;TYPE=HOME:home 2                  
TEL;TYPE=PAGER:pager 6                   TEL;TYPE=PAGER:pager 6                
TEL;TYPE=WORK:business 1                 TEL;TYPE=WORK:business 1              
TITLE:Senior Tester                      TITLE:Senior Tester                   
URL:http://john.doe.com                  URL:http://john.doe.com               
VERSION:3.0                              VERSION:3.0                           
X-ANNIVERSARY:20060109                   X-ANNIVERSARY:20060109                
X-MANAGER:John Doe Senior                X-MANAGER:John Doe Senior             
X-SPOUSE:Joan Doe                        X-SPOUSE:Joan Doe                     
END:VCARD                                END:VCARD                             
-------------------------------------------------------------------------------
failed: env CLIENT_TEST_SERVER=funambol PATH=.:$PATH synccompare
Client_Sync_vcard21_testTwinning.A.test.dat
Client_Sync_vcard21_testTwinning.B.test.dat
 *** failure ignored ***
ClientTest.cpp:372:Assertion
Test name: Client::Sync::vcard21::testTwinning
assertion failed
- Expression: !raiseAssert || equal

Failures !!!
Run: 0   Failure total: 1   Failures: 1   Errors: 0


In the HTML summary, this test is simply marked as "failed" in grey. It would
be nice if it was marked as "known failure" instead.

Yongsheng, can you have a look and/or help one of your colleagues on this?

-- 
Configure bugmail: http://bugs.meego.com/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching someone on the CC list of the bug.
_______________________________________________
Syncevolution-issues mailing list
[email protected]
http://lists.syncevolution.org/listinfo/syncevolution-issues

Reply via email to