Re: [Ryu-devel] How to collect number of passed and failed test cases after ryu-manager execution

[Iwase Yusuke]

Hi Gourav,

Please keep Ryu-devel mailing list.

Hummm... AFAIK, Ryu does not supports such representation and not include tools 
for
reformatting outputs.
Mr.Ishii made a script to reformat logs into markdown like "Ryu certification" 
page, but I
don't know if this script works correctly with the current Ryu.
  Ryu certification:
    https://osrg.github.io/ryu-certification/switch/ovs
  Mail archive:
    https://sourceforge.net/p/ryu/mailman/message/33808412/

Thanks,
Iwase


On 2017年09月13日 15:02, Gourav Gopal wrote:

Hi,

I mean, I am interested to collect "*OK(xxx) / ERROR(xxx)*" at the end of test 
case.

If possible, I am also interested to collect the "*Test Report*" which contains Test cases which are failed which are group by Test cases failures reasons.

/--- Test report --- Received incorrect packet-in(4) match: 29_ICMPV6_TYPE ethernet/vlan/ipv6/icmpv6(type=128)-->'icmpv6_type=128,actions=output:2' match: 29_ICMPV6_TYPE ethernet/vlan/ipv6/icmpv6(type=128)-->'icmpv6_type=128,actions=output:CONTROLLER' match: 30_ICMPV6_CODE ethernet/vlan/ipv6/icmpv6(code=0)-->'icmpv6_code=0,actions=output:2' match: 30_ICMPV6_CODE ethernet/vlan/ipv6/icmpv6(code=0)-->'icmpv6_code=0,actions=output:CONTROLLER' /

OK(6)  /  ERROR(4)

Sorry for creating confusion. I need to be more specific.


Thanks and Regards,
Gourav Gopal

On Wed, Sep 13, 2017 at 11:18 AM, Iwase Yusuke <iwase.yusu...@gmail.com <mailto:iwase.yusu...@gmail.com>> wrote:

    Hi Gourav,

    Let me confirm what "test cases" mean, first.
    It means "OpenFlow Switch Test Tool", right?
    http://osrg.github.io/ryu-book/en/html/switch_test_tool.html
    <http://osrg.github.io/ryu-book/en/html/switch_test_tool.html>

    Doesn't it output the result like "OK(xxx) / ERROR(xxx)" at the end of test?

    $ ryu-manager --test-switch-dir ryu/tests/switch/of13 \
                 --test-switch-tester-version openflow13 \
                 --test-switch-target-version openflow13 \
                 ryu/tests/switch/tester.py
    ...(snip)...
    OK(582) / ERROR(409)

    Thanks,
    Iwase


    On 2017年09月13日 13:58, Gourav Gopal wrote:

        Hi,

        I am using RYU for test Openflow on my switch and I run ryu-manager to 
run the test cases.

        Please let me know the ways to collect the number of passed and failed 
test cases after
        ryu-manager execution.


        Thanks and Regards,
        Gourav Gopal


        
------------------------------------------------------------------------------
        Check out the vibrant tech community on one of the world's most
        engaging tech sites, Slashdot.org! http://sdm.link/slashdot



        _______________________________________________
        Ryu-devel mailing list
        Ryu-devel@lists.sourceforge.net <mailto:Ryu-devel@lists.sourceforge.net>
        https://lists.sourceforge.net/lists/listinfo/ryu-devel
        <https://lists.sourceforge.net/lists/listinfo/ryu-devel>




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot



_______________________________________________
Ryu-devel mailing list
Ryu-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ryu-devel

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Ryu-devel mailing list
Ryu-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ryu-devel