Ok, but this is something we need to focus on improving. Unit and smoke testing is always somewhat adhoc and has room for periodic consolidation. However our formal testing needs to be completely public, and needs to have an appropriate coverage story.
In several pg/pmc discussions we have been discussing and moving towards adding code coverage metric to our test pass material, which also assumes we have comprehensive test cases. I realize nothing will change quickly here for practical reasons, but we do need to fix this asap and have an open test environment that builds off the TPTP test infrastructure. These are basic project imperatives. Thanks for your time. -------------------------------------------------------------------------- Harm Sluiman, STSM, phone:905-413-4032 fax: 4920 cell: 1-647-300-4758 mailto:[EMAIL PROTECTED] Admin : Arlene Treanor [EMAIL PROTECTED] Tie: 969-2323 1-905-413-2323 "Scherbakov, Ruslan" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 03/22/2007 09:39 AM Please respond to TPTP Tracing and Profiling Tools Project developer discussions <tptp-tracing-profiling-tools-dev@eclipse.org> To "TPTP Tracing and Profiling Tools Project developer discussions" <tptp-tracing-profiling-tools-dev@eclipse.org> cc Subject RE: [tptp-tracing-profiling-tools-dev]JVMTI test harness Harm, We regularly run tests locally when new changes in JVMTI profiler are made. Then we report problems to bugzilla. The tests for JVMTI profiler are not contributed yet therefore the test run results are not included into test pass reports. Thanks, Ruslan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Harm Sluiman Sent: Thursday, March 22, 2007 6:51 PM To: TPTP Tracing and Profiling Tools Project developer discussions Subject: RE: [tptp-tracing-profiling-tools-dev]JVMTI test harness I have changed the subject so I don't derail Neil's thread. There is also a basic question here of process. Without the test harness being part of the project, no one could for example port the agent to another platform. How does this test harness relate to the AC test harness or the TPTP test infrastructure? Is someone running this and then entering manual test results in our test pass test logs? Thanks for your time. -------------------------------------------------------------------------- Harm Sluiman, STSM, phone:905-413-4032 fax: 4920 cell: 1-647-300-4758 mailto:[EMAIL PROTECTED] Admin : Arlene Treanor [EMAIL PROTECTED] Tie: 969-2323 1-905-413-2323 "Yaffe, Asaf" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 03/22/2007 07:44 AM Please respond to TPTP Tracing and Profiling Tools Project developer discussions <tptp-tracing-profiling-tools-dev@eclipse.org> To "TPTP Tracing and Profiling Tools Project developer discussions" <tptp-tracing-profiling-tools-dev@eclipse.org> cc Subject RE: [tptp-tracing-profiling-tools-dev] Re:BuildingandinstallingJVMTIruntime with Agent Controller Harm, Contributing the JVMTI test harness has been in discussion for a long time. I am not sure what the current status. I will check with the team in our weekly meeting today. Thanks, Asaf From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Harm Sluiman Sent: Thursday, March 22, 2007 1:30 PM To: TPTP Tracing and Profiling Tools Project developer discussions Subject: RE: [tptp-tracing-profiling-tools-dev] Re:BuildingandinstallingJVMTIruntime with Agent Controller Asaf, I was not aware of any need or use of non- open source in the project. This is not normal practice and should be changed. Either the test harness needs to become part of the TPTP test cases and test infrastructure, or you need to move to the infrastructure we provide. Being self hosting in this scenario is basic hygiene for TPTP and is in fact one of the themes for 4.4. Please get this test harness part of the discussion going in the project to drive some resolution quickly during I3. Thanks for your time. -------------------------------------------------------------------------- Harm Sluiman, STSM, phone:905-413-4032 fax: 4920 cell: 1-647-300-4758 mailto:[EMAIL PROTECTED] Admin : Arlene Treanor [EMAIL PROTECTED] Tie: 969-2323 1-905-413-2323 "Yaffe, Asaf" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 03/22/2007 06:30 AM Please respond to TPTP Tracing and Profiling Tools Project developer discussions <tptp-tracing-profiling-tools-dev@eclipse.org> To "TPTP Tracing and Profiling Tools Project developer discussions" <tptp-tracing-profiling-tools-dev@eclipse.org> cc Subject RE: [tptp-tracing-profiling-tools-dev] Re: BuildingandinstallingJVMTIruntime with Agent Controller Hi Neil, We have an automated test framework that launches all profilers (3, to be exact) in standalone mode on various test applications, and verifies the generated XML file according to some rules we have defined (for example, that methodEntry and methodExit elements are properly nested per thread). I am not sure whether this framework will be contributed to TPTP. Thanks, Asaf -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Neil Dunn Sent: Thursday, March 22, 2007 12:14 PM To: TPTP Tracing and Profiling Tools Project developer discussions Subject: Re: [tptp-tracing-profiling-tools-dev] Re: BuildingandinstallingJVMTIruntime with Agent Controller Oh ok Asaf wll that's good then :-) Ok I missed the Java classes when I ran it last time so that was the obvious problem. I'll just stick with the copying for now. By "more automated" I meant installing all of the necessary libraries into an agent controller install automatically for easier testing with Eclipse. It's not really a big deal though. A slightly bigger deal is the question of testing. How exactly do you test the two profilers? I haven't found any explicit test cases or test automation that I could build on (I'm hacking something into the call graph profiler). Thanks, Neil _______________________________________________ tptp-tracing-profiling-tools-dev mailing list tptp-tracing-profiling-tools-dev@eclipse.org https://dev.eclipse.org/mailman/listinfo/tptp-tracing-profiling-tools-dev _______________________________________________ tptp-tracing-profiling-tools-dev mailing list tptp-tracing-profiling-tools-dev@eclipse.org https://dev.eclipse.org/mailman/listinfo/tptp-tracing-profiling-tools-dev _______________________________________________ tptp-tracing-profiling-tools-dev mailing list tptp-tracing-profiling-tools-dev@eclipse.org https://dev.eclipse.org/mailman/listinfo/tptp-tracing-profiling-tools-dev
_______________________________________________ tptp-tracing-profiling-tools-dev mailing list tptp-tracing-profiling-tools-dev@eclipse.org https://dev.eclipse.org/mailman/listinfo/tptp-tracing-profiling-tools-dev
