Stepan Mishura wrote:
On 8/7/06, *Jimmy, Jing Lv*  wrote:

    <SNIP>
    Sounds pretty good :)
    "exec" do helps, it can check simple situations.
    What I'm concern is that if the return code is not enough for some
    situations, e.g, what exception is thrown exactly, or what cause VM exit
    abnormally. IMHO, it is still necessary for us.

Hi Jimmy, See attached test. It demonstrates VM forking. The test saves VM output and prints it in the end. So I expect that unit tests for 'instrument' module can do the same: fork VM with predefined args, save output and compare it with expected output. BWT, we have utility class[1] in 'support' for this task. It makes sense to improve it for our needs. Thanks,
Stepan.

Thanks Stepan, this is very attractive to me :)

According to your approach, I believe now it can be automatized well, at least for many test.

One concern from me is that, how do you handle output comparison? For an example, if VM halt with a exception, it output some message, so you get the output, find the exception name in it? And what can we do if it output some information only, which RI and Harmony may not appear the same?

However this is a good idea, if no objections, I shall follow this approach in writing some test of instrument.

[1] http://svn.apache.org/viewvc/incubator/harmony/enhanced/classlib/trunk/support/src/test/java/tests/support/Support_Exec.java?revision=386058&view=markup <http://svn.apache.org/viewvc/incubator/harmony/enhanced/classlib/trunk/support/src/test/java/tests/support/Support_Exec.java?revision=386058&view=markup>

     > On 8/7/06, Jimmy, Jing Lv <[EMAIL PROTECTED]
    <mailto:[EMAIL PROTECTED]>> wrote:
     >>
     >> Geir Magnusson Jr wrote:
     >> >
     >> > Jimmy, Jing Lv wrote:
     >> >> Richard Liang wrote:
     >> >>>
     >> >>> Jimmy, Jing Lv wrote:
     >> >>>> Hi,
     >> >>>>
     >> >>>>     As it is hard to write unit test for package
    instrument, I now
     >> >>>> have an idea: write down some documents for details of
    non-unit test
     >> >>>> cases for instrument. The detail of such test cases contain:
     >> >>> Do you mean it's hard to *write* unit test or it's hard to
    integrate
     >> >>> the tests with Harmony build system?
     >> >>>
     >> >> Hard to write unit test, so record them in some document may be a
     >> better
     >> >> way :)
     >> >
     >> > Why is it hard to create unit tests?
     >> >
     >>
     >> To test java.lang.instrument, mostly we need to start up a new
    VM to see
     >> its behavior. Its function(premain, etc) may be run before most
    classes
     >> loaded, and almost all exceptions will cause VM abort. And the
    result is
     >> hard to be checked automatic. What's more, extra java/c code is
    needed
     >> for the test.
     >>
     >> One thought was that we can use exec("java commands") in
    junit(is that
     >> OK to run exec in tests?), but how to check its output is still a
     >> problem.
     >>
     >> I'll put unit test if any, but I believe most necessary and
    important
     >> tests are non-unit tests.
     >>
     >> >>>> 1. The test run on which platform, including special
    environment;
     >> >>>> 2. The test description;
     >> >>>> 3. How to run test (command line, etc.);
     >> >>>> 4. test result;
     >> >>>> 5. resource (or links) for tests, including c/java code for
    test if
     >> any.
     >> >>>>
     >> >>>>     I hope ensure the code quality in this way. Like unit
    test, such
     >> >>>> tests can be checked and re-run for regression, though
     >> un-automatically.
     >> >>>>
     >> >>>>     And I'll put them in Harmony-wiki[1], and any
     >> test-description is
     >> >>>> welcome!. (Geir, I've found an advancement of wiki :) )
     >> >>>>
     >> >>>>     Any suggestions?  :)
     >> >>>>
     >> >>>> [1]http://wiki.apache.org/harmony/INSTRUMENT
     >> >>>>
     >> >>>>> Geir Magnusson Jr wrote:
     >> >>>>> Never appeal to me using a Wiki as an authority :)  It's like
     >> finding
     >> >>>>> something written in chalk on the sidewalk.
     >> >>>>>
     >> >>>>> However, if you had pointed out
     >> >>>>>
     >>
     >>>>>    http://incubator.apache.org/harmony/auth_cont_quest.html
    <http://incubator.apache.org/harmony/auth_cont_quest.html>
     >> >>>>>
     >> >>>>> I'd have agreed w/o having the opportunity to make fun of
    the Wiki.
     >> >>>>>
     >> >>>>> So I agree :)
     >> >>>>>
     >> >>>>> geir


--
Thanks,
Stepan Mishura
Intel Middleware Products Division

------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> For additional commands, e-mail: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>


------------------------------------------------------------------------

import java.io.*;

public class test {

    public static void main(String []av) throws Exception {
        Runtime r = Runtime.getRuntime();

        String[] args = new String[3];
args[0] = System.getProperty("java.home") + "/bin/java";
        args[1] = "-showversion";
        args[2] = "NoSuchClass";
Process proc = r.exec(args);

        MyReader err = new MyReader(proc.getErrorStream());
        MyReader out = new MyReader(proc.getInputStream());
new Thread(err).start();
        new Thread(out).start();
int status = proc.waitFor();

        System.out.println("======OUT=========");
        System.out.println(out.out.toString());
        System.out.println("======ERR=========");
        System.out.println(err.out.toString());
        System.out.println("======EXIT=========");
        System.out.println(status);

    }
}

class MyReader implements Runnable{

    InputStream in;
    ByteArrayOutputStream out = new ByteArrayOutputStream();

    public MyReader(InputStream in){
        this.in = in;
    }
public void run() {
        try {
            for (int b = in.read(); b != -1; b = in.read()) {
                out.write(b);
            }
        } catch (IOException e) {
            e.printStackTrace();
        }
    }
}


------------------------------------------------------------------------

---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


--

Best Regards!

Jimmy, Jing Lv
China Software Development Lab, IBM

---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to