Hallo everyone,
I am planning to develop a test framework for saros IntelliJ in my master
thesis and integrate it with the existing STF so that the same tests can be
used for both Eclipse and IntelliJ IDEA.
For now, I will focus on complete system tests e.g. GUI tests.
I guess my main question for you is: Are there reasons why we would not
want to do without real GUI tests for IntelliJ (and instead test against a
business layer facade)? I do not want remove existing GUI tests for Eclipse.
I am confident that a STF equivalent could be implemented for IntelliJ as I
managed to create a prototype which can click same basic elements (using
fest-swing [1] in combination with RMI). The actual implementation of the
framework may be less comfortable as it was in the case of STF since there
is no support for IntelliJ specific components in swing testing frameworks.
However, maybe we do not need real GUI tests. One alternative would be to
introduce layer just below the GUI (business layer facade). I find both
alternatives equally suited both having its advantages.
List of pros and cons in my opinion:
business layer facade:
+ easier to work with while the IntelliJ GUI is under active development
+ easier to adapt as changes result in compile errors
+ it is nice to have not just for (system) testing
- requires effort to introduce and maintain (changes in production code)
- has to be adopted by all developers
GUI tests:
+ tests whole application exactly as a user would
+ no extra effort to create and maintain interface
- GUI may change over time
- testing framework is probably more difficult to create
- tests may be slower
As a side note, I would view the headless testing framework for IntelliJ
plugins as an addition not a replacement for complete system tests.
However, I could not really explore its potential as it does currently not
work with the Saros plugin due to incompatible versions of the
picocontainer library (which seems quite complicated to solve).
Christian
[1] https://code.google.com/p/fest/
------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
DPP-Devel mailing list
DPP-Devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dpp-devel
