I remember that we have tried to achieve some order once for some case but it didn't work. However this is the link which could help: https://cwiki.apache.org/confluence/display/FLEX/FlexUnit+Order
Maybe we should add "Order" tag to every TestCase class to have ordering. Piotr 2015-02-02 16:16 GMT+01:00 Alex Harui <[email protected]>: > I did run GeneralFunctionsTests by itself and it passed, so really, I’m > interested in having it run as part of the full suite but still run early > to see if other tests are messing it up and make it easier to debug if it > still fails. It looked like FlexUnit supported some “order” attribute but > maybe I don’t know how to get it to work. > > From: Piotr Zarzycki <[email protected]> > Date: Monday, February 2, 2015 at 7:11 AM > To: Alex Harui <[email protected]> > Cc: "[email protected]" <[email protected]>, "[email protected]" > <[email protected]>, "[email protected]" <[email protected]>, " > [email protected]" <[email protected]> > Subject: Re: Build failed in Jenkins: flex-tlf #326 > > Alex, > > The simplest way to run only GeneralFunctionTests is to add this class > to MinimalTestsSuite.as > <http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/automation_tests/src/MinimalTestsSuite.as> > and > change in build.properties minimalTests to true. > > Piotr > > 2015-02-02 16:03 GMT+01:00 Alex Harui <[email protected]>: > >> Anybody know how to get the GeneralFunctionTests to run first? When I run >> the tests in the debugger they are not running first. >> >> Thanks, >> -Alex >> >> On 2/1/15, 10:54 PM, "[email protected]" <[email protected] >> > >> wrote: >> >> >See <http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/326/> >> > >> >------------------------------------------ >> >Started by timer >> >Building remotely on flex_sdk_slave2 in workspace >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/> >> > > C:\Program Files (x86)\Git\cmd\git.exe rev-parse --is-inside-work-tree >> ># timeout=10 >> >Fetching changes from the remote Git repository >> > > C:\Program Files (x86)\Git\cmd\git.exe config remote.origin.url >> >https://git-wip-us.apache.org/repos/asf/flex-tlf.git # timeout=10 >> >Fetching upstream changes from >> >https://git-wip-us.apache.org/repos/asf/flex-tlf.git >> > > C:\Program Files (x86)\Git\cmd\git.exe --version # timeout=10 >> > > C:\Program Files (x86)\Git\cmd\git.exe fetch --tags --progress >> >https://git-wip-us.apache.org/repos/asf/flex-tlf.git >> >+refs/heads/*:refs/remotes/origin/* >> > > C:\Program Files (x86)\Git\cmd\git.exe rev-parse >> >"origin/develop^{commit}" # timeout=10 >> >Checking out Revision b5a5407fd065ab82c9506a4380610bcc93efe36f >> >(origin/develop) >> > > C:\Program Files (x86)\Git\cmd\git.exe config core.sparsecheckout # >> >timeout=10 >> > > C:\Program Files (x86)\Git\cmd\git.exe checkout -f >> >b5a5407fd065ab82c9506a4380610bcc93efe36f >> > > C:\Program Files (x86)\Git\cmd\git.exe rev-list >> >b5a5407fd065ab82c9506a4380610bcc93efe36f # timeout=10 >> >[flex-tlf] $ cmd.exe /C >> >> >'"c:\Jenkins\tools\hudson.tasks.Ant_AntInstallation\c_apache-ant-1.9.3\bin >> >\ant.bat -file build.xml all && exit %%ERRORLEVEL%%"' >> >Buildfile: >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/build.xml> >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >clean: >> > [delete] Deleting directory >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin> >> > [delete] Deleting: >> >< >> http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bundles.properti >> >es> >> > >> >textLayout: >> > [compc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [compc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [compc] C:\Jenkins\workspace\flex-tlf\bin\textLayout.swc (548672 >> >bytes) >> > >> >main: >> > >> >asTestApps: >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >asTestApp: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >> >C:\Jenkins\workspace\flex-tlf\bin\apps\asTestApps\bin\ExplicitFormField.sw >> >f (519803 bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >asTestApp: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\asTestApps\bin\TCMTestFocus2.swf >> >(527001 bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >asTestApp: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\asTestApps\bin\AliceScroll.swf >> >(588502 bytes) >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >asTestApp: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\asTestApps\bin\KeyLogger.swf (2164 >> >bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [echo] FLEX_HOME is >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk> >> > [echo] Minimal test is set false >> > >> >asTestApp: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\asTestApps\bin\OpHammer.swf >> >(530204 bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >textLayout_editBar: >> > [compc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [compc] >> >> >C:\Jenkins\workspace\flex-tlf\bin\apps\testApps\bin\textLayout_editBar.swc >> > (23172 bytes) >> > [compc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >textLayout_ui: >> > [compc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [compc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\testApps\bin\textLayout_ui.swc >> >(112796 bytes) >> > [compc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >testApps: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\automation_apps\bin\Flow.swf >> >(2184689 bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >automation_core: >> > [compc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [compc] >> >> >C:\Jenkins\workspace\flex-tlf\bin\apps\automation_apps\bin\automation_core >> >.swc (34039 bytes) >> > [compc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >automation_tests: >> > [compc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [compc] >> >> >C:\Jenkins\workspace\flex-tlf\bin\apps\automation_apps\bin\automation_test >> >s.swc (224091 bytes) >> > [compc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > >> >automation_apps: >> > [mxmlc] Loading configuration file >> >C:\Jenkins\workspace\flex-sdk\frameworks\flex-config.xml >> > [mxmlc] >> >C:\Jenkins\workspace\flex-tlf\bin\apps\automation_apps\bin\VellumUnit.swf >> >(2278815 bytes) >> > [mxmlc] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> > [copy] Copying 152 files to >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin/apps/test> >> > >> >flexunnit_tests: >> > [flexunit] Validating task attributes ... >> > [flexunit] Generating default values ... >> > [flexunit] Using default working dir >> >[<http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/]> >> > [flexunit] Using the following settings for the test run: >> > [flexunit] FLEX_HOME: >> >[<http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/../flex-sdk]> >> > [flexunit] haltonfailure: [true] >> > [flexunit] headless: [false] >> > [flexunit] display: [99] >> > [flexunit] localTrusted: [true] >> > [flexunit] player: [flash] >> > [flexunit] port: [1024] >> > [flexunit] swf: >> >[< >> http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin/apps/automa >> >tion_apps/bin/VellumUnit.swf]> >> > [flexunit] timeout: [60000ms] >> > [flexunit] toDir: >> >[< >> http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin/apps/automa >> >tion_apps]> >> > [flexunit] Setting up server process ... >> > [flexunit] Entry >> >[< >> http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin/apps/automa >> >tion_apps/bin]> already available in local trust file at >> >[C:\Users\apacheflexbuild\AppData\Roaming\Macromedia\Flash >> >Player\#Security\FlashPlayerTrust\flexUnit.cfg]. >> > [flexunit] Executing 'rundll32' with arguments: >> > [flexunit] 'url.dll,FileProtocolHandler' >> > [flexunit] >> >'< >> http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/bin/apps/automa >> >tion_apps/bin/VellumUnit.swf'> >> > [flexunit] >> > [flexunit] The ' characters around the executable and arguments are >> > [flexunit] not part of the command. >> > [flexunit] >> > [flexunit] Starting server ... >> > [flexunit] Opening server socket on port [1024]. >> > [flexunit] Waiting for client connection ... >> > [flexunit] Client connected. >> > [flexunit] Setting inbound buffer size to [262144] bytes. >> > [flexunit] Receiving data ... >> > [flexunit] Sending acknowledgement to player to start sending test data >> >... >> > [flexunit] >> > [flexunit] FlexUnit test ShortTextMouseEventTBRTLTest in suite >> >UnitTest.Tests.AllEventTest was ignored. >> > [flexunit] FlexUnit test ShortTextMouseEventRLLTRTest in suite >> >UnitTest.Tests.AllEventTest was ignored. >> > [flexunit] FlexUnit test ShortTextMouseEventRLRTLTest in suite >> >UnitTest.Tests.AllEventTest was ignored. >> > [flexunit] FlexUnit test ShortTextMouseEventTBLTRTest in suite >> >UnitTest.Tests.AllEventTest was ignored. >> > [flexunit] FlexUnit test testAllEnumProps in suite >> >UnitTest.Tests.AllParaAttributeTest was ignored. >> > [flexunit] FlexUnit test contentWidthCheckLongFloat in suite >> >UnitTest.Tests.FloatTest was ignored. >> > [flexunit] FlexUnit test paddingBottomTest ([object Object]) in suite >> >UnitTest.Tests.ContainerAttributeTest was ignored. >> > [flexunit] FlexUnit test checkColumnGapOnWidthChangeTest ([object >> >Object]) in suite UnitTest.Tests.ContainerAttributeTest was ignored. >> > [flexunit] FlexUnit test checkColumnGapOnWidthChangeTest ([object >> >Object]) in suite UnitTest.Tests.ContainerAttributeTest was ignored. >> > [flexunit] FlexUnit test paddingBottomTest ([object Object]) in suite >> >UnitTest.Tests.ContainerAttributeTest was ignored. >> > [flexunit] FlexUnit test twoColumnsTest in suite >> >UnitTest.Tests.ScrollingTest was ignored. >> > [flexunit] FlexUnit test applyFormatToElementTest in suite >> >UnitTest.Tests.OperationTest was ignored. >> > [flexunit] FlexUnit test deletePreviousWordTest in suite >> >UnitTest.Tests.OperationTest was ignored. >> > [flexunit] FlexUnit test arabicDirection in suite >> >UnitTest.Tests.WritingModeTest was ignored. >> > [flexunit] FlexUnit test spanElementReplaceTextInvalidPos in suite >> >UnitTest.Tests.ElementOperationTest was ignored. >> > [flexunit] FlexUnit test arrowUp in suite >> >UnitTest.Tests.GeneralFunctionsTest failed. >> > [flexunit] FlexUnit test arrowDown in suite >> >UnitTest.Tests.GeneralFunctionsTest failed. >> > [flexunit] FlexUnit test endTabLongStringTest in suite >> >UnitTest.Tests.TabTest was ignored. >> > [flexunit] FlexUnit test noTabStop in suite UnitTest.Tests.TabTest was >> >ignored. >> > [flexunit] FlexUnit test draggingSelectioinMultiFlows in suite >> >UnitTest.Tests.ContainerTypeTest was ignored. >> > [flexunit] FlexUnit test partialCompositionTest (simple in suite >> >UnitTest.Tests.CompositionTest was ignored. >> > [flexunit] FlexUnit test deleteAtContainerStart (simple in suite >> >UnitTest.Tests.CompositionTest was ignored. >> > [flexunit] FlexUnit test partialCompositionTest (asknot in suite >> >UnitTest.Tests.CompositionTest was ignored. >> > [flexunit] FlexUnit test deleteAtContainerStart (asknot in suite >> >UnitTest.Tests.CompositionTest was ignored. >> > [flexunit] >> > [flexunit] Stopping server ... >> > [flexunit] End of test data reached, sending acknowledgement to player >> >... >> > [flexunit] Closing client connection ... >> > [flexunit] Closing server on port [1024] ... >> > [flexunit] Analyzing reports ... >> > [flexunit] >> > [flexunit] Suite: UnitTest.Tests.OperationTest >> > [flexunit] Tests run: 47, Failures: 0, Errors: 0, Skipped: 2, Time >> >elapsed: 17.843 sec >> > [flexunit] Suite: UnitTest.Tests.GeneralFunctionsTest >> > [flexunit] Tests run: 36, Failures: 2, Errors: 0, Skipped: 0, Time >> >elapsed: 9.228 sec >> > [flexunit] Suite: UnitTest.Tests.CrossContainerTest >> > [flexunit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 0.124 sec >> > [flexunit] Suite: UnitTest.Tests.AllParaAttributeTest >> > [flexunit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 4.542 sec >> > [flexunit] Suite: UnitTest.Tests.TabTest >> > [flexunit] Tests run: 19, Failures: 0, Errors: 0, Skipped: 2, Time >> >elapsed: 1.989 sec >> > [flexunit] Suite: UnitTest.Tests.EventOverrideTest >> > [flexunit] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 1.253 sec >> > [flexunit] Suite: UnitTest.Tests.AllContAttributeTest >> > [flexunit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 10.752 sec >> > [flexunit] Suite: UnitTest.Tests.AccessibilityMethodsTest >> > [flexunit] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 0.572 sec >> > [flexunit] Suite: UnitTest.Tests.FactoryImportTest >> > [flexunit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 0.085 sec >> > [flexunit] Suite: UnitTest.Tests.AllEventTest >> > [flexunit] Tests run: 13, Failures: 0, Errors: 0, Skipped: 4, Time >> >elapsed: 2.287 sec >> > [flexunit] Suite: UnitTest.Tests.BoundsAndAlignmentTest >> > [flexunit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 4.179 sec >> > [flexunit] Suite: UnitTest.Tests.TextFlowEditTest >> > [flexunit] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 0.454 sec >> > [flexunit] Suite: UnitTest.Tests.ContainerTypeTest >> > [flexunit] Tests run: 22, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 0.929 sec >> > [flexunit] Suite: UnitTest.Tests.FloatTest >> > [flexunit] Tests run: 56, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 83.275 sec >> > [flexunit] Suite: UnitTest.Tests.AttributeTest >> > [flexunit] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 5.208 sec >> > [flexunit] Suite: UnitTest.Tests.FlowModelTest >> > [flexunit] Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 3.913 sec >> > [flexunit] Suite: UnitTest.Tests.ElementOperationTest >> > [flexunit] Tests run: 25, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 5.485 sec >> > [flexunit] Suite: UnitTest.Tests.WritingModeTest >> > [flexunit] Tests run: 13, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 1.783 sec >> > [flexunit] Suite: UnitTest.Tests.UndoRedoTest >> > [flexunit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 0.214 sec >> > [flexunit] Suite: UnitTest.Tests.BoxTest >> > [flexunit] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 4.755 sec >> > [flexunit] Suite: UnitTest.Tests.ScrollingTest >> > [flexunit] Tests run: 15, Failures: 0, Errors: 0, Skipped: 1, Time >> >elapsed: 13.329 sec >> > [flexunit] Suite: UnitTest.Tests.AllCharAttributeTest >> > [flexunit] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time >> >elapsed: 15.994 sec >> > [flexunit] Suite: UnitTest.Tests.ContainerAttributeTest >> > [flexunit] Tests run: 31, Failures: 0, Errors: 0, Skipped: 4, Time >> >elapsed: 448.262 sec >> > [flexunit] Suite: UnitTest.Tests.CompositionTest >> > [flexunit] Tests run: 24, Failures: 0, Errors: 0, Skipped: 4, Time >> >elapsed: 8.518 sec >> > [flexunit] >> > [flexunit] Results : >> > [flexunit] >> > [flexunit] Tests run: 428, Failures: 2, Errors: 0, Skipped: 22, Time >> >elapsed: 644.973 sec >> > [flexunit] >> > >> >BUILD FAILED >> ><http://apacheflexbuild.cloudapp.net:8080/job/flex-tlf/ws/build.xml >> >:312: >> >FlexUnit tests failed during the test run. >> > >> >Total time: 13 minutes 49 seconds >> >Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 >> >Build step 'Invoke Ant' marked build as failure >> >Archiving artifacts >> >Recording test results >> >> > > > -- > > Greetings > Piotr Zarzycki > > Flex/AIR/AngularJS Developer > > mobile: +48 880 859 557 > e-mail: [email protected] > skype: zarzycki10 > > LinkedIn: http://www.linkedin.com/piotrzarzycki <http://linkd.in/1aGNqao> > -- Greetings Piotr Zarzycki Flex/AIR/AngularJS Developer mobile: +48 880 859 557 e-mail: [email protected] skype: zarzycki10 LinkedIn: http://www.linkedin.com/piotrzarzycki <http://linkd.in/1aGNqao>
