See <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/818/changes>
Changes: [Glenn Weidner] [SYSTEMML-1246] Use correct jar name in sparkDML.sh of -bin artifact [npansar] [SYSTEMML-1238] Updated the default parameters of mllearn to match that [Glenn Weidner] [SYSTEMML-1211] Update Hadoop 2.6.0 Windows 64-bit binaries [Matthias Boehm] [SYSTEMML-1281] Fix memory efficiency csv/dataset-binary rdd converters ------------------------------------------ [...truncated 12754 lines...] 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 258) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 258 (MapPartitionsRDD[715] at mapPartitionsToPair at RDDConverterUtils.java:257), which has no missing parents 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_258 stored as values in memory (estimated size 21.5 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_258_piece0 stored as bytes in memory (estimated size 9.6 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Added broadcast_258_piece0 in memory on 169.54.146.43:55120 (size: 9.6 KB, free: 1045.1 MB) 17/02/18 04:24:05 INFO spark.SparkContext: Created broadcast 258 from broadcast at DAGScheduler.scala:996 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 258 (MapPartitionsRDD[715] at mapPartitionsToPair at RDDConverterUtils.java:257) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Adding task set 258.0 with 1 tasks 17/02/18 04:24:05 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_258.0 tasks to pool default 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 258.0 (TID 268, localhost, executor driver, partition 0, PROCESS_LOCAL, 6289 bytes) 17/02/18 04:24:05 INFO executor.Executor: Running task 0.0 in stage 258.0 (TID 268) 17/02/18 04:24:05 INFO executor.Executor: Finished task 0.0 in stage 258.0 (TID 268). 1804 bytes result sent to driver 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 258.0 (TID 268) in 12 ms on localhost (executor driver) (1/1) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 258.0, whose tasks have all completed, from pool default 17/02/18 04:24:05 INFO scheduler.DAGScheduler: ShuffleMapStage 258 (mapPartitionsToPair at RDDConverterUtils.java:257) finished in 0.012 s 17/02/18 04:24:05 INFO scheduler.DAGScheduler: looking for newly runnable stages 17/02/18 04:24:05 INFO scheduler.DAGScheduler: running: Set() 17/02/18 04:24:05 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 259) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: failed: Set() 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting ResultStage 259 (MapPartitionsRDD[717] at mapValues at SparkUtils.java:151), which has no missing parents 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_259 stored as values in memory (estimated size 3.8 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_259_piece0 stored as bytes in memory (estimated size 2.1 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Added broadcast_259_piece0 in memory on 169.54.146.43:55120 (size: 2.1 KB, free: 1045.1 MB) 17/02/18 04:24:05 INFO spark.SparkContext: Created broadcast 259 from broadcast at DAGScheduler.scala:996 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 259 (MapPartitionsRDD[717] at mapValues at SparkUtils.java:151) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Adding task set 259.0 with 1 tasks 17/02/18 04:24:05 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_259.0 tasks to pool default 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 259.0 (TID 269, localhost, executor driver, partition 0, ANY, 5753 bytes) 17/02/18 04:24:05 INFO executor.Executor: Running task 0.0 in stage 259.0 (TID 269) 17/02/18 04:24:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks 17/02/18 04:24:05 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms 17/02/18 04:24:05 INFO executor.Executor: Finished task 0.0 in stage 259.0 (TID 269). 2021 bytes result sent to driver 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 259.0 (TID 269) in 12 ms on localhost (executor driver) (1/1) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 259.0, whose tasks have all completed, from pool default 17/02/18 04:24:05 INFO scheduler.DAGScheduler: ResultStage 259 (collect at SparkExecutionContext.java:767) finished in 0.012 s 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Removed broadcast_259_piece0 on 169.54.146.43:55120 in memory (size: 2.1 KB, free: 1045.1 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Removed broadcast_258_piece0 on 169.54.146.43:55120 in memory (size: 9.6 KB, free: 1045.1 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Removed broadcast_257_piece0 on 169.54.146.43:55120 in memory (size: 9.0 KB, free: 1045.2 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Removed broadcast_256_piece0 on 169.54.146.43:55120 in memory (size: 8.9 KB, free: 1045.2 MB) 17/02/18 04:24:05 INFO spark.ContextCleaner: Cleaned accumulator 16831 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Registering RDD 719 (flatMapToPair at RDDConverterUtils.java:275) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Got job 193 (collectAsList at MLContextTest.java:1343) with 1 output partitions 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Final stage: ResultStage 261 (collectAsList at MLContextTest.java:1343) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Parents of final stage: List(ShuffleMapStage 260) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 260) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 260 (MapPartitionsRDD[719] at flatMapToPair at RDDConverterUtils.java:275), which has no missing parents 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_260 stored as values in memory (estimated size 3.9 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_260_piece0 stored as bytes in memory (estimated size 2.2 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Added broadcast_260_piece0 in memory on 169.54.146.43:55120 (size: 2.2 KB, free: 1045.2 MB) 17/02/18 04:24:05 INFO spark.SparkContext: Created broadcast 260 from broadcast at DAGScheduler.scala:996 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 260 (MapPartitionsRDD[719] at flatMapToPair at RDDConverterUtils.java:275) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Adding task set 260.0 with 1 tasks 17/02/18 04:24:05 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_260.0 tasks to pool default 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 260.0 (TID 270, localhost, executor driver, partition 0, PROCESS_LOCAL, 6218 bytes) 17/02/18 04:24:05 INFO executor.Executor: Running task 0.0 in stage 260.0 (TID 270) 17/02/18 04:24:05 INFO executor.Executor: Finished task 0.0 in stage 260.0 (TID 270). 1340 bytes result sent to driver 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 260.0 (TID 270) in 5 ms on localhost (executor driver) (1/1) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 260.0, whose tasks have all completed, from pool default 17/02/18 04:24:05 INFO scheduler.DAGScheduler: ShuffleMapStage 260 (flatMapToPair at RDDConverterUtils.java:275) finished in 0.006 s 17/02/18 04:24:05 INFO scheduler.DAGScheduler: looking for newly runnable stages 17/02/18 04:24:05 INFO scheduler.DAGScheduler: running: Set() 17/02/18 04:24:05 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 261) 17/02/18 04:24:05 INFO scheduler.DAGScheduler: failed: Set() 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting ResultStage 261 (MapPartitionsRDD[725] at collectAsList at MLContextTest.java:1343), which has no missing parents 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_261 stored as values in memory (estimated size 11.3 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO memory.MemoryStore: Block broadcast_261_piece0 stored as bytes in memory (estimated size 5.6 KB, free 1044.7 MB) 17/02/18 04:24:05 INFO storage.BlockManagerInfo: Added broadcast_261_piece0 in memory on 169.54.146.43:55120 (size: 5.6 KB, free: 1045.2 MB) 17/02/18 04:24:05 INFO spark.SparkContext: Created broadcast 261 from broadcast at DAGScheduler.scala:996 17/02/18 04:24:05 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 261 (MapPartitionsRDD[725] at collectAsList at MLContextTest.java:1343) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Adding task set 261.0 with 1 tasks 17/02/18 04:24:05 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_261.0 tasks to pool default 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 261.0 (TID 271, localhost, executor driver, partition 0, ANY, 5783 bytes) 17/02/18 04:24:05 INFO executor.Executor: Running task 0.0 in stage 261.0 (TID 271) 17/02/18 04:24:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks 17/02/18 04:24:05 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 17/02/18 04:24:05 INFO executor.Executor: Finished task 0.0 in stage 261.0 (TID 271). 2024 bytes result sent to driver 17/02/18 04:24:05 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 261.0 (TID 271) in 8 ms on localhost (executor driver) (1/1) 17/02/18 04:24:05 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 261.0, whose tasks have all completed, from pool default 17/02/18 04:24:05 INFO scheduler.DAGScheduler: ResultStage 261 (collectAsList at MLContextTest.java:1343) finished in 0.008 s 17/02/18 04:24:06 INFO storage.BlockManagerInfo: Removed broadcast_260_piece0 on 169.54.146.43:55120 in memory (size: 2.2 KB, free: 1045.2 MB) 17/02/18 04:24:06 INFO storage.BlockManagerInfo: Removed broadcast_261_piece0 on 169.54.146.43:55120 in memory (size: 5.6 KB, free: 1045.2 MB) 17/02/18 04:24:06 INFO spark.ContextCleaner: Cleaned accumulator 17026 17/02/18 04:24:06 INFO spark.ContextCleaner: Cleaned shuffle 67 17/02/18 04:24:06 INFO server.ServerConnector: Stopped ServerConnector@ecb636e{HTTP/1.1}{0.0.0.0:4040} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@488e3cb6{/stages/stage/kill,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@3b2767fe{/jobs/job/kill,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@df4df46{/api,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@5ef5f07f{/,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@2d6bc63a{/static,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@2e030cda{/executors/threadDump/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@64a6fe91{/executors/threadDump,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@30987ea6{/executors/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@7bcf1494{/executors,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@6565e14e{/environment/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@310cacc8{/environment,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@6455e932{/storage/rdd/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@521985ab{/storage/rdd,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@2f4f7e51{/storage/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@5a61fda5{/storage,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@7398ac46{/stages/pool/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@7201f556{/stages/pool,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@75801b7b{/stages/stage/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@4eecf79f{/stages/stage,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@20270f{/stages/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@2ef53e7b{/stages,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@407fa1b{/jobs/job/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@6914f2d6{/jobs/job,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@6050fcd{/jobs/json,null,UNAVAILABLE} 17/02/18 04:24:06 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@753bec6c{/jobs,null,UNAVAILABLE} 17/02/18 04:24:06 INFO ui.SparkUI: Stopped Spark web UI at http://169.54.146.43:4040 17/02/18 04:24:06 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 17/02/18 04:24:06 INFO memory.MemoryStore: MemoryStore cleared 17/02/18 04:24:06 INFO storage.BlockManager: BlockManager stopped 17/02/18 04:24:06 INFO storage.BlockManagerMaster: BlockManagerMaster stopped 17/02/18 04:24:06 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 17/02/18 04:24:06 INFO spark.SparkContext: Successfully stopped SparkContext Running org.apache.sysml.test.integration.mlcontext.MLContextTest Tests run: 169, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.149 sec - in org.apache.sysml.test.integration.mlcontext.MLContextTest 17/02/18 04:24:06 INFO util.ShutdownHookManager: Shutdown hook called 17/02/18 04:24:06 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-04a7c8fa-1cc9-4586-bdec-2da9dca50e67 Running org.apache.sysml.test.integration.functions.append.AppendVectorTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 315.359 sec - in org.apache.sysml.test.integration.functions.append.AppendVectorTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,106.648 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest 17/02/18 04:26:56 INFO util.ShutdownHookManager: Shutdown hook called 17/02/18 04:26:56 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-5873d6ae-98b2-4e68-ad1a-ae05dda495e6 Running org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 751.532 sec - in org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 286.839 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 367.181 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.837 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Running org.apache.sysml.test.integration.functions.reorg.FullOrderTest Tests run: 132, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,493.89 sec - in org.apache.sysml.test.integration.functions.reorg.FullOrderTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest Tests run: 90, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,637.535 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest 17/02/18 04:34:01 INFO util.ShutdownHookManager: Shutdown hook called 17/02/18 04:34:01 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-e5d43462-8743-407e-8bf7-f4af05f75bc2 Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 376.684 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Running org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 549.151 sec - in org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Running org.apache.sysml.test.integration.functions.append.AppendChainTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,116.616 sec - in org.apache.sysml.test.integration.functions.append.AppendChainTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 299.649 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Running org.apache.sysml.test.integration.applications.dml.HITSDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.458 sec - in org.apache.sysml.test.integration.applications.dml.HITSDMLTest Running org.apache.sysml.test.integration.functions.append.AppendMatrixTest Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,504.323 sec - in org.apache.sysml.test.integration.functions.append.AppendMatrixTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 362.407 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Running org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.405 sec - in org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.7 sec - in org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.982 sec - in org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.825 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.707 sec - in org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.057 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.611 sec - in org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Running org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.571 sec - in org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Running org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 294.566 sec - in org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.258 sec - in org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.076 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.299 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Running org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 292.64 sec - in org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Running org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.264 sec - in org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Running org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 584.424 sec - in org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.578 sec - in org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Running org.apache.sysml.test.integration.applications.dml.ID3DMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 402.102 sec - in org.apache.sysml.test.integration.applications.dml.ID3DMLTest Running org.apache.sysml.test.integration.applications.dml.GLMDMLTest Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 937.855 sec - in org.apache.sysml.test.integration.applications.dml.GLMDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.083 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.623 sec - in org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Running org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.95 sec - in org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.462 sec - in org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Running org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.274 sec - in org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.716 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Running org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.119 sec - in org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.922 sec - in org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.077 sec - in org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Running org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.555 sec - in org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Running org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.48 sec - in org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Running org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.608 sec - in org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Running org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 381.552 sec - in org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Running org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.677 sec - in org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Results : Failed tests: FrameMatrixReblockTest.testFrameWriteMultipleSparseBinarySpark:170->runFrameReblockTest:230 31 values are not in equal FullReblockTest.testTextCellSingeMSparseMR:161->runReblockTest:479 29 values are not in equal Tests run: 6639, Failures: 2, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-failsafe-plugin:2.17:verify (default) @ systemml --- [INFO] Failsafe report directory: <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:57 h [INFO] Finished at: 2017-02-18T05:32:22-06:00 [INFO] Final Memory: 64M/2351M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.17:verify (default) on project systemml: There are test failures. [ERROR] [ERROR] Please refer to <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Run condition [Always] enabling perform for step [[]]