[jira] [Commented] (SPARK-15078) Add all TPCDS 1.4 benchmark queries for SparkSQL

[Ovidiu Marcu (JIRA)]

    [ 
https://issues.apache.org/jira/browse/SPARK-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295794#comment-15295794
 ] 

Ovidiu Marcu commented on SPARK-15078:
--------------------------------------

Same exceptions with a second run:
val experiment = tpcds.runExperiment(tpcds.runnable)
experiment: AnyRef{val currentResults: 
scala.collection.mutable.ArrayBuffer[com.databricks.spark.sql.perf.BenchmarkResult];
 val currentRuns: 
scala.collection.mutable.ArrayBuffer[com.databricks.spark.sql.perf.ExperimentRun];
 val currentMessages: scala.collection.mutable.ArrayBuffer[String]; def 
logMessage(msg: String): scala.collection.mutable.ArrayBuffer[String]; def 
currentExecution: String; def currentExecution_=(x$1: String): Unit; def 
currentPlan: String; def currentPlan_=(x$1: String): Unit; def currentConfig: 
String; def currentConfig_=(x$1: String): Unit; def failures: Int; def 
failures_=(x$1: Int): Unit; def startTime: Long; def startTime_=(x$1: Long): 
Unit; def logCollection: () => Unit; def logCollection_=(x$1: () => Unit): 
Unit; def cartesianProduct[T](xss: List[List[T]]): Li...
scala> 

scala> Couldn't read table customer_total_return and its not defined as a 
Benchmark.Table.
Table store exists.
Table customer exists.
Couldn't read table wswscs and its not defined as a Benchmark.Table.
Table date_dim exists.
Table store_sales exists.
Table item exists.
Couldn't read table year_total and its not defined as a Benchmark.Table.
Couldn't read table ssr and its not defined as a Benchmark.Table.
Couldn't read table csr and its not defined as a Benchmark.Table.
Couldn't read table wsr and its not defined as a Benchmark.Table.
Table customer_demographics exists.
Table promotion exists.
Table customer_address exists.
Table reason exists.
Table web_sales exists.
Table household_demographics exists.
Table catalog_sales exists.
Table store_returns exists.
Table inventory exists.
Table warehouse exists.
Couldn't read table ss and its not defined as a Benchmark.Table.
Couldn't read table ws and its not defined as a Benchmark.Table.
Couldn't read table inv and its not defined as a Benchmark.Table.
Table catalog_returns exists.
Couldn't read table v2 and its not defined as a Benchmark.Table.
Table web_returns exists.
Couldn't read table web_v1 and its not defined as a Benchmark.Table.
Couldn't read table store_v1 and its not defined as a Benchmark.Table.
Couldn't read table segments and its not defined as a Benchmark.Table.
Couldn't read table wss and its not defined as a Benchmark.Table.
Table ship_mode exists.
Table web_site exists.
Couldn't read table cross_sales and its not defined as a Benchmark.Table.
Table time_dim exists.
Couldn't read table all_sales and its not defined as a Benchmark.Table.
Couldn't read table sr and its not defined as a Benchmark.Table.
Couldn't read table cs and its not defined as a Benchmark.Table.
Couldn't read table cr and its not defined as a Benchmark.Table.
Couldn't read table wr and its not defined as a Benchmark.Table.
Table income_band exists.
Table web_page exists.
Table call_center exists.
Couldn't read table ssci and its not defined as a Benchmark.Table.
Couldn't read table csci and its not defined as a Benchmark.Table.
Running execution q1-v1.4 iteration: 1, StandardRun=true
16/05/23 01:35:18 WARN BlockManager: Asked to remove block 
broadcast_9155_piece0, which does not exist
Execution time: 6.617463s
Running execution q2-v1.4 iteration: 1, StandardRun=true
Execution time: 4.243055s                                                       
Running execution q3-v1.4 iteration: 1, StandardRun=true
Execution time: 1.528571s                                                       
Running execution q4-v1.4 iteration: 1, StandardRun=true
Execution time: 47.185367s                                                      
Running execution q5-v1.4 iteration: 1, StandardRun=true
Execution time: 13.492008s                                                      
Running execution q7-v1.4 iteration: 1, StandardRun=true
Execution time: 3.690847s                                                       
Running execution q8-v1.4 iteration: 1, StandardRun=true
Execution time: 2.885101s                                                       
Running execution q9-v1.4 iteration: 1, StandardRun=true
16/05/23 01:37:03 ERROR Executor: Exception in task 0.0 in stage 2855.0 (TID 
203594)
java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:37:03 WARN TaskSetManager: Lost task 0.0 in stage 2855.0 (TID 
203594, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

16/05/23 01:37:03 ERROR TaskSetManager: Task 0 in stage 2855.0 failed 1 times; 
aborting job
Execution 'q9-v1.4' failed: Job aborted due to stage failure: Task 0 in stage 
2855.0 failed 1 times, most recent failure: Lost task 0.0 in stage 2855.0 (TID 
203594, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

Driver stacktrace:
Running execution q11-v1.4 iteration: 1, StandardRun=true
Execution time: 27.280455999999997s                                             
Running execution q12-v1.4 iteration: 1, StandardRun=true
Execution time: 2.8020810000000003s                                             
Running execution q13-v1.4 iteration: 1, StandardRun=true
Execution time: 5.978293s                                                       
Running execution q15-v1.4 iteration: 1, StandardRun=true
Execution time: 2.985056s                                                       
Running execution q17-v1.4 iteration: 1, StandardRun=true
Execution time: 17.313678s                                                      
Running execution q18-v1.4 iteration: 1, StandardRun=true
Execution time: 5.243629s                                                       
Running execution q19-v1.4 iteration: 1, StandardRun=true
Execution time: 2.1760059999999997s                                             
Running execution q20-v1.4 iteration: 1, StandardRun=true
Execution time: 5.970836s                                                       
Running execution q21-v1.4 iteration: 1, StandardRun=true
Execution time: 1.7583499999999999s                                             
Running execution q22-v1.4 iteration: 1, StandardRun=true
Execution time: 5.889182s                                                       
Running execution q25-v1.4 iteration: 1, StandardRun=true
Execution time: 18.391087s                                                      
Running execution q26-v1.4 iteration: 1, StandardRun=true
Execution time: 2.8728670000000003s                                             
Running execution q27-v1.4 iteration: 1, StandardRun=true
Execution time: 4.227684s                                                       
Running execution q28-v1.4 iteration: 1, StandardRun=true
Execution time: 15.200277s                                                      
Running execution q29-v1.4 iteration: 1, StandardRun=true
Execution time: 17.654465000000002s                                             
Running execution q31-v1.4 iteration: 1, StandardRun=true
Execution time: 13.221945999999999s                                             
Running execution q34-v1.4 iteration: 1, StandardRun=true
Execution time: 3.169705s                                                       
Running execution q36-v1.4 iteration: 1, StandardRun=true
Execution time: 2.764065s                                                       
Running execution q37-v1.4 iteration: 1, StandardRun=true
Execution time: 3.1756170000000004s                                             
Running execution q38-v1.4 iteration: 1, StandardRun=true
Execution time: 12.249296000000001s                                             
Running execution q39a-v1.4 iteration: 1, StandardRun=true
Execution time: 7.060602s                                                       
Running execution q39b-v1.4 iteration: 1, StandardRun=true
Execution time: 5.280982s                                                       
Running execution q40-v1.4 iteration: 1, StandardRun=true
Execution time: 7.885648s                                                       
Running execution q42-v1.4 iteration: 1, StandardRun=true
Execution time: 1.132826s                                                       
Running execution q43-v1.4 iteration: 1, StandardRun=true
Execution time: 1.550916s                                                       
Running execution q44-v1.4 iteration: 1, StandardRun=true
16/05/23 01:41:33 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:41:33 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:41:34 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:41:34 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:41:34 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:41:34 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 4.567112s                                                       
Running execution q46-v1.4 iteration: 1, StandardRun=true
16/05/23 01:41:46 ERROR BlockManagerSlaveEndpoint: Error in removing block 
broadcast_10332_piece0
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_10332_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply$mcZ$sp(BlockManagerSlaveEndpoint.scala:47)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 3.44353s
Running execution q47-v1.4 iteration: 1, StandardRun=true
Execution time: 33.919877s                                                      
Running execution q48-v1.4 iteration: 1, StandardRun=true
Execution time: 3.436355s                                                       
Running execution q49-v1.4 iteration: 1, StandardRun=true
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:42:32 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 14.238673s                                                      
Running execution q50-v1.4 iteration: 1, StandardRun=true
Execution time: 9.805021s                                                       
Running execution q51-v1.4 iteration: 1, StandardRun=true
Execution time: 31.769738s                                                      
Running execution q52-v1.4 iteration: 1, StandardRun=true
Execution time: 1.1401590000000001s                                             
Running execution q53-v1.4 iteration: 1, StandardRun=true
Execution time: 3.1508339999999997s                                             
Running execution q54-v1.4 iteration: 1, StandardRun=true
Execution time: 8.176337s                                                       
Running execution q55-v1.4 iteration: 1, StandardRun=true
Execution time: 1.223337s                                                       
Running execution q57-v1.4 iteration: 1, StandardRun=true
Execution time: 31.772676999999998s                                             
Running execution q59-v1.4 iteration: 1, StandardRun=true
Execution time: 5.1393320000000005s                                             
Running execution q61-v1.4 iteration: 1, StandardRun=true
Execution time: 2.63469s                                                        
Running execution q62-v1.4 iteration: 1, StandardRun=true
Execution time: 2.349636s                                                       
Running execution q63-v1.4 iteration: 1, StandardRun=true
Execution time: 2.89305s                                                        
Running execution q64-v1.4 iteration: 1, StandardRun=true
Execution time: 37.339732000000005s                                             
Running execution q65-v1.4 iteration: 1, StandardRun=true
Execution time: 9.335443999999999s                                              
Running execution q66-v1.4 iteration: 1, StandardRun=true
Execution time: 4.8635209999999995s                                             
Running execution q67-v1.4 iteration: 1, StandardRun=true
Execution time: 13.436803s                                                      
Running execution q68-v1.4 iteration: 1, StandardRun=true
Execution time: 2.987165s                                                       
Running execution q71-v1.4 iteration: 1, StandardRun=true
Execution time: 4.041181s                                                       
Running execution q72-v1.4 iteration: 1, StandardRun=true
Execution time: 32.572773s                                                      
Running execution q73-v1.4 iteration: 1, StandardRun=true
Execution time: 2.142525s                                                       
Running execution q74-v1.4 iteration: 1, StandardRun=true
Execution time: 25.328758s                                                      
Running execution q75-v1.4 iteration: 1, StandardRun=true
Execution time: 55.798535s                                                      
Running execution q76-v1.4 iteration: 1, StandardRun=true
Execution time: 3.568407s                                                       
Running execution q77-v1.4 iteration: 1, StandardRun=true
Execution time: 6.08091s                                                        
Running execution q78-v1.4 iteration: 1, StandardRun=true
Execution time: 27.151218s                                                      
Running execution q79-v1.4 iteration: 1, StandardRun=true
Execution time: 2.9635390000000004s                                             
Running execution q80-v1.4 iteration: 1, StandardRun=true
16/05/23 01:50:19 WARN BlockManager: Asked to remove block 
broadcast_11620_piece0, which does not exist
Execution time: 27.568234s
Running execution q82-v1.4 iteration: 1, StandardRun=true
16/05/23 01:50:24 ERROR BlockManagerSlaveEndpoint: Error in removing block 
broadcast_11646_piece0
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_11646_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply$mcZ$sp(BlockManagerSlaveEndpoint.scala:47)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 3.3704560000000003s
Running execution q84-v1.4 iteration: 1, StandardRun=true
16/05/23 01:50:30 WARN BlockManager: Asked to remove block 
broadcast_11674_piece0, which does not exist
Execution time: 3.1563359999999996s
Running execution q85-v1.4 iteration: 1, StandardRun=true
Execution time: 9.299822s                                                       
Running execution q86-v1.4 iteration: 1, StandardRun=true
Execution time: 2.066085s                                                       
Running execution q87-v1.4 iteration: 1, StandardRun=true
Execution time: 14.196105s                                                      
Running execution q88-v1.4 iteration: 1, StandardRun=true
Execution time: 5.471768s                                                       
Running execution q89-v1.4 iteration: 1, StandardRun=true
Execution time: 4.0449090000000005s                                             
Running execution q90-v1.4 iteration: 1, StandardRun=true
Execution time: 1.284724s
Running execution q91-v1.4 iteration: 1, StandardRun=true
Execution time: 1.395477s
Running execution q93-v1.4 iteration: 1, StandardRun=true
Execution time: 11.392582s                                                      
Running execution q96-v1.4 iteration: 1, StandardRun=true
Execution time: 0.7931459999999999s
Running execution q97-v1.4 iteration: 1, StandardRun=true
Execution time: 7.1231279999999995s                                             
Running execution q98-v1.4 iteration: 1, StandardRun=true
Execution time: 3.396106s                                                       
Running execution q99-v1.4 iteration: 1, StandardRun=true
Execution time: 2.717594s                                                       
Running execution qSsMax-v1.4 iteration: 1, StandardRun=true
Execution time: 2.175697s                                                       
Running execution q1-v1.4 iteration: 2, StandardRun=true
Execution time: 6.767495s                                                       
Running execution q2-v1.4 iteration: 2, StandardRun=true
Execution time: 3.684542s                                                       
Running execution q3-v1.4 iteration: 2, StandardRun=true
Execution time: 1.223875s                                                       
Running execution q4-v1.4 iteration: 2, StandardRun=true
Execution time: 43.202421s                                                      
Running execution q5-v1.4 iteration: 2, StandardRun=true
Execution time: 11.649104s                                                      
Running execution q7-v1.4 iteration: 2, StandardRun=true
16/05/23 01:53:46 WARN BlockManager: Asked to remove block 
broadcast_12362_piece0, which does not exist
16/05/23 01:53:46 WARN BlockManager: Asked to remove block 
broadcast_12361_piece0, which does not exist
Execution time: 3.234362s
Running execution q8-v1.4 iteration: 2, StandardRun=true
Execution time: 2.550935s
Running execution q9-v1.4 iteration: 2, StandardRun=true
16/05/23 01:54:00 ERROR Executor: Exception in task 0.0 in stage 3724.0 (TID 
267062)
java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:54:00 WARN TaskSetManager: Lost task 0.0 in stage 3724.0 (TID 
267062, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

16/05/23 01:54:00 ERROR TaskSetManager: Task 0 in stage 3724.0 failed 1 times; 
aborting job
Execution 'q9-v1.4' failed: Job aborted due to stage failure: Task 0 in stage 
3724.0 failed 1 times, most recent failure: Lost task 0.0 in stage 3724.0 (TID 
267062, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

Driver stacktrace:
Running execution q11-v1.4 iteration: 2, StandardRun=true
Execution time: 25.775562s                                                      
Running execution q12-v1.4 iteration: 2, StandardRun=true
Execution time: 2.352076s                                                       
Running execution q13-v1.4 iteration: 2, StandardRun=true
Execution time: 3.824069s                                                       
Running execution q15-v1.4 iteration: 2, StandardRun=true
16/05/23 01:54:48 WARN BlockManager: Asked to remove block 
broadcast_12597_piece0, which does not exist
Execution time: 2.6865799999999997s
Running execution q17-v1.4 iteration: 2, StandardRun=true
Execution time: 18.715971s                                                      
Running execution q18-v1.4 iteration: 2, StandardRun=true
Execution time: 6.904504s                                                       
Running execution q19-v1.4 iteration: 2, StandardRun=true
Execution time: 1.820657s                                                       
Running execution q20-v1.4 iteration: 2, StandardRun=true
Execution time: 2.587417s                                                       
Running execution q21-v1.4 iteration: 2, StandardRun=true
Execution time: 1.655894s                                                       
Running execution q22-v1.4 iteration: 2, StandardRun=true
Execution time: 6.048611s                                                       
Running execution q25-v1.4 iteration: 2, StandardRun=true
Execution time: 20.142982s                                                      
Running execution q26-v1.4 iteration: 2, StandardRun=true
Execution time: 2.8262530000000003s                                             
Running execution q27-v1.4 iteration: 2, StandardRun=true
Execution time: 3.858933s                                                       
Running execution q28-v1.4 iteration: 2, StandardRun=true
Execution time: 14.883491s                                                      
Running execution q29-v1.4 iteration: 2, StandardRun=true
Execution time: 18.215739000000003s                                             
Running execution q31-v1.4 iteration: 2, StandardRun=true
Execution time: 13.077354999999999s                                             
Running execution q34-v1.4 iteration: 2, StandardRun=true
Execution time: 3.192834s                                                       
Running execution q36-v1.4 iteration: 2, StandardRun=true
Execution time: 2.799734s                                                       
Running execution q37-v1.4 iteration: 2, StandardRun=true
Execution time: 2.996731s                                                       
Running execution q38-v1.4 iteration: 2, StandardRun=true
16/05/23 01:57:52 WARN BlockManager: Asked to remove block 
broadcast_13133_piece0, which does not exist
Execution time: 11.622470999999999s
Running execution q39a-v1.4 iteration: 2, StandardRun=true
16/05/23 01:58:02 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
13172
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13172_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:58:02 WARN BlockManagerMaster: Failed to remove broadcast 13172 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_13172_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13172_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 6.94695s
Running execution q39b-v1.4 iteration: 2, StandardRun=true
16/05/23 01:58:02 ERROR ContextCleaner: Error cleaning broadcast 13172
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13172_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 4.887805s                                                       
Running execution q40-v1.4 iteration: 2, StandardRun=true
Execution time: 7.92088s                                                        
Running execution q42-v1.4 iteration: 2, StandardRun=true
Execution time: 1.01316s                                                        
Running execution q43-v1.4 iteration: 2, StandardRun=true
16/05/23 01:58:26 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
13267
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13267_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 1.49001s
Running execution q44-v1.4 iteration: 2, StandardRun=true
16/05/23 01:58:26 WARN BlockManagerMaster: Failed to remove broadcast 13267 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_13267_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13267_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:58:26 ERROR ContextCleaner: Error cleaning broadcast 13267
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13267_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:58:26 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:58:26 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:58:27 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:58:27 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:58:27 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:58:27 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 4.787133s                                                       
Running execution q46-v1.4 iteration: 2, StandardRun=true
Execution time: 3.256641s                                                       
Running execution q47-v1.4 iteration: 2, StandardRun=true
Execution time: 34.541382s                                                      
Running execution q48-v1.4 iteration: 2, StandardRun=true
16/05/23 01:59:21 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
13390
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13390_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:59:21 WARN BlockManagerMaster: Failed to remove broadcast 13390 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_13390_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13390_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:59:21 ERROR ContextCleaner: Error cleaning broadcast 13390
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13390_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 4.401242s                                                       
Running execution q49-v1.4 iteration: 2, StandardRun=true
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:30 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 01:59:31 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 13.235333s                                                      
Running execution q50-v1.4 iteration: 2, StandardRun=true
16/05/23 01:59:58 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
13486
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13486_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 9.28675s
Running execution q51-v1.4 iteration: 2, StandardRun=true
16/05/23 01:59:58 WARN BlockManagerMaster: Failed to remove broadcast 13486 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_13486_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13486_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 01:59:58 ERROR ContextCleaner: Error cleaning broadcast 13486
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_13486_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 38.281172s                                                      
Running execution q52-v1.4 iteration: 2, StandardRun=true
Execution time: 1.224683s                                                       
Running execution q53-v1.4 iteration: 2, StandardRun=true
Execution time: 3.202508s                                                       
Running execution q54-v1.4 iteration: 2, StandardRun=true
Execution time: 8.358784s                                                       
Running execution q55-v1.4 iteration: 2, StandardRun=true
Execution time: 1.252599s                                                       
Running execution q57-v1.4 iteration: 2, StandardRun=true
Execution time: 29.693986000000002s                                             
Running execution q59-v1.4 iteration: 2, StandardRun=true
Execution time: 5.106781s                                                       
Running execution q61-v1.4 iteration: 2, StandardRun=true
Execution time: 2.728202s                                                       
Running execution q62-v1.4 iteration: 2, StandardRun=true
Execution time: 2.33921s                                                        
Running execution q63-v1.4 iteration: 2, StandardRun=true
Execution time: 2.7000520000000003s                                             
Running execution q64-v1.4 iteration: 2, StandardRun=true
Execution time: 32.971809s                                                      
Running execution q65-v1.4 iteration: 2, StandardRun=true
Execution time: 8.930701s                                                       
Running execution q66-v1.4 iteration: 2, StandardRun=true
Execution time: 4.868188s                                                       
Running execution q67-v1.4 iteration: 2, StandardRun=true
Execution time: 13.643070999999999s                                             
Running execution q68-v1.4 iteration: 2, StandardRun=true
Execution time: 2.686043s                                                       
Running execution q71-v1.4 iteration: 2, StandardRun=true
Execution time: 3.889704s                                                       
Running execution q72-v1.4 iteration: 2, StandardRun=true
Execution time: 31.440593s                                                      
Running execution q73-v1.4 iteration: 2, StandardRun=true
16/05/23 02:04:15 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
14188
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_14188_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 02:04:15 WARN BlockManagerMaster: Failed to remove broadcast 14188 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_14188_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_14188_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 02:04:15 ERROR ContextCleaner: Error cleaning broadcast 14188
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_14188_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 1.988911s                                                       
Running execution q74-v1.4 iteration: 2, StandardRun=true
Execution time: 23.817432s                                                      
Running execution q75-v1.4 iteration: 2, StandardRun=true
Execution time: 56.739787s                                                      
Running execution q76-v1.4 iteration: 2, StandardRun=true
Execution time: 3.590033s                                                       
Running execution q77-v1.4 iteration: 2, StandardRun=true
Execution time: 5.798122s                                                       
Running execution q78-v1.4 iteration: 2, StandardRun=true
Execution time: 27.8167s                                                        
Running execution q79-v1.4 iteration: 2, StandardRun=true
Execution time: 2.921148s                                                       
Running execution q80-v1.4 iteration: 2, StandardRun=true
Execution time: 27.53409s                                                       
Running execution q82-v1.4 iteration: 2, StandardRun=true
Execution time: 3.352757s                                                       
Running execution q84-v1.4 iteration: 2, StandardRun=true
Execution time: 3.093203s                                                       
Running execution q85-v1.4 iteration: 2, StandardRun=true
Execution time: 14.708607s                                                      
Running execution q86-v1.4 iteration: 2, StandardRun=true
Execution time: 2.3017469999999998s                                             
Running execution q87-v1.4 iteration: 2, StandardRun=true
Execution time: 14.556993s                                                      
Running execution q88-v1.4 iteration: 2, StandardRun=true
Execution time: 5.764111s                                                       
Running execution q89-v1.4 iteration: 2, StandardRun=true
Execution time: 4.077344s                                                       
Running execution q90-v1.4 iteration: 2, StandardRun=true
Execution time: 1.214499s
Running execution q91-v1.4 iteration: 2, StandardRun=true
Execution time: 1.324179s
Running execution q93-v1.4 iteration: 2, StandardRun=true
Execution time: 11.672974s                                                      
Running execution q96-v1.4 iteration: 2, StandardRun=true
Execution time: 0.823091s
Running execution q97-v1.4 iteration: 2, StandardRun=true
Execution time: 6.4967120000000005s                                             
Running execution q98-v1.4 iteration: 2, StandardRun=true
Execution time: 3.31759s                                                        
Running execution q99-v1.4 iteration: 2, StandardRun=true
Execution time: 2.8289250000000004s                                             
Running execution qSsMax-v1.4 iteration: 2, StandardRun=true
Execution time: 2.127368s                                                       
Running execution q1-v1.4 iteration: 3, StandardRun=true
Execution time: 6.551859s                                                       
Running execution q2-v1.4 iteration: 3, StandardRun=true
Execution time: 3.737404s                                                       
Running execution q3-v1.4 iteration: 3, StandardRun=true
16/05/23 02:09:42 ERROR BlockManagerSlaveEndpoint: Error in removing broadcast 
15205
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_15205_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 1.204989s
Running execution q4-v1.4 iteration: 3, StandardRun=true
16/05/23 02:09:42 WARN BlockManagerMaster: Failed to remove broadcast 15205 
with removeFromMaster = true - Task -1024 has already locked 
broadcast_15205_piece0 for writing
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_15205_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 02:09:42 ERROR ContextCleaner: Error cleaning broadcast 15205
org.apache.spark.SparkException: Exception thrown in awaitResult
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:77)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$1.applyOrElse(RpcTimeout.scala:75)
        at 
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at 
org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59)
        at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167)
        at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83)
        at 
org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:135)
        at 
org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:260)
        at 
org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
        at 
org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:60)
        at 
org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:232)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:188)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$2.apply(ContextCleaner.scala:179)
        at scala.Option.foreach(Option.scala:257)
        at 
org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1.apply$mcV$sp(ContextCleaner.scala:179)
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1181)
        at 
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:172)
        at org.apache.spark.ContextCleaner$$anon$1.run(ContextCleaner.scala:67)
Caused by: java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_15205_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManager$$anonfun$removeBroadcast$2.apply(BlockManager.scala:1287)
        at scala.collection.Iterator$class.foreach(Iterator.scala:893)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
        at 
org.apache.spark.storage.BlockManager.removeBroadcast(BlockManager.scala:1287)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply$mcI$sp(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$4.apply(BlockManagerSlaveEndpoint.scala:66)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 41.768116s                                                      
Running execution q5-v1.4 iteration: 3, StandardRun=true
Execution time: 11.956498999999999s                                             
Running execution q7-v1.4 iteration: 3, StandardRun=true
Execution time: 3.4474810000000002s                                             
Running execution q8-v1.4 iteration: 3, StandardRun=true
Execution time: 2.920618s
Running execution q9-v1.4 iteration: 3, StandardRun=true
16/05/23 02:11:05 ERROR Executor: Exception in task 0.0 in stage 4595.0 (TID 
330531)
java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
16/05/23 02:11:05 WARN TaskSetManager: Lost task 0.0 in stage 4595.0 (TID 
330531, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

16/05/23 02:11:05 ERROR TaskSetManager: Task 0 in stage 4595.0 failed 1 times; 
aborting job
Execution 'q9-v1.4' failed: Job aborted due to stage failure: Task 0 in stage 
4595.0 failed 1 times, most recent failure: Lost task 0.0 in stage 4595.0 (TID 
330531, localhost): java.lang.NullPointerException
        at 
org.apache.spark.sql.execution.ScalarSubquery.dataType(subquery.scala:45)
        at 
org.apache.spark.sql.catalyst.expressions.CaseWhenBase.dataType(conditionalExpressions.scala:103)
        at 
org.apache.spark.sql.catalyst.expressions.Alias.toAttribute(namedExpressions.scala:165)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.ProjectExec$$anonfun$output$1.apply(basicPhysicalOperators.scala:33)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.immutable.List.map(List.scala:285)
        at 
org.apache.spark.sql.execution.ProjectExec.output(basicPhysicalOperators.scala:33)
        at 
org.apache.spark.sql.execution.WholeStageCodegenExec.output(WholeStageCodegenExec.scala:289)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:61)
        at 
org.apache.spark.sql.execution.DeserializeToObject$$anonfun$2.apply(objects.scala:60)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$23.apply(RDD.scala:774)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:318)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:282)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
        at org.apache.spark.scheduler.Task.run(Task.scala:85)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

Driver stacktrace:
Running execution q11-v1.4 iteration: 3, StandardRun=true
Execution time: 25.282606s                                                      
Running execution q12-v1.4 iteration: 3, StandardRun=true
Execution time: 2.370492s                                                       
Running execution q13-v1.4 iteration: 3, StandardRun=true
Execution time: 5.721276s                                                       
Running execution q15-v1.4 iteration: 3, StandardRun=true
Execution time: 3.2996909999999997s                                             
Running execution q17-v1.4 iteration: 3, StandardRun=true
Execution time: 22.646562999999997s                                             
Running execution q18-v1.4 iteration: 3, StandardRun=true
16/05/23 02:12:38 WARN BlockManager: Asked to remove block 
broadcast_15671_piece0, which does not exist
Execution time: 6.552301000000001s
Running execution q19-v1.4 iteration: 3, StandardRun=true
Execution time: 2.007296s                                                       
Running execution q20-v1.4 iteration: 3, StandardRun=true
Execution time: 2.8308910000000003s                                             
Running execution q21-v1.4 iteration: 3, StandardRun=true
Execution time: 1.753204s                                                       
Running execution q22-v1.4 iteration: 3, StandardRun=true
Execution time: 6.024535s                                                       
Running execution q25-v1.4 iteration: 3, StandardRun=true
Execution time: 19.104685s                                                      
Running execution q26-v1.4 iteration: 3, StandardRun=true
Execution time: 2.820123s                                                       
Running execution q27-v1.4 iteration: 3, StandardRun=true
Execution time: 3.749286s                                                       
Running execution q28-v1.4 iteration: 3, StandardRun=true
Execution time: 14.530953s                                                      
Running execution q29-v1.4 iteration: 3, StandardRun=true
Execution time: 19.537715s                                                      
Running execution q31-v1.4 iteration: 3, StandardRun=true
Execution time: 13.863425s                                                      
Running execution q34-v1.4 iteration: 3, StandardRun=true
Execution time: 3.211855s                                                       
Running execution q36-v1.4 iteration: 3, StandardRun=true
Execution time: 3.240235s                                                       
Running execution q37-v1.4 iteration: 3, StandardRun=true
Execution time: 3.407339s                                                       
Running execution q38-v1.4 iteration: 3, StandardRun=true
Execution time: 12.08907s                                                       
Running execution q39a-v1.4 iteration: 3, StandardRun=true
16/05/23 02:15:22 WARN BlockManager: Asked to remove block 
broadcast_16166_piece0, which does not exist
16/05/23 02:15:22 WARN BlockManager: Asked to remove block 
broadcast_16161_piece0, which does not exist
Execution time: 7.6058900000000005s
Running execution q39b-v1.4 iteration: 3, StandardRun=true
Execution time: 5.649876s                                                       
Running execution q40-v1.4 iteration: 3, StandardRun=true
Execution time: 7.734599s                                                       
Running execution q42-v1.4 iteration: 3, StandardRun=true
Execution time: 1.183594s                                                       
Running execution q43-v1.4 iteration: 3, StandardRun=true
16/05/23 02:15:44 ERROR BlockManagerSlaveEndpoint: Error in removing block 
broadcast_16247_piece0
java.lang.IllegalStateException: Task -1024 has already locked 
broadcast_16247_piece0 for writing
        at 
org.apache.spark.storage.BlockInfoManager.lockForWriting(BlockInfoManager.scala:232)
        at 
org.apache.spark.storage.BlockManager.removeBlock(BlockManager.scala:1296)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply$mcZ$sp(BlockManagerSlaveEndpoint.scala:47)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$1.apply(BlockManagerSlaveEndpoint.scala:46)
        at 
org.apache.spark.storage.BlockManagerSlaveEndpoint$$anonfun$1.apply(BlockManagerSlaveEndpoint.scala:82)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
        at 
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Execution time: 2.084303s                                                       
Running execution q44-v1.4 iteration: 3, StandardRun=true
16/05/23 02:15:49 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:15:49 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:15:50 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:15:50 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:15:50 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:15:50 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 5.107415s                                                       
Running execution q46-v1.4 iteration: 3, StandardRun=true
Execution time: 3.718758s                                                       
Running execution q47-v1.4 iteration: 3, StandardRun=true
Execution time: 35.893728s                                                      
Running execution q48-v1.4 iteration: 3, StandardRun=true
16/05/23 02:16:54 WARN BlockManager: Asked to remove block 
broadcast_16409_piece0, which does not exist
Execution time: 5.207007s
Running execution q49-v1.4 iteration: 3, StandardRun=true
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:55 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
16/05/23 02:16:56 WARN WindowExec: No Partition Defined for Window operation! 
Moving all data to a single partition, this can cause serious performance 
degradation.
Execution time: 14.54847s                                                       
Running execution q50-v1.4 iteration: 3, StandardRun=true
Execution time: 10.920971999999999s                                             
Running execution q51-v1.4 iteration: 3, StandardRun=true
Execution time: 30.286877s                                                      
Running execution q52-v1.4 iteration: 3, StandardRun=true
Execution time: 1.39721s                                                        
Running execution q53-v1.4 iteration: 3, StandardRun=true
Execution time: 3.7150309999999998s                                             
Running execution q54-v1.4 iteration: 3, StandardRun=true
Execution time: 8.611286s                                                       
Running execution q55-v1.4 iteration: 3, StandardRun=true
Execution time: 1.309299s                                                       
Running execution q57-v1.4 iteration: 3, StandardRun=true
16/05/23 02:19:05 WARN BlockManager: Asked to remove block 
broadcast_16664_piece0, which does not exist
Execution time: 30.944722000000002s
Running execution q59-v1.4 iteration: 3, StandardRun=true
Execution time: 5.298536s                                                       
Running execution q61-v1.4 iteration: 3, StandardRun=true
Execution time: 2.833521s                                                       
Running execution q62-v1.4 iteration: 3, StandardRun=true
Execution time: 2.787988s                                                       
Running execution q63-v1.4 iteration: 3, StandardRun=true
Execution time: 2.930303s                                                       
Running execution q64-v1.4 iteration: 3, StandardRun=true
Execution time: 37.478899s                                                      
Running execution q65-v1.4 iteration: 3, StandardRun=true
Execution time: 8.869102999999999s                                              
Running execution q66-v1.4 iteration: 3, StandardRun=true
16/05/23 02:20:41 WARN BlockManager: Asked to remove block 
broadcast_17038_piece0, which does not exist
Execution time: 5.018206s
Running execution q67-v1.4 iteration: 3, StandardRun=true
Execution time: 14.273181000000001s                                             
Running execution q68-v1.4 iteration: 3, StandardRun=true
Execution time: 3.0729450000000003s                                             
Running execution q71-v1.4 iteration: 3, StandardRun=true
Execution time: 4.273834s                                                       
Running execution q72-v1.4 iteration: 3, StandardRun=true
Execution time: 34.619055s                                                      
Running execution q73-v1.4 iteration: 3, StandardRun=true
Execution time: 2.276553s                                                       
Running execution q74-v1.4 iteration: 3, StandardRun=true
Execution time: 26.942042s                                                      
Running execution q75-v1.4 iteration: 3, StandardRun=true
Execution time: 59.611231s                                                      
Running execution q76-v1.4 iteration: 3, StandardRun=true
Execution time: 3.883047s                                                       
Running execution q77-v1.4 iteration: 3, StandardRun=true
Execution time: 7.909883s                                                       
Running execution q78-v1.4 iteration: 3, StandardRun=true
Execution time: 31.689701s                                                      
Running execution q79-v1.4 iteration: 3, StandardRun=true
Execution time: 3.179386s                                                       
Running execution q80-v1.4 iteration: 3, StandardRun=true
16/05/23 02:25:11 WARN BlockManager: Asked to remove block 
broadcast_17622_piece0, which does not exist
Execution time: 30.073036s
Running execution q82-v1.4 iteration: 3, StandardRun=true
Execution time: 3.748829s                                                       
Running execution q84-v1.4 iteration: 3, StandardRun=true
Execution time: 3.658004s                                                       
Running execution q85-v1.4 iteration: 3, StandardRun=true
Execution time: 9.480852s                                                       
Running execution q86-v1.4 iteration: 3, StandardRun=true
Execution time: 2.383626s                                                       
Running execution q87-v1.4 iteration: 3, StandardRun=true
Execution time: 14.405725s                                                      
Running execution q88-v1.4 iteration: 3, StandardRun=true
Execution time: 5.485186s                                                       
Running execution q89-v1.4 iteration: 3, StandardRun=true
Execution time: 3.775125s                                                       
Running execution q90-v1.4 iteration: 3, StandardRun=true
Execution time: 1.327702s
Running execution q91-v1.4 iteration: 3, StandardRun=true
Execution time: 1.415802s
Running execution q93-v1.4 iteration: 3, StandardRun=true
Execution time: 11.195635s                                                      
Running execution q96-v1.4 iteration: 3, StandardRun=true
Execution time: 0.7678200000000001s
Running execution q97-v1.4 iteration: 3, StandardRun=true
Execution time: 7.154675s                                                       
Running execution q98-v1.4 iteration: 3, StandardRun=true
Execution time: 3.357157s                                                       
Running execution q99-v1.4 iteration: 3, StandardRun=true
Execution time: 2.6294560000000002s                                             
Running execution qSsMax-v1.4 iteration: 3, StandardRun=true
Execution time: 2.1649520000000004s 

> Add all TPCDS 1.4 benchmark queries for SparkSQL
> ------------------------------------------------
>
>                 Key: SPARK-15078
>                 URL: https://issues.apache.org/jira/browse/SPARK-15078
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Sameer Agarwal
>            Assignee: Sameer Agarwal
>             Fix For: 2.0.0, 2.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org