manuzhang commented on pull request #28916:
URL: https://github.com/apache/spark/pull/28916#issuecomment-650909946
@cloud-fan Yes, also from the UT log before this change (I enabled the
lineage log)
```
===== TEST OUTPUT FOR o.a.s.sql.execution.adaptive.AdaptiveQueryExecSuite:
'Empty stage coalesced to 0-partition RDD' =====
...
22:06:00.535 ScalaTest-run-running-AdaptiveQueryExecSuite INFO
ShufflePartitionsUtil: For shuffle(0, 1), advisory target size: 67108864,
actual target size 16.
22:06:00.683 ScalaTest-run-running-AdaptiveQueryExecSuite INFO
CodeGenerator: Code generated in 88.071331 ms
22:06:00.700 ScalaTest-run-running-AdaptiveQueryExecSuite INFO
CodeGenerator: Code generated in 11.333313 ms
22:06:00.752 ScalaTest-run-running-AdaptiveQueryExecSuite INFO
CodeGenerator: Code generated in 9.213245 ms
22:06:00.801 ScalaTest-run-running-AdaptiveQueryExecSuite INFO
CodeGenerator: Code generated in 12.257591 ms
22:06:00.855 ScalaTest-run-running-AdaptiveQueryExecSuite INFO SparkContext:
Starting job: apply at OutcomeOf.scala:85
22:06:00.858 ScalaTest-run-running-AdaptiveQueryExecSuite INFO SparkContext:
RDD's recursive dependencies:
(5) MapPartitionsRDD[43] at apply at OutcomeOf.scala:85 []
| SQLExecutionRDD[42] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[41] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[40] at apply at OutcomeOf.scala:85 []
| ShuffledRowRDD[39] at apply at OutcomeOf.scala:85 []
+-(0) MapPartitionsRDD[38] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[37] at apply at OutcomeOf.scala:85 []
| ZippedPartitionsRDD2[36] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[33] at apply at OutcomeOf.scala:85 []
| ShuffledRowRDD[32] at apply at OutcomeOf.scala:85 []
+-(2) MapPartitionsRDD[27] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[26] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[25] at apply at OutcomeOf.scala:85 []
| ParallelCollectionRDD[24] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[35] at apply at OutcomeOf.scala:85 []
| ShuffledRowRDD[34] at apply at OutcomeOf.scala:85 []
+-(2) MapPartitionsRDD[31] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[30] at apply at OutcomeOf.scala:85 []
| MapPartitionsRDD[29] at apply at OutcomeOf.scala:85 []
| ParallelCollectionRDD[28] at apply at OutcomeOf.scala:85 []
22:06:00.860 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 38
(apply at OutcomeOf.scala:85) as input to shuffle 2
22:06:00.861 dag-scheduler-event-loop INFO DAGScheduler: Got job 2 (apply at
OutcomeOf.scala:85) with 5 output partitions
22:06:00.861 dag-scheduler-event-loop INFO DAGScheduler: Final stage:
ResultStage 5 (apply at OutcomeOf.scala:85)
22:06:00.861 dag-scheduler-event-loop INFO DAGScheduler: Parents of final
stage: List(ShuffleMapStage 4)
22:06:00.862 dag-scheduler-event-loop INFO DAGScheduler: Missing parents:
List()
22:06:00.863 dag-scheduler-event-loop INFO DAGScheduler: Submitting
ResultStage 5 (MapPartitionsRDD[43] at apply at OutcomeOf.scala:85), which has
no missing parents
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
