ABHISHEK KUMAR GUPTA created SPARK-30484: --------------------------------------------
Summary: Job History Storage Tab does not display RDD Table Key: SPARK-30484 URL: https://issues.apache.org/jira/browse/SPARK-30484 Project: Spark Issue Type: Bug Components: Web UI Affects Versions: 3.0.0 Reporter: ABHISHEK KUMAR GUPTA scala> import org.apache.spark.storage.StorageLevel._ import org.apache.spark.storage.StorageLevel._ scala> val rdd = sc.range(0, 100, 1, 5).setName("rdd") rdd: org.apache.spark.rdd.RDD[Long] = rdd MapPartitionsRDD[1] at range at <console>:27 scala> rdd.persist(MEMORY_ONLY_SER) res0: rdd.type = rdd MapPartitionsRDD[1] at range at <console>:27 scala> rdd.count res1: Long = 100 scala> val df = Seq((1, "andy"), (2, "bob"), (2, "andy")).toDF("count", "name") df: org.apache.spark.sql.DataFrame = [count: int, name: string] scala> df.persist(DISK_ONLY) res2: df.type = [count: int, name: string] scala> df.count res3: Long = 3 Open Storage Tab under Incomplete Jobs in Job History Page UI will not display the RDD Table. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org