[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629119#comment-14629119
]
Zhang, Liye commented on SPARK-9044:
------------------------------------
It doesn't matter where *RDDInfo* belongs to which component. It's just a class
contain's RDD infomation and Web UI uses this class. The info showed on Web UI
is based on *sparkListener*, and only if there are changes/updates of the RDD
status, the updated information will be posted to the listeners. And here, if
you just change the RDD name, the CacheManager would not think it need to
update anything, and this is where the bug locates.
For spark-shell, it is the driver, and it knows the RDD name's change, the
spark driver and the Web UI are two separated "systems". That's why you can see
the update from spark-shell but cannot see it from Web UI.
> Updated RDD name does not reflect under "Storage" tab
> -----------------------------------------------------
>
> Key: SPARK-9044
> URL: https://issues.apache.org/jira/browse/SPARK-9044
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.3.1, 1.4.0
> Environment: Mac OSX
> Reporter: Wenjie Zhang
> Priority: Minor
>
> I was playing the spark-shell in my macbook, here is what I did:
> scala> val textFile = sc.textFile("/Users/jackzhang/Downloads/ProdPart.txt");
> scala> textFile.cache
> scala> textFile.setName("test1")
> scala> textFile.collect
> scala> textFile.name
> res10: String = test1
> After this four commands, I can see the "test1" RDD listed in the "Storage"
> tab.
> However, if I continually run following commands, nothing will happen from
> the "Storage" tab:
> scala> textFile.setName("test2")
> scala> textFile.cache
> scala> textFile.collect
> scala> textFile.name
> res10: String = test2
> I am expecting the name of the RDD shows in "Storage" tab should be "test2",
> is this a bug?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
