yaron weinsberg created SPARK-12517:
---------------------------------------
Summary: No default RDD name for ones created by sc.textFile
Key: SPARK-12517
URL: https://issues.apache.org/jira/browse/SPARK-12517
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.5.2, 1.5.0, 1.4.1, 1.4.0
Reporter: yaron weinsberg
Priority: Minor
Fix For: 1.3.1
Having a default name for an RDD created from a file is very handy.
The feature was first added at commit: 7b877b2 but was later removed (probably
by mistake) at commit: fc8b581.
This change sets the default path of RDDs created via sc.textFile(...) to the
path argument.
Here is the symptom:
Using spark-1.5.2-bin-hadoop2.6:
scala> sc.textFile("/home/root/.bashrc").name
res5: String = null
scala> sc.binaryFiles("/home/root/.bashrc").name
res6: String = /home/root/.bashrc
while using Spark 1.3.1:
scala> sc.textFile("/home/root/.bashrc").name
res0: String = /home/root/.bashrc
scala> sc.binaryFiles("/home/root/.bashrc").name
res1: String = /home/root/.bashrc
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
