HyukjinKwon edited a comment on issue #28058: [SPARK-31290][R] Add back the deprecated R APIs URL: https://github.com/apache/spark/pull/28058#issuecomment-605758357 It seems more complicated than I thought. Let me try to clarify the current status here: #### `jsonFile` and `parquetFile` - Scala side, `jsonFile`, `parquetFile` were removed at https://github.com/apache/spark/pull/10559 and recovered at https://github.com/apache/spark/pull/13637 in the same Spark 2.0. - PySpark side, they were removed at https://github.com/apache/spark/pull/10559 and were not recovered afterwards. - SparkR side, they were never removed #### `jsonRDD` - SparkR made RDD API as private APIs as of SPARK-7230; RDD related APIs are supposed to be removed as they are uesless. #### `saveAsParquetFile` - Scala side `saveAsParquetFile` was removed at https://github.com/apache/spark/pull/10559 - PySpark side, it was also removed at https://github.com/apache/spark/pull/10559. - SparkR side, it was never removed. I skimmed user-mailing list with keyword search, and I found no complaints. This implies, no complaints found about: - `jsonFile`, `parquetFile` and `jsonRDD` missing in PySpark from Spark 2.0 - `saveAsParquetFile` in Scala and PySpark from Spark 2.0 So, I guess it's fine to don't add `jsonFile`, `parquetFile`, `jsonRDD` and `saveAsParquetFile` back. <br/> **TL;DR**: from my rough investigation, I think it's fine to don't add `jsonFile`, `parquetFile`, `jsonRDD` and `saveAsParquetFile` because: - people don't quite care about `jsonFile`, `parquetFile`, `jsonRDD` and `saveAsParquetFile`. - `jsonFile` and `parquetFile` don't exist in PySpark. - `jsonRDD` is useless as RDD APIs became private in SparkR. - `saveAsParquetFile` does not exist in Scala and PySpark sides. WDYT @falaki and @mengxr?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
