[
https://issues.apache.org/jira/browse/SPARK-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-15982:
----------------------------------
Description:
Issues with current reader behavior.
- `text()` without args returns an empty DF with no columns -> inconsistent,
its expected that text will always return a DF with `value` string field,
- `textFile()` without args fails with exception because of the above reason,
it expected the DF returned by `text()` to have a `value` field.
- `orc()` does not have var args, inconsistent with others
- `json(single-arg)` was removed, but that caused source compatibility issues -
> Harmonize the behavior of DataFrameReader.text/csv/json/parquet/orc
> -------------------------------------------------------------------
>
> Key: SPARK-15982
> URL: https://issues.apache.org/jira/browse/SPARK-15982
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Tathagata Das
> Assignee: Tathagata Das
>
> Issues with current reader behavior.
> - `text()` without args returns an empty DF with no columns -> inconsistent,
> its expected that text will always return a DF with `value` string field,
> - `textFile()` without args fails with exception because of the above reason,
> it expected the DF returned by `text()` to have a `value` field.
> - `orc()` does not have var args, inconsistent with others
> - `json(single-arg)` was removed, but that caused source compatibility issues
> -
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
