[
https://issues.apache.org/jira/browse/SPARK-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-3205.
----------------------------------
Resolution: Later
Moved the implementation to https://github.com/mengxr/redshift-input-format. If
people feel this input format is common, we can move it to Spark Core later.
> input format for text records saved with in-record delimiter and newline
> characters escaped
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-3205
> URL: https://issues.apache.org/jira/browse/SPARK-3205
> Project: Spark
> Issue Type: New Feature
> Components: Spark Core, SQL
> Reporter: Xiangrui Meng
> Assignee: Xiangrui Meng
>
> Text records may contain in-record delimiter or newline characters. In such
> cases, we can either encode them or escape them. The latter is simpler and
> used by Redshift's UNLOAD with the ESCAPE option. The problem is that a
> record will span multiple lines. We need an input format for it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
