[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217875#comment-17217875
]
Walt Elder commented on SPARK-22236:
[~snemmal], try:
{quote}.option("quote", """){quote}
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975776#comment-16975776
]
Santhosh commented on SPARK-22236:
--
The code mentioned above
spark.read.option('escape',
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582933#comment-16582933
]
Steve Loughran commented on SPARK-22236:
bq. But is the implication that we can never change the
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582930#comment-16582930
]
Steve Loughran commented on SPARK-22236:
bq. One can always repartition after reading, and if
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580229#comment-16580229
]
Joe Pallas commented on SPARK-22236:
{quote}people with preexisting datasets exported by Spark would
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579974#comment-16579974
]
Ondrej Kokes commented on SPARK-22236:
--
Multiline=true by default would cause some slowdown, but
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577063#comment-16577063
]
Joe Pallas commented on SPARK-22236:
One can always repartition after reading, and if the input is
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575629#comment-16575629
]
Steve Loughran commented on SPARK-22236:
I wouldn't recommend changing multiline=true by default
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575305#comment-16575305
]
Joe Pallas commented on SPARK-22236:
If this can't change before 3.0, how about a note in the
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481655#comment-16481655
]
Ondrej Kokes commented on SPARK-22236:
--
There is one more setting that makes the default CSV parser
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199869#comment-16199869
]
Ondrej Kokes commented on SPARK-22236:
--
Thanks for the comments! I originally forgot to note [where
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199825#comment-16199825
]
Hyukjin Kwon commented on SPARK-22236:
--
Yup, what is said ^ looks all correct. I think we should set
[
https://issues.apache.org/jira/browse/SPARK-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199245#comment-16199245
]
Sean Owen commented on SPARK-22236:
---
Interesting, because the Univocity parser internally seems to
13 matches
Mail list logo
