[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:55 PM: -- I see the same

[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:44 PM: -- I see the same

[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:41 PM: -- I see the same

[jira] [Commented] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729825#comment-17729825 ] Zach Liu commented on SPARK-36277: -- I see the same behavior on Spark 3.3.1. I have to create this

[jira] [Commented] (SPARK-43389) spark.read.csv throws NullPointerException when lineSep is set to None

2023-05-08 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720568#comment-17720568 ] Zach Liu commented on SPARK-43389: -- that's why i set the type as "Improvement" and the priority as

[jira] [Created] (SPARK-43389) spark.read.csv throws NullPointerException when lineSep is set to None

2023-05-05 Thread Zach Liu (Jira)
Zach Liu created SPARK-43389: Summary: spark.read.csv throws NullPointerException when lineSep is set to None Key: SPARK-43389 URL: https://issues.apache.org/jira/browse/SPARK-43389 Project: Spark