[jira] [Commented] (SPARK-21677) json_tuple throws NullPointException when column is null as string type.

2017-08-10 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121641#comment-16121641 ] Jen-Ming Chung commented on SPARK-21677: to [~hyukjin.kwon], the return {{NULL}} you mentioned

[jira] [Comment Edited] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-07 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116126#comment-16116126 ] Jen-Ming Chung edited comment on SPARK-21610 at 8/7/17 2:07 PM: I have

[jira] [Comment Edited] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-07 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116126#comment-16116126 ] Jen-Ming Chung edited comment on SPARK-21610 at 8/7/17 6:33 AM: User

[jira] [Commented] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-07 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116126#comment-16116126 ] Jen-Ming Chung commented on SPARK-21610: User 'jmchung' has created a pull request for this

[jira] [Comment Edited] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-07 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116126#comment-16116126 ] Jen-Ming Chung edited comment on SPARK-21610 at 8/7/17 6:33 AM: User

[jira] [Comment Edited] (SPARK-22019) JavaBean int type property

2017-09-15 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167734#comment-16167734 ] Jen-Ming Chung edited comment on SPARK-22019 at 9/15/17 11:29 AM: -- The

[jira] [Comment Edited] (SPARK-22019) JavaBean int type property

2017-09-15 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167725#comment-16167725 ] Jen-Ming Chung edited comment on SPARK-22019 at 9/15/17 11:18 AM: -- Hi

[jira] [Commented] (SPARK-22019) JavaBean int type property

2017-09-15 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167725#comment-16167725 ] Jen-Ming Chung commented on SPARK-22019: Hi [~client.test], The schema inferred after

[jira] [Commented] (SPARK-22019) JavaBean int type property

2017-09-15 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167734#comment-16167734 ] Jen-Ming Chung commented on SPARK-22019: The alternative is giving the explicit schema instead

[jira] [Comment Edited] (SPARK-22019) JavaBean int type property

2017-09-15 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167734#comment-16167734 ] Jen-Ming Chung edited comment on SPARK-22019 at 9/15/17 11:28 AM: -- The

[jira] [Commented] (SPARK-22283) withColumn should replace multiple instances with a single one

2017-10-16 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206988#comment-16206988 ] Jen-Ming Chung commented on SPARK-22283: Hi [~kitbellew], I found the `withColumn` has already

[jira] [Comment Edited] (SPARK-22283) withColumn should replace multiple instances with a single one

2017-10-16 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206988#comment-16206988 ] Jen-Ming Chung edited comment on SPARK-22283 at 10/17/17 4:45 AM: -- Hi

[jira] [Comment Edited] (SPARK-21989) createDataset and the schema of encoder class

2017-09-12 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung edited comment on SPARK-21989 at 9/13/17 5:27 AM: - Hi

[jira] [Comment Edited] (SPARK-21989) createDataset and the schema of encoder class

2017-09-13 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung edited comment on SPARK-21989 at 9/13/17 6:16 AM: - Hi

[jira] [Comment Edited] (SPARK-21989) createDataset and the schema of encoder class

2017-09-12 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung edited comment on SPARK-21989 at 9/13/17 4:58 AM: - Hi

[jira] [Commented] (SPARK-21989) createDataset and the schema of encoder class

2017-09-12 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung commented on SPARK-21989: Hi [~client.test], I write the above code in scala and

[jira] [Comment Edited] (SPARK-21989) createDataset and the schema of encoder class

2017-09-12 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung edited comment on SPARK-21989 at 9/13/17 4:55 AM: - Hi

[jira] [Comment Edited] (SPARK-21989) createDataset and the schema of encoder class

2017-09-12 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164152#comment-16164152 ] Jen-Ming Chung edited comment on SPARK-21989 at 9/13/17 4:56 AM: - Hi

[jira] [Commented] (SPARK-21804) json_tuple returns null values within repeated columns except the first one

2017-08-22 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136594#comment-16136594 ] Jen-Ming Chung commented on SPARK-21804: Submitted a PR at

[jira] [Commented] (SPARK-21804) json_tuple returns null values within repeated columns except the first one

2017-08-22 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136385#comment-16136385 ] Jen-Ming Chung commented on SPARK-21804: I’m working on this > json_tuple returns null values

[jira] [Created] (SPARK-21804) json_tuple returns null values within repeated columns except the first one

2017-08-22 Thread Jen-Ming Chung (JIRA)
Jen-Ming Chung created SPARK-21804: -- Summary: json_tuple returns null values within repeated columns except the first one Key: SPARK-21804 URL: https://issues.apache.org/jira/browse/SPARK-21804

[jira] [Commented] (SPARK-21684) df.write double escaping all the already escaped characters except the first one

2017-08-25 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141790#comment-16141790 ] Jen-Ming Chung commented on SPARK-21684: Hi, [~taransaini43] If udf_comma with

[jira] [Issue Comment Deleted] (SPARK-21684) df.write double escaping all the already escaped characters except the first one

2017-08-25 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jen-Ming Chung updated SPARK-21684: --- Comment: was deleted (was: Hi, [~taransaini43] If udf_comma with {{.option("escape", "\"")}}

[jira] [Commented] (SPARK-22291) Postgresql UUID[] to Cassandra: Conversion Error

2017-10-29 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224248#comment-16224248 ] Jen-Ming Chung commented on SPARK-22291: Thank you all :) > Postgresql UUID[] to Cassandra:

[jira] [Issue Comment Deleted] (SPARK-19039) UDF ClosureCleaner bug when UDF, col applied in paste mode in REPL

2017-10-31 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jen-Ming Chung updated SPARK-19039: --- Comment: was deleted (was: It's weird..you will not get error messages if you paste the code

[jira] [Commented] (SPARK-19039) UDF ClosureCleaner bug when UDF, col applied in paste mode in REPL

2017-10-31 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226528#comment-16226528 ] Jen-Ming Chung commented on SPARK-19039: It's weird..you will not get error messages if you paste