[jira] [Updated] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-24130: --- Attachment: Data Source V2 Join Push Down.pdf > Data Source V2: Join Push Down > ---

[jira] [Comment Edited] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473765#comment-16473765 ] Jia Li edited comment on SPARK-24130 at 5/14/18 4:48 AM: - Thank y

[jira] [Commented] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473765#comment-16473765 ] Jia Li commented on SPARK-24130: Thank you for letting me know the permission issue, Ryan

[jira] [Created] (SPARK-24130) Data Source V2: Join Push Down

Jia Li created SPARK-24130: -- Summary: Data Source V2: Join Push Down Key: SPARK-24130 URL: https://issues.apache.org/jira/browse/SPARK-24130 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

Jia Li created SPARK-22548: -- Summary: Incorrect nested AND expression pushed down to JDBC data source Key: SPARK-22548 URL: https://issues.apache.org/jira/browse/SPARK-22548 Project: Spark Issue Ty

[jira] [Commented] (SPARK-20885) JDBC predicate pushdown uses hardcoded date format

[ https://issues.apache.org/jira/browse/SPARK-20885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025533#comment-16025533 ] Jia Li commented on SPARK-20885: I can help to take a look at this. > JDBC predicate pu

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15239894#comment-15239894 ] Jia Li commented on SPARK-14548: Microsoft SQL Server, IBM DB2 and Sybase Adaptive Server

[jira] [Created] (SPARK-14548) Support !> and !< operator in Spark SQL

Jia Li created SPARK-14548: -- Summary: Support !> and !< operator in Spark SQL Key: SPARK-14548 URL: https://issues.apache.org/jira/browse/SPARK-14548 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13155) add runtime null check when convert catalyst array to external array

[ https://issues.apache.org/jira/browse/SPARK-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15132039#comment-15132039 ] Jia Li commented on SPARK-13155: [~cloud_fan] I was able to reproduce this bug on an olde

[jira] [Issue Comment Deleted] (SPARK-13155) add runtime null check when convert catalyst array to external array

[ https://issues.apache.org/jira/browse/SPARK-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-13155: --- Comment: was deleted (was: I'm working on a fix for this.) > add runtime null check when convert catalyst ar

[jira] [Commented] (SPARK-13155) add runtime null check when convert catalyst array to external array

[ https://issues.apache.org/jira/browse/SPARK-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15131874#comment-15131874 ] Jia Li commented on SPARK-13155: I'm working on a fix for this. > add runtime null check

[jira] [Commented] (SPARK-12779) StringIndexer should handle null

[ https://issues.apache.org/jira/browse/SPARK-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095048#comment-15095048 ] Jia Li commented on SPARK-12779: Hi, I believe this is the same issue as https://issues.

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001439#comment-15001439 ] Jia Li commented on SPARK-11569: Hi [~josephkb] [~holdenk_amp], I'd like to hear your op

[jira] [Commented] (SPARK-11643) inserting date with leading zero inserts null example '0001-12-10'

[ https://issues.apache.org/jira/browse/SPARK-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1536#comment-1536 ] Jia Li commented on SPARK-11643: I looked into the code and found this behavior change wa

[jira] [Commented] (SPARK-11643) inserting date with leading zero inserts null example '0001-12-10'

[ https://issues.apache.org/jira/browse/SPARK-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999624#comment-14999624 ] Jia Li commented on SPARK-11643: I'm able to reproduce this issue. I can take a look. >

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995534#comment-14995534 ] Jia Li commented on SPARK-11569: I'm working on a PR to fix this. > StringIndexer trans

[jira] [Updated] (SPARK-11277) sort_array throws exception scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-11277: --- Description: I was trying out the sort_array function then hit this exception. I looked into the spark sour

[jira] [Updated] (SPARK-11277) sort_array throws exception scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-11277: --- Priority: Major (was: Minor) > sort_array throws exception scala.MatchError > --

[jira] [Commented] (SPARK-11277) sort_array throws exception scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970654#comment-14970654 ] Jia Li commented on SPARK-11277: I already have a fix for this issue and I'm going to cre

[jira] [Updated] (SPARK-11277) sort_array throws exception scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-11277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-11277: --- Description: I was trying out the sort_array function then hit this exception. I looked into the spark sour

[jira] [Created] (SPARK-11277) sort_array throws exception scala.MatchError

Jia Li created SPARK-11277: -- Summary: sort_array throws exception scala.MatchError Key: SPARK-11277 URL: https://issues.apache.org/jira/browse/SPARK-11277 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960052#comment-14960052 ] Jia Li commented on SPARK-5472: --- [~tmyklebu] Does your PR handle BINARY type? Thanks, > A

[jira] [Commented] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952242#comment-14952242 ] Jia Li commented on SPARK-11051: I would like to work on this issue. > NullPointerExcept

[jira] [Updated] (SPARK-10794) Spark-SQL- select query on table column with binary Data Type displays error message- java.lang.ClassCastException: java.lang.String cannot be cast to [B

[ https://issues.apache.org/jira/browse/SPARK-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-10794: --- Attachment: spark_1_5_0.png > Spark-SQL- select query on table column with binary Data Type displays error >

[jira] [Commented] (SPARK-10794) Spark-SQL- select query on table column with binary Data Type displays error message- java.lang.ClassCastException: java.lang.String cannot be cast to [B

[ https://issues.apache.org/jira/browse/SPARK-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945567#comment-14945567 ] Jia Li commented on SPARK-10794: I tried the repro steps on spark 1.5.0 for hadoop 2.6 an