[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

2019-10-01 Thread Paul Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942090#comment-16942090 ] Paul Wu edited comment on SPARK-20427 at 10/1/19 4:13 PM: -- Some one asked me

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

2019-10-01 Thread Paul Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942090#comment-16942090 ] Paul Wu edited comment on SPARK-20427 at 10/1/19 3:49 PM: -- Some one asked me

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

2019-10-01 Thread Paul Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942090#comment-16942090 ] Paul Wu commented on SPARK-20427: - Some one asked me this problem months ago and I found a solution for

[jira] [Updated] (SPARK-27077) DataFrameReader and Number of Connection Limitation

2019-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-27077: Description: I am not very sure this is a Spark core issue or a Vertica issue, however I intended to

[jira] [Created] (SPARK-27077) DataFrameReader and Number of Connection Limitation

2019-03-06 Thread Paul Wu (JIRA)
Paul Wu created SPARK-27077: --- Summary: DataFrameReader and Number of Connection Limitation Key: SPARK-27077 URL: https://issues.apache.org/jira/browse/SPARK-27077 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22371) dag-scheduler-event-loop thread stopped with error Attempted to access garbage collected accumulator 5605982

2018-05-07 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466099#comment-16466099 ] Paul Wu commented on SPARK-22371: - Got the same problem with 2.3 and also the program stalled: {{ 

[jira] [Resolved] (SPARK-23617) Register a Function without params with Spark SQL Java API

2018-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu resolved SPARK-23617. - Resolution: Duplicate Fix Version/s: 2.3.0 As commented by Hyukjin Kwon, the issue is duplicated

[jira] [Updated] (SPARK-23617) Register a Function without params with Spark SQL Java API

2018-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-23617: Description: One can register a function using Scala: {{spark.udf.register("uuid",

[jira] [Updated] (SPARK-23617) Register a Function without params with Spark SQL Java API

2018-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-23617: Description: One can register a function using Scala: spark.udf.register("uuid",

[jira] [Updated] (SPARK-23617) Register a Function without params with Spark SQL Java API

2018-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-23617: Description: One can register a function using Scala: {{spark.udf.register("uuid",

[jira] [Created] (SPARK-23617) Register a Function without params with Spark SQL Java API

2018-03-06 Thread Paul Wu (JIRA)
Paul Wu created SPARK-23617: --- Summary: Register a Function without params with Spark SQL Java API Key: SPARK-23617 URL: https://issues.apache.org/jira/browse/SPARK-23617 Project: Spark Issue Type:

[jira] [Updated] (SPARK-23193) Insert into Spark Table statement cannot specify column names

2018-01-23 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-23193: Summary: Insert into Spark Table statement cannot specify column names (was: Insert into Spark Table

[jira] [Created] (SPARK-23193) Insert into Spark Table cannot specify column names

2018-01-23 Thread Paul Wu (JIRA)
Paul Wu created SPARK-23193: --- Summary: Insert into Spark Table cannot specify column names Key: SPARK-23193 URL: https://issues.apache.org/jira/browse/SPARK-23193 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21740) DataFrame.write does not work with Phoenix JDBC Driver

2017-08-15 Thread Paul Wu (JIRA)
Paul Wu created SPARK-21740: --- Summary: DataFrame.write does not work with Phoenix JDBC Driver Key: SPARK-21740 URL: https://issues.apache.org/jira/browse/SPARK-21740 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105439#comment-16105439 ] Paul Wu commented on SPARK-17614: - Oh, sorry. I thought I could use a query hereas I do with other

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105425#comment-16105425 ] Paul Wu commented on SPARK-17614: - So create a new issue? Or this is not an issue to you? >

[jira] [Comment Edited] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105402#comment-16105402 ] Paul Wu edited comment on SPARK-17614 at 7/28/17 6:14 PM: -- The fix does not

[jira] [Comment Edited] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105402#comment-16105402 ] Paul Wu edited comment on SPARK-17614 at 7/28/17 6:09 PM: -- The fix does not

[jira] [Reopened] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu reopened SPARK-17614: - The fix does not support the syntax on the syntax like this: {{.jdbc(JDBC_URL, "(select * from emp)",

[jira] [Comment Edited] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2017-07-28 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105402#comment-16105402 ] Paul Wu edited comment on SPARK-17614 at 7/28/17 6:08 PM: -- The fix does not

[jira] [Comment Edited] (SPARK-19296) Awkward changes for JdbcUtils.saveTable in Spark 2.1.0

2017-01-20 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831033#comment-15831033 ] Paul Wu edited comment on SPARK-19296 at 1/20/17 9:52 PM: -- We found this Util is

[jira] [Commented] (SPARK-19296) Awkward changes for JdbcUtils.saveTable in Spark 2.1.0

2017-01-19 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831033#comment-15831033 ] Paul Wu commented on SPARK-19296: - We found this Util is very useful in general (much, much better than

[jira] [Created] (SPARK-19296) Awkward changes for JdbcUtils.saveTable in Spark 2.1.0

2017-01-19 Thread Paul Wu (JIRA)
Paul Wu created SPARK-19296: --- Summary: Awkward changes for JdbcUtils.saveTable in Spark 2.1.0 Key: SPARK-19296 URL: https://issues.apache.org/jira/browse/SPARK-19296 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-10-26 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-18123: Description: Blindly quoting every field name for inserting is the issue (Line 110-119,

[jira] [Commented] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-10-26 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610739#comment-15610739 ] Paul Wu commented on SPARK-18123: - Just tried if it worked for the issue. But after I found the code, I

[jira] [Updated] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-10-26 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-18123: Description: Blindly quoting every field name for inserting is the issue (Line 110-119,

[jira] [Created] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

2016-10-26 Thread Paul Wu (JIRA)
Paul Wu created SPARK-18123: --- Summary: org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue Key: SPARK-18123 URL: https://issues.apache.org/jira/browse/SPARK-18123

[jira] [Issue Comment Deleted] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-17614: Comment: was deleted (was: Create pull request: https://github.com/apache/spark/pull/15183) >

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510709#comment-15510709 ] Paul Wu commented on SPARK-17614: - Create pull request: https://github.com/apache/spark/pull/15183 >

[jira] [Comment Edited] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510626#comment-15510626 ] Paul Wu edited comment on SPARK-17614 at 9/21/16 5:42 PM: -- No, Custom

[jira] [Updated] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-17614: Priority: Major (was: Minor) > sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510626#comment-15510626 ] Paul Wu commented on SPARK-17614: - No, Custom JdbcDialect won't resolve the problem since DataFrameReader

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510525#comment-15510525 ] Paul Wu commented on SPARK-17614: - Thanks. I tried to register my custom dialect as following, but it

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-20 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507950#comment-15507950 ] Paul Wu commented on SPARK-17614: - Work around: Rebuild the Cassandra JDBC wrapper by modifying

[jira] [Created] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

2016-09-20 Thread Paul Wu (JIRA)
Paul Wu created SPARK-17614: --- Summary: sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support Key: SPARK-17614 URL: https://issues.apache.org/jira/browse/SPARK-17614

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-24 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Attachment: (was: timestamp_bug.zip) Timestamp handling incorrect for Spark 1.4.1 on Linux

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-24 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641175#comment-14641175 ] Paul Wu commented on SPARK-9255: Related https://issues.apache.org/jira/browse/SPARK-9058,

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-23 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639949#comment-14639949 ] Paul Wu commented on SPARK-9255: [~srowen] I don't think it is due to version

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Attachment: timestamp_bug.zip the project can run without issues. But when it is deployed to the Timestamp

[jira] [Created] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-22 Thread Paul Wu (JIRA)
Paul Wu created SPARK-9255: -- Summary: Timestamp handling incorrect for Spark 1.4.1 on Linux Key: SPARK-9255 URL: https://issues.apache.org/jira/browse/SPARK-9255 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Description: This is a very strange case involving timestamp I can run the program on Windows using dev

[jira] [Comment Edited] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

2015-07-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637336#comment-14637336 ] Paul Wu edited comment on SPARK-9255 at 7/22/15 6:52 PM: - The

[jira] [Closed] (SPARK-9087) Broken SQL on where condition involving timestamp and time string.

2015-07-16 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu closed SPARK-9087. -- Resolution: Fixed Fix Version/s: 1.4.1 1.4.1 fixed the issue. Broken SQL on where condition involving

[jira] [Created] (SPARK-9087) Broken SQL on where condition involving timestamp and time string.

2015-07-15 Thread Paul Wu (JIRA)
Paul Wu created SPARK-9087: -- Summary: Broken SQL on where condition involving timestamp and time string. Key: SPARK-9087 URL: https://issues.apache.org/jira/browse/SPARK-9087 Project: Spark Issue

[jira] [Commented] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555680#comment-14555680 ] Paul Wu commented on SPARK-7804: Unfortunately, JdbcRDD was poorly designed since the

[jira] [Comment Edited] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555680#comment-14555680 ] Paul Wu edited comment on SPARK-7804 at 5/22/15 12:00 PM: --

[jira] [Created] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly and incorrect field value

2015-05-21 Thread Paul Wu (JIRA)
Paul Wu created SPARK-7804: -- Summary: Incorrect results from JDBCRDD -- one record repeatly and incorrect field value Key: SPARK-7804 URL: https://issues.apache.org/jira/browse/SPARK-7804 Project: Spark

[jira] [Updated] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-7804: --- Description: Getting only one record repeated in the RDD and repeated field value: I have a table like:

[jira] [Commented] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555602#comment-14555602 ] Paul Wu commented on SPARK-7804: Thanks -- you are right. The cache() was a problem and

[jira] [Created] (SPARK-7746) SetFetchSize for JDBCRDD's prepareStatement

2015-05-19 Thread Paul Wu (JIRA)
Paul Wu created SPARK-7746: -- Summary: SetFetchSize for JDBCRDD's prepareStatement Key: SPARK-7746 URL: https://issues.apache.org/jira/browse/SPARK-7746 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-16 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498305#comment-14498305 ] Paul Wu commented on SPARK-6936: You are right: I used spark-hive_2.10 instead of

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-16 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498247#comment-14498247 ] Paul Wu commented on SPARK-6936: Not sure about HiveContext. I tried to do the following

[jira] [Issue Comment Deleted] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-16 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-6936: --- Comment: was deleted (was: Not sure about HiveContext. I tried to do the following program and I got

[jira] [Created] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-15 Thread Paul Wu (JIRA)
Paul Wu created SPARK-6936: -- Summary: SQLContext.sql() caused deadlock in multi-thread env Key: SPARK-6936 URL: https://issues.apache.org/jira/browse/SPARK-6936 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-15 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496933#comment-14496933 ] Paul Wu commented on SPARK-6936: 1. The query is something like this (sorry since the data

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-04-15 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497267#comment-14497267 ] Paul Wu commented on SPARK-6936: Currently, I synchronized the part, which seems to be