[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

2015-11-03 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987666#comment-14987666 ] Rick Hillegas commented on SPARK-10601: --- This is a useful operator supported by Oracle:

[jira] [Commented] (SPARK-10600) SparkSQL - Support for Not Exists in a Correlated Subquery

2015-11-03 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987680#comment-14987680 ] Rick Hillegas commented on SPARK-10600: --- Linking to SPARK-4226. > SparkSQL - Support for Not

[jira] [Commented] (SPARK-10664) JDBC DataFrameWriter does not save data to Oracle 11 Database

2015-11-03 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987629#comment-14987629 ] Rick Hillegas commented on SPARK-10664: --- Can this issue be marked as fixed in 1.6? Thanks. > JDBC

[jira] [Commented] (SPARK-10727) Dataframe count is zero after 'except' operation

2015-11-02 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986311#comment-14986311 ] Rick Hillegas commented on SPARK-10727: --- Can this issue be resolved now? Thanks. > Dataframe count

[jira] [Commented] (SPARK-11010) Fixes and enhancements addressing UDTs' api and several usability concerns

2015-10-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983237#comment-14983237 ] Rick Hillegas commented on SPARK-11010: --- Linking this issue to SPARK-10855. The api for declaring

[jira] [Updated] (SPARK-11426) JDBCRDD should use JdbcDialect to probe for the existence of a table

2015-10-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Hillegas updated SPARK-11426: -- Component/s: SQL > JDBCRDD should use JdbcDialect to probe for the existence of a table >

[jira] [Closed] (SPARK-11426) JDBCRDD should use JdbcDialect to probe for the existence of a table

2015-10-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Hillegas closed SPARK-11426. - Resolution: Not A Problem I have decided that this issue is not a problem.

[jira] [Created] (SPARK-11426) JDBCRDD should use JdbcDialect to probe for the existence of a table

2015-10-30 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-11426: - Summary: JDBCRDD should use JdbcDialect to probe for the existence of a table Key: SPARK-11426 URL: https://issues.apache.org/jira/browse/SPARK-11426 Project:

[jira] [Updated] (SPARK-11426) JDBCRDD should use JdbcDialect to probe for the existence of a table

2015-10-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Hillegas updated SPARK-11426: -- Issue Type: Bug (was: Improvement) Changing this to be a bug because this is another SQL

[jira] [Commented] (SPARK-5966) Spark-submit deploy-mode incorrectly affecting submission when master = local[4]

2015-10-26 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974509#comment-14974509 ] Rick Hillegas commented on SPARK-5966: -- Should this issue be assigned to Kevin now, since he

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-23 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971101#comment-14971101 ] Rick Hillegas commented on SPARK-10857: --- Hi Sean, That is my understanding after examining the

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-21 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967695#comment-14967695 ] Rick Hillegas commented on SPARK-10977: --- I have created a pull request for SPARK-10857 which also

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-21 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967930#comment-14967930 ] Rick Hillegas commented on SPARK-10857: --- Hi Reynold, Yes, this would fail if the table were a

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-10-20 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965699#comment-14965699 ] Rick Hillegas commented on SPARK-9338: -- Technically, the requested syntax is not defined by the SQL

[jira] [Commented] (SPARK-10754) table and column name are case sensitive when json Dataframe was registered as tempTable using JavaSparkContext.

2015-10-16 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960802#comment-14960802 ] Rick Hillegas commented on SPARK-10754: --- Note that unquoted identifiers are case-insensitive in the

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-10 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951865#comment-14951865 ] Rick Hillegas commented on SPARK-10977: --- Hi Sean, Yes, I hope to post some patches soon. Thanks.

[jira] [Created] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-09 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-11037: - Summary: Cleanup Option usage in JdbcUtils Key: SPARK-11037 URL: https://issues.apache.org/jira/browse/SPARK-11037 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-09 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950549#comment-14950549 ] Rick Hillegas commented on SPARK-10857: --- The discussion on SPARK-10977 suggests another solution:

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-09 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950543#comment-14950543 ] Rick Hillegas commented on SPARK-10977: --- Thanks, Sean. Yes, I agree. I don't have any better

[jira] [Commented] (SPARK-4235) Add union data type support

2015-10-09 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950572#comment-14950572 ] Rick Hillegas commented on SPARK-4235: -- Hi Cheng, Can you elaborate on what you mean by a union data

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-08 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949110#comment-14949110 ] Rick Hillegas commented on SPARK-10977: --- Hi Sean, The following code raises exceptions on MySQL,

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-07 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947928#comment-14947928 ] Rick Hillegas commented on SPARK-10977: --- Hi Sean, That approach may work for some databases. The ?

[jira] [Created] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

2015-10-07 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10977: - Summary: SQL injection bugs in JdbcUtils and DataFrameWriter Key: SPARK-10977 URL: https://issues.apache.org/jira/browse/SPARK-10977 Project: Spark Issue

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-10-01 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940103#comment-14940103 ] Rick Hillegas commented on SPARK-10857: --- Thanks for that information, Josh. And thanks for running

[jira] [Commented] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-09-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14938334#comment-14938334 ] Rick Hillegas commented on SPARK-10855: --- I intend to create a pull request for this soon after

[jira] [Created] (SPARK-10890) "Column count does not match; SQL statement:" error in JDBCWriteSuite

2015-09-30 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10890: - Summary: "Column count does not match; SQL statement:" error in JDBCWriteSuite Key: SPARK-10890 URL: https://issues.apache.org/jira/browse/SPARK-10890 Project:

[jira] [Created] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-09-28 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10855: - Summary: Add a JDBC dialect for Apache Derby Key: SPARK-10855 URL: https://issues.apache.org/jira/browse/SPARK-10855 Project: Spark Issue Type:

[jira] [Created] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-28 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10857: - Summary: SQL injection bug in JdbcDialect.getTableExistsQuery() Key: SPARK-10857 URL: https://issues.apache.org/jira/browse/SPARK-10857 Project: Spark

[jira] [Commented] (SPARK-6649) DataFrame created through SQLContext.jdbc() failed if columns table must be quoted

2015-09-25 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908609#comment-14908609 ] Rick Hillegas commented on SPARK-6649: -- Hi Fred, The backtick syntax seems to be a feature of HiveQL

[jira] [Commented] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-09-23 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905409#comment-14905409 ] Rick Hillegas commented on SPARK-8616: -- The following email thread may be useful for understanding