[jira] [Updated] (SPARK-6195) Specialized in-memory column type for fixed-precision decimal

2015-03-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6195: -- Summary: Specialized in-memory column type for fixed-precision decimal (was: Specialized in-memory

[jira] [Updated] (SPARK-6195) Specialized in-memory column type for decimal

2015-03-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6195: -- Description: When building in-memory columnar representation, decimal values are currently serialized

[jira] [Created] (SPARK-6452) CheckAnalysis should throw when analyzed plan contains unresolved node(s)

2015-03-22 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6452: - Summary: CheckAnalysis should throw when analyzed plan contains unresolved node(s) Key: SPARK-6452 URL: https://issues.apache.org/jira/browse/SPARK-6452 Project: Spark

[jira] [Commented] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374838#comment-14374838 ] Cheng Lian commented on SPARK-6444: --- Another valid fix for this issue is simply

[jira] [Commented] (SPARK-6444) Sum expression should remain unresolved if the data type isn't a numeric type

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374831#comment-14374831 ] Cheng Lian commented on SPARK-6444: --- This issue also exposes another issue in the

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) with missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the plan contains node(s) with missing input attribute(s)

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Description: Please refer to SPARK-6444 for reproduction steps. The top {{Aggregate}} node in the

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Assignee: (was: Cheng Lian) SQL functions (either built-in or UDF) should check for data types of

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the Aggregate node contains missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the Aggregate node contains missing input attribute(s) (was:

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Summary: SQL functions (either built-in or UDF) should check for data types of their arguments (was:

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the plan contains node(s) missing input attribute(s) (was:

[jira] [Resolved] (SPARK-6408) JDBCRDD fails on where clause with string literal

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6408. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Commented] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374878#comment-14374878 ] Cheng Lian commented on SPARK-6444: --- This PR contains the quick fix I mentioned above. I

[jira] [Resolved] (SPARK-6285) Duplicated code leads to errors

2015-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6285. --- Resolution: Fixed Issue resolved by pull request 5032 [https://github.com/apache/spark/pull/5032]

[jira] [Reopened] (SPARK-6285) Duplicated code leads to errors

2015-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reopened SPARK-6285: --- Reopening this because of the issue [PR #5032|https://github.com/baishuo/spark/pull/2] fixes.

[jira] [Commented] (SPARK-5310) Update SQL programming guide for 1.3

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363024#comment-14363024 ] Cheng Lian commented on SPARK-5310: --- [~marmbrus], [~rxin] and [~yhuai] do we want to

[jira] [Commented] (SPARK-6319) DISTINCT doesn't work for binary type

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363011#comment-14363011 ] Cheng Lian commented on SPARK-6319: --- SPARK-5553 is somewhat related to this one. By

[jira] [Created] (SPARK-6360) For Spark 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with decimal column throws

2015-03-16 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6360: - Summary: For Spark 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with decimal column throws Key: SPARK-6360 URL:

[jira] [Updated] (SPARK-6360) For Spark 1.1 and 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with decimal or UDT column throws

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6360: -- Summary: For Spark 1.1 and 1.2, after any RDD transformations, calling saveAsParquetFile over a

[jira] [Updated] (SPARK-6360) For Spark 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with decimal or UDT column throws

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6360: -- Summary: For Spark 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with

[jira] [Updated] (SPARK-6360) For Spark 1.2, after any RDD transformations, calling saveAsParquetFile over a SchemaRDD with decimal or UDT column throws

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6360: -- Description: Spark shell session for reproduction (use {{:paste}}): {noformat} import

[jira] [Updated] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2087: -- Issue Type: Improvement (was: Bug) Clean Multi-user semantics for thrift JDBC/ODBC server.

[jira] [Commented] (SPARK-6315) SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363523#comment-14363523 ] Cheng Lian commented on SPARK-6315: --- Hi [~Michael Davies], really sorry for the trouble!

[jira] [Updated] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2087: -- Affects Version/s: 1.3.0 1.0.2 1.1.1

[jira] [Updated] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2087: -- Assignee: Cheng Hao Clean Multi-user semantics for thrift JDBC/ODBC server.

[jira] [Resolved] (SPARK-5712) Semicolon at end of a comment line

2015-03-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5712. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4500

[jira] [Updated] (SPARK-6366) In Python API, the default save mode for save and saveAsTable should be error instead of append.

2015-03-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6366: -- Fix Version/s: (was: 1.3.0) 1.3.1 In Python API, the default save mode for save

[jira] [Resolved] (SPARK-6366) In Python API, the default save mode for save and saveAsTable should be error instead of append.

2015-03-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6366. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 5053

[jira] [Created] (SPARK-6387) HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0

2015-03-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6387: - Summary: HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0 Key: SPARK-6387 URL: https://issues.apache.org/jira/browse/SPARK-6387 Project: Spark

[jira] [Updated] (SPARK-5821) JSONRelation should check if delete is successful for the overwrite operation.

2015-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Description: When you run CTAS command such as {code sql} CREATE TEMPORARY TABLE jsonTable USING

[jira] [Updated] (SPARK-5821) JSONRelation should check if delete is successful for the overwrite operation.

2015-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Description: When you run CTAS command such as {code:sql} CREATE TEMPORARY TABLE jsonTable USING

[jira] [Updated] (SPARK-5821) JSONRelation should check if delete is successful for the overwrite operation.

2015-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Description: When you run CTAS command such as {code sql} CREATE TEMPORARY TABLE jsonTable USING

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371116#comment-14371116 ] Cheng Lian commented on SPARK-6432: --- Yeah, sorry for my carelessness, it's OK if either

[jira] [Resolved] (SPARK-5821) JSONRelation should check if delete is successful for the overwrite operation.

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5821. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-5821) JSONRelation and ParquetRelation2 should check if delete is successful for the overwrite operation.

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Target Version/s: 1.4.0, 1.3.1 (was: 1.3.1) JSONRelation and ParquetRelation2 should check if delete

[jira] [Updated] (SPARK-5821) JSONRelation and ParquetRelation2 should check if delete is successful for the overwrite operation.

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Assignee: Yanbo Liang JSONRelation and ParquetRelation2 should check if delete is successful for the

[jira] [Resolved] (SPARK-6315) SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6315. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-5821) JSONRelation and ParquetRelation2 should check if delete is successful for the overwrite operation.

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5821: -- Summary: JSONRelation and ParquetRelation2 should check if delete is successful for the overwrite

[jira] [Created] (SPARK-6444) Sum expression should remain unresolved if the data type isn't a numeric type

2015-03-20 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6444: - Summary: Sum expression should remain unresolved if the data type isn't a numeric type Key: SPARK-6444 URL: https://issues.apache.org/jira/browse/SPARK-6444 Project: Spark

[jira] [Commented] (SPARK-5203) union with different decimal type report error

2015-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372847#comment-14372847 ] Cheng Lian commented on SPARK-5203: --- Good point! [This

[jira] [Updated] (SPARK-5203) union with different decimal type report error

2015-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5203: -- Description: Test case like this: {code:sql} create table test (a decimal(10,1)); select a from test

[jira] [Updated] (SPARK-6408) JDBCRDD fails on where clause with string literal

2015-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6408: -- Priority: Blocker (was: Critical) Target Version/s: 1.3.1 JDBCRDD fails on where clause

[jira] [Commented] (SPARK-5821) JSONRelation should check if delete is successful for the overwrite operation.

2015-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369305#comment-14369305 ] Cheng Lian commented on SPARK-5821: --- Left comments on GitHub. JSONRelation should

[jira] [Assigned] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6432: - Assignee: Cheng Lian Cannot load parquet data with partitions if not all partition columns

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371039#comment-14371039 ] Cheng Lian commented on SPARK-6432: --- The problem is that, if all partition columns

[jira] [Commented] (SPARK-6201) INSET should coerce types

2015-03-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353030#comment-14353030 ] Cheng Lian commented on SPARK-6201: --- Played Hive type implicit conversion a bit more and

[jira] [Comment Edited] (SPARK-6201) INSET should coerce types

2015-03-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353030#comment-14353030 ] Cheng Lian edited comment on SPARK-6201 at 3/9/15 5:10 PM: ---

[jira] [Comment Edited] (SPARK-6201) INSET should coerce types

2015-03-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353030#comment-14353030 ] Cheng Lian edited comment on SPARK-6201 at 3/9/15 5:13 PM: ---

[jira] [Assigned] (SPARK-5451) And predicates are not properly pushed down

2015-03-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-5451: - Assignee: Cheng Lian And predicates are not properly pushed down

[jira] [Resolved] (SPARK-6317) Interactive HIVE scala console is not starting

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6317. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5011

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6317: -- Description: {{build/sbt hive/console}} is failing {noformat} [info] Starting scala interpreter...

[jira] [Updated] (SPARK-6317) Interactive HIVE scala console is not starting

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6317: -- Description: {{build/sbt hive/console}} is failing {noformat{ [info] Starting scala interpreter...

[jira] [Resolved] (SPARK-6285) Duplicated code leads to errors

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6285. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5010

[jira] [Resolved] (SPARK-6195) Specialized in-memory column type for decimal

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6195. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4938

[jira] [Closed] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-6147. - Resolution: Won't Fix No actions need to be taken for this ticket from the perspective of the Spark

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Summary: HiveQuerySuite throws when using MySQL as Hive metastore storage (was: when mysql is used as

[jira] [Commented] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361888#comment-14361888 ] Cheng Lian commented on SPARK-6147: --- Makes sense. Created [a GitHub

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Description: Exception: {noformat} from org.apache.hadoop.hive.ql.exec.DDLTask. Database default

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Description: Exception: {noformat} from org.apache.hadoop.hive.ql.exec.DDLTask. Database default

[jira] [Assigned] (SPARK-6285) Duplicated code leads to errors

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6285: - Assignee: Cheng Lian Duplicated code leads to errors ---

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360147#comment-14360147 ] Cheng Lian commented on SPARK-6285: --- [~fiberit] and [~srowen], thanks for reporting

[jira] [Created] (SPARK-6319) DISTINCT doesn't work for binary type

2015-03-13 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6319: - Summary: DISTINCT doesn't work for binary type Key: SPARK-6319 URL: https://issues.apache.org/jira/browse/SPARK-6319 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-03-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5281: -- Description: Application crashes on this line {{rdd.registerTempTable(temp)}} in 1.2 version when

[jira] [Created] (SPARK-6195) Specialized in-memory column type for decimal

2015-03-05 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6195: - Summary: Specialized in-memory column type for decimal Key: SPARK-6195 URL: https://issues.apache.org/jira/browse/SPARK-6195 Project: Spark Issue Type:

[jira] [Created] (SPARK-6502) HiveThriftServer2 fails to inspect underlying Hive version when compiled against Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6502: - Summary: HiveThriftServer2 fails to inspect underlying Hive version when compiled against Hive 0.12.0 Key: SPARK-6502 URL: https://issues.apache.org/jira/browse/SPARK-6502

[jira] [Updated] (SPARK-6387) HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6387: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-6109 HTTP mode of HiveThriftServer2 doesn't

[jira] [Commented] (SPARK-6109) Unit tests fail when compiled against Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377897#comment-14377897 ] Cheng Lian commented on SPARK-6109: --- I had created [PR

[jira] [Commented] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377915#comment-14377915 ] Cheng Lian commented on SPARK-6505: --- Here is [a WiP simpler fix for

[jira] [Created] (SPARK-6503) Create Jenkins builder for testing Spark SQL with Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6503: - Summary: Create Jenkins builder for testing Spark SQL with Hive 0.12.0 Key: SPARK-6503 URL: https://issues.apache.org/jira/browse/SPARK-6503 Project: Spark Issue

[jira] [Created] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6505: - Summary: Remove the reflection call in HiveFunctionWrapper Key: SPARK-6505 URL: https://issues.apache.org/jira/browse/SPARK-6505 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6501) Blacklist Hive 0.13.1 specific tests when compiled against Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6501: - Summary: Blacklist Hive 0.13.1 specific tests when compiled against Hive 0.12.0 Key: SPARK-6501 URL: https://issues.apache.org/jira/browse/SPARK-6501 Project: Spark

[jira] [Updated] (SPARK-6387) HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6387: -- Shepherd: Cheng Lian HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0

[jira] [Updated] (SPARK-6501) Blacklist Hive 0.13.1 specific tests when compiled against Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6501: -- Shepherd: Cheng Lian Blacklist Hive 0.13.1 specific tests when compiled against Hive 0.12.0

[jira] [Updated] (SPARK-6109) Unit tests fail when compiled against Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6109: -- Shepherd: Cheng Lian Assignee: (was: Cheng Lian) Unit tests fail when compiled against Hive

[jira] [Updated] (SPARK-6503) Create Jenkins builder for testing Spark SQL with Hive 0.12.0

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6503: -- Shepherd: Cheng Lian Create Jenkins builder for testing Spark SQL with Hive 0.12.0

[jira] [Updated] (SPARK-6507) Create separate Hive Driver instance for each SQL query in HiveThriftServer2

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6507: -- Shepherd: Cheng Lian Create separate Hive Driver instance for each SQL query in HiveThriftServer2

[jira] [Updated] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6505: -- Shepherd: Cheng Lian Remove the reflection call in HiveFunctionWrapper

[jira] [Commented] (SPARK-6495) DataFrame#insertInto method should support insert rows with sub-columns

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378051#comment-14378051 ] Cheng Lian commented on SPARK-6495: --- Inserting a subset of columns in the original

[jira] [Created] (SPARK-6507) Create separate Hive Driver instance for each SQL query in HiveThriftServer2

2015-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6507: - Summary: Create separate Hive Driver instance for each SQL query in HiveThriftServer2 Key: SPARK-6507 URL: https://issues.apache.org/jira/browse/SPARK-6507 Project: Spark

[jira] [Comment Edited] (SPARK-6450) Native Parquet reader does not assign table name as qualifier

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379125#comment-14379125 ] Cheng Lian edited comment on SPARK-6450 at 3/25/15 1:56 AM:

[jira] [Commented] (SPARK-6450) Native Parquet reader does not assign table name as qualifier

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379114#comment-14379114 ] Cheng Lian commented on SPARK-6450: --- [~chinnitv], could you please provide the DDL of

[jira] [Commented] (SPARK-6450) Native Parquet reader does not assign table name as qualifier

2015-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379125#comment-14379125 ] Cheng Lian commented on SPARK-6450: --- [~chinnitv], never mind, reproduced this issue with

[jira] [Updated] (SPARK-6450) Metastore Parquet table conversion fails when a single metastore Parquet table appears multiple times in the query

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6450: -- Summary: Metastore Parquet table conversion fails when a single metastore Parquet table appears

[jira] [Updated] (SPARK-6450) f

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6450: -- Summary: f (was: Native Parquet reader does not assign table name as qualifier) f -

[jira] [Updated] (SPARK-6450) MetastoreRelation.equals doesn't compare output attributes

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6450: -- Summary: MetastoreRelation.equals doesn't compare output attributes (was: f)

[jira] [Commented] (SPARK-6450) Metastore Parquet table conversion fails when a single metastore Parquet table appears multiple times in the query

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379499#comment-14379499 ] Cheng Lian commented on SPARK-6450: --- Here is a simpler Spark shell snippet for

[jira] [Updated] (SPARK-6482) Remove synchronization of Hive Native commands

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6482: -- Target Version/s: 1.4.0 Remove synchronization of Hive Native commands

[jira] [Updated] (SPARK-6482) Remove synchronization of Hive Native commands

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6482: -- Shepherd: Cheng Lian Remove synchronization of Hive Native commands

[jira] [Updated] (SPARK-6482) Remove synchronization of Hive Native commands

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6482: -- Affects Version/s: 1.3.0 Remove synchronization of Hive Native commands

[jira] [Resolved] (SPARK-6507) Create separate Hive Driver instance for each SQL query in HiveThriftServer2

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6507. --- Resolution: Duplicate Create separate Hive Driver instance for each SQL query in HiveThriftServer2

[jira] [Commented] (SPARK-6465) GenericRowWithSchema: KryoException: Class cannot be created (missing no-arg constructor):

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379812#comment-14379812 ] Cheng Lian commented on SPARK-6465: --- I believe for now this is only used for testing

[jira] [Updated] (SPARK-6533) Allow using wildcard and other file pattern in Parquet DataSource

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6533: -- Priority: Critical (was: Major) Target Version/s: 1.4.0 Allow using wildcard and other

[jira] [Assigned] (SPARK-6533) Allow using wildcard and other file pattern in Parquet DataSource

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6533: - Assignee: Cheng Lian Allow using wildcard and other file pattern in Parquet DataSource

[jira] [Assigned] (SPARK-6450) Metastore Parquet table conversion fails when a single metastore Parquet table appears multiple times in the query

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6450: - Assignee: Cheng Lian (was: Michael Armbrust) Metastore Parquet table conversion fails when a

[jira] [Commented] (SPARK-6533) Allow using wildcard and other file pattern in Parquet DataSource

2015-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380131#comment-14380131 ] Cheng Lian commented on SPARK-6533: --- Bumped to critical because this should be

[jira] [Updated] (SPARK-6546) Build failure caused by PR #5029 together with #4289

2015-03-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Component/s: (was: Build) SQL Description: PR

[jira] [Updated] (SPARK-6546) Using the wrong code that will make spark compile failed!!

2015-03-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Assignee: DoingDone9 Using the wrong code that will make spark compile failed!!

<    1   2   3   4   5   6   7   8   9   10   >