[jira] [Resolved] (SPARK-6546) Using the wrong code that will make spark compile failed!!

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6546. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5198

[jira] [Updated] (SPARK-6546) Using the wrong code that will make spark compile failed!!

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Affects Version/s: 1.4.0 Using the wrong code that will make spark compile failed!!

[jira] [Commented] (SPARK-6546) Build failure caused by PR #5029 together with #4289

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381606#comment-14381606 ] Cheng Lian commented on SPARK-6546: --- Updated ticket title and description to refect the

[jira] [Created] (SPARK-6555) Override equals and hashCode in MetastoreRelation

Cheng Lian created SPARK-6555: - Summary: Override equals and hashCode in MetastoreRelation Key: SPARK-6555 URL: https://issues.apache.org/jira/browse/SPARK-6555 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Target Version/s: 1.3.1, 1.4.0 Cannot use partition columns in where clause

[jira] [Assigned] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6554: - Assignee: Cheng Lian Cannot use partition columns in where clause

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381703#comment-14381703 ] Cheng Lian commented on SPARK-6481: --- Maybe unrelated to this issue, but I saw a lot of

[jira] [Resolved] (SPARK-6465) GenericRowWithSchema: KryoException: Class cannot be created (missing no-arg constructor):

[ https://issues.apache.org/jira/browse/SPARK-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6465. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Description: I'm having trouble referencing partition columns in my queries with Parquet. In the

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381850#comment-14381850 ] Cheng Lian commented on SPARK-6554: --- Marked this as critical rather than blocker mostly

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381862#comment-14381862 ] Cheng Lian commented on SPARK-6554: --- Parquet filter push-down isn't enabled by default

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-5463 Cannot use partition columns in where

[jira] [Updated] (SPARK-5463) Fix Parquet filter push-down

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5463: -- Affects Version/s: 1.3.0 Fix Parquet filter push-down

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381811#comment-14381811 ] Cheng Lian commented on SPARK-6481: --- Aha, so I'm not the only one! Although I just

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Summary: Cannot use partition columns in where clause when Parquet filter push-down is enabled (was:

[jira] [Commented] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381846#comment-14381846 ] Cheng Lian commented on SPARK-6471: --- Bumped to blocker level since this is actually a

[jira] [Updated] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6471: -- Priority: Blocker (was: Major) Target Version/s: 1.3.1, 1.4.0 Metastore schema should

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381788#comment-14381788 ] Cheng Lian commented on SPARK-6554: --- Hi [~jonchase], did you happen to turn on Parquet

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Priority: Critical (was: Major) Cannot use partition columns in where clause

[jira] [Resolved] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6471. --- Resolution: Fixed Fix Version/s: 1.3.1 Issue resolved by pull request 5141

[jira] [Updated] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6471: -- Assignee: Yash Datta Metastore schema should only be a subset of parquet schema to support dropping

[jira] [Updated] (SPARK-6575) Add configuration to disable schema merging while converting metastore Parquet tables

[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6575: -- Description: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots

[jira] [Assigned] (SPARK-6608) Make DataFrame.rdd a lazy val

[ https://issues.apache.org/jira/browse/SPARK-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6608: - Assignee: Cheng Lian Make DataFrame.rdd a lazy val -

[jira] [Updated] (SPARK-6607) Aggregation attribute name including special chars '(' and ')' should be replaced before generating Parquet schema

[ https://issues.apache.org/jira/browse/SPARK-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6607: -- Assignee: Liang-Chi Hsieh Aggregation attribute name including special chars '(' and ')' should be

[jira] [Updated] (SPARK-6607) Aggregation attribute name including special chars '(' and ')' should be replaced before generating Parquet schema

[ https://issues.apache.org/jira/browse/SPARK-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6607: -- Target Version/s: 1.4.0 Affects Version/s: 1.1.1 1.2.1

[jira] [Created] (SPARK-6608) Make DataFrame.rdd a lazy val

Cheng Lian created SPARK-6608: - Summary: Make DataFrame.rdd a lazy val Key: SPARK-6608 URL: https://issues.apache.org/jira/browse/SPARK-6608 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6595. --- Resolution: Fixed Fixed by https://github.com/apache/spark/pull/5251 DataFrame self joins with

[jira] [Updated] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4226: -- Description: I have a test table defined in Hive as follows: {code:sql} CREATE TABLE sparkbug ( id

[jira] [Resolved] (SPARK-6369) InsertIntoHiveTable and Parquet Relation should use logic from SparkHadoopWriter

[ https://issues.apache.org/jira/browse/SPARK-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6369. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Assigned] (SPARK-6555) Override equals and hashCode in MetastoreRelation

[ https://issues.apache.org/jira/browse/SPARK-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6555: - Assignee: Cheng Lian Override equals and hashCode in MetastoreRelation

[jira] [Resolved] (SPARK-6618) HiveMetastoreCatalog.lookupRelation should use fine-grained lock

[ https://issues.apache.org/jira/browse/SPARK-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6618. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1

[jira] [Resolved] (SPARK-6542) Add CreateStruct as an Expression

[ https://issues.apache.org/jira/browse/SPARK-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6542. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5195

[jira] [Updated] (SPARK-6644) [SPARK-SQL]when the partition schema does not match table schema(ADD COLUMN), new column value is NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Description: In Hive, the schema of a partition may differ from the table schema. For example, we may

[jira] [Updated] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Summary: After adding new columns to a partitioned table and inserting data to an old partition, data

[jira] [Updated] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6644: -- Description: In Hive, the schema of a partition may differ from the table schema. For example, we may

[jira] [Commented] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

[ https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383627#comment-14383627 ] Cheng Lian commented on SPARK-6566: --- Hi [~k.shaposhni...@gmail.com], as described in

[jira] [Created] (SPARK-6565) Deprecate jsonRDD and replace it by jsonDataFrame / jsonDF

Cheng Lian created SPARK-6565: - Summary: Deprecate jsonRDD and replace it by jsonDataFrame / jsonDF Key: SPARK-6565 URL: https://issues.apache.org/jira/browse/SPARK-6565 Project: Spark Issue

[jira] [Updated] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6587: -- Description: (Don't know if this is a functionality bug, error reporting bug or an RFE ...) I define

[jira] [Commented] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695 ] Cheng Lian commented on SPARK-6587: --- This behavior is expected. There are two problems

[jira] [Comment Edited] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385695#comment-14385695 ] Cheng Lian edited comment on SPARK-6587 at 3/29/15 10:32 AM: -

[jira] [Commented] (SPARK-6579) save as parquet with overwrite failed

[ https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385694#comment-14385694 ] Cheng Lian commented on SPARK-6579: --- Here's another Parquet issue with Hadoop 1.0.4:

[jira] [Updated] (SPARK-6579) save as parquet with overwrite failed when linking with Hadoop 1.0.4

[ https://issues.apache.org/jira/browse/SPARK-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6579: -- Summary: save as parquet with overwrite failed when linking with Hadoop 1.0.4 (was: save as parquet

[jira] [Updated] (SPARK-6581) Metadata is missing when saving parquet file using hadoop 1.0.4

[ https://issues.apache.org/jira/browse/SPARK-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6581: -- Target Version/s: 1.4.0 Metadata is missing when saving parquet file using hadoop 1.0.4

[jira] [Updated] (SPARK-6570) Spark SQL arrays: explode() fails and cannot save array type to Parquet

[ https://issues.apache.org/jira/browse/SPARK-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6570: -- Target Version/s: 1.4.0 Spark SQL arrays: explode() fails and cannot save array type to Parquet

[jira] [Commented] (SPARK-6450) Self joining query failure

[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375343#comment-14375343 ] Cheng Lian commented on SPARK-6450: --- Ah, I see. Will handle this ASAP. [~chinnitv]

[jira] [Resolved] (SPARK-4985) Parquet support for date type

[ https://issues.apache.org/jira/browse/SPARK-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4985. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-4985) Parquet support for date type

[ https://issues.apache.org/jira/browse/SPARK-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4985: -- Assignee: Adrian Wang Parquet support for date type -

[jira] [Updated] (SPARK-4985) Parquet support for date type

[ https://issues.apache.org/jira/browse/SPARK-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4985: -- Target Version/s: 1.3.1, 1.4.0 Parquet support for date type -

[jira] [Commented] (SPARK-6020) Flaky test: o.a.s.sql.columnar.PartitionBatchPruningSuite

[ https://issues.apache.org/jira/browse/SPARK-6020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344602#comment-14344602 ] Cheng Lian commented on SPARK-6020: --- Hey [~andrewor14], I think [PR

[jira] [Created] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

Cheng Lian created SPARK-6136: - Summary: Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities Key: SPARK-6136 URL: https://issues.apache.org/jira/browse/SPARK-6136

[jira] [Updated] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5707: -- Description: Exception thrown: {noformat} org.apache.spark.SparkException: Job aborted due to stage

[jira] [Updated] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5707: -- Description: Exception thrown: {noformat} org.apache.spark.SparkException: Job aborted due to stage

[jira] [Updated] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

[ https://issues.apache.org/jira/browse/SPARK-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6136: -- Description: Integration test suites in the JDBC data source ({{MySQLIntegration}} and

[jira] [Resolved] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

[ https://issues.apache.org/jira/browse/SPARK-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5775. --- Resolution: Fixed Fix Version/s: 1.3.0 GenericRow cannot be cast to SpecificMutableRow when

[jira] [Resolved] (SPARK-6073) Need to refresh metastore cache after append data in CreateMetastoreDataSourceAsSelect

[ https://issues.apache.org/jira/browse/SPARK-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6073. --- Resolution: Fixed Fix Version/s: 1.3.0 Need to refresh metastore cache after append data in

[jira] [Created] (SPARK-6109) Unit tests fail when compiled against Hive 0.12.0

Cheng Lian created SPARK-6109: - Summary: Unit tests fail when compiled against Hive 0.12.0 Key: SPARK-6109 URL: https://issues.apache.org/jira/browse/SPARK-6109 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6052) In JSON schema inference, we should always set containsNull of an ArrayType to true

[ https://issues.apache.org/jira/browse/SPARK-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6052. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4806

[jira] [Updated] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

[ https://issues.apache.org/jira/browse/SPARK-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6153: -- Assignee: Adrian Wang intellij import from maven cannot debug sparksqlclidriver

[jira] [Resolved] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

[ https://issues.apache.org/jira/browse/SPARK-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6153. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4884

[jira] [Updated] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

[ https://issues.apache.org/jira/browse/SPARK-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6153: -- Description: The {{hive-thriftserver}} module depends on Guava indirectly via {{hive}} module. However,

[jira] [Updated] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

[ https://issues.apache.org/jira/browse/SPARK-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6153: -- Description: The {{hive-thriftserver}} module depends on Guava indirectly via {{hive]} module. However,

[jira] [Commented] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

[ https://issues.apache.org/jira/browse/SPARK-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348407#comment-14348407 ] Cheng Lian commented on SPARK-6153: --- Updated JIRA description to reflect the actual

[jira] [Created] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

Cheng Lian created SPARK-6147: - Summary: Move JDBC data source integration tests to the Spark integration tests project Key: SPARK-6147 URL: https://issues.apache.org/jira/browse/SPARK-6147 Project:

[jira] [Created] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 because of runtime incompatibility issues caused by Guava (15?)

Cheng Lian created SPARK-6149: - Summary: Spark SQL CLI doesn't work when compiled against Hive 12 because of runtime incompatibility issues caused by Guava (15?) Key: SPARK-6149 URL:

[jira] [Commented] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime incompatibility issues caused by Guava 15

[ https://issues.apache.org/jira/browse/SPARK-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346414#comment-14346414 ] Cheng Lian commented on SPARK-6149: --- Pointed out by [~pwendell], this is a Maven-vs-SBT

[jira] [Updated] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime incompatibility issues caused by Guava (15?)

[ https://issues.apache.org/jira/browse/SPARK-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6149: -- Summary: Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime

[jira] [Updated] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime incompatibility issues caused by Guava 15

[ https://issues.apache.org/jira/browse/SPARK-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6149: -- Summary: Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime

[jira] [Resolved] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

[ https://issues.apache.org/jira/browse/SPARK-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6136. --- Resolution: Fixed Fix Version/s: 1.3.0 Docker client library introduces Guava 17.0, which

[jira] [Resolved] (SPARK-6134) Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive

[ https://issues.apache.org/jira/browse/SPARK-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6134. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4870

[jira] [Updated] (SPARK-5938) Generate row from json efficiently

[ https://issues.apache.org/jira/browse/SPARK-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5938: -- Assignee: Liang-Chi Hsieh Generate row from json efficiently --

[jira] [Updated] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

[ https://issues.apache.org/jira/browse/SPARK-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6136: -- Description: Integration test suites in the JDBC data source ({{MySQLIntegration}} and

[jira] [Created] (SPARK-5947) First class partitioning support in data sources API

Cheng Lian created SPARK-5947: - Summary: First class partitioning support in data sources API Key: SPARK-5947 URL: https://issues.apache.org/jira/browse/SPARK-5947 Project: Spark Issue Type:

[jira] [Created] (SPARK-5948) Support writing to partitioned table for the Parquet data source

Cheng Lian created SPARK-5948: - Summary: Support writing to partitioned table for the Parquet data source Key: SPARK-5948 URL: https://issues.apache.org/jira/browse/SPARK-5948 Project: Spark

[jira] [Created] (SPARK-6010) Exception thrown when reading Spark SQL generated Parquet files with different but compatible schemas

Cheng Lian created SPARK-6010: - Summary: Exception thrown when reading Spark SQL generated Parquet files with different but compatible schemas Key: SPARK-6010 URL: https://issues.apache.org/jira/browse/SPARK-6010

[jira] [Updated] (SPARK-5968) Parquet warning in spark-shell

[ https://issues.apache.org/jira/browse/SPARK-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5968: -- Description: This may happen in the case of schema evolving, namely appending new Parquet data with

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335082#comment-14335082 ] Cheng Lian commented on SPARK-3850: --- Actually that was a Scala source file, where we put

[jira] [Resolved] (SPARK-6016) Cannot read the parquet table after overwriting the existing table when spark.sql.parquet.cacheMetadata=true

[ https://issues.apache.org/jira/browse/SPARK-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6016. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4775

[jira] [Resolved] (SPARK-6023) ParquetConversions fails to replace the destination MetastoreRelation of an InsertIntoTable node to ParquetRelation2

[ https://issues.apache.org/jira/browse/SPARK-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6023. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4782

[jira] [Commented] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

[ https://issues.apache.org/jira/browse/SPARK-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339010#comment-14339010 ] Cheng Lian commented on SPARK-5775: --- Hey [~avignon], sorry for the delay. I've left

[jira] [Resolved] (SPARK-5751) Flaky test: o.a.s.sql.hive.thriftserver.HiveThriftServer2Suite sometimes times out

[ https://issues.apache.org/jira/browse/SPARK-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5751. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4720

[jira] [Updated] (SPARK-6037) Avoiding duplicate Parquet schema merging

[ https://issues.apache.org/jira/browse/SPARK-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6037: -- Assignee: Liang-Chi Hsieh Avoiding duplicate Parquet schema merging

[jira] [Resolved] (SPARK-6037) Avoiding duplicate Parquet schema merging

[ https://issues.apache.org/jira/browse/SPARK-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6037. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4786

[jira] [Commented] (SPARK-6572) When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1

[ https://issues.apache.org/jira/browse/SPARK-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383999#comment-14383999 ] Cheng Lian commented on SPARK-6572: --- Would you please provide exact command line you

[jira] [Updated] (SPARK-6575) Add configuration to disable schema merging while converting metastore Parquet tables

[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6575: -- Description: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots

[jira] [Updated] (SPARK-6575) Add configuration to disable schema merging while converting metastore Parquet tables

[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6575: -- Description: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots

[jira] [Resolved] (SPARK-6483) Spark SQL udf(ScalaUdf) is very slow

[ https://issues.apache.org/jira/browse/SPARK-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6483. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5154

[jira] [Updated] (SPARK-6483) Spark SQL udf(ScalaUdf) is very slow

[ https://issues.apache.org/jira/browse/SPARK-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6483: -- Assignee: zzc Spark SQL udf(ScalaUdf) is very slow

[jira] [Resolved] (SPARK-6538) Add missing nullable Metastore fields when merging a Parquet schema

[ https://issues.apache.org/jira/browse/SPARK-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6538. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Created] (SPARK-6467) Override QueryPlan.missingInput when necessary and rely on it CheckAnalysis

Cheng Lian created SPARK-6467: - Summary: Override QueryPlan.missingInput when necessary and rely on it CheckAnalysis Key: SPARK-6467 URL: https://issues.apache.org/jira/browse/SPARK-6467 Project: Spark

[jira] [Updated] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Description: Virtual columns like GROUPING__ID should never be considered as missing input, and thus

[jira] [Comment Edited] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375481#comment-14375481 ] Cheng Lian edited comment on SPARK-6456 at 3/23/15 7:21 AM:

[jira] [Updated] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Summary: Exclude virtual columns from QueryPlan.missingInput (was: Override QueryPlan.missingInput

[jira] [Updated] (SPARK-6397) Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Affects Version/s: 1.3.0 Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[jira] [Updated] (SPARK-6397) Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Assignee: Yadong Qi Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[jira] [Commented] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375680#comment-14375680 ] Cheng Lian commented on SPARK-6397: --- Hey [~smolav], after some discussion with

[jira] [Resolved] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6397. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6456: -- Description: Spark connects with Hive Metastore. I am able to run simple queries like show table and

[jira] [Commented] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375481#comment-14375481 ] Cheng Lian commented on SPARK-6456: --- How many partitions are there? Spark Sql throwing

[jira] [Resolved] (SPARK-5203) union with different decimal type report error

[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5203. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4004

[jira] [Resolved] (SPARK-4521) Parquet fails to read columns with spaces in the name

[ https://issues.apache.org/jira/browse/SPARK-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4521. --- Resolution: Done This ticket is covered by SPARK-6607. Parquet fails to read columns with spaces in

<    1   2   3   4   5   6   7   8   9   10   >