[
https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14283308#comment-14283308
]
Adrian Wang commented on SPARK-5327:
------------------------------------
[~lian cheng]Do you mean we have to test both 0.12 and 0.13.1 for each test?
For queries with different behavior, we can add those in shims.
For `create_view_translate`, hive-0.12.0 has a different `.q`. If you set
correct HIVE_DEV_HOME, then this case is ok.
> HiveCompatibilitySuite fails when executed against Hive 0.12.0
> --------------------------------------------------------------
>
> Key: SPARK-5327
> URL: https://issues.apache.org/jira/browse/SPARK-5327
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.3.0, 1.2.1
> Reporter: Cheng Lian
> Assignee: Adrian Wang
>
> Git commit: e7884bc950a374408959b6118efe2c62fbe50608
> Run the following SBT session to reproduce:
> {code}
> $ ./build/sbt -Pyarn,hive,hive-thriftserver,hive-0.12.0,hadoop-2.4,scala-2.10
> -Dhadoop.version=2.4.1
> ...
> > hive/test-only *.HiveCompatibilitySuite -- -z create_view_translate
> ...
> [info] - create_view_translate *** FAILED *** (9 seconds, 216 milliseconds)
> [info] Failed to execute query using catalyst:
> [info] Error: Failed to parse: SELECT `items`.`id`,
> items`items`.`info`info['price'] FROM `default`.`items`
> [info] org.apache.spark.sql.hive.HiveQl$ParseException: Failed to parse:
> SELECT `items`.`id`, items`items`.`info`info['price'] FROM `default`.`items`
> [info] at
> org.apache.spark.sql.hive.HiveQl$.createPlan(HiveQl.scala:249)
> [info] at
> org.apache.spark.sql.hive.HiveQl$.createPlanForView(HiveQl.scala:275)
> [info] at
> org.apache.spark.sql.hive.HiveMetastoreCatalog.lookupRelation(HiveMetastoreCatalog.scala:151)
> ...
> {code}
> Seems that something went wrong when dealing with nested fields. Hive 0.13.1
> is OK.
> There are some other test cases also fail when executed against Hive 0.12.0.
> Will list them later.
> *UPDATE*
> Test cases that should be blacklisted for Hive 0.12.0 (because they use new
> features introduced in 0.13.1)
> - {{udf_to_double}}
> - {{udf_pmod}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
