[ 
https://issues.apache.org/jira/browse/HIVE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16087911#comment-16087911
 ] 

Sahil Takiar commented on HIVE-17090:
-------------------------------------

Ok looks like that changed worked! The spark.only.query.files files are now 
being run by ptest, the bad news is that lots of them are failing:

{code}
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning]
 (batchId=167)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning_2]
 (batchId=169)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1]
 (batchId=168)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_use_op_stats]
 (batchId=167)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_use_ts_stats_for_mapjoin]
 (batchId=168)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_vectorized_dynamic_partition_pruning]
 (batchId=167)
{code}

Filed HIVE-17099 to fix these tests.

> spark.only.query.files are not being run by ptest
> -------------------------------------------------
>
>                 Key: HIVE-17090
>                 URL: https://issues.apache.org/jira/browse/HIVE-17090
>             Project: Hive
>          Issue Type: Bug
>          Components: Test
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>
> Checked a recent run of Hive QA and it doesn't look like qtests specified in 
> spark.only.query.files are being run.
> I think some modifications to ptest config files are required to get this 
> working - e.g. the deployed master-m2.properties file for ptest should 
> contain mainProperties.$\{spark.only.query.files} in the 
> qFileTest.miniSparkOnYarn.groups.normal key.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to