Thomas Friedrich created HIVE-8503:
--------------------------------------
Summary: UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
Key: HIVE-8503
URL: https://issues.apache.org/jira/browse/HIVE-8503
Project: Hive
Issue Type: Sub-task
Components: Spark
Reporter: Thomas Friedrich
Priority: Minor
The 3 tests
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
create directories in HDFS, but TestSparkCliDriver is not using HDFS.
That's why the tests fail when creating a dir, for example mkdir -p
hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver
which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).
We may need to configure a TestSparkMinimrCliDriver in
itests/qtest-spark/pom.xml if we want to run these test cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
