Xuefu Zhang created HIVE-7382:
---------------------------------
Summary: Create a MiniSparkCluster and set up a testing framework
Key: HIVE-7382
URL: https://issues.apache.org/jira/browse/HIVE-7382
Project: Hive
Issue Type: Sub-task
Components: Spark
Reporter: Xuefu Zhang
To automatically test Hive functionality over Spark execution engine, we need
to create a test framework that can execute Hive queries with Spark as the
backend. For that, we should create a MiniSparkCluser for this, similar to
other execution engines.
Spark has a way to create a local cluster with a few processes in the local
machine, each process is a work node. It's fairly close to a real Spark
cluster. Our mini cluster can be based on that.
For more info, please refer to the design doc on wiki.
--
This message was sent by Atlassian JIRA
(v6.2#6252)