Xuefu Zhang created HIVE-7382:
---------------------------------

             Summary: Create a MiniSparkCluster and set up a testing framework
                 Key: HIVE-7382
                 URL: https://issues.apache.org/jira/browse/HIVE-7382
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Xuefu Zhang


To automatically test Hive functionality over Spark execution engine, we need 
to create a test framework that can execute Hive queries with Spark as the 
backend. For that, we should create a MiniSparkCluser for this, similar to 
other execution engines.

Spark has a way to create a local cluster with a few processes in the local 
machine, each process is a work node. It's fairly close to a real Spark 
cluster. Our mini cluster can be based on that.

For more info, please refer to the design doc on wiki.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to