liyunzhang_intel created PIG-4863:
-------------------------------------
Summary: Re-design Spark plan to optimize the RDD pipeline
Key: PIG-4863
URL: https://issues.apache.org/jira/browse/PIG-4863
Project: Pig
Issue Type: Sub-task
Components: spark
Reporter: liyunzhang_intel
Currently the SparkLaucher converts the SparkPlan to RDD pipeline and
immediately executes it,There is no intermediate step that allows optimization
of the RDD pipeline, if so deemed necessary,before execution, This will need
re-working of sparkPlanToRDD(), perhaps by introduction of a RDDPlan of
RDDOperators.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
