Matthias Boehm created SYSTEMML-1009:
----------------------------------------
Summary: Avoid spark context creation on parfor optimization
Key: SYSTEMML-1009
URL: https://issues.apache.org/jira/browse/SYSTEMML-1009
Project: SystemML
Issue Type: Improvement
Reporter: Matthias Boehm
Currently, every parfor script triggers the lazy spark context creation,
independent of its input data size and script in order to obtain memory budgets
and parallelism. On small data the the spark context creation dominates
end-to-end execution time. We should improve this to a configuration-only
analysis, which would avoid the context creation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
