Joseph Jacob created SDAP-151:
---------------------------------
Summary: Determine parallelism automatically for Spark analytics
Key: SDAP-151
URL: https://issues.apache.org/jira/browse/SDAP-151
Project: Apache Science Data Analytics Platform
Issue Type: Improvement
Reporter: Joseph Jacob
Some of the built-in NEXUS analytics like TimeSeries and TimeAvgMap currently
get the desired parallelism from a job request parameter like
"spark=mesos,16,32". If that is omitted, we currently default to
"spark=local,1,1", which runs on a single core. Instead we would like to
automatically determine the appropriate level of parallelism based on the job's
input data size.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)