Marcelo Vanzin created SPARK-8852:
-------------------------------------
Summary: spark-streaming-flume-assembly packages too many
dependencies
Key: SPARK-8852
URL: https://issues.apache.org/jira/browse/SPARK-8852
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.5.0
Reporter: Marcelo Vanzin
This assembly was recently added to make it easier to start pyspark jobs that
use the flume backend; but it packages way too many dependencies, several of
which are already packaged in the main Spark assembly, making the final file
unnecessarily large.
We should clean up the dependency tree for that module and only package what's
really needed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
