[
https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214480#comment-14214480
]
Patrick Wendell commented on SPARK-3962:
----------------------------------------
I think this is causing the build to fail because of this bug:
https://jira.codehaus.org/browse/MSHADE-148
Would it be possible to remove the test-jar dependency on streaming for these
modules (/cc @tdas)? If we need to have a moderate amount of code duplication I
think it's fine because as it stands now these aren't really usable for people.
I looked and I only found some minor dependencies that could be inlined into
the modules.
> Mark spark dependency as "provided" in external libraries
> ---------------------------------------------------------
>
> Key: SPARK-3962
> URL: https://issues.apache.org/jira/browse/SPARK-3962
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Reporter: Patrick Wendell
> Assignee: Prashant Sharma
> Priority: Blocker
>
> Right now there is not an easy way for users to link against the external
> streaming libraries and not accidentally pull Spark into their assembly jar.
> We should mark Spark as "provided" in the external connector pom's so that
> user applications can simply include those like any other dependency in the
> user's jar.
> This is also the best format for third-party libraries that depend on Spark
> (of which there will eventually be many) so it would be nice for our own
> build to conform to this nicely.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
