[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227339#comment-14227339 ]
Reynold Xin commented on SPARK-4628: ------------------------------------ Shall we also not depend on artifacts that are not in maven central? It should be a high bar for Spark to depend on some library, and if they can't make it to maven central, it doesn't inspire a lot of confidence. Of course, this can only be a general rule and there can also be exceptions. > Put all external projects behind a build flag > --------------------------------------------- > > Key: SPARK-4628 > URL: https://issues.apache.org/jira/browse/SPARK-4628 > Project: Spark > Issue Type: Improvement > Reporter: Patrick Wendell > Priority: Blocker > > This is something we talked about doing for convenience, but I'm escalating > this based on realizing today that some of our external projects depend on > code that is not in maven central. I.e. if one of these dependencies is taken > down (as happened recently with mqtt), all Spark builds will fail. > The proposal here is simple, have a profile -Pexternal-projects that enables > these. This can follow the exact pattern of -Pkinesis-asl which was disabled > by default due to a license issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org