Patrick Wendell created SPARK-5025: -------------------------------------- Summary: Write a guide for creating well-formed packages for Spark Key: SPARK-5025 URL: https://issues.apache.org/jira/browse/SPARK-5025 Project: Spark Issue Type: Bug Components: Documentation Reporter: Patrick Wendell Assignee: Patrick Wendell
There are an increasing number of OSS projects providing utilities and extensions to Spark. We should write a guide in the Spark docs that explains how to create, package, and publish a third party Spark library. There are a few issues here such as how to list your dependency on Spark, how to deal with your own third party dependencies, etc. We should also cover how to do this for Python libraries. In general, we should make it easy to build extension points against any of Spark's API's (e.g. for new data sources, streaming receivers, ML algos, etc) and self-publish libraries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org