[ https://issues.apache.org/jira/browse/BAHIR-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671894#comment-15671894 ]
ASF GitHub Bot commented on BAHIR-75: ------------------------------------- Github user lresende commented on a diff in the pull request: https://github.com/apache/bahir/pull/27#discussion_r88345357 --- Diff: datasource-webhdfs/README.md --- @@ -0,0 +1,53 @@ +A custom data source to read and write data from and to remote HDFS clusters using the [WebHDFS](https://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-hdfs/WebHDFS.html) protocol. + +## Linking + +Using SBT: + +```scala +libraryDependencies += "org.apache.bahir" %% "spark-datasource-webhdfs" % "2.1.0-SNAPSHOT" +``` + +Using Maven: + +```xml +<dependency> + <groupId>org.apache.bahir</groupId> + <artifactId>spark-datasource-webhdfs_2.11</artifactId> + <version>2.1.0-SNAPSHOT</version> +</dependency> +``` + +This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. +For example, to include it when starting the spark shell: + + $ bin/spark-shell --packages org.apache.bahir:spark-datasource-webhdfs_2.11:2.1.0-SNAPSHOT + +Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. +The `--packages` argument can also be used with `bin/spark-submit`. + +This library is compiled for Scala 2.11 only, and intends to support Spark 2.0 onwards. --- End diff -- This line above is not required. During our release process we do build 2.10 and 2.11 artifacts and make sure it is compatible with the Spark release being built with. > Initial Code Delivery > --------------------- > > Key: BAHIR-75 > URL: https://issues.apache.org/jira/browse/BAHIR-75 > Project: Bahir > Issue Type: Sub-task > Components: Spark SQL Data Sources > Reporter: Sourav Mazumder > Original Estimate: 504h > Remaining Estimate: 504h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)