Hi Daniel, yes it supported, however you need to add hadoop-azure.jar to
classpath of spark shell
(http://search.maven.org/#search%7Cga%7C1%7Chadoop-azure - it's
available only for hadoop-2.7.0). Try to find it on your node and run:
export CLASSPATH=$CLASSPATH:hadoop-azure.jar && spark-shell
Thanks,
Peter Rudenko
On 2015-06-25 20:37, Daniel Haviv wrote:
Hi,
I'm trying to use spark over Azure's HDInsight but the spark-shell
fails when starting:
java.io.IOException: No FileSystem for scheme: wasb
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
Is Azure's blob storage supported ?
Thanks,
Daniel
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
