Thanks a lot Jonas and Patrick :) Yes my Crail service is running: I have made a directory, copied some data on it from my local FS and check with crail fs -ls This part is fine.
Part of my error was to test with a path starting with « hdfs:// » and port 9060 (not crail). I was not sure about this since I got this error with Spark (pyspark): No FileSystem for Scheme : crail See bellow the (very basic example I want to test, reading a file from crail and writing its content, some kind of copy, in a folder). I have surely forgotten something (on Spark side to use crail??) Thanks again. Best, Laurent > Le 27 avr. 2021 à 15:12, Jonas Pfefferle <peppe...@japf.ch> a écrit : > > Sure, no problem: > > Hi Laurent > > Yes crail://localhost:9060/mypath would be the path you want to use in your > Spark program to access Crail. Did you check if your Crail deployment is up > and running and can be accessed using the crail hdfs client (./bin/crail fs)? > If the crail hdfs client works access via Spark should be a matter of setting > the extra class path. > > Please also take a look at > > https://incubator-crail.readthedocs.io/en/latest/config.html#configuration > > for examples how to configure Crail on a single machine or on a cluster. > > -Patrick > > On Tue, 27 Apr 2021 14:56:48 +0200 > Laurent d'Orazio <laurent.dora...@univ-rennes1.fr> wrote: >> Hi Jonas, >> I have just checked, but I do not find it (even in my spams). >> Can you forward it to me? >> Thanks again and sorry to bother you with that :( >> Best, >> Laurent >>> Le 27 avr. 2021 à 14:51, Jonas Pfefferle <peppe...@japf.ch> a écrit : >>> Hi Laurent, >>> The question has been answered by Patrick already. Check your history... >>> Best, >>> Jonas >>> On Mon, 26 Apr 2021 18:21:01 +0200 >>> Laurent d'Orazio <laurent.dora...@univ-rennes1.fr> wrote: >>>> Dear all, >>>> A gentle remind. >>>> Thanks again. >>>> Best, >>>> Laurent >>>>> Le 19 avr. 2021 à 18:07, Laurent d'Orazio >>>>> <laurent.dora...@univ-rennes1.fr> a écrit : >>>>> Dear all, >>>>> My deepest apologies for a probably naive question :( >>>>> I want to test Crail instead of HDFS with a basic Spark test (in Python) >>>>> reading a very small (3 lines of 3 columns) cvs file (textFile) and >>>>> saving it in another file (with saveAsTextFile). >>>>> I have thus changed the path from hdfs://localhost:9000/<mypath> to >>>>> hdfs://localhost:9060/<mypath> >>>>> I have the enclosed error. >>>>> Please note that I tried using crail://localhost:9060/<mypath>, but in >>>>> that case I have a Java.io.IOException: No FileSystem for Scheme : crail. >>>>> Can you let me know what is my mistake? >>>>> Thanks in advance. >>>>> Best, >>>>> Laurent >>>>> <GraphiqueCollé-1.tiff> > >
