Sure, no problem:
Hi Laurent
Yes crail://localhost:9060/mypath would be the path you want to use in your
Spark program to access Crail. Did you check if your Crail deployment is up
and running and can be accessed using the crail hdfs client (./bin/crail
fs)? If the crail hdfs client works access via Spark should be a matter of
setting the extra class path.
Please also take a look at
https://incubator-crail.readthedocs.io/en/latest/config.html#configuration
for examples how to configure Crail on a single machine or on a cluster.
-Patrick
On Tue, 27 Apr 2021 14:56:48 +0200
Laurent d'Orazio <[email protected]> wrote:
Hi Jonas,
I have just checked, but I do not find it (even in my spams).
Can you forward it to me?
Thanks again and sorry to bother you with that :(
Best,
Laurent
Le 27 avr. 2021 à 14:51, Jonas Pfefferle <[email protected]> a écrit
:
Hi Laurent,
The question has been answered by Patrick already. Check your
history...
Best,
Jonas
On Mon, 26 Apr 2021 18:21:01 +0200
Laurent d'Orazio <[email protected]> wrote:
Dear all,
A gentle remind.
Thanks again.
Best,
Laurent
Le 19 avr. 2021 à 18:07, Laurent d'Orazio
<[email protected]> a écrit :
Dear all,
My deepest apologies for a probably naive question :(
I want to test Crail instead of HDFS with a basic Spark test (in
Python) reading a very small (3 lines of 3 columns) cvs file
(textFile) and saving it in another file (with saveAsTextFile).
I have thus changed the path from hdfs://localhost:9000/<mypath> to
hdfs://localhost:9060/<mypath>
I have the enclosed error.
Please note that I tried using crail://localhost:9060/<mypath>, but
in that case I have a Java.io.IOException: No FileSystem for Scheme :
crail.
Can you let me know what is my mistake?
Thanks in advance.
Best,
Laurent
<GraphiqueCollé-1.tiff>
