Re: What is the best way for Spark to read HDF5@scale?
Here is the solution
sc.textFile("hdfs://nn1home:8020/input/war-and-peace.txt")
How did I find out nn1home:8020?
Just search for the file core-site.xml and look for xml element fs.defaultFS
On Fri, Sep 14, 2018 at 7:57 PM kathleen li wrote:
> Hi,
> Any Spark-connector for HDF5?
>
> The following link does not work anymore?
>
> https://www.hdfgroup.org/downloads/spark-connector/
> down vo
>
> Thanks,
>
> Kathleen
>
--
Thanks and Regards,
Saurav Sinha
Contact: 9742879062
What is the best way for Spark to read HDF5@scale?
Hi, Any Spark-connector for HDF5? The following link does not work anymore? https://www.hdfgroup.org/downloads/spark-connector/ down vo Thanks, Kathleen
