Hi Chenghao,

Apache Hop supports HDFS over VFS[1]. However, there may be some system
configuration that is required.
Are you able to view and access your hdfs files over CLI tools e.g. `hdfs
dfs ls <YOUR_PATH>`?
Are there any logs in the Hop Gui output (console or your pipeline) when
you try to access files of HDFS?

[1]
https://hop.apache.org//manual/latest/vfs.html#_apache_hop_vfs_file_systems

Regards,
Bart

On Thu, Oct 19, 2023 at 8:25 AM 车 成皓 <[email protected]> wrote:

> Hello guys,
>
> I want to read a CSV file from an HDFS cluster. However, when I added the
> HDFS file path in the Text File Input transform and click Show File
> Contents, it says that hop GUI cannot find a valid file.
>
> Is there anything should have been done before I use HDFS as file system
> in HOP?
>
> By the way, I tried other VFS as well, like zip. It works well. It seems
> that “hdfs://” is an unknown scheme.
>
> I’m looking forward to hearing from you.
>
> Thanks in advance,
> Chenghao

Reply via email to