Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-24 Thread Denis Magda
Just in case, please check this thread: http://apache-ignite-users.70518.x6.nabble.com/Future-of-IGFS-td28119.html#a28131 Not sure what your goals for IGFS are but that thread is worth reading. - Denis On Fri, May 24, 2019 at 3:24 AM joaquinsanroman wrote: > Hi, > > Ok, I will start one

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-24 Thread joaquinsanroman
Hi, Ok, I will start one client because with igfs://igfs@/host1:10500/ it will not balance the access to all ignite servers. Thank you very much, Regards. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-24 Thread Ilya Kasnacheev
Hello! igfs://igfs@/host1:10500/ is access through IPC and you said it works for you. You will definitely need to run a client anyway if you want to use Ignite configration, with discovery and stuff. Regards, -- Ilya Kasnacheev чт, 23 мая 2019 г. в 18:40, joaquinsanroman : > Hi, > > Thank

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread joaquinsanroman
Hi, Thank you very much for your help! You mean that I need to run one IgniteClient inside the host from I want to make the query? With this configuration the hdfs will access to the cluster through the local client, right? I would like to access without having to run the ignite client in

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread Ilya Kasnacheev
Hello! Unfortunately I'm not familiar enough with IGFS to answer such question purely from configuration variables. What does it say when it does not work? Have you tried starting Ignite client in the same VM prior to the launch? If you don't have Ignite client, you will have to use IPC.

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread joaquinsanroman
Hi, I set fs.igfs.igfs.endpoint.no_embed to false, but it does not run. This is the actual situation: [xxx@snnni0006 ~]$ hdfs getconf -confkey fs.igfs.igfs.endpoint.no_embed false [xxx@snnni0006 ~]$ hdfs getconf -confkey IgfsIpcEndpointConfiguration.host snnni0010 [xxx@snnni0006 ~]$ hdfs

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread Ilya Kasnacheev
Hello! It seems that Igfs can try use client node from the same process if fs.igfs.igfs.endpoint.no_embed is set to false. But you have it set to true. In this case it will use IPC by host/port. Regards, -- Ilya Kasnacheev чт, 23 мая 2019 г. в 17:20, joaquinsanroman : > Hi, > > Yes, this

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread joaquinsanroman
Hi, Yes, this what I need. When I run "hdfs dfs -ls igfs://igfs@" in an external node (who has not an ignite node) it should connect to a defined endpoint:port to do IGFS operations. I have checked the documentation and I found 2 properties (File system URI:

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread Ilya Kasnacheev
Hello! I don't understand what you are trying to do. Do you want igfs://igfs@/ to spawn a client node that would connect to a cluster and do IGFS operations? Regards, -- Ilya Kasnacheev чт, 23 мая 2019 г. в 16:16, joaquinsanroman : > Hi Ilya, > > I am not using SHMEM, because the client and

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread joaquinsanroman
Hi Ilya, I am not using SHMEM, because the client and the servers are in different hosts. If I use @localhost:10500, I will never connect because in localhost is not running one node of ignite. My intention is to connect to one cluster remotely. Do you know how to do it? Thank you very much,

Re: Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread Ilya Kasnacheev
Hello! I don't think you actually want to use SHMEM. How about just using @localhost:10500? -- Ilya Kasnacheev чт, 23 мая 2019 г. в 13:15, joaquinsanroman : > Hi, > > First of all, thak you very much for your help. > > I have configured one IGFS cluster without HDFS secondary filesystem >

Hadoop client configuration IGFS - hdfs dfs

2019-05-23 Thread joaquinsanroman
Hi, First of all, thak you very much for your help. I have configured one IGFS cluster without HDFS secondary filesystem because the intention is to use IGFS as an independent storage. The configuration file for all server nodes is the next: http://www.springframework.org/schema/beans;