Is your NVMe shared and all datanodes sending I/O to the same set of disks ? Is it possible for you to see the I/O queue length of the NVMe Devices? I would suggest that you try to find out what is causing the perf issue, and once we know in ball park where the issue is -- that is, is it disks or HDFS, it might be possible to see what we can do.
Thanks Anu On Tue, Jun 25, 2019 at 7:20 AM Daegyu Han <hdg9...@gmail.com> wrote: > Hi all, > > I am using storage disaggregation by mounting nvme ssds on the storage > node. > > When we connect the compute node and the storage node with nvme over > fabric (nvmeof) and test it, performance is much lower than that of > local storage (DAS). > > In general, we know that applications need to increase io parallelism > and io size to improve the performance of nvmeof. > > How can I change the settings of hdfs specifically to improve the io > performance of NVMeOF in HDFS? > > Best regards, > Daegyu > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org > For additional commands, e-mail: user-h...@hadoop.apache.org > >
