Interesting benchmark. Thank you, Daegyu.
Can you try a larger file too? Like 128mb or 1gb? HDFS is not optimized for
smaller files.
What did you use for benchmark?
Daegyu Han 於 2019年8月29日 週四，下午11:40寫道：
> Hi all,
>
> Is ShortCircuit read faster than legacy read which goes through data nodes?
>
Yes, i have tried. That have solved the untrusted image from execution.
However still hitting the exit code 127 error. Mind to have second thoughts
on this?
On Fri, 30 Aug 2019 at 5:19 PM, Prabhu Josephraj
wrote:
> Can you test with adding local into docker.trusted.registries in
>
Can you test with adding local into docker.trusted.registries in
container-executor.cfg.
Fyi
https://community.cloudera.com/t5/Support-Questions/Not-able-to-run-docker-container-on-yarn-even-after/m-p/224259
On Fri, Aug 30, 2019 at 2:07 PM Yen-Onn Hiu wrote:
> hi all,
>
> I have a bash script
hi all,
I have a bash script testing the docker container executor, try to
configure the distributedshell such like below. But keep having error as
like below.
Any helps please... Thanks!
#!/bin/bash
export HADOOP_HOME="/usr/hdp/3.1.0.0-78/hadoop"
export
Hi all,
Is ShortCircuit read faster than legacy read which goes through data nodes?
I have evaluated SCR and legacy local read on both HDD and NVMe SSD.
However, I have not seen any results that SCR is faster than legacy.
Rather, SCR was slower than legacy when using NVMe SSDs because of the
