Hello Demai, HDFS short-circuit read currently does not work on Mac, due to some platform differences in handling of domain sockets. The last time I checked, our Hadoop code was exceeding a maximum path length enforced on Mac for domain socket paths. I haven't had availability to look at this in a while, but the prior work is tracked in JIRA issues HDFS-3296 and HADOOP-11957 if you want to see the current progress.
--Chris Nauroth From: Demai Ni <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Tuesday, September 8, 2015 at 4:46 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: HDFS ShortCircuit Read on Mac? hi, folks, wondering anyone has setup HDFS shortcircuit Read on Mac? I installed hadoop through homebrew on Mac. It is up and running. But I cannot config "dfs.domain.socket.path" as instructed here: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html Since there is no dn_socket on the mac. any pointers are appreciated. Demai
