marin-ma commented on code in PR #7982:
URL: https://github.com/apache/incubator-gluten/pull/7982#discussion_r1847659293
##########
docs/developers/MicroBenchmarks.md:
##########
@@ -358,6 +358,11 @@
ShuffleWriteRead/iterations:1/process_time/real_time/threads:1 121637629714 ns
Unless `spark.gluten.sql.debug` is set in the INI file via `--conf`, the
logging behavior is same as debug mode off.
Developers can use `--debug-mode` command line flag to turn on debug mode when
needed, and set verbosity/severity level via command line flags `--v` and
`--minloglevel`. Note that constructing and deconstructing log strings can be
very time-consuming, which may cause benchmark times to be inaccurate.
+
+## Enable HDFS support
+
+After enabling the dynamic loading of libhdfs.so at runtime to support HDFS,
if you run the benchmark with an HDFS file, you need to set the classpath for
Hadoop. You can do this by running `export CLASSPATH=`$HADOOP_HOME/bin/hdfs
classpath --glob``. Otherwise, the HDFS connection will fail.
Review Comment:
Could you also explain that in the doc? For example, add something like
```
If you have replaced ${HADOOP_HOME}/lib/native/libhdfs.so with libhdfs3.so,
there is no need to set the `CLASSPATH`.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
