ROOBALJINDAL commented on issue #5540:
URL: https://github.com/apache/hudi/issues/5540#issuecomment-1212833387
@nsivabalan I tried enabling debug logs by changing root
`log4j.rootLogger=INFO` to `log4j.rootLogger=DEBUG` in Hudi jar for following
files
**log4j.properties
log4j-surefire.properties
log4j-surefire-quiet.properties**
Also updated some other properties in these files:
```
log4j.rootLogger=DEBUG, CONSOLE
log4j.logger.org.apache=INFO
log4j.logger.org.apache.hudi=DEBUG
```
I am using this custom hudi jar by following spark command:
```
spark-submit \
--class
org.apache.hudi.utilities.deltastreamer.HoodieMultiTableDeltaStreamer
s3://slava-redshift-test/hudi/roobal-hudi-Debug-logger/hudi-utilities-bundle_2.12-0.11.0_edfx_debug.jar
\
```
I have also tried this:
```
spark-submit \
--conf spark.executor.extraJavaOptions=-Dlog4j.debug=true \
```
Can you help what I am missing?
Note: I am using EMR cluster on AWS.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
