Sean Wong created SPARK-18933:
---------------------------------
Summary: Different log output between Terminal screen and stderr
file
Key: SPARK-18933
URL: https://issues.apache.org/jira/browse/SPARK-18933
Project: Spark
Issue Type: Bug
Components: Deploy, Documentation, Web UI
Affects Versions: 1.6.3
Environment: Yarn mode and standalone mode
Reporter: Sean Wong
First of all, I use the default log4j.properties in the Spark conf/
But I found that the log output(e.g., INFO) is different between Terminal
screen and stderr File. Some INFO logs exist in both of them. Some INFO logs
exist in either of them. Why this happens? Is it supposed that the output logs
are same between the terminal screen and stderr file?
Then I did a Test. I modified the source code in SparkContext.scala and add one
line log code "logInfo("This is textFile")" in the textFile function. However,
after running an application, I found the log "This is textFile" shown in the
terminal screen. no such log in the stderr file. I am not sure if this is a
bug. So, hope you can solve this question. Thanks
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
