Re: Flink log and out files

2018-08-01 Thread vino yang
Hi Alexander, Yes, usually if you configure the log output as a .log file, the .out file will not have content, but sometimes some fatal exceptions, such as JVM exit exceptions, may be printed to the .out file. If Flink logs appear in your .out file, and it seems that the format of the log is inco

Re: Flink log and out files

2018-08-01 Thread Alexander Smirnov
thanks guys, So, is it a correct statement - if my job doesn't write anything to stdout, the "*.out" file should be empty? for some reason it contains the same info as "log" and much more. For the "log" files, I can control rotation via log4j configuration, but how do I setup rotation for "out"

Re: Flink log and out files

2018-08-01 Thread Andrey Zagrebin
Hi Alexander, there is also a doc link where log configuration is described: https://ci.apache.org/projects/flink/flink-docs-release-1.5/monitoring/logging.html You can modify log configuration in conf directo

Re: Flink log and out files

2018-08-01 Thread vino yang
Hi Alexander: .log and .out are different. Usually, the .log file stores the log information output by the log framework. Flink uses slf4j as the log interface and supports log4j and logback configurations. The .out file stores the STDOUT information. This information is usually output by you call

Flink log and out files

2018-08-01 Thread Alexander Smirnov
Hi, could you please explain the difference between *.log and *.out files in Flink? What information is supposed to be in each of them? Is "log" a subset of "out"? How do I setup rotation with gzipping? Thank you, Alex