Re: Question regarding logging capabilities in flink

2016-06-30 Thread Aljoscha Krettek
Hi, I think there is no way to get the output from these log statements into the Yarn logs. The reason is that this code is only executed on the client and not in any Yarn context/container. This code is setting up everything for Yarn and then control is handed over so it is executed before the

Re: Question regarding logging capabilities in flink

2016-06-24 Thread Sharma, Samiksha
Hi, I think what I wanted to know was if I add some logging in my flink job, I do not see them on Yarn. For example, In the following snippet in WordCount example when I add Logging, I do not see this in yarn logs when I run the job. However, I see them as client log on my side but not on yarn.

RE: Question regarding logging capabilities in flink

2016-06-24 Thread VALLEE Charles
Hi, http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/ -Message d'origine- De : m...@apache.org [mailto:m...@apache.org] Envoyé : vendredi 24 juin 2016 13:53 À : user@flink.apache.org Objet : Re: Question regarding logging capabilities in flink Hi, Flink

Re: Question regarding logging capabilities in flink

2016-06-24 Thread Maximilian Michels
Hi, Flink prints the Yarn application id during deployment of the cluster. You can then query the logs from Yarn using the `yarn logs -applicationId ` command. Please have a look at https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/YarnCommands.html#logs Cheers, Max On Thu,

Question regarding logging capabilities in flink

2016-06-23 Thread Sharma, Samiksha
Hi, I was reading this link regarding logging in flink jobs (https://ci.apache.org/projects/flink/flink-docs-master/internals/logging.html) and with modifications to log4j files I am able to see logs in flink/log directory when I run job Standalone or on Yarn, but I was more interested in