Ufuk Celebi created FLINK-5207: ---------------------------------- Summary: Decrease HadoopFileSystem logging Key: FLINK-5207 URL: https://issues.apache.org/jira/browse/FLINK-5207 Project: Flink Issue Type: Improvement Reporter: Ufuk Celebi
HadoopFileSystem logging is very noisy when trying to get the Hadoop configuration, which happens for every HadoopFileSystem. This happens for example when a checkpoint is written to HDFS in case of HA. 1) Two log messages relate to the user config: {code} final String hdfsDefaultPath = GlobalConfiguration.getString(ConfigConstants.HDFS_DEFAULT_CONFIG, null); if (hdfsDefaultPath != null) { retConf.addResource(new org.apache.hadoop.fs.Path(hdfsDefaultPath)); } else { LOG.debug("Cannot find hdfs-default configuration file"); } {code} Since this is reflected in the logged configuration properties, it is mostly unnecessary to log over and over again. Therefore I propose to go with TRACE. (2) Two log messages relate to the default config files of Hadoop. There I would change the debug message to happen only when they are *not* found. If it is still too noisy, we could completely remove it or decrease to TRACE at another time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)