> On Aug. 29, 2016, 8:09 a.m., Mike Percy wrote: > > flume-ng-configuration/src/main/java/org/apache/flume/conf/FlumeConfiguration.java, > > line 373 > > <https://reviews.apache.org/r/51182/diff/7-8/?file=1486702#file1486702line373> > > > > for consistency, add logger.isDebugEnabled()
thanks for spotting, indeed it should have been like that. fixed > On Aug. 29, 2016, 8:09 a.m., Mike Percy wrote: > > flume-ng-sdk/src/main/java/org/apache/flume/util/LogPrivacyUtil.java, line > > 71 > > <https://reviews.apache.org/r/51182/diff/8/?file=1487629#file1487629line71> > > > > nit: This is weird camel caps. Should be allowLogRawData() fixed > On Aug. 29, 2016, 8:09 a.m., Mike Percy wrote: > > flume-ng-sdk/src/main/java/org/apache/flume/util/LogPrivacyUtil.java, line > > 80 > > <https://reviews.apache.org/r/51182/diff/8/?file=1487629#file1487629line80> > > > > nit: fix camel caps: allowLogPrintConfig() fixed > On Aug. 29, 2016, 8:09 a.m., Mike Percy wrote: > > flume-ng-sdk/src/main/java/org/apache/flume/util/LogPrivacyUtil.java, line > > 46 > > <https://reviews.apache.org/r/51182/diff/8/?file=1487629#file1487629line46> > > > > nit: the indentation here is weird, can you just line up the > > indentation with the opening parenthesis? Something like > > > > logger.warn("Logging of configuration details of the agent has > > been turned on by " + > > "setting {} to true. Please use this setting with > > extra caution as it may result " + > > "in logging of private data. This setting is not > > recommended in " + > > "production environments.", > > LOG_PRINTCONFIG_PROP); > > > > Same with the other log messages in this file. fixed - Attila ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51182/#review147119 ----------------------------------------------------------- On Aug. 29, 2016, 8:41 a.m., Attila Simon wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51182/ > ----------------------------------------------------------- > > (Updated Aug. 29, 2016, 8:41 a.m.) > > > Review request for Flume. > > > Bugs: FLUME-2954 > https://issues.apache.org/jira/browse/FLUME-2954 > > > Repository: flume-git > > > Description > ------- > > -------------------------------------------------------------------------------- > flume-ng-channel --- > flume-jdbc-channel --- > JdbcChannelProviderImpl#98 <- fail properties <REMOVED> > JdbcChannelProviderImpl#261 #431 <- fail properties: jdbc url > might include password <KEPT><FOLLOWUP IN JIRA> > flume-kafka-channel --- > KafkaChannel#230 #253 <- fail properties <REMOVED> > -------------------------------------------------------------------------------- > flume-ng-configuration --- > FlumeConfiguration#315 #372 <- fail properties <DRIVE BY > PROPERTY> > -------------------------------------------------------------------------------- > flume-ng-core --- > SyslogAvroEventSerializer#150 <- fail data: > SyslogEvent.message gets logged <DRIVE BY PROPERTY> > GangliaServer#224 #245 <- safe data: only flume > component metrics data <KEPT> > LoggerSink#95 <- fail data: on purpose <KEPT> > AvroSource#347 <- fail data: log whole message > <DRIVE BY PROPERTY> > MultiportSyslogTCPSource#360 <- fail data: log whole message > <DRIVE BY PROPERTY> > BLOBHandler#70 <- fail data: logs http request > headers <DRIVE BY PROPERTY> > -------------------------------------------------------------------q------------- > flume-ng-embedded-agent --- > EmbeddedAgent#155 <- fail properties: printing > all config <DRIVE BY PROPERTY> > -------------------------------------------------------------------------------- > flume-ng-sinks --- > flume-hive-sink --- > HiveEndPoint has an URI field. <- fail properties > <KEPT><FOLLOWUP IN JIRA> > It may contain private data > (URI string may contain password) as it is > excessively logged within this module. > Appears in HiveSink#298 #342 #400 #403 #428, > HiveWriter#210 #319 #330 #337 #353 #365 #368 #407...) > HiveEndPoint is also attached to exception logs as well > flume-ng-hbase-sink --- > AsyncHBaseSink#641 <- safe data: error details > gets logged in case of failure <KEPT> > flume-ng-kafka-sink --- > KafkaSink#179 <- fail data: log whole message > <REMOVED> > KafkaSink#304 <- fail properties <REMOVED> > flume-ng-morphline-solr-sink --- > BlobHandler#98 #113 <- fail data: log http request > headers <DRIVE BY PROPERTY> > MorphlineSink#139 <- fail data: logs event <DRIVE > BY PROPERTY> > -------------------------------------------------------------------------------- > flume-ng-sources --- > flume-kafka-source --- > KafkaSource#247 <- fail data: log whole <DRIVE > BY PROPERTY> > flume-twitter-source --- > TwitterSource#110-113 <- fail properties <REMOVED> > -------------------------------------------------------------------------------- > > > Diffs > ----- > > conf/flume-env.ps1.template 8bf535a > conf/flume-env.sh.template c8b660f > > flume-ng-channels/flume-jdbc-channel/src/main/java/org/apache/flume/channel/jdbc/impl/JdbcChannelProviderImpl.java > 845b794 > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java > 684120f > > flume-ng-configuration/src/main/java/org/apache/flume/conf/FlumeConfiguration.java > 9b3a434 > flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java 8b9b956 > > flume-ng-core/src/main/java/org/apache/flume/source/MultiportSyslogTCPSource.java > b9f2438 > flume-ng-core/src/main/java/org/apache/flume/source/http/BLOBHandler.java > e24d4c6 > > flume-ng-core/src/test/java/org/apache/flume/serialization/SyslogAvroEventSerializer.java > 05af3b1 > flume-ng-doc/sphinx/FlumeUserGuide.rst 7e207aa > > flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgent.java > ad3e138 > flume-ng-sdk/src/main/java/org/apache/flume/util/LogPrivacyUtil.java > PRE-CREATION > > flume-ng-sinks/flume-ng-kafka-sink/src/main/java/org/apache/flume/sink/kafka/KafkaSink.java > 9453546 > > flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/BlobHandler.java > ca7614a > > flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/MorphlineSink.java > f7a73f3 > > flume-ng-sources/flume-kafka-source/src/main/java/org/apache/flume/source/kafka/KafkaSource.java > 90e4715 > > flume-ng-sources/flume-twitter-source/src/main/java/org/apache/flume/source/twitter/TwitterSource.java > f5c8328 > > Diff: https://reviews.apache.org/r/51182/diff/ > > > Testing > ------- > > compiles, site builds, all unit test passes, distribution target handles the > system properties as expected: > bin/flume-ng agent --conf conf --conf-file > ../../../../../flume-conf/flume-log.conf --name a1 > -Dflume.root.logger=DEBUG,console -Dorg.apache.flume.log.printconfig=true > -Dorg.apache.flume.log.rawdata=true (with and without the extra properties) > > > Thanks, > > Attila Simon > >
