[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447717#comment-17447717 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any star imports .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:red}-1{color} There are [20] new bugs found below threshold in total that must be fixed. .{color:green}+1{color} There are no new bugs found in [webapp]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive]. .{color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. .{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. .{color:green}+1{color} There are no new bugs found in [sharelib/oozie]. .{color:green}+1{color} There are no new bugs found in [sharelib/git]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive2]. .{color:green}+1{color} There are no new bugs found in [sharelib/streaming]. .{color:green}+1{color} There are no new bugs found in [sharelib/distcp]. .{color:green}+1{color} There are no new bugs found in [sharelib/spark]. .{color:green}+1{color} There are no new bugs found in [sharelib/pig]. .{color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. .{color:green}+1{color} There are no new bugs found in [docs]. .{color:green}+1{color} There are no new bugs found in [examples]. .{color:green}+1{color} There are no new bugs found in [client]. .{color:green}+1{color} There are no new bugs found in [server]. .{color:red}-1{color} There are [5] new bugs found below threshold in [core] that must be fixed. .You can find the SpotBugs diff here (look for the red and orange ones): core/findbugs-new.html .The most important SpotBugs errors are: .At BulkJPAExecutor.java:[line 206]: This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection .At BulkJPAExecutor.java:[line 176]: At BulkJPAExecutor.java:[line 175] .At BulkJPAExecutor.java:[line 205]: At BulkJPAExecutor.java:[line 199] .This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 206] .At BulkJPAExecutor.java:[line 111]: At BulkJPAExecutor.java:[line 127] .{color:red}-1{color} There are [15] new bugs found below threshold in [tools] that must be fixed, listing only the first [5] ones. .You can find the SpotBugs diff here (look for the red and orange ones): tools/findbugs-new.html .The top [5] most important SpotBugs errors are: .At OozieDBCLI.java:[line 584]: This use of java/sql/Statement.executeUpdate(Ljava/lang/String;)I can be vulnerable to SQL injection .At OozieDBCLI.java:[line 574]: At OozieDBCLI.java:[line 573] .At OozieDBCLI.java:[line 577]: At OozieDBCLI.java:[line 575] .At OozieDBCLI.java:[line 579]: At OozieDBCLI.java:[line 578] .At OozieDBCLI.java:[line 584]: At OozieDBCLI.java:[line 581] {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3215 .{color:orange}Tests failed at first run:{color} TestBlockingInputStream#testFastWritingBlockingInputStream .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:green}+1 MODERNIZER{color} {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://ci-hadoop.apache.org
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447687#comment-17447687 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch, oozie-2338-005.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809591#comment-16809591 ] Andras Salamon commented on OOZIE-2338: --- [~nobigo] Thanks for the new patch. * For {{HCAT_CONFIGURATION}} the solution of the old patch (by [~rkanter]) was to add the property to {{oozie-default.xml}}. Your patch just adds it to the exception list. Why? * If we add {{HCAT_CONFIGURATION}} to to exception list: Why do you use {{contains}} for {{HCAT_CONFIGURATION}} checking? Why not {{equals}}? * If we need to use {{startsWith}} and {{equals}} (or {{contains}}) at the same time, then I think we should you regexp matches instead. * Could you please also check the whitespace formatting. For instance spaces after {{for}}, {{if}}... My biggest concern is the fact that we may miss a few other properties, I don't really know any foolproof way to list all the properties missing from {{oozie-default.xml}} We have discussed this issue with [~kmarton] and opened OOZIE-3462. I think it might be useful to fix OOZIE-3462 first. That requires to checks lots of code, we might find a few more special properties. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch, oozie-2338-005.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801303#comment-16801303 ] duan xiong commented on OOZIE-2338: --- Hi,[~asalamon74],Can you help me to review this?Thank you very much! > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch, oozie-2338-005.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789726#comment-16789726 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any star imports .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:red}-1{color} There are [20] new bugs found below threshold in total that must be fixed. .{color:green}+1{color} There are no new bugs found in [sharelib/hive2]. .{color:green}+1{color} There are no new bugs found in [sharelib/spark]. .{color:green}+1{color} There are no new bugs found in [sharelib/oozie]. .{color:green}+1{color} There are no new bugs found in [sharelib/pig]. .{color:green}+1{color} There are no new bugs found in [sharelib/streaming]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive]. .{color:green}+1{color} There are no new bugs found in [sharelib/distcp]. .{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. .{color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. .{color:green}+1{color} There are no new bugs found in [sharelib/git]. .{color:green}+1{color} There are no new bugs found in [client]. .{color:green}+1{color} There are no new bugs found in [docs]. .{color:red}-1{color} There are [15] new bugs found below threshold in [tools] that must be fixed, listing only the first [5] ones. .You can find the SpotBugs diff here (look for the red and orange ones): tools/findbugs-new.html .The top [5] most important SpotBugs errors are: .At OozieDBCLI.java:[line 578]: This use of java/sql/Statement.executeUpdate(Ljava/lang/String;)I can be vulnerable to SQL injection .At OozieDBCLI.java:[line 568]: At OozieDBCLI.java:[line 567] .At OozieDBCLI.java:[line 571]: At OozieDBCLI.java:[line 569] .At OozieDBCLI.java:[line 573]: At OozieDBCLI.java:[line 572] .At OozieDBCLI.java:[line 578]: At OozieDBCLI.java:[line 575] .{color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. .{color:orange}0{color} There are [4] new bugs found in [server] that would be nice to have fixed. .You can find the SpotBugs diff here: server/findbugs-new.html .{color:green}+1{color} There are no new bugs found in [webapp]. .{color:green}+1{color} There are no new bugs found in [examples]. .{color:red}-1{color} There are [5] new bugs found below threshold in [core] that must be fixed. .You can find the SpotBugs diff here (look for the red and orange ones): core/findbugs-new.html .The most important SpotBugs errors are: .At BulkJPAExecutor.java:[line 207]: This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection .At BulkJPAExecutor.java:[line 177]: At BulkJPAExecutor.java:[line 176] .At BulkJPAExecutor.java:[line 206]: At BulkJPAExecutor.java:[line 200] .This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 207] .At BulkJPAExecutor.java:[line 112]: At BulkJPAExecutor.java:[line 128] {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3169 {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/1046/ > Invalid configuration defined reported for some valid configs > -
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789623#comment-16789623 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch, oozie-2338-005.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789290#comment-16789290 ] Andras Salamon commented on OOZIE-2338: --- Thanks for the explanation [~nobigo]. I now see the reason for omitting some of the previous patch. It seems to me some of the e-mail settings (e.g. {{oozie.email.blacklist.*}} were not added to {{oozie-default.xml}}. Similarly the patch also refers to {{oozie.service.HCatAccessorService.hcat.configuration}}. Could you please check those properties? > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786763#comment-16786763 ] duan xiong commented on OOZIE-2338: --- Hi,[~asalamon74],I have check the new version about oozie 5.2.0-SNAPSHOT. The configuration about "oozie.emil" had been add by someone in oozie-default.xml. So the warn information about "oozie.email" is not show now. So I upload patch to resolve the log warn about "ProxyUserService" and "GroupsService". Thank you. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786673#comment-16786673 ] Andras Salamon commented on OOZIE-2338: --- [~nobigo] I don't really understand your explanation. The last patch from 2016 ( OOZIE-2338.002.patch ) contains lots of code which is missing from your patches ( oozie-2338-003.patch, oozie-2338-004.patch ). What is the reason for that? > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784397#comment-16784397 ] duan xiong commented on OOZIE-2338: --- Hi,I delete entirely the patch Because I named that path is OOZIE-2338-001.patch. This name should be continue OOZIE-2338-003.patch. So I delete. Andras Salamon (JIRA) 于2019年3月5日周二 下午6:45写道: > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784306#comment-16784306 ] Andras Salamon commented on OOZIE-2338: --- [~nobigo] It seems to me you created a brand new patch and entirely dropped the old patch. What was the reasoning behind that? > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783050#comment-16783050 ] duan xiong commented on OOZIE-2338: --- Hi,[~asalamon74],Can you help me to review this?Thank you very much! > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782926#comment-16782926 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any star imports .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:red}-1{color} There are [20] new bugs found below threshold in total that must be fixed. .{color:green}+1{color} There are no new bugs found in [examples]. .{color:red}-1{color} There are [5] new bugs found below threshold in [core] that must be fixed. .You can find the SpotBugs diff here (look for the red and orange ones): core/findbugs-new.html .The most important SpotBugs errors are: .At BulkJPAExecutor.java:[line 207]: This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection .At BulkJPAExecutor.java:[line 177]: At BulkJPAExecutor.java:[line 176] .At BulkJPAExecutor.java:[line 206]: At BulkJPAExecutor.java:[line 200] .This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 207] .At BulkJPAExecutor.java:[line 112]: At BulkJPAExecutor.java:[line 128] .{color:green}+1{color} There are no new bugs found in [sharelib/distcp]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive]. .{color:green}+1{color} There are no new bugs found in [sharelib/pig]. .{color:green}+1{color} There are no new bugs found in [sharelib/spark]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive2]. .{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. .{color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. .{color:green}+1{color} There are no new bugs found in [sharelib/oozie]. .{color:green}+1{color} There are no new bugs found in [sharelib/streaming]. .{color:green}+1{color} There are no new bugs found in [sharelib/git]. .{color:green}+1{color} There are no new bugs found in [webapp]. .{color:red}-1{color} There are [15] new bugs found below threshold in [tools] that must be fixed, listing only the first [5] ones. .You can find the SpotBugs diff here (look for the red and orange ones): tools/findbugs-new.html .The top [5] most important SpotBugs errors are: .At OozieDBCLI.java:[line 578]: This use of java/sql/Statement.executeUpdate(Ljava/lang/String;)I can be vulnerable to SQL injection .At OozieDBCLI.java:[line 568]: At OozieDBCLI.java:[line 567] .At OozieDBCLI.java:[line 571]: At OozieDBCLI.java:[line 569] .At OozieDBCLI.java:[line 573]: At OozieDBCLI.java:[line 572] .At OozieDBCLI.java:[line 578]: At OozieDBCLI.java:[line 575] .{color:green}+1{color} There are no new bugs found in [docs]. .{color:orange}0{color} There are [4] new bugs found in [server] that would be nice to have fixed. .You can find the SpotBugs diff here: server/findbugs-new.html .{color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. .{color:green}+1{color} There are no new bugs found in [client]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3145 {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . h
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782912#comment-16782912 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch, oozie-2338-004.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782593#comment-16782593 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any star imports .{color:red}-1{color} the patch contains 1 line(s) longer than 132 characters .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:red}-1{color} There are [20] new bugs found below threshold in total that must be fixed. .{color:green}+1{color} There are no new bugs found in [webapp]. .{color:red}-1{color} There are [5] new bugs found below threshold in [core] that must be fixed. .You can find the SpotBugs diff here (look for the red and orange ones): core/findbugs-new.html .The most important SpotBugs errors are: .At BulkJPAExecutor.java:[line 207]: This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection .At BulkJPAExecutor.java:[line 177]: At BulkJPAExecutor.java:[line 176] .At BulkJPAExecutor.java:[line 206]: At BulkJPAExecutor.java:[line 200] .This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 207] .At BulkJPAExecutor.java:[line 112]: At BulkJPAExecutor.java:[line 128] .{color:green}+1{color} There are no new bugs found in [client]. .{color:green}+1{color} There are no new bugs found in [docs]. .{color:green}+1{color} There are no new bugs found in [sharelib/streaming]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive2]. .{color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. .{color:green}+1{color} There are no new bugs found in [sharelib/oozie]. .{color:green}+1{color} There are no new bugs found in [sharelib/git]. .{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. .{color:green}+1{color} There are no new bugs found in [sharelib/pig]. .{color:green}+1{color} There are no new bugs found in [sharelib/spark]. .{color:green}+1{color} There are no new bugs found in [sharelib/distcp]. .{color:green}+1{color} There are no new bugs found in [examples]. .{color:red}-1{color} There are [15] new bugs found below threshold in [tools] that must be fixed, listing only the first [5] ones. .You can find the SpotBugs diff here (look for the red and orange ones): tools/findbugs-new.html .The top [5] most important SpotBugs errors are: .At OozieDBCLI.java:[line 578]: This use of java/sql/Statement.executeUpdate(Ljava/lang/String;)I can be vulnerable to SQL injection .At OozieDBCLI.java:[line 568]: At OozieDBCLI.java:[line 567] .At OozieDBCLI.java:[line 571]: At OozieDBCLI.java:[line 569] .At OozieDBCLI.java:[line 573]: At OozieDBCLI.java:[line 572] .At OozieDBCLI.java:[line 578]: At OozieDBCLI.java:[line 575] .{color:orange}0{color} There are [4] new bugs found in [server] that would be nice to have fixed. .You can find the SpotBugs diff here: server/findbugs-new.html .{color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3145 .{color:orange}Tests failed at first run:{color} TestCoordChangeXCommand#testCoordChangeEndTime3 .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782582#comment-16782582 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch, > oozie-2338-003.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782581#comment-16782581 ] duan xiong commented on OOZIE-2338: --- Hi.[~kmarton].I have check the new version about oozie 5.2.0-SNAPSHOT. The configuration about "oozie.emil" had been add by someone in oozie-default.xml.So I upload patch to resolve the log warn about "ProxyUserService" and "GroupsService". Please help me review this.Thank you. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773697#comment-16773697 ] duan xiong commented on OOZIE-2338: --- I will to take over it. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: duan xiong >Priority: Major > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773042#comment-16773042 ] duan xiong commented on OOZIE-2338: --- Hi,[~abhishekbafna], I think should add : endWith() . make log more accuracy. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772506#comment-16772506 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:red}-1{color} Patch failed to apply to head of branch > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772501#comment-16772501 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772496#comment-16772496 ] duan xiong commented on OOZIE-2338: --- Hi,[~rkanter],If you don't mind, I will continue this Bug? > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396435#comment-16396435 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:red}-1{color} Patch failed to apply to head of branch > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396428#comment-16396428 ] Hadoop QA commented on OOZIE-2338: -- PreCommit-OOZIE-Build started > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter >Priority: Major > Fix For: trunk > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504327#comment-15504327 ] Rohini Palaniswamy commented on OOZIE-2338: --- 1) Connection timeout and socket timeout are different. One is for establishing connection and other is for response. Better to keep two different settings for them. I am fine getting rid of SMTP_TIMEOUT and using EMAIL_SMTP_SOCKET_TIMEOUT_MS instead. But can we add equivalent EmailActionExecutor.EMAIL_CONNECTION_SOCKET_TIMEOUT_MS for SMTP_CONNECTION_TIMEOUT and use that in EmailActionExecutor as well for connection timeout. {code} -String smtpConnectTimeout = conf.get(SMTP_CONNECTION_TIMEOUT, SMTP_CONNECTION_TIMEOUT_DEFAULT); -String smtpTimeout = conf.get(SMTP_TIMEOUT, SMTP_TIMEOUT_DEFAULT); +Integer timeoutMillisInt = ConfigurationService.getInt(EmailActionExecutor.EMAIL_SMTP_SOCKET_TIMEOUT_MS); {code} 2) String path = ConfigurationService.get(HCAT_CONFIGURATION).trim(); Not a fan of this idea as it is hacky. Requires adding dummy values to oozie-default.xml when it does not make sense and handling the dummy value in code. I would rather have them included in a separate list like VERIFY_PREFIX_PROPERTIES_TO_IGNORE and be skipped. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Fix For: 4.3.0 > > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404711#comment-15404711 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:red}-1 COMPILE{color} .{color:red}-1{color} HEAD does not compile .{color:red}-1{color} patch does not compile .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} .Tests run: 1792 .Tests failed: 27 .Tests errors: 75 .The patch failed the following testcases: . testCoordMaterializeTriggerService3(org.apache.oozie.service.TestCoordMaterializeTriggerService) . testRaceConditionWithOldXerces(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testParserDefaultNameNodeFail(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testParserDefaultJobTrackerFail(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testWfNoForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testSimpleForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testNestedForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testForkJoinFailure(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testNestedForkJoinFailure(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testTransitionFailure1(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testTransition2(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testTransition3(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testErrorTransitionForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionsToJoinForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionsToKillForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionForkJoinFailure(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionToEndForkJoinFailure(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionTwoPathsForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testMultipleDecisionThreePathsForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testMultipleDecisionThreePathsForkJoinFailure(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testMultipleDecisionThreePathsForkJoinFailure2(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDecisionMultipleForks(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testForkJoinMismatch(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testForkJoinDuplicateTransitionsFromFork(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testDisableWFValidateForkJoin(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser) . testCoordinatorActionCommandsSubmitAndStart(org.apache.oozie.sla.TestSLAEventGeneration) {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3173/ > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch, OOZIE-2338.002.patch > > > OOZIE-1890 moved all default co
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396796#comment-15396796 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:red}-1{color} Patch failed to apply to head of branch > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391396#comment-15391396 ] abhishek bafna commented on OOZIE-2338: --- [~rkanter] Can you please rebase the patch. Thanks. > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057405#comment-15057405 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:red}-1{color} Patch failed to apply to head of branch > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720704#comment-14720704 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2520/ > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717288#comment-14717288 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2518/ > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2338) Invalid configuration defined reported for some valid configs
[ https://issues.apache.org/jira/browse/OOZIE-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710236#comment-14710236 ] Hadoop QA commented on OOZIE-2338: -- Testing JIRA OOZIE-2338 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2516/ > Invalid configuration defined reported for some valid configs > - > > Key: OOZIE-2338 > URL: https://issues.apache.org/jira/browse/OOZIE-2338 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.2.0 >Reporter: Robert Kanter >Assignee: Robert Kanter > Attachments: OOZIE-2338.001.patch > > > OOZIE-1890 moved all default config values from the code and oozie-site into > oozie-default; it also added a WARN message on startup when a config is found > in oozie-site that's not defined in oozie-default. > However, this can produce some false positives. In particular, we observed > these: > {noformat} > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.auth] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.host] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.HCatAccessorService.hcat.configuration] > 2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.from.address] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.hosts] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.GroupsService.hadoop.security.group.mapping] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, [oozie.email.smtp.port] > 2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: > SERVER[] Invalid configuration defined, > [oozie.service.ProxyUserService.proxyuser.hue.groups] > {noformat} > While harmful, these messages may be concerning or confusing for users. > Some of these are simply missing from oozie-default (because they have no > default value?), while others such as the ProxyUserService configs, will > require special handling because the property name can vary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)