[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483105#comment-16483105 ] Hadoop QA commented on OOZIE-2826: -- Testing JIRA OOZIE-2826 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [server]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 2134 .{color:orange}Tests failed at first run:{color} TestCoordActionsKillXCommand#testActionKillCommandActionNumbers .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/553/ > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.1.0 > > Attachments: OOZIE-2826-03.patch, OOZIE-2826-1.patch, > OOZIE-2826-2.patch, OOZIE-2826.patch, oozie-joda.example-feed.xml, > oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) >
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482988#comment-16482988 ] Hadoop QA commented on OOZIE-2826: -- PreCommit-OOZIE-Build started > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.1.0 > > Attachments: OOZIE-2826-03.patch, OOZIE-2826-1.patch, > OOZIE-2826-2.patch, OOZIE-2826.patch, oozie-joda.example-feed.xml, > oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) > at org.apa
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482954#comment-16482954 ] Artem Ervits commented on OOZIE-2826: - joda-time is now being used in core so my original patch doesn't work, put joda back into main pom, sharelib/pig tests pass successfully. Couldn't run full suite successfully due to flaky tests. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.1.0 > > Attachments: OOZIE-2826-03.patch, OOZIE-2826-1.patch, > OOZIE-2826-2.patch, OOZIE-2826.patch, oozie-joda.example-feed.xml, > oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) >
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227028#comment-16227028 ] Hadoop QA commented on OOZIE-2826: -- Testing JIRA OOZIE-2826 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings .{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s) {color:red}-1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:red}-1{color} patch does not compile .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [tools]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:red}-1 DISTRO{color} .{color:red}-1{color} distro tarball fails with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/154/ > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043284#comment-16043284 ] Artem Ervits commented on OOZIE-2826: - PIG-5251 was merged to Pig trunk. Joda-time now matches the Pig and Oozie Pig sharelib version. Please review. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInfo
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035757#comment-16035757 ] Artem Ervits commented on OOZIE-2826: - [~rkanter] filed https://issues.apache.org/jira/browse/PIG-5251 to match joda-time 2.9.9 to the one in Oozie, tests pass locally. I removed joda-time from main pom. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422)
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035400#comment-16035400 ] Rohini Palaniswamy commented on OOZIE-2826: --- bq. should I file a jira against Pig to bump it to 2.9.9 or change Oozie dep to 2.9.3? Increase version in Pig. Always better to have latest joda-time as it ships updated timezone data. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035021#comment-16035021 ] Artem Ervits commented on OOZIE-2826: - failing tests related to https://issues.apache.org/jira/browse/OOZIE-2815 {code}org.apache.oozie.util.TestMetricsInstrumentation{code} passes locally > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > or
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034140#comment-16034140 ] Hadoop QA commented on OOZIE-2826: -- Testing JIRA OOZIE-2826 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings .{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [tools]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} .Tests run: 1959 .Tests failed: 1 .Tests errors: 3 .The patch failed the following testcases: . testNofindLogs(org.apache.oozie.util.TestTimestampedMessageParser) .Tests failing with errors: . testProcessRemainingLog(org.apache.oozie.util.TestTimestampedMessageParser) . testProcessRemainingCoordinatorLogForActions(org.apache.oozie.util.TestTimestampedMessageParser) . testJMXInstrumentation(org.apache.oozie.util.TestMetricsInstrumentation) {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3857/ > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826-2.patch, > OOZIE-2826.patch, oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) >
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033380#comment-16033380 ] Robert Kanter commented on OOZIE-2826: -- IIRC, Oozie itself doesn't use joda-time; it's only here for Pig. We need to make sure that Pig is okay with upping the version. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826.patch, > oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInf
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033107#comment-16033107 ] Artem Ervits commented on OOZIE-2826: - {noformat} Results : Tests in error: testActionDataUploadToHdfsSucceeds(org.apache.oozie.action.hadoop.TestHdfsOperations) testActionDataUploadToHdfsFailsWhenAppendingToWriter(org.apache.oozie.action.hadoop.TestHdfsOperations): Unexpected exception, expected but was testActionDataUploadToHdfsFailsWhenWriterIsNull(org.apache.oozie.action.hadoop.TestHdfsOperations): Unexpected exception, expected but was Tests run: 41, Failures: 0, Errors: 3, Skipped: 0 [ERROR] There are test failures. {noformat} ran the tests individually, all pass locally and unrelated to this JIRA. > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826.patch, > oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) >
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032428#comment-16032428 ] Hadoop QA commented on OOZIE-2826: -- Testing JIRA OOZIE-2826 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warnings .{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [tools]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 1959 .Tests rerun: 4 .Tests failed at first run: org.apache.oozie.action.hadoop.TestHdfsOperations,org.apache.oozie.command.wf.TestWorkflowActionRetryInfoXCommand, {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3849/ > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Assignee: Artem Ervits >Priority: Minor > Fix For: 5.0.0 > > Attachments: OOZIE-2826-1.patch, OOZIE-2826.patch, > oozie-joda.example-feed.xml, oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1
[jira] [Commented] (OOZIE-2826) Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later
[ https://issues.apache.org/jira/browse/OOZIE-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993413#comment-15993413 ] Steve Loughran commented on OOZIE-2826: --- Joda time needs to be >= 2.8.1 to work on recent Java 8 & Java 7 JVMs; 2.5 isn't going to work there. Sorry > Falcon feed fails to aws s3; Oozie joda time version does not meet required > jar version 2.2 or later > > > Key: OOZIE-2826 > URL: https://issues.apache.org/jira/browse/OOZIE-2826 > Project: Oozie > Issue Type: Bug > Components: workflow >Affects Versions: 4.3.0 >Reporter: Péter Gergő Barna >Priority: Minor > Fix For: trunk > > Attachments: OOZIE-2826.patch, oozie-joda.example-feed.xml, > oozie-joda.log.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > Symptom: > 2016-11-04 17:34:50,283 WARN [main] > com.amazonaws.services.s3.internal.S3MetadataResponseHandler: Unable to parse > last modified date: Wed, 02 Nov 2016 23:05:38 GMT > java.lang.IllegalStateException: Joda-time 2.2 or later version is > required, but found version: 2.1 > at com.amazonaws.util.DateUtils.handleException(DateUtils.java:149) > at com.amazonaws.util.DateUtils.parseRFC822Date(DateUtils.java:195) > at > com.amazonaws.services.s3.internal.ServiceUtils.parseRfc822Date(ServiceUtils.java:78) > at > com.amazonaws.services.s3.internal.AbstractS3ResponseHandler.populateObjectMetadata(AbstractS3ResponseHandler.java:115) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:32) > at > com.amazonaws.services.s3.internal.S3MetadataResponseHandler.handle(S3MetadataResponseHandler.java:25) > at > com.amazonaws.http.AmazonHttpClient.handleResponse(AmazonHttpClient.java:1072) > at > com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:746) > at > com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489) > at > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310) > at > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050) > at > com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:850) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1403) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:1343) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:1308) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1898) > at > org.apache.falcon.util.DistCPOptionsUtil.getDistCpOptions(DistCPOptionsUtil.java:90) > at > org.apache.falcon.replication.FeedReplicator.getDistCpOptions(FeedReplicator.java:229) > at > org.apache.falcon.replication.FeedReplicator.run(FeedReplicator.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.falcon.replication.FeedReplicator.main(FeedReplicator.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:35) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) > at org.apache.hadoop.m