Qi created CAMEL-8769:
-------------------------
Summary: copy request delete the source file under bucket root
Key: CAMEL-8769
URL: https://issues.apache.org/jira/browse/CAMEL-8769
Project: Camel
Issue Type: Bug
Components: camel-aws
Affects Versions: 2.14.2
Environment: Windows 7 64 bit, JDK7
Reporter: Qi
java API CopyObjectRequest delete the source file sometimes:
case 1. copy from /xxx-workspaces/temp/bbb.txt0 to anywhere
works properly. after copy, the source file bbb.txt0 still there.
case 2. copy from /xxx-workspaces/bbb.txt0 to anywhere
unexpected behaviour! After copy, the source file bbb.txt0 got deleted!
CopyObjectRequest is the only request I submitted. but I can see there's
"DELETE" request from the log. Also there is lots of "GET" requests to retrieve
the log.
Tested with pure CopyObjectRequest by using aws Java Client API directly, It
works fine and no extra "DELETE" and "GET" submitted.
Code to do the Copy:
public class CamelS3SaverRouteBuilder extends RouteBuilder {
....
@Override
public void configure()
throws Exception {
ProfileCredentialsProvider awsCredentials = new
ProfileCredentialsProvider(AWS_PROFILE_CONFIG_NAME,
WORKSPACE_BUCKET_NAME);
AmazonS3 client = new AmazonS3Client(awsCredentials);
// Copying object
CopyObjectRequest copyObjRequest = new CopyObjectRequest(
srcBucket.bucketName, srcBucket.bucketKey,
destBucket.bucketName, destBucket.bucketKey);
client.copyObject(copyObjRequest);
JndiRegistry registry = (JndiRegistry) (
(PropertyPlaceholderDelegateRegistry)getContext().getRegistry()).getRegistry();
registry.bind("client", client);
// lets shutdown faster in case of in-flight messages stack up
getContext().getShutdownStrategy().setTimeout(10);
onException(Exception.class)
.handled(true).maximumRedeliveries(3)
.to("log:error processing message");
from("aws-s3://" + srcBucket.bucketName +
"?amazonS3Client=#client®ion=us-east-1")
.setExchangePattern(ExchangePattern.InOnly)
.process(new Processor() {
@Override
public void process(Exchange exchange) throws Exception {
/* trashing whatever message after having processed
it */
exchange.getIn().setBody(null);
// stop Camel by signalling to the latch
latch.countDown();
}
})
.log("Finished file transfer between S3!");
}
....
}
LOG when deletion happens:
13:24:41.257 [ CamelS3SaverRouteBuilder] srcBucket bucketName = xxx-test (0ms)
13:24:41.259 [ CamelS3SaverRouteBuilder] srcBucket bucketKey = bbb.txt0 (2ms)
13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketName = xxx-workspaces
(0ms)
13:24:41.259 [ CamelS3SaverRouteBuilder] destBucket bucketKey =
user-null/temp/import/999/raw-data/bbb.txt0 (0ms)
13:24:41.265 [...camel.main.MainSupport] Apache Camel 2.14.1 starting (6ms)
13:24:41.532 [..mpl.DefaultCamelContext] Adding routes from builder: Routes: []
(267ms)
13:24:41.533 [..mpl.DefaultCamelContext] Using ComponentResolver:
org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component
with name: properties (1ms)
13:24:41.544 [..efaultComponentResolver] Found component: properties in
registry: null (11ms)
13:24:41.548 [..efaultComponentResolver] Found component: properties via type:
org.apache.camel.component.properties.PropertiesComponent via:
META-INF/services/org/apache/camel/component/properties (4ms)
13:24:42.645 [ com.amazonaws.request] Sending Request: PUT
https://xxx-workspaces.s3.amazonaws.com
/user-null/temp/import/999/raw-data/bbb.txt0 Headers: (x-amz-copy-source:
/xxx-test/bbb.txt0, Content-Length: 0, User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71,
Content-Type: application/x-www-form-urlencoded; charset=utf-8, ) (1097ms)
13:24:43.496 [ org.apache.http.wire] >> "PUT
/user-null/temp/import/999/raw-data/bbb.txt0 HTTP/1.1[\r][\n]" (851ms)
13:24:43.498 [ org.apache.http.wire] >> "Host:
xxx-workspaces.s3.amazonaws.com[\r][\n]" (2ms)
13:24:43.498 [ org.apache.http.wire] >> "x-amz-copy-source:
/xxx-test/bbb.txt0[\r][\n]" (0ms)
13:24:43.498 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:EvEC4VlkWvkf6KDQUMGFG0ImgtA=[\r][\n]" (0ms)
13:24:43.498 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:42
GMT[\r][\n]" (0ms)
13:24:43.498 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:43.498 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
13:24:43.498 [ org.apache.http.wire] >> "Content-Length: 0[\r][\n]" (0ms)
13:24:43.498 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:43.498 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:43.498 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:43.575 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (77ms)
13:24:43.581 [ org.apache.http.wire] << "x-amz-id-2:
0U2iXSNdG48eOJChLNe5pOwSWF1aykCkejluv9A4DUH0k4ktmmc9xHgtWdeDvx5Emot7fiyemyg=[\r][\n]"
(6ms)
13:24:43.582 [ org.apache.http.wire] << "x-amz-request-id:
CFC6F4E833716E1C[\r][\n]" (1ms)
13:24:43.582 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18
GMT[\r][\n]" (0ms)
13:24:43.582 [ org.apache.http.wire] << "Content-Type:
application/xml[\r][\n]" (0ms)
13:24:43.582 [ org.apache.http.wire] << "Content-Length: 234[\r][\n]" (0ms)
13:24:43.582 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:43.583 [ org.apache.http.wire] << "[\r][\n]" (1ms)
13:24:43.605 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (22ms)
13:24:43.714 [ org.apache.http.wire] << "<?xml version="1.0"
encoding="UTF-8"?>[\n]" (109ms)
13:24:43.715 [ org.apache.http.wire] << "<CopyObjectResult
xmlns="http://s3.amazonaws.com/doc/2006-03-01/";><LastModified>2015-05-08T17:25:18.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag></CopyObjectResult>"
(1ms)
13:24:43.723 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: CFC6F4E833716E1C (8ms)
13:24:43.761 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext:
camel-1) is starting (38ms)
13:24:43.761 [..mpl.DefaultCamelContext] Using
ClassResolver=org.apache.camel.impl.DefaultClassResolver@60e028e1,
PackageScanClassResolver=org.apache.camel.impl.DefaultPackageScanClassResolver@1c9bfd77,
ApplicationContextClassLoader=sun.misc.Launcher$AppClassLoader@1667a232 (0ms)
13:24:43.762 [..nagedManagementStrategy] JMX is enabled (1ms)
13:24:43.763 [...DefaultManagementAgent] Starting JMX agent on server:
com.sun.jmx.mbeanserver.JmxMBeanServer@11507b87 (1ms)
13:24:43.827 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=context,name="camel-1" (64ms)
13:24:43.827 [..rt.TimerListenerManager] Added TimerListener:
org.apache.camel.management.mbean.ManagedCamelContext@4efa1bec (0ms)
13:24:43.827 [..gementLifecycleStrategy] Registering 1 pre registered services
(0ms)
13:24:43.831 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="properties" (4ms)
13:24:43.865 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (34ms)
13:24:43.877 [..tionTypeConverterLoader] Found 3 packages with 15 @Converter
classes to load (12ms)
13:24:43.929 [..tionTypeConverterLoader] Loading file
META-INF/services/org/apache/camel/TypeConverter to retrieve list of packages,
from url:
jar:file:/C:/src/qi/xxx/main/webapp/WEB-INF/lib/camel-core-2.14.1.jar!/META-INF/services/org/apache/camel/TypeConverter
(52ms)
13:24:43.930 [..tionTypeConverterLoader] No additional package names found in
classpath for annotated type converters. (1ms)
13:24:43.931 [..er.DefaultTypeConverter] Loaded 178 type converters (1ms)
13:24:43.939 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (8ms)
13:24:43.942 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager
(3ms)
13:24:43.944 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool
(2ms)
13:24:43.945 [..aredProducerServicePool] Starting service pool:
org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
13:24:43.947 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository
(2ms)
13:24:43.950 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy
(3ms)
13:24:43.953 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver
(3ms)
13:24:43.961 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (8ms)
13:24:43.965 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c)
(4ms)
13:24:43.970 [..mpl.DefaultCamelContext] Using ComponentResolver:
org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component
with name: aws-s3 (5ms)
13:24:43.970 [..efaultComponentResolver] Found component: aws-s3 in registry:
null (0ms)
13:24:43.972 [..efaultComponentResolver] Found component: aws-s3 via type:
org.apache.camel.component.aws.s3.S3Component via:
META-INF/services/org/apache/camel/component/aws-s3 (2ms)
13:24:43.975 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="aws-s3" (3ms)
13:24:43.978 [..l.impl.DefaultComponent] Creating endpoint
uri=[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1],
path=[xxx-test] (3ms)
13:24:43.982 [..il.IntrospectionSupport] Configured property: amazonS3Client on
bean: org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value:
com.amazonaws.services.s3.AmazonS3Client@15f9a2a4 (4ms)
13:24:43.982 [..il.IntrospectionSupport] Configured property: region on bean:
org.apache.camel.component.aws.s3.S3Configuration@550661b8 with value:
us-east-1 (0ms)
13:24:43.989 [..mpl.DefaultCamelContext]
aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1 converted to
endpoint: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
by component: org.apache.camel.component.aws.s3.S3Component@1d2d2db8 (7ms)
13:24:43.993 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1"
(4ms)
13:24:43.994 [ com.amazonaws.request] Sending Request: GET
https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 0, ) Headers:
(User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (1ms)
13:24:44.390 [ org.apache.http.wire] >> "GET /?max-keys=0 HTTP/1.1[\r][\n]"
(396ms)
13:24:44.390 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:44.391 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:0a5FG38433Kj9wO2lFfByO4/UR8=[\r][\n]" (1ms)
13:24:44.391 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:43
GMT[\r][\n]" (0ms)
13:24:44.391 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:44.391 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
13:24:44.391 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:44.392 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(1ms)
13:24:44.392 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (64ms)
13:24:44.456 [ org.apache.http.wire] << "x-amz-id-2:
30pFcCgf7i7WAGPirV1uBiSF8fWhAO66W5dkbvTmXbCRtC45ZlGscQnBds47pAKlZ0t9zRZgVyY=[\r][\n]"
(0ms)
13:24:44.456 [ org.apache.http.wire] << "x-amz-request-id:
0F9F8EB13565C850[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:18
GMT[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "Content-Type:
application/xml[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "Transfer-Encoding:
chunked[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:44.456 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:44.458 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (2ms)
13:24:44.460 [ org.apache.http.wire] << "ed[\r][\n]" (2ms)
13:24:44.461 [ org.apache.http.wire] << "<?xml version="1.0"
encoding="UTF-8"?>[\n]" (1ms)
13:24:44.461 [ org.apache.http.wire] << "<ListBucketResult
xmlns="http://s3.amazonaws.com/doc/2006-03-01/";><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>0</MaxKeys><IsTruncated>false</IsTruncated></ListBucketResult>"
(0ms)
13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:44.461 [ org.apache.http.wire] << "0[\r][\n]" (0ms)
13:24:44.461 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:44.462 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: 0F9F8EB13565C850 (1ms)
13:24:44.492 [..mpl.DefaultCamelContext] Using ComponentResolver:
org.apache.camel.impl.DefaultComponentResolver@2c8d23f9 to resolve component
with name: log (30ms)
13:24:44.492 [..efaultComponentResolver] Found component: log in registry: null
(0ms)
13:24:44.494 [..efaultComponentResolver] Found component: log via type:
org.apache.camel.component.log.LogComponent via:
META-INF/services/org/apache/camel/component/log (2ms)
13:24:44.499 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="log" (5ms)
13:24:44.500 [..l.impl.DefaultComponent] Creating endpoint
uri=[log://error%20processing%20message], path=[error processing message] (1ms)
13:24:44.504 [..mpl.DefaultCamelContext] log://error%20processing%20message
converted to endpoint: Endpoint[log://error%20processing%20message] by
component: org.apache.camel.component.log.LogComponent@460bfa3c (4ms)
13:24:44.509 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message"
(5ms)
13:24:44.517 [..erceptor.DefaultChannel] Initialize channel for target:
'To[log:error processing message]' (8ms)
13:24:44.528 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (11ms)
13:24:44.539 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (11ms)
13:24:44.545 [..erceptor.DefaultChannel] Initialize channel for target:
'setExchangePattern[pattern: InOnly]' (6ms)
13:24:44.561 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)"
(16ms)
13:24:44.574 [..mel.model.LogDefinition] The LogName is null. Falling back to
create logger by using the route id route1. (13ms)
13:24:44.575 [..erceptor.DefaultChannel] Initialize channel for target:
'Log[Starting file transfer between S3...]' (1ms)
13:24:44.577 [..erceptor.DefaultChannel] Initialize channel for target:
'process[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]'
(2ms)
13:24:44.579 [..mel.model.LogDefinition] The LogName is null. Falling back to
create logger by using the route id route1. (2ms)
13:24:44.579 [..erceptor.DefaultChannel] Initialize channel for target:
'Log[Finished file transfer between S3!]' (0ms)
13:24:44.586 [..mpl.DefaultCamelContext] AllowUseOriginalMessage is enabled. If
access to the original message is not needed, then its recommended to turn this
option off as it may improve performance. (7ms)
13:24:44.586 [..mpl.DefaultCamelContext] StreamCaching is not in use. If using
streams then its recommended to enable stream caching. See more details at
http://camel.apache.org/stream-caching.html (0ms)
13:24:44.587 [..mpl.DefaultCamelContext] Warming up route id: route1 having
autoStartup=true (1ms)
13:24:44.587 [..camel.impl.RouteService] Starting services on route: route1
(0ms)
13:24:44.592 [..camel.impl.RouteService] Starting child service on route:
route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]],
Channel[Log(route1)[Starting file transfer between S3...]],
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]],
Channel[Log(route1)[Finished file transfer between S3!]]]] (5ms)
13:24:44.598 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158)
(6ms)
13:24:44.598 [..mponent.log.LogProducer] Starting producer:
Producer[log://error%20processing%20message] (0ms)
13:24:44.599 [..amel.impl.ProducerCache] Adding to producer cache with key:
Endpoint[log://error%20processing%20message] for producer:
Producer[log://error%20processing%20message] (1ms)
13:24:44.599 [..sor.DefaultErrorHandler] Redelivery enabled: true on error
handler:
DefaultErrorHandler[Instrumentation:setExchangePattern[SetExchangePattern[InOnly]]]
(0ms)
13:24:44.610 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool"
(11ms)
13:24:44.610 [..tExecutorServiceManager] Created new ScheduledThreadPool for
source: ErrorHandlerRedeliveryThreadPool with name: ErrorHandlerRedeliveryTask.
->
org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask]
(0ms)
13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error
handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Starting file
transfer between S3...]]] (0ms)
13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error
handler:
DefaultErrorHandler[Instrumentation:process[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]]]
(0ms)
13:24:44.610 [..sor.DefaultErrorHandler] Redelivery enabled: true on error
handler: DefaultErrorHandler[Instrumentation:log[Log(route1)[Finished file
transfer between S3!]]] (0ms)
13:24:44.610 [..camel.impl.RouteService] Starting child service on route:
route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]],
Channel[Log(route1)[Starting file transfer between S3...]],
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]],
Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
13:24:44.610 [..camel.impl.RouteService] Starting child service on route:
route1 -> SetExchangePattern[InOnly] (0ms)
13:24:44.622 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1"
(12ms)
13:24:44.622 [..camel.impl.RouteService] Starting child service on route:
route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
13:24:44.622 [..camel.impl.RouteService] Starting child service on route:
route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
13:24:44.626 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="log1" (4ms)
13:24:44.627 [..camel.impl.RouteService] Starting child service on route:
route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (1ms)
13:24:44.627 [..camel.impl.RouteService] Starting child service on route:
route1 ->
DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]
(0ms)
13:24:44.631 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="process1" (4ms)
13:24:44.631 [..camel.impl.RouteService] Starting child service on route:
route1 ->
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]]
(0ms)
13:24:44.631 [..camel.impl.RouteService] Starting child service on route:
route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
13:24:44.635 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="log2" (4ms)
13:24:44.635 [..camel.impl.RouteService] Starting child service on route:
route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
13:24:44.648 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=routes,name="route1" (13ms)
13:24:44.648 [..rt.TimerListenerManager] Added TimerListener:
org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (0ms)
13:24:44.648 [..mpl.DefaultCamelContext] Route: route1 >>>
EventDrivenConsumerRoute[Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
-> Pipeline[[Channel[SetExchangePattern[InOnly]], Channel[Log(route1)[Starting
file transfer between S3...]],
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]],
Channel[Log(route1)[Finished file transfer between S3!]]]]] (0ms)
13:24:44.649 [..mpl.DefaultCamelContext] Starting consumer (order: 1000) on
route: route1 (1ms)
13:24:44.655 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b)
(6ms)
13:24:44.655 [..onent.aws.s3.S3Consumer] Starting consumer:
S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
13:24:44.659 [..il.IntrospectionSupport] Configured property: initialDelay on
bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with
value: 1000 (4ms)
13:24:44.659 [..il.IntrospectionSupport] Configured property: timeUnit on bean:
org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with
value: MILLISECONDS (0ms)
13:24:44.659 [..il.IntrospectionSupport] Configured property:
scheduledExecutorService on bean:
org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with
value: null (0ms)
13:24:44.659 [..il.IntrospectionSupport] Configured property: useFixedDelay on
bean: org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with
value: true (0ms)
13:24:44.659 [..il.IntrospectionSupport] Configured property: delay on bean:
org.apache.camel.impl.DefaultScheduledPollConsumerScheduler@1f707a6a with
value: 500 (0ms)
13:24:44.661 [...DefaultManagementAgent] Registered MBean with ObjectName:
org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)"
(2ms)
13:24:44.662 [..tExecutorServiceManager] Created new ScheduledThreadPool for
source: S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
with name: aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1. ->
org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
(1ms)
13:24:44.662 [..edPollConsumerScheduler] Scheduling poll (fixed delay) with
initialDelay: 1000, delay: 500 (milliseconds) for:
Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
13:24:44.666 [..mpl.DefaultCamelContext] Route: route1 started and consuming
from: Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
(4ms)
13:24:44.666 [..gementLifecycleStrategy] Load performance statistics disabled
(0ms)
13:24:44.666 [..mpl.DefaultCamelContext] Total 1 routes, of which 1 is started.
(0ms)
13:24:44.668 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext:
camel-1) started in 0.905 seconds (2ms)
13:24:45.665 [ com.amazonaws.request] Sending Request: GET
https://xxx-test.s3.amazonaws.com / Parameters: (max-keys: 10, ) Headers:
(User-Agent: aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (997ms)
13:24:45.669 [ org.apache.http.wire] >> "GET /?max-keys=10
HTTP/1.1[\r][\n]" (4ms)
13:24:45.669 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:45.670 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:+RL93PYc7l7fbSL1wCIBzmi547g=[\r][\n]" (1ms)
13:24:45.670 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45
GMT[\r][\n]" (0ms)
13:24:45.670 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:45.670 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
13:24:45.670 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:45.670 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:45.670 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:45.906 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (236ms)
13:24:45.907 [ org.apache.http.wire] << "x-amz-id-2:
Gq/0uubPkJRiyi6Am5iuUmxZn6w/1b7JzF58u5GqHtY7UwfMxT289+GakyeTmLKh0/Ov1UNrnyE=[\r][\n]"
(1ms)
13:24:45.907 [ org.apache.http.wire] << "x-amz-request-id:
FA7EB44DD92B1343[\r][\n]" (0ms)
13:24:45.907 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20
GMT[\r][\n]" (0ms)
13:24:45.907 [ org.apache.http.wire] << "Content-Type:
application/xml[\r][\n]" (0ms)
13:24:45.907 [ org.apache.http.wire] << "Transfer-Encoding:
chunked[\r][\n]" (0ms)
13:24:45.907 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:45.907 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:45.907 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (0ms)
13:24:45.909 [ org.apache.http.wire] << "512[\r][\n]" (2ms)
13:24:45.909 [ org.apache.http.wire] << "<?xml version="1.0"
encoding="UTF-8"?>[\n]" (0ms)
13:24:45.909 [ org.apache.http.wire] << "<ListBucketResult
xmlns="http://s3.amazonaws.com/doc/2006-03-01/";><Name>xxx-test</Name><Prefix></Prefix><Marker></Marker><MaxKeys>10</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>abc12.txt</Key><LastModified>2015-05-07T20:36:02.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>bbb.txt0</Key><LastModified>2015-05-08T17:25:08.000Z</LastModified><ETag>"9e9ee72bd937cf7b6d7242c64f9214bd"</ETag><Size>10</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>test/2015/abc12.txt</Key><LastModified>2015-05-07T19:53:40.000Z</LastModified><ETag>"3f376a7d147c8c2e0d28d0da97d70999"</ETag><Size>2733677708</Size><Owner><ID>52a027bcc58ec546c69a154a6668993008ca81ad219aa22f4480667b7dccad90</ID><DisplayName>cscdigitalmarketing-billing</DisplayName></Owner><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>"
(0ms)
13:24:45.909 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:45.910 [ org.apache.http.wire] << "0[\r][\n]" (1ms)
13:24:45.910 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:45.916 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: FA7EB44DD92B1343 (6ms)
13:24:45.918 [ com.amazonaws.request] Sending Request: GET
https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent:
aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (2ms)
13:24:45.920 [ org.apache.http.wire] >> "GET /abc12.txt HTTP/1.1[\r][\n]"
(2ms)
13:24:45.920 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:45.920 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:GBtozfcK1psdSlgyP9MlwIIxZHA=[\r][\n]" (0ms)
13:24:45.920 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:45
GMT[\r][\n]" (0ms)
13:24:45.920 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:45.920 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
13:24:45.921 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(1ms)
13:24:45.921 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:45.921 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:46.058 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (137ms)
13:24:46.058 [ org.apache.http.wire] << "x-amz-id-2:
wRPHWaZ38MDI9slzGQPSVMxMqOUCrkzCGqXmXxnR0981lp72DdwnlG31lP6Hg+zS3V90vdvkGrQ=[\r][\n]"
(0ms)
13:24:46.059 [ org.apache.http.wire] << "x-amz-request-id:
9183346338F941B7[\r][\n]" (1ms)
13:24:46.059 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20
GMT[\r][\n]" (0ms)
13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (0ms)
13:24:46.059 [ org.apache.http.wire] << "x-amz-meta-mtime:
1431028974[\r][\n]" (0ms)
13:24:46.060 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]"
(1ms)
13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
13:24:46.060 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]"
(0ms)
13:24:46.060 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015
20:36:02 GMT[\r][\n]" (0ms)
13:24:46.060 [ org.apache.http.wire] << "ETag:
"3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
13:24:46.061 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (1ms)
13:24:46.061 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]"
(0ms)
13:24:46.061 [ org.apache.http.wire] << "Content-Length:
2733677708[\r][\n]" (0ms)
13:24:46.061 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:46.061 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:46.062 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
13:24:46.086 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: 9183346338F941B7 (24ms)
13:24:46.092 [ com.amazonaws.request] Sending Request: GET
https://xxx-test.s3.amazonaws.com /bbb.txt0 Headers: (User-Agent:
aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (6ms)
13:24:46.370 [ org.apache.http.wire] >> "GET /bbb.txt0 HTTP/1.1[\r][\n]"
(278ms)
13:24:46.370 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:46.371 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:241o6egyQEetCin2uT/Yd/SaaT0=[\r][\n]" (1ms)
13:24:46.371 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46
GMT[\r][\n]" (0ms)
13:24:46.371 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:46.371 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (0ms)
13:24:46.371 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:46.371 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:46.372 [ org.apache.http.wire] >> "[\r][\n]" (1ms)
13:24:46.447 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (75ms)
13:24:46.448 [ org.apache.http.wire] << "x-amz-id-2:
LuxT43ah+N02FkH38qAPPEEOu/2wFnc7kroRXLoJV/zyp1UW24Dtw5hahvgAgwgxGa0dQYpy5EY=[\r][\n]"
(1ms)
13:24:46.448 [ org.apache.http.wire] << "x-amz-request-id:
5782AC9143E67431[\r][\n]" (0ms)
13:24:46.448 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:20
GMT[\r][\n]" (0ms)
13:24:46.448 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]"
(0ms)
13:24:46.448 [ org.apache.http.wire] << "Last-Modified: Fri, 08 May 2015
17:25:08 GMT[\r][\n]" (0ms)
13:24:46.449 [ org.apache.http.wire] << "ETag:
"9e9ee72bd937cf7b6d7242c64f9214bd"[\r][\n]" (1ms)
13:24:46.449 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
13:24:46.449 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]"
(0ms)
13:24:46.449 [ org.apache.http.wire] << "Content-Length: 10[\r][\n]" (0ms)
13:24:46.449 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:46.449 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:46.450 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
13:24:46.451 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: 5782AC9143E67431 (1ms)
13:24:46.451 [ com.amazonaws.request] Sending Request: GET
https://xxx-test.s3.amazonaws.com /test/2015/abc12.txt Headers: (User-Agent:
aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
13:24:46.695 [ org.apache.http.wire] >> "GET /test/2015/abc12.txt
HTTP/1.1[\r][\n]" (244ms)
13:24:46.695 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:46.695 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:Y3S5FBOh6Sx+DIu4hmma762kzmE=[\r][\n]" (0ms)
13:24:46.695 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46
GMT[\r][\n]" (0ms)
13:24:46.695 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:46.696 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
13:24:46.696 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:46.696 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:46.696 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:46.896 [ org.apache.http.wire] << "HTTP/1.1 200 OK[\r][\n]" (200ms)
13:24:46.896 [ org.apache.http.wire] << "x-amz-id-2:
WElpbJnvgDm2sKYpUTdGaN5NCGFFdCj6nE4PsOxhU7opXOoZcRgCv91q/dtzL3Y0RgtXv4h51Sg=[\r][\n]"
(0ms)
13:24:46.896 [ org.apache.http.wire] << "x-amz-request-id:
618C9C6B8F2E187B[\r][\n]" (0ms)
13:24:46.896 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21
GMT[\r][\n]" (0ms)
13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-gid: 1001[\r][\n]" (1ms)
13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mtime:
1431028232[\r][\n]" (0ms)
13:24:46.897 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]"
(0ms)
13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-uid: 1001[\r][\n]" (0ms)
13:24:46.897 [ org.apache.http.wire] << "x-amz-meta-mode: 33204[\r][\n]"
(0ms)
13:24:46.898 [ org.apache.http.wire] << "Last-Modified: Thu, 07 May 2015
19:53:40 GMT[\r][\n]" (1ms)
13:24:46.898 [ org.apache.http.wire] << "ETag:
"3f376a7d147c8c2e0d28d0da97d70999"[\r][\n]" (0ms)
13:24:46.898 [ org.apache.http.wire] << "Accept-Ranges: bytes[\r][\n]" (0ms)
13:24:46.898 [ org.apache.http.wire] << "Content-Type: text/plain[\r][\n]"
(0ms)
13:24:46.898 [ org.apache.http.wire] << "Content-Length:
2733677708[\r][\n]" (0ms)
13:24:46.899 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (1ms)
13:24:46.899 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:46.900 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
13:24:46.901 [ com.amazonaws.request] Received successful response: 200, AWS
Request ID: 618C9C6B8F2E187B (1ms)
13:24:46.928 [ route1] Starting file transfer between S3...
(27ms)
13:24:46.928 [..amelS3SaverRouteBuilder] Processing... (0ms)
13:24:46.928 [...camel.main.MainSupport] Apache Camel 2.14.1 stopping (0ms)
13:24:46.928 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext:
camel-1) is shutting down (0ms)
13:24:46.929 [ route1] Finished file transfer between S3!
(1ms)
13:24:46.929 [..DefaultShutdownStrategy] Starting to graceful shutdown 1 routes
(timeout 10 seconds) (0ms)
13:24:46.929 [ com.amazonaws.request] Sending Request: DELETE
https://xxx-test.s3.amazonaws.com /abc12.txt Headers: (User-Agent:
aws-sdk-java/1.9.33 Windows_7/6.1
Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71, Content-Type:
application/x-www-form-urlencoded; charset=utf-8, ) (0ms)
13:24:46.932 [..tExecutorServiceManager] Created new ThreadPool for source:
org.apache.camel.impl.DefaultShutdownStrategy@20ad3a7a with name: ShutdownTask.
->
org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks =
0][ShutdownTask] (3ms)
13:24:46.935 [..DefaultShutdownStrategy] There are 1 routes to shutdown (3ms)
13:24:46.937 [..DefaultShutdownStrategy] Route: route1 suspended and shutdown
deferred, was consuming from:
Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (2ms)
13:24:46.937 [..DefaultShutdownStrategy] Waiting as there are still 1 inflight
and pending exchanges to complete, timeout in 10 seconds. (0ms)
13:24:47.190 [ org.apache.http.wire] >> "DELETE /abc12.txt
HTTP/1.1[\r][\n]" (253ms)
13:24:47.190 [ org.apache.http.wire] >> "Host:
xxx-test.s3.amazonaws.com[\r][\n]" (0ms)
13:24:47.190 [ org.apache.http.wire] >> "Authorization: AWS
AKIAJIY6B67JBFCXLL5A:FAeigwZab6FKtgvT9+KWTFYZSbM=[\r][\n]" (0ms)
13:24:47.190 [ org.apache.http.wire] >> "Date: Fri, 08 May 2015 17:24:46
GMT[\r][\n]" (0ms)
13:24:47.190 [ org.apache.http.wire] >> "User-Agent: aws-sdk-java/1.9.33
Windows_7/6.1 Java_HotSpot(TM)_64-Bit_Server_VM/24.71-b01/1.7.0_71[\r][\n]"
(0ms)
13:24:47.191 [ org.apache.http.wire] >> "Content-Type:
application/x-www-form-urlencoded; charset=utf-8[\r][\n]" (1ms)
13:24:47.191 [ org.apache.http.wire] >> "Connection: Keep-Alive[\r][\n]"
(0ms)
13:24:47.191 [ org.apache.http.wire] >> "Accept-Encoding: gzip[\r][\n]"
(0ms)
13:24:47.191 [ org.apache.http.wire] >> "[\r][\n]" (0ms)
13:24:47.279 [ org.apache.http.wire] << "HTTP/1.1 204 No Content[\r][\n]"
(88ms)
13:24:47.279 [ org.apache.http.wire] << "x-amz-id-2:
xbTWOgHJWqro7cjTekdIwriz3jKVWp+2nVloj+SNqqtQXRiVDtmzy6OhOXMe4/xst4/P/rPwavw=[\r][\n]"
(0ms)
13:24:47.279 [ org.apache.http.wire] << "x-amz-request-id:
F6AD4E2E785E0AEA[\r][\n]" (0ms)
13:24:47.279 [ org.apache.http.wire] << "Date: Fri, 08 May 2015 17:25:21
GMT[\r][\n]" (0ms)
13:24:47.280 [ org.apache.http.wire] << "x-amz-version-id: null[\r][\n]"
(1ms)
13:24:47.280 [ org.apache.http.wire] << "x-amz-delete-marker: true[\r][\n]"
(0ms)
13:24:47.280 [ org.apache.http.wire] << "Server: AmazonS3[\r][\n]" (0ms)
13:24:47.280 [ org.apache.http.wire] << "[\r][\n]" (0ms)
13:24:47.281 [..s.http.AmazonHttpClient] x-amzn-RequestId: not available (1ms)
13:24:47.281 [ com.amazonaws.request] Received successful response: 204, AWS
Request ID: F6AD4E2E785E0AEA (0ms)
13:24:47.937 [..DefaultShutdownStrategy] Route: route1 preparing to shutdown
complete. (656ms)
13:24:47.937 [..edPollConsumerScheduler] This consumer is stopping, so
cancelling scheduled task:
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2486bd80
(0ms)
13:24:47.937 [..onent.aws.s3.S3Consumer] Stopping consumer:
S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
13:24:47.938 [..aredProducerServicePool] Stopping service pool:
org.apache.camel.impl.SharedProducerServicePool@7075cca9 (1ms)
13:24:47.938 [..mponent.log.LogProducer] Stopping producer:
Producer[log://error%20processing%20message] (0ms)
13:24:47.938 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=producers,name=LogProducer(0x89b2158)
(0ms)
13:24:47.939 [..DefaultShutdownStrategy] Route: route1 shutdown complete, was
consuming from:
Endpoint[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (1ms)
13:24:47.939 [..DefaultShutdownStrategy] Graceful shutdown of 1 routes
completed in 1 seconds (0ms)
13:24:47.940 [..rt.TimerListenerManager] Removed TimerListener:
org.apache.camel.management.mbean.ManagedSuspendableRoute@60bb132e (1ms)
13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=routes,name="route1" (0ms)
13:24:47.940 [..camel.impl.RouteService] Stopping services on route: route1
(0ms)
13:24:47.940 [..camel.impl.RouteService] Shutting down child service on route:
route1 ->
S3Consumer[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1] (0ms)
13:24:47.940 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=consumers,name=S3Consumer(0x218a968b)
(0ms)
13:24:47.941 [..tExecutorServiceManager] Forcing shutdown of ExecutorService:
org.apache.camel.util.concurrent.SizedScheduledExecutorService@1174d546[aws-s3://xxx-test?amazonS3Client=%23client®ion=us-east-1]
(1ms)
13:24:47.941 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=threadpools,name="S3Consumer(0x218a968b)"
(0ms)
13:24:47.941 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]],
Channel[Log(route1)[Starting file transfer between S3...]],
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]],
Channel[Log(route1)[Finished file transfer between S3!]]]] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Pipeline[[Channel[SetExchangePattern[InOnly]],
Channel[Log(route1)[Starting file transfer between S3...]],
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]],
Channel[Log(route1)[Finished file transfer between S3!]]]] (1ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> SetExchangePattern[InOnly] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Channel[SetExchangePattern[InOnly]] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Log(route1)[Starting file transfer between S3...] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Channel[Log(route1)[Starting file transfer between S3...]] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 ->
DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]
(0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 ->
Channel[DelegateSync[com.google.refine.importing.camel.CamelS3SaverRouteBuilder$1@18f63b8e]]
(0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Log(route1)[Finished file transfer between S3!] (0ms)
13:24:47.942 [..camel.impl.RouteService] Shutting down child service on route:
route1 -> Channel[Log(route1)[Finished file transfer between S3!]] (0ms)
13:24:47.943 [..camel.impl.RouteService] Shutting down services on route:
route1 (1ms)
13:24:47.943 [..tExecutorServiceManager] Forcing shutdown of ExecutorService:
org.apache.camel.util.concurrent.SizedScheduledExecutorService@4e67f43b[ErrorHandlerRedeliveryTask]
(0ms)
13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=threadpools,name="ErrorHandlerRedeliveryThreadPool"
(1ms)
13:24:47.944 [..rt.TimerListenerManager] Removed TimerListener:
org.apache.camel.management.mbean.ManagedCamelContext@a03313c (0ms)
13:24:47.944 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=context,name="camel-1" (0ms)
13:24:47.945 [..tExecutorServiceManager] Forcing shutdown of ExecutorService:
org.apache.camel.util.concurrent.RejectableThreadPoolExecutor@3c443007[Running,
pool size = 1, active threads = 0, queued tasks = 0, completed tasks =
1][ShutdownTask] (1ms)
13:24:47.945 [..faultInflightRepository] Shutting down with no inflight
exchanges. (0ms)
13:24:47.946 [...camel.util.EventHelper] Ignoring notifying event Stopped
CamelContext: camel-1. The EventNotifier has not been started yet:
org.apache.camel.impl.DefaultRuntimeEndpointRegistry@7bab0b6c (1ms)
13:24:47.946 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultTypeConverter (0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=eventnotifiers,name=EventNotifier(0x7bab0b6c)
(1ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=SharedProducerServicePool
(0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="setExchangePattern1"
(0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="aws-s3" (0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultRestRegistry (0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=EndpointRegistry (0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="log1" (0ms)
13:24:47.947 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultPackageScanClassResolver
(0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=errorhandlers,name="DefaultErrorHandlerBuilder(ref:CamelDefaultErrorHandlerBuilder)"
(1ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="process1" (0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=endpoints,name="log://error%20processing%20message"
(0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=tracer,name=BacklogTracer (0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="properties" (0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=components,name="log" (0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=tracer,name=BacklogDebugger (0ms)
13:24:47.948 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=processors,name="log2" (0ms)
13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultInflightRepository
(1ms)
13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=endpoints,name="aws-s3://xxx-test\?amazonS3Client=%23client®ion=us-east-1"
(0ms)
13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultShutdownStrategy
(0ms)
13:24:47.949 [...DefaultManagementAgent] Unregistered MBean with ObjectName:
org.apache.camel:context=camel-1,type=services,name=DefaultExecutorServiceManager
(0ms)
13:24:47.949 [..il.IntrospectionSupport] Clearing cache[size=42, hits=57,
misses=46, evicted=0] (0ms)
13:24:47.954 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext:
camel-1) uptime 4.193 seconds (5ms)
13:24:47.955 [..mpl.DefaultCamelContext] Apache Camel 2.14.1 (CamelContext:
camel-1) is shutdown in 1.026 seconds (1ms)
13:24:47.956 [..pport$HangupInterceptor] Received hang up - stopping the main
instance. (1ms)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
