This is an automated email from the ASF dual-hosted git repository. acosentino pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/camel.git
commit 9120e488b685a75ac89d25aa7be8811454e48694 Author: Andrea Cosentino <[email protected]> AuthorDate: Fri Sep 10 14:43:55 2021 +0200 Camel-AWS2-S3: Put emphasis on AWS S3 Streaming upload Timeout --- .../camel-aws2-s3/src/main/docs/aws2-s3-component.adoc | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/components/camel-aws/camel-aws2-s3/src/main/docs/aws2-s3-component.adoc b/components/camel-aws/camel-aws2-s3/src/main/docs/aws2-s3-component.adoc index 48d63d6..2124ba2 100644 --- a/components/camel-aws/camel-aws2-s3/src/main/docs/aws2-s3-component.adoc +++ b/components/camel-aws/camel-aws2-s3/src/main/docs/aws2-s3-component.adoc @@ -629,6 +629,20 @@ Setting the header means potentially change the file name on each exchange and t The selected naming strategy will do the rest of the of the work. ==== +Another possibility is specifying a streamingUploadTimeout with batchMessageNumber and batchSize options. With this option the user will be able to complete the upload of a file after a certain time passed. +In this way the upload completion will be passed on three tiers: the timeout, the number of messages and the batch size. + +As an example: + +[source,java] +-------------------------------------------------------------------------------- +from(kafka("topic1").brokers("localhost:9092")) + .log("Kafka Message is: ${body}") + .to(aws2S3("camel-bucket").streamingUploadMode(true).batchMessageNumber(25).streamingUploadTimeout(10000).namingStrategy(AWS2S3EndpointBuilderFactory.AWSS3NamingStrategyEnum.progressive).keyName("{{kafkaTopic1}}/{{kafkaTopic1}}.txt")); +-------------------------------------------------------------------------------- + +In this case the upload will be completed after 10 seconds. + == Bucket Autocreation With the option `autoCreateBucket` users are able to avoid the autocreation of an S3 Bucket in case it doesn't exist. The default for this option is `true`.
