[
https://issues.apache.org/jira/browse/BEAM-12601?focusedWorklogId=635351&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-635351
]
ASF GitHub Bot logged work on BEAM-12601:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 06/Aug/21 16:00
Start Date: 06/Aug/21 16:00
Worklog Time Spent: 10m
Work Description: echauchot commented on pull request #15257:
URL: https://github.com/apache/beam/pull/15257#issuecomment-894357432
> Thanks @egalpin and @echauchot !
>
> One question, what would be the process to get this backported to 2.30.x ?
We would like to use this change in a GCP Dataflow Template.
There is no more LTS release in Beam. Your change will be included in next
release (2.33) from master. There is at a time only one release. I can't
remember a time when we backported to a release and added a minor version we
rather release next version. The only time when we "backport" is when a release
branch was cut and we include important changes that arose since cut from
master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 635351)
Time Spent: 5h 10m (was: 5h)
> Support append-only indices in ES output
> -----------------------------------------
>
> Key: BEAM-12601
> URL: https://issues.apache.org/jira/browse/BEAM-12601
> Project: Beam
> Issue Type: Improvement
> Components: io-java-elasticsearch
> Reporter: Andres Rodriguez
> Priority: P2
> Fix For: 2.33.0
>
> Time Spent: 5h 10m
> Remaining Estimate: 0h
>
> Currently, the Apache Beam Elasticsearch sink is
> [using|https://github.com/apache/beam/blob/master/sdks/java/io/elasticsearch/src/main/java/org/apache/beam/sdk/io/elasticsearch/ElasticsearchIO.java#L1532]
> the
> [index|https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html#bulk-api-request-body]
> bulk API operation to add data to the target index. When using append-only
> indices it is better to use the
> [create|https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html#bulk-api-request-body]
> operation. This also applies to new append-only indexes, like [data
> streams|https://www.elastic.co/guide/en/elasticsearch/reference/7.x/use-a-data-stream.html#add-documents-to-a-data-stream].
> The scope of this improvement is to add a new boolean configuration option,
> {{append-only}}, to the Elasticsearch sink, with a default value of {{false}}
> (to keep the current behaivour) that when enabled makes it use the {{create}}
> operation instead of the {{index}} one when sending data.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
