[jira] [Commented] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-04-16 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819121#comment-16819121 ] Mark Norkin commented on BEAM-6902: ---  Also I've attached sample [project|[https://githu

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-04-16 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Attachment: beam-kafka-io-commit-model-examples-master.zip > Beam model contract for finalization of Che

[jira] [Updated] (BEAM-7047) Direct Runner loses checkpoint marks when committing offsets to Apache Kafka partitions using KafkaIO

2019-04-10 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-7047: -- Description: On our project we are using Apache Kafka as a source for most of our Apache Beam pipelines

[jira] [Updated] (BEAM-7047) Direct Runner loses checkpoint marks when committing offsets to Apache Kafka partitions using KafkaIO

2019-04-10 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-7047: -- Attachment: beam-direct-runner-not-finalize-all-kafka-offsets-master.zip > Direct Runner loses checkpoin

[jira] [Created] (BEAM-7047) Direct Runner loses checkpoint marks when committing offsets to Apache Kafka partitions using KafkaIO

2019-04-10 Thread Mark Norkin (JIRA)
Mark Norkin created BEAM-7047: - Summary: Direct Runner loses checkpoint marks when committing offsets to Apache Kafka partitions using KafkaIO Key: BEAM-7047 URL: https://issues.apache.org/jira/browse/BEAM-7047

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Labels: docuentation (was: ) > Beam model contract for finalization of CheckpointMark's > -

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- External issue URL: https://stackoverflow.com/questions/55336635/beam-model-contract-for-finalization-of

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Labels: documentation (was: docuentation) > Beam model contract for finalization of CheckpointMark's

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Description: Question: What is the contract in Beam model for when checkpoint marks shall be finalized,

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Description: Question: What is the contract in Beam model for when checkpoint marks shall be finalized,

[jira] [Updated] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6902: -- Description: Question: What is the contract in Beam model for when checkpoint marks shall be finalized,

[jira] [Created] (BEAM-6902) Beam model contract for finalization of CheckpointMark's

2019-03-25 Thread Mark Norkin (JIRA)
Mark Norkin created BEAM-6902: - Summary: Beam model contract for finalization of CheckpointMark's Key: BEAM-6902 URL: https://issues.apache.org/jira/browse/BEAM-6902 Project: Beam Issue Type

[jira] [Commented] (BEAM-6168) Allow modification of JSON value before writing to ElasticSearch

2019-01-03 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732785#comment-16732785 ] Mark Norkin commented on BEAM-6168: --- Thank you explanation, got your point now. I under

[jira] [Commented] (BEAM-6168) Allow modification of JSON value before writing to ElasticSearch

2018-12-28 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730468#comment-16730468 ] Mark Norkin commented on BEAM-6168: --- [~echauchot] thank you for the reply. The workarou

[jira] [Updated] (BEAM-6168) Allow modification of JSON value before writing to ElasticSearch

2018-12-27 Thread Mark Norkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Norkin updated BEAM-6168: -- Description: I have an Apache Beam streaming job which reads data from Kafka and writes to ElasticSearc

[jira] [Created] (BEAM-6168) Allow modification of JSON value before writing to ElasticSearch

2018-12-03 Thread Mark Norkin (JIRA)
Mark Norkin created BEAM-6168: - Summary: Allow modification of JSON value before writing to ElasticSearch Key: BEAM-6168 URL: https://issues.apache.org/jira/browse/BEAM-6168 Project: Beam Issue