[jira] [Resolved] (BEAM-6170) NexmarkLauncher stall warning causes benchmark failure

2019-01-22 Thread Sam Whittle (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle resolved BEAM-6170. --- Resolution: Fixed Fix Version/s: 2.10.0 > NexmarkLauncher stall warning causes benchmark

[jira] [Created] (BEAM-6170) NexmarkLauncher stall warning causes benchmark failure

2018-12-03 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-6170: - Summary: NexmarkLauncher stall warning causes benchmark failure Key: BEAM-6170 URL: https://issues.apache.org/jira/browse/BEAM-6170 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-06-12 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-7547: - Summary: StreamingDataflowWorker can observe inconsistent cache for stale work items Key: BEAM-7547 URL: https://issues.apache.org/jira/browse/BEAM-7547 Project: Beam

[jira] [Created] (BEAM-7235) GrpcWindmillServer creates commit streams before necessary

2019-05-06 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-7235: - Summary: GrpcWindmillServer creates commit streams before necessary Key: BEAM-7235 URL: https://issues.apache.org/jira/browse/BEAM-7235 Project: Beam Issue Type:

[jira] [Created] (BEAM-7234) Improve batching for GrpcWindmillServer GetData streams

2019-05-06 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-7234: - Summary: Improve batching for GrpcWindmillServer GetData streams Key: BEAM-7234 URL: https://issues.apache.org/jira/browse/BEAM-7234 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-07-01 Thread Sam Whittle (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle updated BEAM-7547: -- Environment: Dataflow Streaming Engine Fix Version/s: 2.15.0 > StreamingDataflowWorker can

[jira] [Resolved] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-07-01 Thread Sam Whittle (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle resolved BEAM-7547. --- Resolution: Fixed > StreamingDataflowWorker can observe inconsistent cache for stale work items >

[jira] [Commented] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-07-01 Thread Sam Whittle (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876399#comment-16876399 ] Sam Whittle commented on BEAM-7547: --- The symptoms described in that issue certainly line up with what

[jira] [Created] (BEAM-7913) Add drain() to DataflowPipelineJob

2019-08-06 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-7913: - Summary: Add drain() to DataflowPipelineJob Key: BEAM-7913 URL: https://issues.apache.org/jira/browse/BEAM-7913 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7913) Add drain() to DataflowPipelineJob

2019-08-06 Thread Sam Whittle (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901431#comment-16901431 ] Sam Whittle commented on BEAM-7913: --- Current way to drain from a DataflowPipelineJob and

[jira] [Created] (BEAM-7796) Improve health signal for StreamingDataflowWorker

2019-07-22 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-7796: - Summary: Improve health signal for StreamingDataflowWorker Key: BEAM-7796 URL: https://issues.apache.org/jira/browse/BEAM-7796 Project: Beam Issue Type:

[jira] [Created] (BEAM-8810) Dataflow runner - Work stuck in state COMMITTING with streaming commit rpcs

2019-11-22 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-8810: - Summary: Dataflow runner - Work stuck in state COMMITTING with streaming commit rpcs Key: BEAM-8810 URL: https://issues.apache.org/jira/browse/BEAM-8810 Project: Beam

[jira] [Resolved] (BEAM-8810) Dataflow runner - Work stuck in state COMMITTING with streaming commit rpcs

2019-12-18 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle resolved BEAM-8810. --- Fix Version/s: 2.19.0 Resolution: Fixed > Dataflow runner - Work stuck in state COMMITTING

[jira] [Created] (BEAM-9439) KinesisReader does not report correct backlog statistics

2020-03-04 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-9439: - Summary: KinesisReader does not report correct backlog statistics Key: BEAM-9439 URL: https://issues.apache.org/jira/browse/BEAM-9439 Project: Beam Issue Type:

[jira] [Created] (BEAM-9399) Possible deadlock between DataflowWorkerLoggingHandler and overridden System.err PrintStream

2020-02-27 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-9399: - Summary: Possible deadlock between DataflowWorkerLoggingHandler and overridden System.err PrintStream Key: BEAM-9399 URL: https://issues.apache.org/jira/browse/BEAM-9399

[jira] [Comment Edited] (BEAM-9483) PubsubIO.readMessagesWithMessageId does not work with streaming dataflow pipeline

2020-03-11 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057355#comment-17057355 ] Sam Whittle edited comment on BEAM-9483 at 3/11/20, 8:19 PM: - Oops, that is

[jira] [Commented] (BEAM-9483) PubsubIO.readMessagesWithMessageId does not work with streaming dataflow pipeline

2020-03-11 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057355#comment-17057355 ] Sam Whittle commented on BEAM-9483: --- Oops, that is what I meant I must have copied the wrong function to

[jira] [Updated] (BEAM-9483) PubsubIO.readMessagesWithMessageId does not work with streaming dataflow pipeline

2020-03-11 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle updated BEAM-9483: -- Summary: PubsubIO.readMessagesWithMessageId does not work with streaming dataflow pipeline (was:

[jira] [Assigned] (BEAM-9483) PubsubIO.readMessagesWithAttributesWithMessageId does not work with streaming dataflow pipeline

2020-03-10 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle reassigned BEAM-9483: - Assignee: Sam Whittle > PubsubIO.readMessagesWithAttributesWithMessageId does not work with

[jira] [Closed] (BEAM-9660) StreamingDataflowWorker has confusing exception on commits over 2GB

2020-04-03 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle closed BEAM-9660. - Fix Version/s: 2.21.0 Resolution: Fixed > StreamingDataflowWorker has confusing exception on

[jira] [Commented] (BEAM-9651) StreamingDataflowWorker stuck waiting for org.apache.beam.runners.dataflow.worker.windmill.DirectStreamObserver.onNext

2020-03-31 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072114#comment-17072114 ] Sam Whittle commented on BEAM-9651: --- This looks similar to BEAM-4280 regarding the fnapi DirectObserver

[jira] [Created] (BEAM-9651) StreamingDataflowWorker stuck waiting for org.apache.beam.runners.dataflow.worker.windmill.DirectStreamObserver.onNext

2020-03-31 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-9651: - Summary: StreamingDataflowWorker stuck waiting for org.apache.beam.runners.dataflow.worker.windmill.DirectStreamObserver.onNext Key: BEAM-9651 URL:

[jira] [Commented] (BEAM-9651) StreamingDataflowWorker stuck waiting for org.apache.beam.runners.dataflow.worker.windmill.DirectStreamObserver.onNext

2020-03-31 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072207#comment-17072207 ] Sam Whittle commented on BEAM-9651: --- This is different from the other issue because we are not making

[jira] [Created] (BEAM-9660) StreamingDataflowWorker has confusing exception on commits over 2GB

2020-04-01 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-9660: - Summary: StreamingDataflowWorker has confusing exception on commits over 2GB Key: BEAM-9660 URL: https://issues.apache.org/jira/browse/BEAM-9660 Project: Beam

[jira] [Resolved] (BEAM-9651) StreamingDataflowWorker stuck waiting for org.apache.beam.runners.dataflow.worker.windmill.DirectStreamObserver.onNext

2020-05-06 Thread Sam Whittle (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Whittle resolved BEAM-9651. --- Fix Version/s: 2.21.0 Resolution: Fixed > StreamingDataflowWorker stuck waiting for >

[jira] [Created] (BEAM-9483) PubsubIO.readMessagesWithAttributesWithMessageId does not work with streaming dataflow pipeline

2020-03-10 Thread Sam Whittle (Jira)
Sam Whittle created BEAM-9483: - Summary: PubsubIO.readMessagesWithAttributesWithMessageId does not work with streaming dataflow pipeline Key: BEAM-9483 URL: https://issues.apache.org/jira/browse/BEAM-9483