[jira] [Created] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-02-21 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3726: - Summary: Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards Key: BEAM-3726 URL: https://issues.apache.org/jira/browse/BEAM-3726 Projec

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-02-21 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3726: -- Description: When the job is restored from savepoint Kinesis Reader throws sometimes {{java.lang

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-02-22 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3726: -- Description: When the job is restored from savepoint Kinesis Reader throws almost always  {{java.

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383570#comment-16383570 ] Pawel Bartoszek commented on BEAM-3726: --- [~iemejia] we upgraded to Beam 2.3 and Flink

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3726: -- Description: When the job is restored from savepoint Kinesis Reader throws almost always  {{java.

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383736#comment-16383736 ] Pawel Bartoszek commented on BEAM-3726: --- [~iemejia]  I have looked into PubSubIO impl

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3726: -- Attachment: KinesisIO-state.txt > Kinesis Reader: java.lang.IllegalArgumentException: Attempting

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383763#comment-16383763 ] Pawel Bartoszek commented on BEAM-3726: ---   [~iemejia] I managed to catch this except

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383882#comment-16383882 ] Pawel Bartoszek commented on BEAM-3726: --- Another think I noticed (I might be complete

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383882#comment-16383882 ] Pawel Bartoszek edited comment on BEAM-3726 at 3/2/18 5:51 PM: --

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383882#comment-16383882 ] Pawel Bartoszek edited comment on BEAM-3726 at 3/2/18 5:57 PM: --

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-02 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383882#comment-16383882 ] Pawel Bartoszek edited comment on BEAM-3726 at 3/2/18 6:06 PM: --

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-03 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384564#comment-16384564 ] Pawel Bartoszek commented on BEAM-3726: --- [~iemejia] I managed to write a test that re

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-03 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384564#comment-16384564 ] Pawel Bartoszek edited comment on BEAM-3726 at 3/3/18 9:00 AM: --

[jira] [Created] (BEAM-3488) Reduce log noise coming from File sink

2018-01-17 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3488: - Summary: Reduce log noise coming from File sink Key: BEAM-3488 URL: https://issues.apache.org/jira/browse/BEAM-3488 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-3500) JdbcIO: Improve connection management

2018-01-19 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3500: - Summary: JdbcIO: Improve connection management Key: BEAM-3500 URL: https://issues.apache.org/jira/browse/BEAM-3500 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-3500) JdbcIO: Improve connection management

2018-01-21 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16333739#comment-16333739 ] Pawel Bartoszek commented on BEAM-3500: --- [~jbonofre], can you post a link to a branch

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2018-02-01 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2018-02-01 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Created] (BEAM-3863) AfterProcessingTime trigger doesn't fire reliably

2018-03-16 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3863: - Summary: AfterProcessingTime trigger doesn't fire reliably Key: BEAM-3863 URL: https://issues.apache.org/jira/browse/BEAM-3863 Project: Beam Issue Type: Bu

[jira] [Updated] (BEAM-3863) AfterProcessingTime trigger doesn't fire reliably

2018-03-16 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3863: -- Description: *Issue* Beam AfterProcessingTime trigger doesn't fire always reliably after a conf

[jira] [Updated] (BEAM-3863) AfterProcessingTime trigger doesn't fire reliably

2018-03-16 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3863: -- Description: *Issue* Beam AfterProcessingTime trigger doesn't fire always reliably after a conf

[jira] [Updated] (BEAM-3863) AfterProcessingTime trigger doesn't fire reliably

2018-03-16 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3863: -- Description: *Issue* Beam AfterProcessingTime trigger doesn't fire always reliably after a conf

[jira] [Updated] (BEAM-3863) AfterProcessingTime trigger doesn't fire reliably

2018-03-16 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3863: -- Description: *Issue* Beam AfterProcessingTime trigger doesn't fire always reliably after a conf

[jira] [Commented] (BEAM-3225) Non deterministic behaviour of AfterProcessingTime trigger with multiple group by transformations

2018-03-16 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403089#comment-16403089 ] Pawel Bartoszek commented on BEAM-3225: --- [~dawidwys] I think this issue might have be

[jira] [Created] (BEAM-2752) Job fails to checkpoint with kinesis stream as an input for Flink job

2017-08-08 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-2752: - Summary: Job fails to checkpoint with kinesis stream as an input for Flink job Key: BEAM-2752 URL: https://issues.apache.org/jira/browse/BEAM-2752 Project: Beam

[jira] [Updated] (BEAM-2752) Job fails to checkpoint with kinesis stream as an input for Flink job

2017-08-08 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-2752: -- Description: Our job is reading from kinesis stream as a job input. Quiet often when the job is

[jira] [Updated] (BEAM-2752) Job fails to checkpoint with kinesis stream as an input for Flink job

2017-08-08 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-2752: -- Description: Our job is reading from kinesis stream as a job input. Quiet often when the job is

[jira] [Created] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3186: - Summary: In-flight data loss when restoring from savepoint Key: BEAM-3186 URL: https://issues.apache.org/jira/browse/BEAM-3186 Project: Beam Issue Type: Bu

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Attachment: restore_no_trigger.png restore_with_trigger.png > In-flight data loss

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: !restore_no_trigger.png|thumbnail! !restore_with_trigger.png|thumbnail! > In-flight

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context: * I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Attachment: (was: restore_no_trigger.png) > In-flight data loss when restoring from savepoint

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Attachment: restore_no_trigger.png restore_with_trigger.png > In-flight data loss

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Attachment: (was: restore_with_trigger.png) > In-flight data loss when restoring from savepoi

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-14 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-15 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Description: *The context:* I want to count how many events of given type(A,B, etc) I receive ev

[jira] [Created] (BEAM-3225) Non deterministic behaviour of AfterProcessingTime trigger with multiple group by transformations

2017-11-20 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3225: - Summary: Non deterministic behaviour of AfterProcessingTime trigger with multiple group by transformations Key: BEAM-3225 URL: https://issues.apache.org/jira/browse/BEAM-3225

[jira] [Updated] (BEAM-3225) Non deterministic behaviour of AfterProcessingTime trigger with multiple group by transformations

2017-11-20 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3225: -- Description: *Context* I run my [test code|https://gist.github.com/pbartoszek/fe6b1d7501333a2a4

[jira] [Updated] (BEAM-3225) Non deterministic behaviour of AfterProcessingTime trigger with multiple group by transformations

2017-11-20 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3225: -- Description: *Context* I run my [test code|https://gist.github.com/pbartoszek/fe6b1d7501333a2a4

[jira] [Updated] (BEAM-3186) In-flight data loss when restoring from savepoint

2017-11-22 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3186: -- Attachment: restore_with_trigger_b.png As [~aljoscha] suggested I performed another test depicted

[jira] [Updated] (BEAM-2752) KinesisIO throws ConcurrentModificationException on checkpoint

2017-11-23 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-2752: -- Affects Version/s: 2.2.0 2.1.0 Description: >From time to time K

[jira] [Updated] (BEAM-2752) KinesisIO throws ConcurrentModificationException on checkpoint

2017-11-23 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-2752: -- Description: >From time to time Kinesis IO throws ConcurrentModificationException on taking >a c

[jira] [Commented] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-15 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167625#comment-16167625 ] Pawel Bartoszek commented on BEAM-2948: --- For anybody running into similar issue befor

[jira] [Comment Edited] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-15 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167625#comment-16167625 ] Pawel Bartoszek edited comment on BEAM-2948 at 9/15/17 9:39 AM: -

[jira] [Created] (BEAM-3151) AfterProcessingTime trigger doesn't create expected file panes

2017-11-07 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3151: - Summary: AfterProcessingTime trigger doesn't create expected file panes Key: BEAM-3151 URL: https://issues.apache.org/jira/browse/BEAM-3151 Project: Beam

[jira] [Updated] (BEAM-3151) AfterProcessingTime trigger doesn't create expected file panes

2017-11-07 Thread Pawel Bartoszek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pawel Bartoszek updated BEAM-3151: -- Description: I am seeing some weird behaviour with Beam 2.0.0 about file panes created when usin

[jira] [Created] (BEAM-3152) AfterProcessingTime trigger doesn't create any file panes

2017-11-07 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created BEAM-3152: - Summary: AfterProcessingTime trigger doesn't create any file panes Key: BEAM-3152 URL: https://issues.apache.org/jira/browse/BEAM-3152 Project: Beam Issue