[jira] [Updated] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure HadoopFileSystem to use it for

[jira] [Updated] (BEAM-4397) Add details of using org.apache.beam.sdk.io.hdfs with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure  "org.apache.beam.sdk.io.hdfs" to use

[jira] [Updated] (BEAM-4397) Add details of using org.apache.beam.sdk.io.hdfs with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Summary: Add details of using org.apache.beam.sdk.io.hdfs with different FS (was: Add details

[jira] [Updated] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure HadoopFileSystem to use it for

[jira] [Created] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4397: -- Summary: Add details of using HadoopFileSystem with different FS Key: BEAM-4397 URL: https://issues.apache.org/jira/browse/BEAM-4397 Project: Beam Issue

[jira] [Created] (BEAM-4463) Add unit tests for S3ReadableSeekableByteChannel

2018-06-04 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4463: -- Summary: Add unit tests for S3ReadableSeekableByteChannel Key: BEAM-4463 URL: https://issues.apache.org/jira/browse/BEAM-4463 Project: Beam Issue Type:

[jira] [Updated] (BEAM-4463) Add unit tests for S3ReadableSeekableByteChannel

2018-06-04 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4463: --- Description: There are no any tests for _S3ReadableSeekableByteChannel,_ it can cause the

[jira] [Assigned] (BEAM-4421) Cannot read s3 files using ParquetIO

2018-06-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-4421: -- Assignee: Alexey Romanenko (was: Łukasz Gajowy) > Cannot read s3 files using

[jira] [Commented] (BEAM-4587) Test interoperability between Spark, Flink and Beam in terms of reading/writing Parquet files

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527926#comment-16527926 ] Alexey Romanenko commented on BEAM-4587: Great to hear that it works fine. Good job, [~ŁukaszG]!

[jira] [Comment Edited] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528145#comment-16528145 ] Alexey Romanenko edited comment on BEAM-4622 at 6/29/18 7:48 PM: - [~kenn]

[jira] [Commented] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528145#comment-16528145 ] Alexey Romanenko commented on BEAM-4622: Can I take this one? Actually, I did a refactoring and

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-06-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523937#comment-16523937 ] Alexey Romanenko commented on BEAM-4632: Seems that it works in streaming mode only when I run a

[jira] [Commented] (BEAM-4632) kafkIO should be the streaming mode over spark runner

2018-06-25 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522486#comment-16522486 ] Alexey Romanenko commented on BEAM-4632: Hello Rick, thank you for report.  Do you see any error

[jira] [Commented] (BEAM-4632) kafkIO should be the streaming mode over spark runner

2018-06-25 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522491#comment-16522491 ] Alexey Romanenko commented on BEAM-4632: One remark - according to your [pom

[jira] [Commented] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2018-06-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523346#comment-16523346 ] Alexey Romanenko commented on BEAM-3246: Thanks you! > BigtableIO should merge splits if they

[jira] [Commented] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2018-06-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520417#comment-16520417 ] Alexey Romanenko commented on BEAM-3246: Can we resolve this issue since PR was already merged? >

[jira] [Created] (BEAM-3409) Unexpected behavior of DoFn teardown method running in unit tests

2018-01-04 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-3409: -- Summary: Unexpected behavior of DoFn teardown method running in unit tests Key: BEAM-3409 URL: https://issues.apache.org/jira/browse/BEAM-3409 Project: Beam

[jira] [Assigned] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3539: -- Assignee: Alexey Romanenko > BigtableIO.Write javadoc of some methods is incorrect >

[jira] [Updated] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3539: --- Description: Some methods in BigtableIO.Write have wrong javadoc which says that it returns

[jira] [Updated] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3539: --- Description: Some methods in BigtableIO.Write have wrong javadoc which says that it returns

[jira] [Updated] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3539: --- Description: Some methods in BigtableIO.Write have wrong javadoc which says that it returns

[jira] [Commented] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340819#comment-16340819 ] Alexey Romanenko commented on BEAM-3539: Sure, I'll do! > BigtableIO.Write javadoc of some methods

[jira] [Updated] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3539: --- Description: Some methods in BigtableIO.Write have wrong javadoc which says that it returns

[jira] [Updated] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3539: --- Description: Some methods in BigtableIO.Write have wrong javadoc which says that it returns

[jira] [Created] (BEAM-3539) BigtableIO.Write javadoc of some methods is incorrect

2018-01-26 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-3539: -- Summary: BigtableIO.Write javadoc of some methods is incorrect Key: BEAM-3539 URL: https://issues.apache.org/jira/browse/BEAM-3539 Project: Beam Issue

[jira] [Assigned] (BEAM-3538) Remove (or merge) Java 8 specific tests module into the main one.

2018-02-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3538: -- Assignee: Alexey Romanenko > Remove (or merge) Java 8 specific tests module into the

[jira] [Commented] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-06 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354264#comment-16354264 ] Alexey Romanenko commented on BEAM-3605: The first observation. This particular test call

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-06 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354264#comment-16354264 ] Alexey Romanenko edited comment on BEAM-3605 at 2/6/18 6:08 PM: The first

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-12 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360783#comment-16360783 ] Alexey Romanenko edited comment on BEAM-3605 at 2/12/18 2:10 PM: - Just

[jira] [Commented] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-12 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360783#comment-16360783 ] Alexey Romanenko commented on BEAM-3605: Just submitted a PR (4661) which fixes BEAM-3605 (this

[jira] [Commented] (BEAM-3637) HBaseIOTest methods do not clean up tables

2018-02-12 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361056#comment-16361056 ] Alexey Romanenko commented on BEAM-3637: Disabling and truncating/deleting is quite expensive

[jira] [Assigned] (BEAM-3228) KinesisMockReadTest is flaky

2018-02-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3228: -- Assignee: Alexey Romanenko > KinesisMockReadTest is flaky >

[jira] [Assigned] (BEAM-3637) HBaseIOTest methods do not clean up tables

2018-02-07 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3637: -- Assignee: Alexey Romanenko > HBaseIOTest methods do not clean up tables >

[jira] [Commented] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-07 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355726#comment-16355726 ] Alexey Romanenko commented on BEAM-3605: There are several opened jiras related to these flaky

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-07 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355726#comment-16355726 ] Alexey Romanenko edited comment on BEAM-3605 at 2/7/18 5:09 PM: Hi

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-07 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355726#comment-16355726 ] Alexey Romanenko edited comment on BEAM-3605 at 2/7/18 5:11 PM: Hi

[jira] [Updated] (BEAM-3273) ArtifactServiceStagerTest flaky

2018-02-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3273: --- Labels: flake (was: ) > ArtifactServiceStagerTest flaky > --- > >

[jira] [Commented] (BEAM-3317) KinesisReaderTest is Flaky due to overadvanced watermarks

2018-02-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365664#comment-16365664 ] Alexey Romanenko commented on BEAM-3317: [~iemejia] Well, actually this is two different errors

[jira] [Commented] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370144#comment-16370144 ] Alexey Romanenko commented on BEAM-3605: Finally, it was fixed by using `Mockito.timeout` >

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370144#comment-16370144 ] Alexey Romanenko edited comment on BEAM-3605 at 2/20/18 3:32 PM: - Finally,

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576473#comment-16576473 ] Alexey Romanenko commented on BEAM-4803: [~rangadi] Interesting! Don't you know why this value (1

[jira] [Resolved] (BEAM-5147) Expose document metadata in ElasticsearchIO read

2018-08-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-5147. Resolution: Fixed Fix Version/s: 2.7.0 > Expose document metadata in ElasticsearchIO

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-08-08 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573139#comment-16573139 ] Alexey Romanenko commented on BEAM-4803: [~vivek_17] Yes, as you properly noticed, runner should

[jira] [Resolved] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-4632. Resolution: Cannot Reproduce Fix Version/s: 2.6.0 > KafkaIO seems to fail on

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576039#comment-16576039 ] Alexey Romanenko commented on BEAM-4632: [~Ricklin] Unfortunately, I can't reproduce your issue on

[jira] [Commented] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586158#comment-16586158 ] Alexey Romanenko commented on BEAM-5060: [~bvt279] Thank you for reporting this. Could you attach

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: (was: Reuven Lax) > Port FilterExamplesTest off DoFnTester >

[jira] [Updated] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3654: --- Fix Version/s: (was: Not applicable) 2.7.0 > Port FilterExamplesTest

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: Reuven Lax > Port FilterExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: Reuven Lax > Port FilterExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: (was: Reuven Lax) > Port FilterExamplesTest off DoFnTester >

[jira] [Commented] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589924#comment-16589924 ] Alexey Romanenko commented on BEAM-5060: I changed priority to "Critical" since it's a release

[jira] [Updated] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5060: --- Priority: Critical (was: Major) > Issues with aws KPL while writing to kinesis using beam >

[jira] [Updated] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4803: --- Affects Version/s: 2.5.0 > Beam spark runner not working properly with kafka >

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550897#comment-16550897 ] Alexey Romanenko commented on BEAM-4803: I can confirm that it starts new job every time, not sure

[jira] [Assigned] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-4803: -- Assignee: Raghu Angadi (was: Alexey Romanenko) > Beam spark runner not working

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550912#comment-16550912 ] Alexey Romanenko commented on BEAM-4632: [~Ricklin] Thank you for all this provided information.

[jira] [Resolved] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-07-17 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-4622. Resolution: Fixed Fix Version/s: 2.6.0 > Many Beam SQL expressions never have their

[jira] [Updated] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4798: --- Affects Version/s: 2.4.0 > IndexOutOfBoundsException when Flink parallelism > 1 >

[jira] [Commented] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549044#comment-16549044 ] Alexey Romanenko commented on BEAM-4798: Yes, I did, Thanks! > IndexOutOfBoundsException when

[jira] [Created] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-16 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4798: -- Summary: IndexOutOfBoundsException when Flink parallelism > 1 Key: BEAM-4798 URL: https://issues.apache.org/jira/browse/BEAM-4798 Project: Beam Issue

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547834#comment-16547834 ] Alexey Romanenko commented on BEAM-4803: [~rangadi] Sure, I'll take a look on this. [~vivek_17]

[jira] [Created] (BEAM-5309) Add streaming support for HadoopOutputFormat

2018-09-05 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-5309: -- Summary: Add streaming support for HadoopOutputFormat Key: BEAM-5309 URL: https://issues.apache.org/jira/browse/BEAM-5309 Project: Beam Issue Type:

[jira] [Updated] (BEAM-3912) Add batching support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Summary: Add batching support of HadoopOutputFormatIO (was: Add support of

[jira] [Created] (BEAM-5310) Add support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-5310: -- Summary: Add support of HadoopOutputFormatIO Key: BEAM-5310 URL: https://issues.apache.org/jira/browse/BEAM-5310 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-5309) Add streaming support for HadoopOutputFormat

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5309: --- Issue Type: Sub-task (was: Improvement) Parent: BEAM-5310 > Add streaming support

[jira] [Updated] (BEAM-3912) Add batching support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Summary: Add batching support for HadoopOutputFormatIO (was: Add batching support of

[jira] [Updated] (BEAM-3912) Add batching support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Issue Type: Sub-task (was: Improvement) Parent: BEAM-5310 > Add batching support of

[jira] [Updated] (BEAM-5309) Add streaming support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5309: --- Summary: Add streaming support for HadoopOutputFormatIO (was: Add streaming support for

[jira] [Updated] (BEAM-5310) Add support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5310: --- Description: For the moment, there is only HadoopInputFormatIO in Beam. To provide a support

[jira] [Updated] (BEAM-3912) Add batching support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Description: (was: For the moment, there is only HadoopInputFormatIO in Beam. To provide

[jira] [Assigned] (BEAM-3819) Add withLimit() option to KinesisIO

2018-03-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3819: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > Add withLimit() option to

[jira] [Comment Edited] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-03-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398841#comment-16398841 ] Alexey Romanenko edited comment on BEAM-3087 at 3/14/18 4:46 PM: - Does

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400152#comment-16400152 ] Alexey Romanenko commented on BEAM-3726: It looks like that this issue is related to this one: 

[jira] [Commented] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-03-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398841#comment-16398841 ] Alexey Romanenko commented on BEAM-3087: Does anyone work on this? It looks like it's related to

[jira] [Assigned] (BEAM-3424) CassandraIO uses 1 split if can't estimate size

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3424: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO uses 1 split if

[jira] [Assigned] (BEAM-3425) CassandraIO fails to estimate size: Codec not found for requested operation: [varchar <-> java.lang.Long]

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3425: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO fails to estimate

[jira] [Assigned] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3485: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO.read() splitting

[jira] [Resolved] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-3726. Resolution: Fixed Fix Version/s: 2.5.0 Fixed by

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426686#comment-16426686 ] Alexey Romanenko edited comment on BEAM-3726 at 4/5/18 9:53 AM: Fixed by

[jira] [Commented] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426717#comment-16426717 ] Alexey Romanenko commented on BEAM-3946: Thank you! > Python SDK tests are failing if no

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426686#comment-16426686 ] Alexey Romanenko edited comment on BEAM-3726 at 4/5/18 9:55 AM: Fixed by

[jira] [Assigned] (BEAM-2852) Add support for Kafka as source/sink on Nexmark

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-2852: -- Assignee: Alexey Romanenko (was: Kai Jiang) > Add support for Kafka as source/sink on

[jira] [Commented] (BEAM-2852) Add support for Kafka as source/sink on Nexmark

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427272#comment-16427272 ] Alexey Romanenko commented on BEAM-2852: I'd take this one since there was not update for a while.

[jira] [Commented] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437551#comment-16437551 ] Alexey Romanenko commented on BEAM-4066: The root cause of this issue - the anonymous inner class

[jira] [Updated] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4066: --- Attachment: gistfile1.txt > Nexmark fails when running with PubSub as source/sink >

[jira] [Created] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4066: -- Summary: Nexmark fails when running with PubSub as source/sink Key: BEAM-4066 URL: https://issues.apache.org/jira/browse/BEAM-4066 Project: Beam Issue

[jira] [Comment Edited] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437245#comment-16437245 ] Alexey Romanenko edited comment on BEAM-3485 at 4/13/18 12:23 PM: --

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437245#comment-16437245 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] Thank you for working on this. I assume

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437332#comment-16437332 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] Could you run this command locally?

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437513#comment-16437513 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] 1. BEAM-3424 I agree with what you

[jira] [Comment Edited] (BEAM-3484) HadoopInputFormatIO reads big datasets invalid

2018-04-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442721#comment-16442721 ] Alexey Romanenko edited comment on BEAM-3484 at 4/18/18 3:49 PM: - This

[jira] [Commented] (BEAM-3484) HadoopInputFormatIO reads big datasets invalid

2018-04-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442721#comment-16442721 ] Alexey Romanenko commented on BEAM-3484: This issue can be easily reproduced by increasing the

[jira] [Commented] (BEAM-4086) KafkaIOTest is flaky

2018-04-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443769#comment-16443769 ] Alexey Romanenko commented on BEAM-4086: [~rangadi] For me it happened not every time, I'd say 1

[jira] [Commented] (BEAM-4086) KafkaIO is flaky with gradle build

2018-04-16 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439210#comment-16439210 ] Alexey Romanenko commented on BEAM-4086: It hangs with maven too sometimes: {code:java} mvn clean

[jira] [Updated] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3946: --- Description: Running locally mvn clean install fails on following Apache Beam :: SDKs ::

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3726: --- Issue Type: Bug (was: Improvement) > Kinesis Reader: java.lang.IllegalArgumentException:

[jira] [Assigned] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3726: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > Kinesis Reader:

[jira] [Updated] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3946: --- Description: Running locally mvn clean install fails on following Apache Beam :: SDKs ::

[jira] [Created] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-3946: -- Summary: Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set Key: BEAM-3946 URL: https://issues.apache.org/jira/browse/BEAM-3946 Project:

  1   2   >