[jira] [Resolved] (BEAM-3655) Port MaxPerKeyExamplesTest off DoFnTester

2018-10-09 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-3655. Resolution: Fixed Fix Version/s: 2.8.0 > Port MaxPerKeyExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-5607) Typing library no longer provisional in Python 3.7

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-5607: -- Assignee: Alexey Romanenko (was: Manu Zhang) > Typing library no longer provisional

[jira] [Assigned] (BEAM-5607) Typing library no longer provisional in Python 3.7

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-5607: -- Assignee: Manu Zhang (was: Alexey Romanenko) > Typing library no longer provisional

[jira] [Assigned] (BEAM-5607) Typing library no longer provisional in Python 3.7

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-5607: -- Assignee: Alexey Romanenko (was: Manu Zhang) > Typing library no longer provisional

[jira] [Assigned] (BEAM-5607) Typing library no longer provisional in Python 3.7

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-5607: -- Assignee: Manu Zhang (was: Alexey Romanenko) > Typing library no longer provisional

[jira] [Commented] (BEAM-4038) Support Kafka Headers in KafkaIO

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635696#comment-16635696 ] Alexey Romanenko commented on BEAM-4038: [~rangadi] Thank you. Do you know if we have a Jira to

[jira] [Resolved] (BEAM-3371) Add ability to stage directories with compiled classes to Spark

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-3371. Resolution: Fixed Fix Version/s: 2.8.0 > Add ability to stage directories with

[jira] [Assigned] (BEAM-3371) Add ability to stage directories with compiled classes to Spark

2018-10-02 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3371: -- Assignee: Lukasz Gajowy (was: Jean-Baptiste Onofré) > Add ability to stage

[jira] [Comment Edited] (BEAM-3651) Port BigQueryTornadoesTest off DoFnTester

2018-10-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634270#comment-16634270 ] Alexey Romanenko edited comment on BEAM-3651 at 10/1/18 4:27 PM: - Hi

[jira] [Commented] (BEAM-3651) Port BigQueryTornadoesTest off DoFnTester

2018-10-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634273#comment-16634273 ] Alexey Romanenko commented on BEAM-3651: [~iemejia] Could you add [~niuk-a] as a new contributor?

[jira] [Comment Edited] (BEAM-3651) Port BigQueryTornadoesTest off DoFnTester

2018-10-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634270#comment-16634270 ] Alexey Romanenko edited comment on BEAM-3651 at 10/1/18 4:26 PM: - Hi

[jira] [Commented] (BEAM-3651) Port BigQueryTornadoesTest off DoFnTester

2018-10-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634270#comment-16634270 ] Alexey Romanenko commented on BEAM-3651: Hi [~niuk-a], sure! Thank you for your contribution. >

[jira] [Created] (BEAM-5530) Migrate to java.time lib instead of joda-time

2018-10-01 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-5530: -- Summary: Migrate to java.time lib instead of joda-time Key: BEAM-5530 URL: https://issues.apache.org/jira/browse/BEAM-5530 Project: Beam Issue Type:

[jira] [Commented] (BEAM-4038) Support Kafka Headers in KafkaIO

2018-10-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633920#comment-16633920 ] Alexey Romanenko commented on BEAM-4038: [~gkumar7] Hi, are you going to continue working on this?

[jira] [Assigned] (BEAM-5144) [beam_PostCommit_Java_GradleBuild][org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMark][Flake] Expected messages count assert fails

2018-09-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-5144: -- Assignee: Andrew Fulton (was: Jean-Baptiste Onofré) >

[jira] [Updated] (BEAM-3912) Add batching support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Description: (was: For the moment, there is only HadoopInputFormatIO in Beam. To provide

[jira] [Updated] (BEAM-5310) Add support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5310: --- Description: For the moment, there is only HadoopInputFormatIO in Beam. To provide a support

[jira] [Updated] (BEAM-5309) Add streaming support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5309: --- Summary: Add streaming support for HadoopOutputFormatIO (was: Add streaming support for

[jira] [Updated] (BEAM-5309) Add streaming support for HadoopOutputFormat

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5309: --- Issue Type: Sub-task (was: Improvement) Parent: BEAM-5310 > Add streaming support

[jira] [Updated] (BEAM-3912) Add batching support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Issue Type: Sub-task (was: Improvement) Parent: BEAM-5310 > Add batching support of

[jira] [Updated] (BEAM-3912) Add batching support for HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Summary: Add batching support for HadoopOutputFormatIO (was: Add batching support of

[jira] [Created] (BEAM-5310) Add support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-5310: -- Summary: Add support of HadoopOutputFormatIO Key: BEAM-5310 URL: https://issues.apache.org/jira/browse/BEAM-5310 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-3912) Add batching support of HadoopOutputFormatIO

2018-09-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3912: --- Summary: Add batching support of HadoopOutputFormatIO (was: Add support of

[jira] [Created] (BEAM-5309) Add streaming support for HadoopOutputFormat

2018-09-05 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-5309: -- Summary: Add streaming support for HadoopOutputFormat Key: BEAM-5309 URL: https://issues.apache.org/jira/browse/BEAM-5309 Project: Beam Issue Type:

[jira] [Commented] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589924#comment-16589924 ] Alexey Romanenko commented on BEAM-5060: I changed priority to "Critical" since it's a release

[jira] [Updated] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-5060: --- Priority: Critical (was: Major) > Issues with aws KPL while writing to kinesis using beam >

[jira] [Updated] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-23 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3654: --- Fix Version/s: (was: Not applicable) 2.7.0 > Port FilterExamplesTest

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: (was: Reuven Lax) > Port FilterExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: Reuven Lax > Port FilterExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: (was: Reuven Lax) > Port FilterExamplesTest off DoFnTester >

[jira] [Assigned] (BEAM-3654) Port FilterExamplesTest off DoFnTester

2018-08-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3654: -- Assignee: Reuven Lax > Port FilterExamplesTest off DoFnTester >

[jira] [Commented] (BEAM-5060) Issues with aws KPL while writing to kinesis using beam

2018-08-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586158#comment-16586158 ] Alexey Romanenko commented on BEAM-5060: [~bvt279] Thank you for reporting this. Could you attach

[jira] [Resolved] (BEAM-5147) Expose document metadata in ElasticsearchIO read

2018-08-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-5147. Resolution: Fixed Fix Version/s: 2.7.0 > Expose document metadata in ElasticsearchIO

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576473#comment-16576473 ] Alexey Romanenko commented on BEAM-4803: [~rangadi] Interesting! Don't you know why this value (1

[jira] [Resolved] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-4632. Resolution: Cannot Reproduce Fix Version/s: 2.6.0 > KafkaIO seems to fail on

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-08-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576039#comment-16576039 ] Alexey Romanenko commented on BEAM-4632: [~Ricklin] Unfortunately, I can't reproduce your issue on

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-08-08 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573139#comment-16573139 ] Alexey Romanenko commented on BEAM-4803: [~vivek_17] Yes, as you properly noticed, runner should

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550912#comment-16550912 ] Alexey Romanenko commented on BEAM-4632: [~Ricklin] Thank you for all this provided information.

[jira] [Updated] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4803: --- Affects Version/s: 2.5.0 > Beam spark runner not working properly with kafka >

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550897#comment-16550897 ] Alexey Romanenko commented on BEAM-4803: I can confirm that it starts new job every time, not sure

[jira] [Assigned] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-4803: -- Assignee: Raghu Angadi (was: Alexey Romanenko) > Beam spark runner not working

[jira] [Commented] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549044#comment-16549044 ] Alexey Romanenko commented on BEAM-4798: Yes, I did, Thanks! > IndexOutOfBoundsException when

[jira] [Updated] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4798: --- Affects Version/s: 2.4.0 > IndexOutOfBoundsException when Flink parallelism > 1 >

[jira] [Commented] (BEAM-4803) Beam spark runner not working properly with kafka

2018-07-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547834#comment-16547834 ] Alexey Romanenko commented on BEAM-4803: [~rangadi] Sure, I'll take a look on this. [~vivek_17]

[jira] [Resolved] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-07-17 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-4622. Resolution: Fixed Fix Version/s: 2.6.0 > Many Beam SQL expressions never have their

[jira] [Created] (BEAM-4798) IndexOutOfBoundsException when Flink parallelism > 1

2018-07-16 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4798: -- Summary: IndexOutOfBoundsException when Flink parallelism > 1 Key: BEAM-4798 URL: https://issues.apache.org/jira/browse/BEAM-4798 Project: Beam Issue

[jira] [Comment Edited] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528145#comment-16528145 ] Alexey Romanenko edited comment on BEAM-4622 at 6/29/18 7:48 PM: - [~kenn]

[jira] [Commented] (BEAM-4622) Many Beam SQL expressions never have their validation called

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528145#comment-16528145 ] Alexey Romanenko commented on BEAM-4622: Can I take this one? Actually, I did a refactoring and

[jira] [Commented] (BEAM-4587) Test interoperability between Spark, Flink and Beam in terms of reading/writing Parquet files

2018-06-29 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527926#comment-16527926 ] Alexey Romanenko commented on BEAM-4587: Great to hear that it works fine. Good job, [~ŁukaszG]!

[jira] [Commented] (BEAM-4632) KafkaIO seems to fail on streaming mode over spark runner

2018-06-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523937#comment-16523937 ] Alexey Romanenko commented on BEAM-4632: Seems that it works in streaming mode only when I run a

[jira] [Commented] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2018-06-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523346#comment-16523346 ] Alexey Romanenko commented on BEAM-3246: Thanks you! > BigtableIO should merge splits if they

[jira] [Commented] (BEAM-4632) kafkIO should be the streaming mode over spark runner

2018-06-25 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522491#comment-16522491 ] Alexey Romanenko commented on BEAM-4632: One remark - according to your [pom

[jira] [Commented] (BEAM-4632) kafkIO should be the streaming mode over spark runner

2018-06-25 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522486#comment-16522486 ] Alexey Romanenko commented on BEAM-4632: Hello Rick, thank you for report.  Do you see any error

[jira] [Commented] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2018-06-22 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520417#comment-16520417 ] Alexey Romanenko commented on BEAM-3246: Can we resolve this issue since PR was already merged? >

[jira] [Updated] (BEAM-4463) Add unit tests for S3ReadableSeekableByteChannel

2018-06-04 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4463: --- Description: There are no any tests for _S3ReadableSeekableByteChannel,_ it can cause the

[jira] [Created] (BEAM-4463) Add unit tests for S3ReadableSeekableByteChannel

2018-06-04 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4463: -- Summary: Add unit tests for S3ReadableSeekableByteChannel Key: BEAM-4463 URL: https://issues.apache.org/jira/browse/BEAM-4463 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-4421) Cannot read s3 files using ParquetIO

2018-06-01 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-4421: -- Assignee: Alexey Romanenko (was: Łukasz Gajowy) > Cannot read s3 files using

[jira] [Updated] (BEAM-4397) Add details of using org.apache.beam.sdk.io.hdfs with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure  "org.apache.beam.sdk.io.hdfs" to use

[jira] [Updated] (BEAM-4397) Add details of using org.apache.beam.sdk.io.hdfs with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Summary: Add details of using org.apache.beam.sdk.io.hdfs with different FS (was: Add details

[jira] [Updated] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure HadoopFileSystem to use it for

[jira] [Updated] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4397: --- Description: We need to add more details how to configure HadoopFileSystem to use it for

[jira] [Created] (BEAM-4397) Add details of using HadoopFileSystem with different FS

2018-05-24 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4397: -- Summary: Add details of using HadoopFileSystem with different FS Key: BEAM-4397 URL: https://issues.apache.org/jira/browse/BEAM-4397 Project: Beam Issue

[jira] [Commented] (BEAM-4086) KafkaIOTest is flaky

2018-04-19 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443769#comment-16443769 ] Alexey Romanenko commented on BEAM-4086: [~rangadi] For me it happened not every time, I'd say 1

[jira] [Comment Edited] (BEAM-3484) HadoopInputFormatIO reads big datasets invalid

2018-04-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442721#comment-16442721 ] Alexey Romanenko edited comment on BEAM-3484 at 4/18/18 3:49 PM: - This

[jira] [Commented] (BEAM-3484) HadoopInputFormatIO reads big datasets invalid

2018-04-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442721#comment-16442721 ] Alexey Romanenko commented on BEAM-3484: This issue can be easily reproduced by increasing the

[jira] [Commented] (BEAM-4086) KafkaIO is flaky with gradle build

2018-04-16 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439210#comment-16439210 ] Alexey Romanenko commented on BEAM-4086: It hangs with maven too sometimes: {code:java} mvn clean

[jira] [Commented] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437551#comment-16437551 ] Alexey Romanenko commented on BEAM-4066: The root cause of this issue - the anonymous inner class

[jira] [Updated] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-4066: --- Attachment: gistfile1.txt > Nexmark fails when running with PubSub as source/sink >

[jira] [Created] (BEAM-4066) Nexmark fails when running with PubSub as source/sink

2018-04-13 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-4066: -- Summary: Nexmark fails when running with PubSub as source/sink Key: BEAM-4066 URL: https://issues.apache.org/jira/browse/BEAM-4066 Project: Beam Issue

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437513#comment-16437513 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] 1. BEAM-3424 I agree with what you

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437332#comment-16437332 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] Could you run this command locally?

[jira] [Comment Edited] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437245#comment-16437245 ] Alexey Romanenko edited comment on BEAM-3485 at 4/13/18 12:23 PM: --

[jira] [Commented] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437245#comment-16437245 ] Alexey Romanenko commented on BEAM-3485: [~adejanovski] Thank you for working on this. I assume

[jira] [Assigned] (BEAM-3425) CassandraIO fails to estimate size: Codec not found for requested operation: [varchar <-> java.lang.Long]

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3425: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO fails to estimate

[jira] [Assigned] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3485: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO.read() splitting

[jira] [Assigned] (BEAM-3424) CassandraIO uses 1 split if can't estimate size

2018-04-10 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3424: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > CassandraIO uses 1 split if

[jira] [Assigned] (BEAM-2852) Add support for Kafka as source/sink on Nexmark

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-2852: -- Assignee: Alexey Romanenko (was: Kai Jiang) > Add support for Kafka as source/sink on

[jira] [Commented] (BEAM-2852) Add support for Kafka as source/sink on Nexmark

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427272#comment-16427272 ] Alexey Romanenko commented on BEAM-2852: I'd take this one since there was not update for a while.

[jira] [Commented] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426717#comment-16426717 ] Alexey Romanenko commented on BEAM-3946: Thank you! > Python SDK tests are failing if no

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426686#comment-16426686 ] Alexey Romanenko edited comment on BEAM-3726 at 4/5/18 9:55 AM: Fixed by

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426686#comment-16426686 ] Alexey Romanenko edited comment on BEAM-3726 at 4/5/18 9:53 AM: Fixed by

[jira] [Resolved] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-04-05 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-3726. Resolution: Fixed Fix Version/s: 2.5.0 Fixed by

[jira] [Updated] (BEAM-3819) Add withRequestRecordsLimit option to KinesisIO

2018-03-28 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3819: --- Summary: Add withRequestRecordsLimit option to KinesisIO (was: Add withLimit() option to

[jira] [Comment Edited] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415183#comment-16415183 ] Alexey Romanenko edited comment on BEAM-3726 at 3/27/18 3:16 PM: -

[jira] [Updated] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3946: --- Description: Running locally mvn clean install fails on following Apache Beam :: SDKs ::

[jira] [Updated] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3946: --- Description: Running locally mvn clean install fails on following Apache Beam :: SDKs ::

[jira] [Created] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-03-27 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-3946: -- Summary: Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set Key: BEAM-3946 URL: https://issues.apache.org/jira/browse/BEAM-3946 Project:

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415183#comment-16415183 ] Alexey Romanenko commented on BEAM-3726: [~pawelbartoszek] The issue BEAM-3087 was fixed. Could you

[jira] [Assigned] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3726: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > Kinesis Reader:

[jira] [Updated] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-27 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-3726: --- Issue Type: Bug (was: Improvement) > Kinesis Reader: java.lang.IllegalArgumentException:

[jira] [Commented] (BEAM-3881) Failure reading backlog in KinesisIO

2018-03-26 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413452#comment-16413452 ] Alexey Romanenko commented on BEAM-3881: [~kvncp] Great to hear that it was already fixed and it

[jira] [Created] (BEAM-3912) Add support of HadoopOutputFormatIO

2018-03-22 Thread Alexey Romanenko (JIRA)
Alexey Romanenko created BEAM-3912: -- Summary: Add support of HadoopOutputFormatIO Key: BEAM-3912 URL: https://issues.apache.org/jira/browse/BEAM-3912 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-3881) Failure reading backlog in KinesisIO

2018-03-21 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407937#comment-16407937 ] Alexey Romanenko commented on BEAM-3881: Unfortunately, I can't reproduce this issue using the same

[jira] [Assigned] (BEAM-3881) Failure reading backlog in KinesisIO

2018-03-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3881: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > Failure reading backlog in

[jira] [Commented] (BEAM-3726) Kinesis Reader: java.lang.IllegalArgumentException: Attempting to move backwards

2018-03-15 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400152#comment-16400152 ] Alexey Romanenko commented on BEAM-3726: It looks like that this issue is related to this one: 

[jira] [Comment Edited] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-03-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398841#comment-16398841 ] Alexey Romanenko edited comment on BEAM-3087 at 3/14/18 4:46 PM: - Does

[jira] [Commented] (BEAM-3087) Extend lock scope in Flink UnboundedSourceWrapper

2018-03-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398841#comment-16398841 ] Alexey Romanenko commented on BEAM-3087: Does anyone work on this? It looks like it's related to

[jira] [Assigned] (BEAM-3819) Add withLimit() option to KinesisIO

2018-03-13 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-3819: -- Assignee: Alexey Romanenko (was: Jean-Baptiste Onofré) > Add withLimit() option to

[jira] [Commented] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370144#comment-16370144 ] Alexey Romanenko commented on BEAM-3605: Finally, it was fixed by using `Mockito.timeout` >

[jira] [Comment Edited] (BEAM-3605) Kinesis ShardReadersPoolTest shouldForgetClosedShardIterator failure

2018-02-20 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370144#comment-16370144 ] Alexey Romanenko edited comment on BEAM-3605 at 2/20/18 3:32 PM: - Finally,

  1   2   >