[jira] [Work logged] (BEAM-8382) Add polling interval to KinesisIO.Read

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8382?focusedWorklogId=333246=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333246 ] ASF GitHub Bot logged work on BEAM-8382: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8086) Add isRetraction() to WindowedValue

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8086?focusedWorklogId=333149=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333149 ] ASF GitHub Bot logged work on BEAM-8086: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-8278) Get output from PROCESS environment

2019-10-24 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-8278. --- Fix Version/s: Not applicable Resolution: Not A Problem > Get output from PROCESS environment

[jira] [Created] (BEAM-8469) Add tests for reiterability of GBK result

2019-10-24 Thread Jira
Jan Lukavský created BEAM-8469: -- Summary: Add tests for reiterability of GBK result Key: BEAM-8469 URL: https://issues.apache.org/jira/browse/BEAM-8469 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kamil Wasilewski (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Wasilewski reassigned BEAM-7440: -- Assignee: Kamil Wasilewski > Cannot setup flink 1.8 on dataproc (testing

[jira] [Work logged] (BEAM-8191) Multiple Flatten.pCollections() transforms generate an overwhelming number of tasks

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8191?focusedWorklogId=333151=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333151 ] ASF GitHub Bot logged work on BEAM-8191: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8471: -- Summary: Flink native job submission for portable pipelines Key: BEAM-8471 URL: https://issues.apache.org/jira/browse/BEAM-8471 Project: Beam Issue Type:

[jira] [Created] (BEAM-8472) Get default GCP region from gcloud

2019-10-24 Thread Kyle Weaver (Jira)
Kyle Weaver created BEAM-8472: - Summary: Get default GCP region from gcloud Key: BEAM-8472 URL: https://issues.apache.org/jira/browse/BEAM-8472 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333518=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333518 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333517 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333519=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333519 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7847) Generate Python SDK docs using Python 3

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7847?focusedWorklogId=333529=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333529 ] ASF GitHub Bot logged work on BEAM-7847: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8446) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types is flaky

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8446?focusedWorklogId=333539=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333539 ] ASF GitHub Bot logged work on BEAM-8446: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333562=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333562 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8467) Enable reading compressed files with Python fileio

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8467?focusedWorklogId=333567=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333567 ] ASF GitHub Bot logged work on BEAM-8467: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333594=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333594 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?focusedWorklogId=333442=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333442 ] ASF GitHub Bot logged work on BEAM-8462: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8472) Get default GCP region from gcloud

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8472?focusedWorklogId=333462=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333462 ] ASF GitHub Bot logged work on BEAM-8472: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333492=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333492 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333565=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333565 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333571=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333571 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?focusedWorklogId=333456=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333456 ] ASF GitHub Bot logged work on BEAM-8462: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333472=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333472 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4420) Add KafkaIO Integration Tests

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4420?focusedWorklogId=333512=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333512 ] ASF GitHub Bot logged work on BEAM-4420: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4420) Add KafkaIO Integration Tests

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4420?focusedWorklogId=333511=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333511 ] ASF GitHub Bot logged work on BEAM-4420: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4420) Add KafkaIO Integration Tests

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4420?focusedWorklogId=333510=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333510 ] ASF GitHub Bot logged work on BEAM-4420: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?focusedWorklogId=333556=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333556 ] ASF GitHub Bot logged work on BEAM-8393: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?focusedWorklogId=333449=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333449 ] ASF GitHub Bot logged work on BEAM-8462: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?focusedWorklogId=333448=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333448 ] ASF GitHub Bot logged work on BEAM-8462: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?focusedWorklogId=333446=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333446 ] ASF GitHub Bot logged work on BEAM-8462: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333475=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333475 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8388) Update Avro to 1.9.1 from 1.8.2

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8388?focusedWorklogId=333522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333522 ] ASF GitHub Bot logged work on BEAM-8388: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7738) Support PubSubIO to be configured externally for use with other SDKs

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7738?focusedWorklogId=333536=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333536 ] ASF GitHub Bot logged work on BEAM-7738: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333574=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333574 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333573=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333573 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?focusedWorklogId=333575=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333575 ] ASF GitHub Bot logged work on BEAM-8471: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333587=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333587 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5967) ProtoCoder doesn't support DynamicMessage

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5967?focusedWorklogId=333595=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333595 ] ASF GitHub Bot logged work on BEAM-5967: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Description: There are currently two methods to run a portable pipeline written in a non-JVM

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333469=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333469 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=333516=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333516 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-10-24 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7870: Summary: Externally configured KafkaIO / PubsubIO consumer causes coder problems (was: Externally

[jira] [Work logged] (BEAM-8446) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types is flaky

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8446?focusedWorklogId=333540=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333540 ] ASF GitHub Bot logged work on BEAM-8446: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333468=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333468 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333466 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=333467=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333467 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7738) Support PubSubIO to be configured externally for use with other SDKs

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7738?focusedWorklogId=333523=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333523 ] ASF GitHub Bot logged work on BEAM-7738: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333564=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333564 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-10-24 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959062#comment-16959062 ] Lukasz Gajowy commented on BEAM-8422: - I looked more into possibilities of turning off emails for

[jira] [Updated] (BEAM-8352) Reading records in background may lead to OOM errors

2019-10-24 Thread Alexey Romanenko (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-8352: --- Fix Version/s: (was: 2.17.0) > Reading records in background may lead to OOM errors >

[jira] [Work logged] (BEAM-7847) Generate Python SDK docs using Python 3

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7847?focusedWorklogId=93=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-93 ] ASF GitHub Bot logged work on BEAM-7847: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?focusedWorklogId=333407=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333407 ] ASF GitHub Bot logged work on BEAM-8470: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8462: Status: Open (was: Triage Needed) > Upgrade supported Flink version to 1.9 >

[jira] [Work logged] (BEAM-8352) Reading records in background may lead to OOM errors

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8352?focusedWorklogId=77=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-77 ] ASF GitHub Bot logged work on BEAM-8352: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8352) Reading records in background may lead to OOM errors

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8352?focusedWorklogId=78=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-78 ] ASF GitHub Bot logged work on BEAM-8352: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kamil Wasilewski (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958898#comment-16958898 ] Kamil Wasilewski edited comment on BEAM-7440 at 10/24/19 1:35 PM: -- I'm

[jira] [Commented] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kamil Wasilewski (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958899#comment-16958899 ] Kamil Wasilewski commented on BEAM-7440: Just to give more context: the issue is caused by

[jira] [Comment Edited] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kamil Wasilewski (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958898#comment-16958898 ] Kamil Wasilewski edited comment on BEAM-7440 at 10/24/19 1:35 PM: -- I'm

[jira] [Commented] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kamil Wasilewski (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958898#comment-16958898 ] Kamil Wasilewski commented on BEAM-7440: I'm currently working on other issue to ugrade Flink

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=81=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-81 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7440) Cannot setup flink 1.8 on dataproc (testing infrastructure).

2019-10-24 Thread Kyle Weaver (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958791#comment-16958791 ] Kyle Weaver commented on BEAM-7440: --- I had the same problem a while back and fixed it by using a Flink

[jira] [Created] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8470: -- Summary: Create a new Spark runner based on Spark Structured streaming framework Key: BEAM-8470 URL: https://issues.apache.org/jira/browse/BEAM-8470 Project:

[jira] [Closed] (BEAM-198) Spark runner batch translator to work with Datasets instead of RDDs

2019-10-24 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-198. - Fix Version/s: Not applicable Resolution: Fixed > Spark runner batch translator to work

[jira] [Work logged] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?focusedWorklogId=333718=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333718 ] ASF GitHub Bot logged work on BEAM-8471: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8476) Flag to skip triggering precommit jobs

2019-10-24 Thread Ankur Goenka (Jira)
Ankur Goenka created BEAM-8476: -- Summary: Flag to skip triggering precommit jobs Key: BEAM-8476 URL: https://issues.apache.org/jira/browse/BEAM-8476 Project: Beam Issue Type: Bug

[jira] [Work logged] (BEAM-4132) Element type inference doesn't work for multi-output DoFns

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4132?focusedWorklogId=333751=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333751 ] ASF GitHub Bot logged work on BEAM-4132: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7473) Update RestrictionTracker within Python to not be required to be thread safe

2019-10-24 Thread Boyuan Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyuan Zhang reassigned BEAM-7473: -- Assignee: Boyuan Zhang > Update RestrictionTracker within Python to not be required to be

[jira] [Created] (BEAM-8478) Create WatermarkEstomator for tracking watermark

2019-10-24 Thread Boyuan Zhang (Jira)
Boyuan Zhang created BEAM-8478: -- Summary: Create WatermarkEstomator for tracking watermark Key: BEAM-8478 URL: https://issues.apache.org/jira/browse/BEAM-8478 Project: Beam Issue Type:

[jira] [Work logged] (BEAM-8480) Explicitly set restriction coder for bounded reader wrapper SDF.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8480?focusedWorklogId=333763=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333763 ] ASF GitHub Bot logged work on BEAM-8480: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8198) Investigate possible performance regression of Wordcount 1GB batch benchmark on Py3.

2019-10-24 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959211#comment-16959211 ] Ahmet Altay commented on BEAM-8198: --- Could we resolve this? IIRC, this was an issue with the local

[jira] [Commented] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-10-24 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959233#comment-16959233 ] Valentyn Tymofieiev commented on BEAM-7950: --- Yes, we removed Py3 warnings since 2.16.0. We now

[jira] [Resolved] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-10-24 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev resolved BEAM-7950. --- Fix Version/s: (was: 2.17.0) 2.16.0 Resolution: Fixed >

[jira] [Work logged] (BEAM-4132) Element type inference doesn't work for multi-output DoFns

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4132?focusedWorklogId=333742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333742 ] ASF GitHub Bot logged work on BEAM-4132: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7472) Update SplittableDoFn implementation within Python to use ProcessContinuation instead of defer_remainder/defer_status on the RestrictionTracker

2019-10-24 Thread Boyuan Zhang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959275#comment-16959275 ] Boyuan Zhang commented on BEAM-7472: After a discussion around this one, we decided to keep

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333761=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333761 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8479) Python pattern for side input

2019-10-24 Thread Ankur Goenka (Jira)
Ankur Goenka created BEAM-8479: -- Summary: Python pattern for side input Key: BEAM-8479 URL: https://issues.apache.org/jira/browse/BEAM-8479 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-8480) Explicitly set restriction coder for bounded reader wrapper SDF.

2019-10-24 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8480: - Summary: Explicitly set restriction coder for bounded reader wrapper SDF. Key: BEAM-8480 URL: https://issues.apache.org/jira/browse/BEAM-8480 Project: Beam

[jira] [Assigned] (BEAM-8480) Explicitly set restriction coder for bounded reader wrapper SDF.

2019-10-24 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-8480: - Assignee: Robert Bradshaw > Explicitly set restriction coder for bounded reader wrapper

[jira] [Work started] (BEAM-8342) upgrade samza runner to use samza 1.2

2019-10-24 Thread Hai Lu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8342 started by Hai Lu. > upgrade samza runner to use samza 1.2 > - > >

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=333776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333776 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4132) Element type inference doesn't work for multi-output DoFns

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4132?focusedWorklogId=333717=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333717 ] ASF GitHub Bot logged work on BEAM-4132: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333739=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333739 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8477) Prioritize precommit over post commit jobs

2019-10-24 Thread Ankur Goenka (Jira)
Ankur Goenka created BEAM-8477: -- Summary: Prioritize precommit over post commit jobs Key: BEAM-8477 URL: https://issues.apache.org/jira/browse/BEAM-8477 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-8397) DataflowRunnerTest.test_remote_runner_display_data fails due to infinite recursion during pickling.

2019-10-24 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959265#comment-16959265 ] Valentyn Tymofieiev commented on BEAM-8397: --- It appears that there is a known issue that

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333749=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333749 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8382) Add polling interval to KinesisIO.Read

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8382?focusedWorklogId=333719=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333719 ] ASF GitHub Bot logged work on BEAM-8382: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8456) BigQuery to Beam SQL timestamp has the wrong default: truncation makes the most sense

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8456?focusedWorklogId=333726=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333726 ] ASF GitHub Bot logged work on BEAM-8456: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8456) BigQuery to Beam SQL timestamp has the wrong default: truncation makes the most sense

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8456?focusedWorklogId=333725=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333725 ] ASF GitHub Bot logged work on BEAM-8456: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8456) BigQuery to Beam SQL timestamp has the wrong default: truncation makes the most sense

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8456?focusedWorklogId=333724=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333724 ] ASF GitHub Bot logged work on BEAM-8456: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8341) basic bundling support for samza portable runner

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8341?focusedWorklogId=333740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333740 ] ASF GitHub Bot logged work on BEAM-8341: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8475) Kill old jenkins job for a PR when PR is updated

2019-10-24 Thread Ankur Goenka (Jira)
Ankur Goenka created BEAM-8475: -- Summary: Kill old jenkins job for a PR when PR is updated Key: BEAM-8475 URL: https://issues.apache.org/jira/browse/BEAM-8475 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-366) Support Display Data on Composite Transforms

2019-10-24 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959263#comment-16959263 ] Valentyn Tymofieiev commented on BEAM-366: -- cc: [~robertwb], [~udim] > Support Display Data on

[jira] [Commented] (BEAM-366) Support Display Data on Composite Transforms

2019-10-24 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959262#comment-16959262 ] Valentyn Tymofieiev commented on BEAM-366: -- [~joar], very likely. I encountered this issue

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333747=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333747 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333748=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333748 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-8341) basic bundling support for samza portable runner

2019-10-24 Thread Hai Lu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Lu resolved BEAM-8341. -- Fix Version/s: Not applicable Resolution: Fixed > basic bundling support for samza portable runner >

[jira] [Work logged] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-10-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?focusedWorklogId=333772=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-333772 ] ASF GitHub Bot logged work on BEAM-8434: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8481) Python 3.7 Postcommit test -- frequent timeouts

2019-10-24 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8481: - Summary: Python 3.7 Postcommit test -- frequent timeouts Key: BEAM-8481 URL: https://issues.apache.org/jira/browse/BEAM-8481 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

2019-10-24 Thread Ning Kang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Kang resolved BEAM-8457. - Resolution: Fixed PR is merged. Resolve this in case it blocks the release. > Instrument Dataflow jobs

[jira] [Work started] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

2019-10-24 Thread Ning Kang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8457 started by Ning Kang. --- > Instrument Dataflow jobs that are launched from Notebooks >

  1   2   >