[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Romain Manni-Bucau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814034#comment-16814034 ] Romain Manni-Bucau commented on BEAM-7042: -- [~reuvenlax] as mentionned it is a regression so a

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225398=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225398 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6935) Spark Portable Runner: Support side inputs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6935?focusedWorklogId=225372=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225372 ] ASF GitHub Bot logged work on BEAM-6935: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3072) Improve error handling at staging time time for DataflowRunner

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3072?focusedWorklogId=225370=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225370 ] ASF GitHub Bot logged work on BEAM-3072: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6935) Spark Portable Runner: Support side inputs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6935?focusedWorklogId=225368=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225368 ] ASF GitHub Bot logged work on BEAM-6935: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813947#comment-16813947 ] Kenneth Knowles commented on BEAM-7042: --- Vendoring == an empty project with a bundled + relocated

[jira] [Resolved] (BEAM-6934) Unexpected TestStream behavior when testing stateful DoFn (DirectRunner)

2019-04-09 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-6934. - Resolution: Fixed Fix Version/s: 2.13.0 > Unexpected TestStream behavior when testing

[jira] [Commented] (BEAM-6934) Unexpected TestStream behavior when testing stateful DoFn (DirectRunner)

2019-04-09 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813940#comment-16813940 ] Pablo Estrada commented on BEAM-6934: - This code snippet has been added as a unit test, and fixed.

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225353=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225353 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225352=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225352 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6695) Latest transform for Python SDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6695?focusedWorklogId=225349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225349 ] ASF GitHub Bot logged work on BEAM-6695: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7046) fix http_proxy warnings from grpc in tests

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7046?focusedWorklogId=225345=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225345 ] ASF GitHub Bot logged work on BEAM-7046: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6942) Pipeline options to experiment propagation is not working in Dataflow runner.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6942?focusedWorklogId=225343=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225343 ] ASF GitHub Bot logged work on BEAM-6942: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225339=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225339 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6892) Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in GCS if not specified by user.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6892?focusedWorklogId=225332=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225332 ] ASF GitHub Bot logged work on BEAM-6892: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6527) Parallel tox (unit) tests run on Jenkins

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6527?focusedWorklogId=225330=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225330 ] ASF GitHub Bot logged work on BEAM-6527: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7046) fix http_proxy warnings from grpc in tests

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7046?focusedWorklogId=225320=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225320 ] ASF GitHub Bot logged work on BEAM-7046: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7046) fix http_proxy warnings from grpc in tests

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7046?focusedWorklogId=225318=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225318 ] ASF GitHub Bot logged work on BEAM-7046: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-7042: - Fix Version/s: (was: 2.12.0) 2.13.0 > [regression]

[jira] [Work logged] (BEAM-6867) Data race in Side Input Metrics code

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6867?focusedWorklogId=225316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225316 ] ASF GitHub Bot logged work on BEAM-6867: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813875#comment-16813875 ] Reuven Lax commented on BEAM-7042: -- Given that Antlr has been part of core since 2.10, I don't think this

[jira] [Work logged] (BEAM-6934) Unexpected TestStream behavior when testing stateful DoFn (DirectRunner)

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6934?focusedWorklogId=225315=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225315 ] ASF GitHub Bot logged work on BEAM-6934: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7046) fix http_proxy warnings from grpc in tests

2019-04-09 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7046: --- Summary: fix http_proxy warnings from grpc in tests Key: BEAM-7046 URL: https://issues.apache.org/jira/browse/BEAM-7046 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-6695) Latest transform for Python SDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6695?focusedWorklogId=225311=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225311 ] ASF GitHub Bot logged work on BEAM-6695: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud reassigned BEAM-7042: Assignee: Reuven Lax > [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0

[jira] [Work logged] (BEAM-6872) Add hook for user-defined JVM initialization in workers

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6872?focusedWorklogId=225310=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225310 ] ASF GitHub Bot logged work on BEAM-6872: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813864#comment-16813864 ] Andrew Pilloud commented on BEAM-7042: -- Hello, I'm about to cut RC3. Is this really a release

[jira] [Work logged] (BEAM-6872) Add hook for user-defined JVM initialization in workers

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6872?focusedWorklogId=225308=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225308 ] ASF GitHub Bot logged work on BEAM-6872: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud resolved BEAM-7038. -- Resolution: Fixed > coder changes are incompatible with dataflow update operation >

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225301=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225301 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225300=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225300 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225299 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225297=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225297 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7045) Element counters in the Web UI graph representations for transforms for Python streaming jobs in Google Cloud Dataflow

2019-04-09 Thread Efim Muratov (JIRA)
Efim Muratov created BEAM-7045: -- Summary: Element counters in the Web UI graph representations for transforms for Python streaming jobs in Google Cloud Dataflow Key: BEAM-7045 URL:

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225289=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225289 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225275=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225275 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225276=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225276 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225277=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225277 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225270=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225270 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6991) EOS: Streaming job fails on job restart with withEOS specified

2019-04-09 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813819#comment-16813819 ] Raghu Angadi commented on BEAM-6991: [~aromanenko], you are right, the error is appropriate here.

[jira] [Commented] (BEAM-5328) Java starter archetype does not contain dependency versions

2019-04-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813808#comment-16813808 ] Luke Cwik commented on BEAM-5328: - To finish BEAM-5328, you also want to ensure that your test runs via

[jira] [Work logged] (BEAM-5328) Java starter archetype does not contain dependency versions

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5328?focusedWorklogId=225257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225257 ] ASF GitHub Bot logged work on BEAM-5328: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Romain Manni-Bucau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813806#comment-16813806 ] Romain Manni-Bucau commented on BEAM-7042: -- [~reuvenlax] no, dont mix consumer and producer.

[jira] [Work logged] (BEAM-7036) Spark portable runner: stage files to run on 'remote' cluster

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7036?focusedWorklogId=225250=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225250 ] ASF GitHub Bot logged work on BEAM-7036: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7035) Clear() method of OutputTimer is inconsistent

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7035?focusedWorklogId=225239=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225239 ] ASF GitHub Bot logged work on BEAM-7035: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225236=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225236 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable Python connector

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=225214=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225214 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225206=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225206 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225201=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225201 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6942) Pipeline options to experiment propagation is not working in Dataflow runner.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6942?focusedWorklogId=225198=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225198 ] ASF GitHub Bot logged work on BEAM-6942: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6942) Pipeline options to experiment propagation is not working in Dataflow runner.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6942?focusedWorklogId=225199=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225199 ] ASF GitHub Bot logged work on BEAM-6942: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6942) Pipeline options to experiment propagation is not working in Dataflow runner.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6942?focusedWorklogId=225197=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225197 ] ASF GitHub Bot logged work on BEAM-6942: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6872) Add hook for user-defined JVM initialization in workers

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6872?focusedWorklogId=225196=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225196 ] ASF GitHub Bot logged work on BEAM-6872: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6527) Parallel tox (unit) tests run on Jenkins

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6527?focusedWorklogId=225193=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225193 ] ASF GitHub Bot logged work on BEAM-6527: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813669#comment-16813669 ] Reuven Lax commented on BEAM-7042: -- question for [~romain.manni-bucau]. The Antlr dependency went in in

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813662#comment-16813662 ] Reuven Lax commented on BEAM-7042: -- The current design of schemas is for them to be a type system for

[jira] [Created] (BEAM-7044) Spark portable runner: support user state

2019-04-09 Thread Kyle Weaver (JIRA)
Kyle Weaver created BEAM-7044: - Summary: Spark portable runner: support user state Key: BEAM-7044 URL: https://issues.apache.org/jira/browse/BEAM-7044 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-6865) Refactor common portable runner infrastructure for better reuse

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6865?focusedWorklogId=225175=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225175 ] ASF GitHub Bot logged work on BEAM-6865: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7036) Spark portable runner: stage files to run on 'remote' cluster

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7036?focusedWorklogId=225165=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225165 ] ASF GitHub Bot logged work on BEAM-7036: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6991) EOS: Streaming job fails on job restart with withEOS specified

2019-04-09 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813636#comment-16813636 ] Alexey Romanenko commented on BEAM-6991: [~anton.lytvynenko] Thank you for reporting this and

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225156=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225156 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Romain Manni-Bucau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813628#comment-16813628 ] Romain Manni-Bucau commented on BEAM-7042: -- Another good and saner option is IMHO to not mess up

[jira] [Commented] (BEAM-7006) test_split_crazy_sdf broken in python presubmit. 'DataInputOperation' object has no attribute 'index'

2019-04-09 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813622#comment-16813622 ] Yueyang Qiu commented on BEAM-7006: --- This should be fixed by https://github.com/apache/beam/pull/8256 >

[jira] [Work logged] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6978?focusedWorklogId=225150=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225150 ] ASF GitHub Bot logged work on BEAM-6978: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6978?focusedWorklogId=225149=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225149 ] ASF GitHub Bot logged work on BEAM-6978: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6978. - Resolution: Fixed > Make Dataflow service receive required restriction encoding parameter on >

[jira] [Work logged] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6978?focusedWorklogId=225148=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225148 ] ASF GitHub Bot logged work on BEAM-6978: Author: ASF GitHub Bot

[jira] [Reopened] (BEAM-6978) Make Dataflow service receive required restriction encoding parameter on SplittableParDo

2019-04-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reopened BEAM-6978: - Breaks

[jira] [Work logged] (BEAM-6825) Improve pipeline construction time error messages in Go SDK.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6825?focusedWorklogId=225138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225138 ] ASF GitHub Bot logged work on BEAM-6825: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7024) Calcite BINARY to Beam Schema BYTES missing in CalciteUtils

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7024?focusedWorklogId=225136=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225136 ] ASF GitHub Bot logged work on BEAM-7024: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5663) Add tox suites for various Python 3 versions (3.5, 3.6, 3.7)

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5663?focusedWorklogId=225099=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225099 ] ASF GitHub Bot logged work on BEAM-5663: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5663) Add tox suites for various Python 3 versions (3.5, 3.6, 3.7)

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5663?focusedWorklogId=225098=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225098 ] ASF GitHub Bot logged work on BEAM-5663: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5663) Add tox suites for various Python 3 versions (3.5, 3.6, 3.7)

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5663?focusedWorklogId=225097=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225097 ] ASF GitHub Bot logged work on BEAM-5663: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225094=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225094 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225096=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225096 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225093=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225093 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?focusedWorklogId=225092=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225092 ] ASF GitHub Bot logged work on BEAM-7038: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-6870) python 3 test_hourly_team_score_it fails with bigquery job id already exists

2019-04-09 Thread Juta Staes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juta Staes closed BEAM-6870. Resolution: Cannot Reproduce Fix Version/s: Not applicable > python 3 test_hourly_team_score_it

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225082=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225082 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225081 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225085=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225085 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225083=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225083 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6747) Adding ExternalTransform in JavaSDK

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6747?focusedWorklogId=225084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225084 ] ASF GitHub Bot logged work on BEAM-6747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225079=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225079 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225075=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225075 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225074=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225074 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225078=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225078 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225077=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225077 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225076=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225076 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225069=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225069 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6825) Improve pipeline construction time error messages in Go SDK.

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6825?focusedWorklogId=225067=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225067 ] ASF GitHub Bot logged work on BEAM-6825: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6769) BigQuery IO does not support bytes in Python 3

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6769?focusedWorklogId=225059=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225059 ] ASF GitHub Bot logged work on BEAM-6769: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3279) Deprecate and remove Coder consistentWithEquals in favor of overriding structuredValue

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3279?focusedWorklogId=225058=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225058 ] ASF GitHub Bot logged work on BEAM-3279: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225057=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225057 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813547#comment-16813547 ] Reuven Lax commented on BEAM-7042: -- though I'm a bit confused as to why antlr depends on jsonp at all :P

[jira] [Work logged] (BEAM-7029) Support KafkaIO to be configured externally for use with other SDKs

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7029?focusedWorklogId=225055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225055 ] ASF GitHub Bot logged work on BEAM-7029: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7042) [regression] org.apache.beam:beam-sdks-java-core:jar:2.12.0 dependencies are way fatter and conflicting than before

2019-04-09 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813541#comment-16813541 ] Reuven Lax commented on BEAM-7042: -- Yes, I do believe it needs to be in core. Schema select-statement

[jira] [Work logged] (BEAM-4087) Gradle build does not allow to overwrite versions of provided dependencies

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4087?focusedWorklogId=225047=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225047 ] ASF GitHub Bot logged work on BEAM-4087: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7038) coder changes are incompatible with dataflow update operation

2019-04-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813533#comment-16813533 ] Kenneth Knowles commented on BEAM-7038: --- It appears that Combine with hotkey fanout uses a Java

[jira] [Work logged] (BEAM-7041) JdbcIO should not wrap the provided datasource if it's already a pollable one

2019-04-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7041?focusedWorklogId=225042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-225042 ] ASF GitHub Bot logged work on BEAM-7041: Author: ASF GitHub Bot

  1   2   >