[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631522462 Run Java postcommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631583545 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631583361 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631583181 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631598650 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tvalentyn commented on pull request #11707: [BEAM-9810] Add a Tox (precommit) suite for Python 3.8

2020-05-20 Thread GitBox
tvalentyn commented on pull request #11707: URL: https://github.com/apache/beam/pull/11707#issuecomment-631622571 Thanks! Let's merge this once BEAM-9994 is closed. I will add comments there. This is an automated message

[GitHub] [beam] chamikaramj commented on pull request #11757: [BEAM-8019] Clarifies Dataflow execution environment model

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11757: URL: https://github.com/apache/beam/pull/11757#issuecomment-631637932 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pulasthi commented on a change in pull request #10888: [BEAM-7304] Twister2 Beam runner

2020-05-20 Thread GitBox
pulasthi commented on a change in pull request #10888: URL: https://github.com/apache/beam/pull/10888#discussion_r428226234 ## File path: runners/twister2/src/main/java/org/apache/beam/runners/twister2/Twister2LegacyRunner.java ## @@ -0,0 +1,339 @@ +/* + * Licensed to the

[GitHub] [beam] nielm commented on a change in pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
nielm commented on a change in pull request #11529: URL: https://github.com/apache/beam/pull/11529#discussion_r428235563 ## File path: sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIOWriteTest.java ## @@ -263,6 +263,17 @@ private

[GitHub] [beam] TheNeuralBit commented on pull request #11754: [BEAM-10037] BeamSqlExample.java fails to build

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11754: URL: https://github.com/apache/beam/pull/11754#issuecomment-631665220 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] lukecwik commented on a change in pull request #11746: [BEAM-10028] Add support for the state backed iterable coder to the Java SDK harness.

2020-05-20 Thread GitBox
lukecwik commented on a change in pull request #11746: URL: https://github.com/apache/beam/pull/11746#discussion_r428246537 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/state/StateBackedIterable.java ## @@ -0,0 +1,223 @@ +/* + * Licensed to the

[GitHub] [beam] chamikaramj commented on pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11360: URL: https://github.com/apache/beam/pull/11360#issuecomment-631668418 LGTM. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] chamikaramj commented on pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11360: URL: https://github.com/apache/beam/pull/11360#issuecomment-631668518 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] youngoli commented on pull request #11763: [BEAM-9978] Adding functionality and tests to Go offset range tracker.

2020-05-20 Thread GitBox
youngoli commented on pull request #11763: URL: https://github.com/apache/beam/pull/11763#issuecomment-631668755 R: @lostluck This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] TheNeuralBit commented on pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11529: URL: https://github.com/apache/beam/pull/11529#issuecomment-631668950 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] nielm commented on a change in pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
nielm commented on a change in pull request #11529: URL: https://github.com/apache/beam/pull/11529#discussion_r428246820 ## File path: sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIOWriteTest.java ## @@ -263,6 +263,17 @@ private

[GitHub] [beam] youngoli opened a new pull request #11763: [BEAM-9978] Adding functionality and tests to Go offset range tracker.

2020-05-20 Thread GitBox
youngoli opened a new pull request #11763: URL: https://github.com/apache/beam/pull/11763 Pretty simple. Moves some commonly desired behaviors out of the SDF code and into the offset range tracker/restriction code + adds tests. Thank you for your

[GitHub] [beam] nielm removed a comment on pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
nielm removed a comment on pull request #11529: URL: https://github.com/apache/beam/pull/11529#issuecomment-630491891 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] chamikaramj commented on pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11360: URL: https://github.com/apache/beam/pull/11360#issuecomment-631669059 I can "squash and merge" after tests pass. Feel free to squash/fixup commits if you need more than one commit.

[GitHub] [beam] nielm commented on pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
nielm commented on pull request #11529: URL: https://github.com/apache/beam/pull/11529#issuecomment-631668908 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] epicfaace opened a new pull request #11760: Fix grammar / spelling

2020-05-20 Thread GitBox
epicfaace opened a new pull request #11760: URL: https://github.com/apache/beam/pull/11760 Fix grammar / spelling in code comments. R: @kamilwu Post-Commit Tests Status (on master branch)

[GitHub] [beam] veblush commented on pull request #11651: [BEAM-8889] Upgrades gcsio to 2.1.3

2020-05-20 Thread GitBox
veblush commented on pull request #11651: URL: https://github.com/apache/beam/pull/11651#issuecomment-631632732 This is the result of linkage chekcer. (it was challenging because it seems to require Java8 strictly to finish it smoothly) ``` # /bin/bash

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631645585 heh no worries. I'll discuss with @jaketf to see what we do... This is an automated message from the Apache Git

[GitHub] [beam] aaltay commented on pull request #11744: [BEAM-10007] Handle ValueProvider pipeline options in PortableRunner

2020-05-20 Thread GitBox
aaltay commented on pull request #11744: URL: https://github.com/apache/beam/pull/11744#issuecomment-631658770 > Somehow this seems to introduce an additional flake in `SdkWorkerMainTest`. I can't replicate it locally... I suspect it only occurs when pipeline options get polluted from

[GitHub] [beam] lukecwik commented on a change in pull request #11746: [BEAM-10028] Add support for the state backed iterable coder to the Java SDK harness.

2020-05-20 Thread GitBox
lukecwik commented on a change in pull request #11746: URL: https://github.com/apache/beam/pull/11746#discussion_r428246181 ## File path: runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/ModelCoders.java ## @@ -59,6 +60,14 @@ private

[GitHub] [beam] aaltay commented on pull request #11744: [BEAM-10007] Handle ValueProvider pipeline options in PortableRunner

2020-05-20 Thread GitBox
aaltay commented on pull request #11744: URL: https://github.com/apache/beam/pull/11744#issuecomment-631667834 > test_parse_pipeline_options This test is a bit flawed. `expected_options.get_all_options()` could return all registered options. Test is assuming that no other option

[GitHub] [beam] TheNeuralBit commented on pull request #11701: [BEAM-9899] Fix some issues around storing schema `id` on user types

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11701: URL: https://github.com/apache/beam/pull/11701#issuecomment-631633755 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] tvalentyn commented on pull request #11738: [BEAM-9936] Create SDK harness containers with Python 3.8

2020-05-20 Thread GitBox
tvalentyn commented on pull request #11738: URL: https://github.com/apache/beam/pull/11738#issuecomment-631640224 Awesome, thank you! I also opened BEAM-10046 to make sure Python 3.8 is reflected in the Beam release.

[GitHub] [beam] TheNeuralBit commented on pull request #11744: [BEAM-10007] Handle ValueProvider pipeline options in PortableRunner

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11744: URL: https://github.com/apache/beam/pull/11744#issuecomment-631653792 Somehow this seems to introduce an additional flake in `SdkWorkerMainTest`. I can't replicate it locally... I suspect it only occurs when pipeline options get polluted from

[GitHub] [beam] TheNeuralBit edited a comment on pull request #11575: [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform

2020-05-20 Thread GitBox
TheNeuralBit edited a comment on pull request #11575: URL: https://github.com/apache/beam/pull/11575#issuecomment-631666570 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] epicfaace commented on pull request #11759: [BEAM-9926] Docs - show placeholder code snippets if code snippets are unavailable

2020-05-20 Thread GitBox
epicfaace commented on pull request #11759: URL: https://github.com/apache/beam/pull/11759#issuecomment-631565034 @pabloem This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631585052 Run Java Postcommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11755: [BEAM-10038] Add script to mass-comment Jenkins triggers on PR

2020-05-20 Thread GitBox
TheNeuralBit commented on a change in pull request #11755: URL: https://github.com/apache/beam/pull/11755#discussion_r428148051 ## File path: release/src/main/scripts/mass_comment.py ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631585200 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631585253 Run Java Postcommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TheNeuralBit commented on pull request #11754: [BEAM-10037] BeamSqlExample.java fails to build

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11754: URL: https://github.com/apache/beam/pull/11754#issuecomment-631585754 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] tvalentyn commented on pull request #11738: [BEAM-9936] Create SDK harness containers with Python 3.8

2020-05-20 Thread GitBox
tvalentyn commented on pull request #11738: URL: https://github.com/apache/beam/pull/11738#issuecomment-631629202 Run Python Dataflow ValidatesContainer This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] TheNeuralBit commented on pull request #11575: [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11575: URL: https://github.com/apache/beam/pull/11575#issuecomment-631629222 I plan to merge when CI is green This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] ibzib commented on pull request #11738: [BEAM-9936] Create SDK harness containers with Python 3.8

2020-05-20 Thread GitBox
ibzib commented on pull request #11738: URL: https://github.com/apache/beam/pull/11738#issuecomment-631639325 > > @ibzib Do you know if we will need to update release instructions to make sure we build and release Python 3.8 containers for future releases? (It may be done in a future PR).

[GitHub] [beam] TheNeuralBit commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631643889 @pabloem I'm fine with adding the test data in this PR if you are. Sorry to jump in with a random comment.

[GitHub] [beam] lukecwik commented on pull request #11406: [BEAM-9748] Refactor Reparallelize as an alternative Reshuffle implementation

2020-05-20 Thread GitBox
lukecwik commented on pull request #11406: URL: https://github.com/apache/beam/pull/11406#issuecomment-631656387 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] y1chi commented on a change in pull request #11756: [BEAM-9603] Add timer family support to FnApiDoFnRunner

2020-05-20 Thread GitBox
y1chi commented on a change in pull request #11756: URL: https://github.com/apache/beam/pull/11756#discussion_r428242655 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -460,14 +461,22 @@ public void accept(WindowedValue

[GitHub] [beam] y1chi commented on a change in pull request #11756: [BEAM-9603] Add timer family support to FnApiDoFnRunner

2020-05-20 Thread GitBox
y1chi commented on a change in pull request #11756: URL: https://github.com/apache/beam/pull/11756#discussion_r428241083 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -460,14 +461,22 @@ public void accept(WindowedValue

[GitHub] [beam] lukecwik commented on a change in pull request #11406: [BEAM-9748] Refactor Reparallelize as an alternative Reshuffle implementation

2020-05-20 Thread GitBox
lukecwik commented on a change in pull request #11406: URL: https://github.com/apache/beam/pull/11406#discussion_r428239285 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Reshuffle.java ## @@ -107,10 +108,57 @@ public void processElement( /**

[GitHub] [beam] y1chi commented on a change in pull request #11756: [BEAM-9603] Add timer family support to FnApiDoFnRunner

2020-05-20 Thread GitBox
y1chi commented on a change in pull request #11756: URL: https://github.com/apache/beam/pull/11756#discussion_r428241263 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -1207,15 +1224,51 @@ private void output(Instant

[GitHub] [beam] TheNeuralBit commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631591988 This PR is almost 300k lines, it seems to mostly be due to committing a lot of JSON test data, which isn't ideal. Is there any way to store that test data elsewhere?

[GitHub] [beam] pabloem commented on pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-05-20 Thread GitBox
pabloem commented on pull request #11086: URL: https://github.com/apache/beam/pull/11086#issuecomment-631609774 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] jaketf commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
jaketf commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631609714 We could stage these / pull these in from GCS. This will mean devs would need access to this bucket to run the tests.

[GitHub] [beam] lukecwik commented on pull request #11406: [BEAM-9748] Refactor Reparallelize as an alternative Reshuffle implementation

2020-05-20 Thread GitBox
lukecwik commented on pull request #11406: URL: https://github.com/apache/beam/pull/11406#issuecomment-631612221 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11575: [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform

2020-05-20 Thread GitBox
TheNeuralBit commented on a change in pull request #11575: URL: https://github.com/apache/beam/pull/11575#discussion_r428198550 ## File path: sdks/python/apache_beam/transforms/sql.py ## @@ -31,8 +31,15 @@ __all__ = ['SqlTransform'] +_SQL_PLANNERS = { +'zetasql':

[GitHub] [beam] TheNeuralBit commented on pull request #11575: [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11575: URL: https://github.com/apache/beam/pull/11575#issuecomment-631628284 Run XVR_Flink PostCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] tvalentyn commented on pull request #11738: [BEAM-9936] Create SDK harness containers with Python 3.8

2020-05-20 Thread GitBox
tvalentyn commented on pull request #11738: URL: https://github.com/apache/beam/pull/11738#issuecomment-631628792 @ibzib Do you know if we will need to update release instructions to make sure we build and release Python 3.8 containers for future releases? (It may be done in a future PR).

[GitHub] [beam] ibzib commented on pull request #11738: [BEAM-9936] Create SDK harness containers with Python 3.8

2020-05-20 Thread GitBox
ibzib commented on pull request #11738: URL: https://github.com/apache/beam/pull/11738#issuecomment-631634279 > @ibzib Do you know if we will need to update release instructions to make sure we build and release Python 3.8 containers for future releases? (It may be done in a future PR).

[GitHub] [beam] ibzib commented on pull request #11403: [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch

2020-05-20 Thread GitBox
ibzib commented on pull request #11403: URL: https://github.com/apache/beam/pull/11403#issuecomment-631641621 Run Release Gradle Build This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] lukecwik commented on pull request #11406: [BEAM-9748] Refactor Reparallelize as an alternative Reshuffle implementation

2020-05-20 Thread GitBox
lukecwik commented on pull request #11406: URL: https://github.com/apache/beam/pull/11406#issuecomment-631647633 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] HuangLED commented on a change in pull request #11746: [BEAM-10028] Add support for the state backed iterable coder to the Java SDK harness.

2020-05-20 Thread GitBox
HuangLED commented on a change in pull request #11746: URL: https://github.com/apache/beam/pull/11746#discussion_r427657090 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/state/StateBackedIterable.java ## @@ -0,0 +1,223 @@ +/* + * Licensed to the

[GitHub] [beam] pabloem merged pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem merged pull request #11596: URL: https://github.com/apache/beam/pull/11596 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] epicfaace opened a new pull request #11762: [BEAM-10044] Remove curly quotes from documentation code samples

2020-05-20 Thread GitBox
epicfaace opened a new pull request #11762: URL: https://github.com/apache/beam/pull/11762 Remove curly quotes from documentation code samples. R: @pabloem It might be good to add a CI check for markdown formatting in the future. Post-Commit Tests Status (on master branch)

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631582267 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631595939 Run Java Postcommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on pull request #11744: [BEAM-10007] Handle ValueProvider pipeline options in PortableRunner

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11744: URL: https://github.com/apache/beam/pull/11744#issuecomment-631630548 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] ibzib commented on a change in pull request #11755: [BEAM-10038] Add script to mass-comment Jenkins triggers on PR

2020-05-20 Thread GitBox
ibzib commented on a change in pull request #11755: URL: https://github.com/apache/beam/pull/11755#discussion_r428217875 ## File path: release/src/main/scripts/mass_comment.py ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] [beam] robertwb commented on a change in pull request #11701: [BEAM-9899] Fix some issues around storing schema `id` on user types

2020-05-20 Thread GitBox
robertwb commented on a change in pull request #11701: URL: https://github.com/apache/beam/pull/11701#discussion_r428217917 ## File path: sdks/python/apache_beam/coders/row_coder.py ## @@ -134,19 +134,18 @@ def __init__(self, schema, components): def encode_to_stream(self,

[GitHub] [beam] TheNeuralBit commented on pull request #11754: [BEAM-10037] BeamSqlExample.java fails to build

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11754: URL: https://github.com/apache/beam/pull/11754#issuecomment-631654862 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on pull request #11744: [BEAM-10007] Handle ValueProvider pipeline options in PortableRunner

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11744: URL: https://github.com/apache/beam/pull/11744#issuecomment-631661434 ``` self = def test_parse_pipeline_options(self): expected_options = PipelineOptions([]) expected_options.view_as(

[GitHub] [beam] epicfaace opened a new pull request #11759: [BEAM-9926] Docs - show placeholder code snippets if code snippets are unavailable

2020-05-20 Thread GitBox
epicfaace opened a new pull request #11759: URL: https://github.com/apache/beam/pull/11759 Fix an issue where if the language setting in the docs is toggled to something like Python, all examples that were only in Java disappeared completely. Usually, docs would look like this (in

[GitHub] [beam] rionmonster opened a new pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-05-20 Thread GitBox
rionmonster opened a new pull request #11761: URL: https://github.com/apache/beam/pull/11761 In this PR, you can find a fork of the latest version of all of the current Java Beam Katas that have been ported to use Kotlin with the associated conversions and dependencies made. A

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631584938 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631584876 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lazylynx commented on pull request #11707: [BEAM-9810] Add a Tox (precommit) suite for Python 3.8

2020-05-20 Thread GitBox
lazylynx commented on pull request #11707: URL: https://github.com/apache/beam/pull/11707#issuecomment-631604104 LGTM, Thanks! I checked pydoc generated with `py38-docs` to make sure and it's OK. This is an automated

[GitHub] [beam] chamikaramj commented on a change in pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on a change in pull request #11360: URL: https://github.com/apache/beam/pull/11360#discussion_r428215342 ## File path: sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeIO.java ## @@ -0,0 +1,735 @@ +/* + * Licensed to the

[GitHub] [beam] TheNeuralBit commented on pull request #11701: [BEAM-9899] Fix some issues around storing schema `id` on user types

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11701: URL: https://github.com/apache/beam/pull/11701#issuecomment-631649461 Run XVR_Spark PostCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11701: [BEAM-9899] Fix some issues around storing schema `id` on user types

2020-05-20 Thread GitBox
TheNeuralBit commented on a change in pull request #11701: URL: https://github.com/apache/beam/pull/11701#discussion_r428223966 ## File path: sdks/python/apache_beam/coders/row_coder.py ## @@ -134,19 +134,18 @@ def __init__(self, schema, components): def

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
TheNeuralBit commented on a change in pull request #11529: URL: https://github.com/apache/beam/pull/11529#discussion_r428237904 ## File path: sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIOWriteTest.java ## @@ -263,6 +263,17 @@

[GitHub] [beam] davidcavazos commented on pull request #10165: [BEAM-7390] Add code snippet for GroupIntoBatches

2020-05-20 Thread GitBox
davidcavazos commented on pull request #10165: URL: https://github.com/apache/beam/pull/10165#issuecomment-631659989 @aaltay sorry for the delay on this, this should be ready for review. This is an automated message from the

[GitHub] [beam] stale[bot] commented on pull request #10165: [BEAM-7390] Add code snippet for GroupIntoBatches

2020-05-20 Thread GitBox
stale[bot] commented on pull request #10165: URL: https://github.com/apache/beam/pull/10165#issuecomment-631659293 This pull request is no longer marked as stale. This is an automated message from the Apache Git Service.

[GitHub] [beam] DariuszAniszewski commented on a change in pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
DariuszAniszewski commented on a change in pull request #11360: URL: https://github.com/apache/beam/pull/11360#discussion_r428244242 ## File path: sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeIO.java ## @@ -0,0 +1,735 @@ +/* + * Licensed to

[GitHub] [beam] TheNeuralBit commented on pull request #11575: [BEAM-9699] Add test verifying we can use ZetaSQL in Python SqlTransform

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11575: URL: https://github.com/apache/beam/pull/11575#issuecomment-631666570 XVR Flink [passed](https://builds.apache.org/job/beam_PostCommit_XVR_Flink_PR/100] before the package-info run, so I won't do it again

[GitHub] [beam] chamikaramj commented on pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11360: URL: https://github.com/apache/beam/pull/11360#issuecomment-631669498 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11529: URL: https://github.com/apache/beam/pull/11529#issuecomment-631669226 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631523853 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lukecwik commented on a change in pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
lukecwik commented on a change in pull request #11596: URL: https://github.com/apache/beam/pull/11596#discussion_r428095390 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java ## @@ -472,24 +523,77 @@ public void

[GitHub] [beam] nfisher commented on a change in pull request #11732: [BEAM-10017] Expose Cassandra Connect and Read timeouts

2020-05-20 Thread GitBox
nfisher commented on a change in pull request #11732: URL: https://github.com/apache/beam/pull/11732#discussion_r428008097 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraIO.java ## @@ -330,6 +331,24 @@ private CassandraIO() {}

[GitHub] [beam] kamilwu commented on pull request #11707: [BEAM-9810] Add a Tox (precommit) suite for Python 3.8

2020-05-20 Thread GitBox
kamilwu commented on pull request #11707: URL: https://github.com/apache/beam/pull/11707#issuecomment-631472237 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] RyanSkraba commented on a change in pull request #10888: [BEAM-7304] Twister2 Beam runner

2020-05-20 Thread GitBox
RyanSkraba commented on a change in pull request #10888: URL: https://github.com/apache/beam/pull/10888#discussion_r427878327 ## File path: runners/twister2/src/main/java/org/apache/beam/runners/twister2/Twister2PipelineOptions.java ## @@ -0,0 +1,93 @@ +/* + * Licensed to the

[GitHub] [beam] kamilwu commented on pull request #11707: [BEAM-9810] Add a Tox (precommit) suite for Python 3.8

2020-05-20 Thread GitBox
kamilwu commented on pull request #11707: URL: https://github.com/apache/beam/pull/11707#issuecomment-631500053 > We need to address BEAM-9994 before we can merge this. I think we get it. Please see the description of the issue. However, I'm a bit worried about the time needed

[GitHub] [beam] ibzib commented on a change in pull request #11755: [BEAM-10038] Add script to mass-comment Jenkins triggers on PR

2020-05-20 Thread GitBox
ibzib commented on a change in pull request #11755: URL: https://github.com/apache/beam/pull/11755#discussion_r428096074 ## File path: release/src/main/scripts/mass_comment.py ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] [beam] mwalenia commented on a change in pull request #11566: [BEAM-9723] Add DLP integration transforms

2020-05-20 Thread GitBox
mwalenia commented on a change in pull request #11566: URL: https://github.com/apache/beam/pull/11566#discussion_r428033761 ## File path: sdks/java/extensions/ml/build.gradle ## @@ -26,15 +28,23 @@ description = 'Apache Beam :: SDKs :: Java :: Extensions :: ML' dependencies

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631521398 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11339: [BEAM-9468] Fhir io

2020-05-20 Thread GitBox
pabloem commented on pull request #11339: URL: https://github.com/apache/beam/pull/11339#issuecomment-631521592 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
pabloem commented on pull request #11596: URL: https://github.com/apache/beam/pull/11596#issuecomment-631522261 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] nfisher commented on a change in pull request #11732: [BEAM-10017] Expose Cassandra Connect and Read timeouts

2020-05-20 Thread GitBox
nfisher commented on a change in pull request #11732: URL: https://github.com/apache/beam/pull/11732#discussion_r428007520 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraIO.java ## @@ -106,19 +107,13 @@ * * Cassandra Socket

[GitHub] [beam] lukecwik commented on a change in pull request #11596: [BEAM-9856] Optimization/hl7v2 io list messages

2020-05-20 Thread GitBox
lukecwik commented on a change in pull request #11596: URL: https://github.com/apache/beam/pull/11596#discussion_r428107636 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java ## @@ -427,39 +458,59 @@ private

[GitHub] [beam] DariuszAniszewski commented on a change in pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
DariuszAniszewski commented on a change in pull request #11360: URL: https://github.com/apache/beam/pull/11360#discussion_r427993794 ## File path: sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/SnowflakeIO.java ## @@ -0,0 +1,735 @@ +/* + * Licensed to

[GitHub] [beam] TheNeuralBit commented on pull request #11529: [BEAM-9822] Simplify pipeline when batching is disabled.

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11529: URL: https://github.com/apache/beam/pull/11529#issuecomment-631676277 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] lukecwik commented on pull request #11715: [BEAM-9977] Implement GrowableOffsetRangeTracker

2020-05-20 Thread GitBox
lukecwik commented on pull request #11715: URL: https://github.com/apache/beam/pull/11715#issuecomment-631722098 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] chamikaramj commented on pull request #11651: [BEAM-8889] Upgrades gcsio to 2.1.3

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11651: URL: https://github.com/apache/beam/pull/11651#issuecomment-631745259 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] chamikaramj commented on pull request #11360: [BEAM-9722] added SnowflakeIO with Read operation

2020-05-20 Thread GitBox
chamikaramj commented on pull request #11360: URL: https://github.com/apache/beam/pull/11360#issuecomment-631745574 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on pull request #11651: [BEAM-8889] Upgrades gcsio to 2.1.3

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11651: URL: https://github.com/apache/beam/pull/11651#issuecomment-631748270 whoops This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] TheNeuralBit commented on pull request #11651: [BEAM-8889] Upgrades gcsio to 2.1.3

2020-05-20 Thread GitBox
TheNeuralBit commented on pull request #11651: URL: https://github.com/apache/beam/pull/11651#issuecomment-631748120 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message,

  1   2   3   >