[GitHub] [beam] vmarquez commented on a change in pull request #10546: [BEAM-9008] Add CassandraIO readAll method

2020-06-02 Thread GitBox
vmarquez commented on a change in pull request #10546: URL: https://github.com/apache/beam/pull/10546#discussion_r434318846 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraIO.java ## @@ -370,384 +488,16 @@ private CassandraIO() {}

[GitHub] [beam] vmarquez commented on a change in pull request #10546: [BEAM-9008] Add CassandraIO readAll method

2020-06-02 Thread GitBox
vmarquez commented on a change in pull request #10546: URL: https://github.com/apache/beam/pull/10546#discussion_r434318532 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraIO.java ## @@ -326,7 +371,78 @@ private CassandraIO() {}

[GitHub] [beam] pabloem commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637963899 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] vmarquez commented on a change in pull request #10546: [BEAM-9008] Add CassandraIO readAll method

2020-06-02 Thread GitBox
vmarquez commented on a change in pull request #10546: URL: https://github.com/apache/beam/pull/10546#discussion_r434304763 ## File path: sdks/java/io/cassandra/src/test/java/org/apache/beam/sdk/io/cassandra/CassandraIOTest.java ## @@ -480,66 +527,22 @@ public void testCustomM

[GitHub] [beam] vmarquez commented on a change in pull request #10546: [BEAM-9008] Add CassandraIO readAll method

2020-06-02 Thread GitBox
vmarquez commented on a change in pull request #10546: URL: https://github.com/apache/beam/pull/10546#discussion_r434303784 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraIO.java ## @@ -326,7 +371,78 @@ private CassandraIO() {}

[GitHub] [beam] henryken commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
henryken commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637946055 We've made it! 🙌 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] pabloem commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637945801 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] pabloem commented on pull request #11780: [BEAM-9948] Uploading mascot to the website

2020-06-02 Thread GitBox
pabloem commented on pull request #11780: URL: https://github.com/apache/beam/pull/11780#issuecomment-637938193 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] aijamalnk commented on pull request #11780: [BEAM-9948] Uploading mascot to the website

2020-06-02 Thread GitBox
aijamalnk commented on pull request #11780: URL: https://github.com/apache/beam/pull/11780#issuecomment-637937054 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] aijamalnk commented on pull request #11780: [BEAM-9948] Uploading mascot to the website

2020-06-02 Thread GitBox
aijamalnk commented on pull request #11780: URL: https://github.com/apache/beam/pull/11780#issuecomment-637936990 @iemejia can you try merging now? I've tried to rebase the change onto master This is an automated message from

[GitHub] [beam] aijamalnk commented on pull request #11780: [BEAM-9948] Uploading mascot to the website

2020-06-02 Thread GitBox
aijamalnk commented on pull request #11780: URL: https://github.com/apache/beam/pull/11780#issuecomment-637936845 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] boyuanzz commented on pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11749: URL: https://github.com/apache/beam/pull/11749#issuecomment-637922023 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [beam] boyuanzz commented on pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11894: URL: https://github.com/apache/beam/pull/11894#issuecomment-637921787 @robertwb Please take another look : ) A simple clear timer support is added to FnApiRunner. Thanks! This is an

[GitHub] [beam] jaketf commented on a change in pull request #11862: [BEAM-10141] HL7v2 io timestamps / watermark estimate

2020-06-02 Thread GitBox
jaketf commented on a change in pull request #11862: URL: https://github.com/apache/beam/pull/11862#discussion_r434278353 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java ## @@ -179,25 +189,51 @@ public static Li

[GitHub] [beam] jaketf commented on pull request #11702: [BEAM-9990] Add Conditional Update and Conditional Create to FhirIO

2020-06-02 Thread GitBox
jaketf commented on pull request #11702: URL: https://github.com/apache/beam/pull/11702#issuecomment-637901651 @pabloem yes PTAL. I've removed one of the transforms because just in writing the tests I realized this was too difficult an interface to use. --

[GitHub] [beam] jaketf removed a comment on pull request #11702: [BEAM-9990] Add Conditional Update and Conditional Create to FhirIO

2020-06-02 Thread GitBox
jaketf removed a comment on pull request #11702: URL: https://github.com/apache/beam/pull/11702#issuecomment-628285515 To highlight just the latest changes to FhirIO you can take a look at [this PR on my fork](https://github.com/jaketf/beam/pull/1/files) --

[GitHub] [beam] aaltay merged pull request #11779: [BEAM-10055] Add --region to python examples where it was missing

2020-06-02 Thread GitBox
aaltay merged pull request #11779: URL: https://github.com/apache/beam/pull/11779 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [beam] aaltay merged pull request #11682: [BEAM-9946] | added new api in Partition Transform

2020-06-02 Thread GitBox
aaltay merged pull request #11682: URL: https://github.com/apache/beam/pull/11682 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [beam] aaltay merged pull request #11885: Add a GCThrashingPerPeriod option for MemoryMonitor

2020-06-02 Thread GitBox
aaltay merged pull request #11885: URL: https://github.com/apache/beam/pull/11885 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [beam] ibzib commented on pull request #11902: [BEAM-10168] Add Github 'publish release' to release guide

2020-06-02 Thread GitBox
ibzib commented on pull request #11902: URL: https://github.com/apache/beam/pull/11902#issuecomment-637893319 Brian, if you want, you can try to "verify" the release by making sure the tag's signature matches whatever Github expects. But I don't think it's too important so I'm merging this

[GitHub] [beam] ibzib merged pull request #11902: [BEAM-10168] Add Github 'publish release' to release guide

2020-06-02 Thread GitBox
ibzib merged pull request #11902: URL: https://github.com/apache/beam/pull/11902 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] pabloem commented on pull request #11702: [BEAM-9990] Add Conditional Update and Conditional Create to FhirIO

2020-06-02 Thread GitBox
pabloem commented on pull request #11702: URL: https://github.com/apache/beam/pull/11702#issuecomment-637890525 should I take a look at the APIs for the transforms? This is an automated message from the Apache Git Service. To

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11901: Prototype schema-inferring Row constructor.

2020-06-02 Thread GitBox
TheNeuralBit commented on a change in pull request #11901: URL: https://github.com/apache/beam/pull/11901#discussion_r434246368 ## File path: sdks/python/apache_beam/transforms/sql.py ## @@ -74,3 +77,8 @@ def __init__(self, query, dialect=None): SqlTransformSchema(

[GitHub] [beam] TheNeuralBit commented on a change in pull request #11901: Prototype schema-inferring Row constructor.

2020-06-02 Thread GitBox
TheNeuralBit commented on a change in pull request #11901: URL: https://github.com/apache/beam/pull/11901#discussion_r434245470 ## File path: sdks/python/apache_beam/typehints/opcodes.py ## @@ -120,7 +120,7 @@ def get_iter(state, unused_arg): def symmetric_binary_op(state, u

[GitHub] [beam] ibzib opened a new pull request #11905: [BEAM-10132] Update Docker images in Flink runner page.

2020-06-02 Thread GitBox
ibzib opened a new pull request #11905: URL: https://github.com/apache/beam/pull/11905 R: @mxm Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](

[GitHub] [beam] TheNeuralBit opened a new pull request #11904: [DO NOT MERGE] Update Beam website to release 2.22.0

2020-06-02 Thread GitBox
TheNeuralBit opened a new pull request #11904: URL: https://github.com/apache/beam/pull/11904 Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpum

[GitHub] [beam] TheNeuralBit opened a new pull request #11903: Fix hub existence test in RC script

2020-06-02 Thread GitBox
TheNeuralBit opened a new pull request #11903: URL: https://github.com/apache/beam/pull/11903 The logic in this script is incorrect. `-z` checks if the command writes any output at all, and `which` always writes output. Post-Commit Tests Status (on master branch) ---

[GitHub] [beam] ibzib opened a new pull request #11902: [BEAM-10168] Add Github 'publish release' to release guide

2020-06-02 Thread GitBox
ibzib opened a new pull request #11902: URL: https://github.com/apache/beam/pull/11902 R: @TheNeuralBit Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose review

[GitHub] [beam] pabloem commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637874451 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] pabloem commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637875180 LGTM. I'll merge after tests pass. This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [beam] tvalentyn commented on pull request #11788: [BEAM-9785] Add Python 3.8 postcommit tests

2020-06-02 Thread GitBox
tvalentyn commented on pull request #11788: URL: https://github.com/apache/beam/pull/11788#issuecomment-637863213 Failed with: ``` 16:39:16 16:39:16 FAILURE: Build failed with an exception. 16:39:16 16:39:16 * What went wrong: 16:39:16 Could not determine the dependencies

[GitHub] [beam] tvalentyn commented on pull request #11788: [BEAM-9785] Add Python 3.8 postcommit tests

2020-06-02 Thread GitBox
tvalentyn commented on pull request #11788: URL: https://github.com/apache/beam/pull/11788#issuecomment-637862976 Run Python 3.6 PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] tvalentyn commented on pull request #11788: [BEAM-9785] Add Python 3.8 postcommit tests

2020-06-02 Thread GitBox
tvalentyn commented on pull request #11788: URL: https://github.com/apache/beam/pull/11788#issuecomment-637862778 Run Python 3.8 PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] boyuanzz commented on pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11894: URL: https://github.com/apache/beam/pull/11894#issuecomment-637860496 > Maybe better to list the runners that should skip instead so that we don't limit coverage for new/unknown runners? Re: @tweise It's kind of hard to do that since we have

[GitHub] [beam] apilloud commented on a change in pull request #11820: [BEAM-10093] ZetaSql Nexmark variant

2020-06-02 Thread GitBox
apilloud commented on a change in pull request #11820: URL: https://github.com/apache/beam/pull/11820#discussion_r434226724 ## File path: sdks/java/testing/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/zetasql/ZetaSqlQuery0.java ## @@ -0,0 +1,92 @@ +/* + * Licensed

[GitHub] [beam] robertwb merged pull request #11878: Remove conditional grpc imports.

2020-06-02 Thread GitBox
robertwb merged pull request #11878: URL: https://github.com/apache/beam/pull/11878 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] boyuanzz commented on pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11894: URL: https://github.com/apache/beam/pull/11894#issuecomment-637858581 Run Python Spark ValidatesRunner This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [beam] KevinGG commented on a change in pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
KevinGG commented on a change in pull request #11898: URL: https://github.com/apache/beam/pull/11898#discussion_r434227564 ## File path: sdks/python/apache_beam/io/gcp/bigquery.py ## @@ -1702,7 +1702,8 @@ def _get_destination_uri(self, temp_location): logging.debug("gcs_

[GitHub] [beam] robertwb commented on pull request #11901: Prototype schema-inferring Row constructor.

2020-06-02 Thread GitBox
robertwb commented on pull request #11901: URL: https://github.com/apache/beam/pull/11901#issuecomment-637855309 @TheNeuralBit Not try to overwhelm you, but I figured you'd be interested in this one. This is an automated me

[GitHub] [beam] robertwb opened a new pull request #11901: Prototype schema-inferring Row constructor.

2020-06-02 Thread GitBox
robertwb opened a new pull request #11901: URL: https://github.com/apache/beam/pull/11901 This allows easy construction of schemas with PCollections. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickl

[GitHub] [beam] tvalentyn commented on pull request #11788: [BEAM-9785] Add Python 3.8 postcommit tests

2020-06-02 Thread GitBox
tvalentyn commented on pull request #11788: URL: https://github.com/apache/beam/pull/11788#issuecomment-637855187 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] tvalentyn commented on pull request #11788: [BEAM-9785] Add Python 3.8 postcommit tests

2020-06-02 Thread GitBox
tvalentyn commented on pull request #11788: URL: https://github.com/apache/beam/pull/11788#issuecomment-637852060 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] robertwb merged pull request #11785: [BEAM-10063] Create a WontImplementError for skipping features.

2020-06-02 Thread GitBox
robertwb merged pull request #11785: URL: https://github.com/apache/beam/pull/11785 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] pabloem commented on a change in pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on a change in pull request #11898: URL: https://github.com/apache/beam/pull/11898#discussion_r434218178 ## File path: sdks/python/apache_beam/io/gcp/bigquery.py ## @@ -1702,7 +1702,8 @@ def _get_destination_uri(self, temp_location): logging.debug("gcs_

[GitHub] [beam] robertwb commented on a change in pull request #11766: [BEAM-10036] More flexible dataframes partitioning.

2020-06-02 Thread GitBox
robertwb commented on a change in pull request #11766: URL: https://github.com/apache/beam/pull/11766#discussion_r434217321 ## File path: sdks/python/apache_beam/dataframe/partitionings.py ## @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] robertwb commented on a change in pull request #11766: [BEAM-10036] More flexible dataframes partitioning.

2020-06-02 Thread GitBox
robertwb commented on a change in pull request #11766: URL: https://github.com/apache/beam/pull/11766#discussion_r434215127 ## File path: sdks/python/apache_beam/dataframe/expressions.py ## @@ -85,16 +87,10 @@ def evaluate_at(self, session): # type: (Session) -> T """Retu

[GitHub] [beam] aaltay merged pull request #11897: [BEAM-10177] Remove "Review Release Notes in JIRA" from release guide

2020-06-02 Thread GitBox
aaltay merged pull request #11897: URL: https://github.com/apache/beam/pull/11897 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [beam] robertwb commented on a change in pull request #11766: [BEAM-10036] More flexible dataframes partitioning.

2020-06-02 Thread GitBox
robertwb commented on a change in pull request #11766: URL: https://github.com/apache/beam/pull/11766#discussion_r434214501 ## File path: sdks/python/apache_beam/dataframe/partitionings.py ## @@ -0,0 +1,133 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] robertwb commented on pull request #11878: Remove conditional grpc imports.

2020-06-02 Thread GitBox
robertwb commented on pull request #11878: URL: https://github.com/apache/beam/pull/11878#issuecomment-637844453 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] KevinGG commented on a change in pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
KevinGG commented on a change in pull request #11898: URL: https://github.com/apache/beam/pull/11898#discussion_r434212247 ## File path: sdks/python/apache_beam/io/gcp/bigquery.py ## @@ -1702,7 +1702,8 @@ def _get_destination_uri(self, temp_location): logging.debug("gcs_

[GitHub] [beam] ibzib merged pull request #11880: [BEAM-10167] Fix 2.21.0 downloads link in blog post

2020-06-02 Thread GitBox
ibzib merged pull request #11880: URL: https://github.com/apache/beam/pull/11880 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] pabloem commented on pull request #11893: [BEAM-10175] use bearer token header instead of url param for token

2020-06-02 Thread GitBox
pabloem commented on pull request #11893: URL: https://github.com/apache/beam/pull/11893#issuecomment-637839937 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [beam] pabloem commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-02 Thread GitBox
pabloem commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-637831911 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] lukecwik merged pull request #11899: [BEAM-10179] Clean-up URNJavaDoFn workaround in Go SDK.

2020-06-02 Thread GitBox
lukecwik merged pull request #11899: URL: https://github.com/apache/beam/pull/11899 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] pabloem commented on a change in pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-02 Thread GitBox
pabloem commented on a change in pull request #11824: URL: https://github.com/apache/beam/pull/11824#discussion_r434194515 ## File path: sdks/python/apache_beam/io/httpio.py ## @@ -0,0 +1,167 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contrib

[GitHub] [beam] TheNeuralBit opened a new pull request #11900: [BEAM-10181] Always use python3 for license script virtualenv

2020-06-02 Thread GitBox
TheNeuralBit opened a new pull request #11900: URL: https://github.com/apache/beam/pull/11900 R: @udim Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow

[GitHub] [beam] Akshay-Iyangar commented on pull request #11396: [BEAM-9742] Add Configurable FluentBackoff to JdbcIO Write

2020-06-02 Thread GitBox
Akshay-Iyangar commented on pull request #11396: URL: https://github.com/apache/beam/pull/11396#issuecomment-637828525 @aromanenko-dev @lukecwik could you'll please have a look? Thanks This is an automated message from the

[GitHub] [beam] lukecwik commented on a change in pull request #11873: [BEAM-3489] DataflowRunner to read PubsubMessage if getNeedsMessageId is true

2020-06-02 Thread GitBox
lukecwik commented on a change in pull request #11873: URL: https://github.com/apache/beam/pull/11873#discussion_r434197026 ## File path: runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java ## @@ -1353,14 +1353,14 @@ public voi

[GitHub] [beam] lostluck commented on pull request #11899: [BEAM-10179] Clean-up URNJavaDoFn workaround in Go SDK.

2020-06-02 Thread GitBox
lostluck commented on pull request #11899: URL: https://github.com/apache/beam/pull/11899#issuecomment-637826896 Run Go PostCommit This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] lukecwik commented on pull request #11899: [BEAM-10179] Clean-up URNJavaDoFn workaround in Go SDK.

2020-06-02 Thread GitBox
lukecwik commented on pull request #11899: URL: https://github.com/apache/beam/pull/11899#issuecomment-637823925 R: @lostluck @youngoli This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [beam] lukecwik opened a new pull request #11899: [BEAM-10179] Clean-up URNJavaDoFn workaround in Go SDK.

2020-06-02 Thread GitBox
lukecwik opened a new pull request #11899: URL: https://github.com/apache/beam/pull/11899 Now that the SDK has migrated to use the Dataflow runner v2, this is no longer required. Thank you for your contribution! Follow this checklist to help us incorp

[GitHub] [beam] iemejia merged pull request #11888: [BEAM-10173] Upgrade zstd-jni to version 1.4.5-2

2020-06-02 Thread GitBox
iemejia merged pull request #11888: URL: https://github.com/apache/beam/pull/11888 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [beam] boyuanzz commented on pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11749: URL: https://github.com/apache/beam/pull/11749#issuecomment-637820927 > @boyuanzz Yes, afaik, it's used only for [performance testing](http://metrics.beam.apache.org/d/bnlHKP3Wz/java-io-it-tests-dataflow?panelId=21&fullscreen&orgId=1&from=158853992

[GitHub] [beam] pabloem commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-02 Thread GitBox
pabloem commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-637821019 ok just looking at this now... This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [beam] lukecwik commented on a change in pull request #11873: [BEAM-3489] DataflowRunner to read PubsubMessage if getNeedsMessageId is true

2020-06-02 Thread GitBox
lukecwik commented on a change in pull request #11873: URL: https://github.com/apache/beam/pull/11873#discussion_r434188515 ## File path: runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java ## @@ -1353,14 +1353,14 @@ public voi

[GitHub] [beam] iemejia commented on a change in pull request #10546: [BEAM-9008] Add CassandraIO readAll method

2020-06-02 Thread GitBox
iemejia commented on a change in pull request #10546: URL: https://github.com/apache/beam/pull/10546#discussion_r433896372 ## File path: sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/RingRange.java ## @@ -55,4 +58,9 @@ public boolean isWrapping() { p

[GitHub] [beam] rionmonster commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
rionmonster commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637814323 @henryken / @pabloem Thanks to both of you guys for helping me through this process, both in review and getting it merged in. I shot out an e-mail on the user mailing

[GitHub] [beam] tweise commented on a change in pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
tweise commented on a change in pull request #11894: URL: https://github.com/apache/beam/pull/11894#discussion_r434181735 ## File path: sdks/python/apache_beam/runners/portability/portable_runner_test.py ## @@ -241,7 +241,8 @@ def process(self, kv, index=beam.DoFn.StateParam(i

[GitHub] [beam] pabloem commented on pull request #11893: [BEAM-10175] use bearer token header instead of url param for token

2020-06-02 Thread GitBox
pabloem commented on pull request #11893: URL: https://github.com/apache/beam/pull/11893#issuecomment-637810880 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] boyuanzz commented on a change in pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
boyuanzz commented on a change in pull request #11894: URL: https://github.com/apache/beam/pull/11894#discussion_r434177432 ## File path: sdks/python/apache_beam/runners/portability/portable_runner_test.py ## @@ -241,7 +241,8 @@ def process(self, kv, index=beam.DoFn.StateParam

[GitHub] [beam] tweise commented on a change in pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
tweise commented on a change in pull request #11894: URL: https://github.com/apache/beam/pull/11894#discussion_r434176084 ## File path: sdks/python/apache_beam/runners/portability/portable_runner_test.py ## @@ -241,7 +241,8 @@ def process(self, kv, index=beam.DoFn.StateParam(i

[GitHub] [beam] aromanenko-dev commented on pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-02 Thread GitBox
aromanenko-dev commented on pull request #11749: URL: https://github.com/apache/beam/pull/11749#issuecomment-637806753 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [beam] aromanenko-dev commented on pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-02 Thread GitBox
aromanenko-dev commented on pull request #11749: URL: https://github.com/apache/beam/pull/11749#issuecomment-637806567 @boyuanzz Yes, afaik, it's used only for [performance testing](http://metrics.beam.apache.org/d/bnlHKP3Wz/java-io-it-tests-dataflow?panelId=21&fullscreen&orgId=1&from=15885

[GitHub] [beam] pabloem commented on pull request #11896: [BEAM-8841] Make bigquery_avro_tools_test py3 compatible

2020-06-02 Thread GitBox
pabloem commented on pull request #11896: URL: https://github.com/apache/beam/pull/11896#issuecomment-637806282 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] pabloem commented on a change in pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on a change in pull request #11898: URL: https://github.com/apache/beam/pull/11898#discussion_r434172894 ## File path: sdks/python/apache_beam/io/gcp/bigquery.py ## @@ -1702,7 +1702,8 @@ def _get_destination_uri(self, temp_location): logging.debug("gcs_

[GitHub] [beam] pabloem commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
pabloem commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637803100 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] KevinGG commented on pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
KevinGG commented on pull request #11898: URL: https://github.com/apache/beam/pull/11898#issuecomment-637798776 R: @pabloem PTAL, thx! This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [beam] KevinGG opened a new pull request #11898: [BEAM-10178] Improved error messages when option is not set

2020-06-02 Thread GitBox
KevinGG opened a new pull request #11898: URL: https://github.com/apache/beam/pull/11898 The error messages emit from bigquery io: 1. For Java SDK, updated error message when tempLocation is not set. 2. For Python SDK, updated error message when neither gcs_location nor temp_loca

[GitHub] [beam] dmvk commented on pull request #11889: [BEAM-10164] Flink Batch Runner: Memory efficient combine implementat…

2020-06-02 Thread GitBox
dmvk commented on pull request #11889: URL: https://github.com/apache/beam/pull/11889#issuecomment-637793402 Run Flink ValidatesRunner This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [beam] pabloem commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637793166 thanks a lot @rionmonster @henryken - I'd encourage you to announce on user@ or even write a blog post if you feel up to it : ) -

[GitHub] [beam] dmvk commented on pull request #11889: [BEAM-10164] Flink Batch Runner: Memory efficient combine implementat…

2020-06-02 Thread GitBox
dmvk commented on pull request #11889: URL: https://github.com/apache/beam/pull/11889#issuecomment-637792716 Run Flink Validates Runner This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [beam] pabloem commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637792899 Thank you! This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem merged pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem merged pull request #11761: URL: https://github.com/apache/beam/pull/11761 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [beam] boyuanzz commented on pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-02 Thread GitBox
boyuanzz commented on pull request #11894: URL: https://github.com/apache/beam/pull/11894#issuecomment-637786219 `test_pardo_timers_clear` doesn't work with multi-workers in fn_runner. Going to skip it with multi-workers. Th

[GitHub] [beam] pabloem commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637783954 unfortunately the ASF now only allows committers to trigger tests. Triggering... This is an automated message fr

[GitHub] [beam] pabloem commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637783731 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [beam] lukecwik merged pull request #11891: [BEAM-4766] Migrate to use vendored protobuf for bytestring

2020-06-02 Thread GitBox
lukecwik merged pull request #11891: URL: https://github.com/apache/beam/pull/11891 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] rionmonster commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
rionmonster commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637781876 retest this please This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [beam] rionmonster edited a comment on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
rionmonster edited a comment on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637781462 @pabloem Doh! It looks like one of the headers was missed. Just pushed up another commit to add that one. I don't know if I have the power to trigger a retest (

[GitHub] [beam] rionmonster commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
rionmonster commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637781462 @pabloem Doh! It looks like one of the headers was missed. Just pushed up another commit to add that one.

[GitHub] [beam] stale[bot] commented on pull request #10958: [BEAM] Submitting final communication strategy

2020-06-02 Thread GitBox
stale[bot] commented on pull request #10958: URL: https://github.com/apache/beam/pull/10958#issuecomment-637778766 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

[GitHub] [beam] TheNeuralBit opened a new pull request #11897: [BEAM-10177] Remove "Review Release Notes in JIRA" from release guide

2020-06-02 Thread GitBox
TheNeuralBit opened a new pull request #11897: URL: https://github.com/apache/beam/pull/11897 R: @aaltay Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflo

[GitHub] [beam] robertwb commented on a change in pull request #11785: [BEAM-10063] Create a WontImplementError for skipping features.

2020-06-02 Thread GitBox
robertwb commented on a change in pull request #11785: URL: https://github.com/apache/beam/pull/11785#discussion_r434143456 ## File path: sdks/python/apache_beam/dataframe/doctests.py ## @@ -242,6 +242,11 @@ def __init__(self, env, use_beam=True, **kwargs): **kwargs)

[GitHub] [beam] dmvk commented on pull request #11889: [BEAM-10164] Flink Batch Runner: Memory efficient combine implementat…

2020-06-02 Thread GitBox
dmvk commented on pull request #11889: URL: https://github.com/apache/beam/pull/11889#issuecomment-637769674 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [beam] pabloem commented on pull request #11893: [BEAM-10175] use bearer token header instead of url param for token

2020-06-02 Thread GitBox
pabloem commented on pull request #11893: URL: https://github.com/apache/beam/pull/11893#issuecomment-637768756 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [beam] pabloem commented on pull request #11893: [BEAM-10175] use bearer token header instead of url param for token

2020-06-02 Thread GitBox
pabloem commented on pull request #11893: URL: https://github.com/apache/beam/pull/11893#issuecomment-637768610 Run Java PostCommit This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [beam] TheNeuralBit edited a comment on pull request #11770: [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch (2.22.0)

2020-06-02 Thread GitBox
TheNeuralBit edited a comment on pull request #11770: URL: https://github.com/apache/beam/pull/11770#issuecomment-637764980 Failures in VR tests are all known and don't represent regressions: - Samza: testOutputTimestampDefault [BEAM-10025](https://issues.apache.org/jira/browse/BEAM-1002

[GitHub] [beam] TheNeuralBit commented on pull request #11770: [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch (2.22.0)

2020-06-02 Thread GitBox
TheNeuralBit commented on pull request #11770: URL: https://github.com/apache/beam/pull/11770#issuecomment-637764980 Failures in VR tests are all known and don't represent regressions: Samza: testOutputTimestampDefault [BEAM-10025](https://issues.apache.org/jira/browse/BEAM-10025) Spa

[GitHub] [beam] pabloem commented on pull request #11761: [BEAM-10027] Support for Kotlin-based Beam Katas

2020-06-02 Thread GitBox
pabloem commented on pull request #11761: URL: https://github.com/apache/beam/pull/11761#issuecomment-637764092 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [beam] chunyang commented on pull request #11896: [BEAM-8841] Make bigquery_avro_tools_test py3 compatible

2020-06-02 Thread GitBox
chunyang commented on pull request #11896: URL: https://github.com/apache/beam/pull/11896#issuecomment-637762788 R: @pabloem This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   >