[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] tvalentyn removed a comment on pull request #12524: [BEAM-10586] Remove Python 2.7 support in Dataflow runner.

tvalentyn removed a comment on pull request #12524: URL: https://github.com/apache/beam/pull/12524#issuecomment-697151217 Run Seed Job This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] tvalentyn commented on pull request #12524: [BEAM-10586] Remove Python 2.7 support in Dataflow runner.

tvalentyn commented on pull request #12524: URL: https://github.com/apache/beam/pull/12524#issuecomment-697151217 Run Seed Job This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] tvalentyn opened a new pull request #12524: [BEAM-10586] Remove Python 2.7 support in Dataflow runner.

tvalentyn opened a new pull request #12524: URL: https://github.com/apache/beam/pull/12524 Pre-Commit Tests Status (on master branch) --- |Java | Python | Go | Website --- | --- |

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] tvalentyn commented on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

tvalentyn commented on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697148902 Run Portable_Python PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] tvalentyn commented on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

tvalentyn commented on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697145496 Run Seed Job This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] tvalentyn closed pull request #12524: [BEAM-10586] Remove Python 2.7 support in Dataflow runner.

tvalentyn closed pull request #12524: URL: https://github.com/apache/beam/pull/12524 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-7372][BEAM-8371][BEAM-9372] Sunset Python 2 and Python 3.5 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-9372][BEAM-7372] Remove Py2 and Py35 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] tvalentyn commented on pull request #12911: [BEAM-9372][BEAM-7372] Remove Py2 and Py35 support.

tvalentyn commented on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697133199 Run Portable_Python PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] codecov[bot] edited a comment on pull request #12888: [BEAM-10861]Moves PubSub Runner API encoding to Read/Write transforms

codecov[bot] edited a comment on pull request #12888: URL: https://github.com/apache/beam/pull/12888#issuecomment-696562704 # [Codecov](https://codecov.io/gh/apache/beam/pull/12888?src=pr=h1) Report > Merging [#12888](https://codecov.io/gh/apache/beam/pull/12888?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12911: [BEAM-9372][BEAM-7372] Remove Py2 and Py35 support.

codecov[bot] edited a comment on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] commented on pull request #12911: [BEAM-9372][BEAM-7372] Remove Py2 and Py35 support.

codecov[bot] commented on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697122845 # [Codecov](https://codecov.io/gh/apache/beam/pull/12911?src=pr=h1) Report > Merging [#12911](https://codecov.io/gh/apache/beam/pull/12911?src=pr=desc) into

[GitHub] [beam] TheNeuralBit merged pull request #12906: [BEAM-7372] Drop Python 2 shims and update docstring in apache_beam.typehints.schemas

TheNeuralBit merged pull request #12906: URL: https://github.com/apache/beam/pull/12906 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] reuvenlax commented on a change in pull request #12864: [BEAM-10650] Windmill implementation for TimestampOrderedState

reuvenlax commented on a change in pull request #12864: URL: https://github.com/apache/beam/pull/12864#discussion_r493143979 ## File path: runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/WindmillStateInternals.java ## @@ -470,81

[GitHub] [beam] codecov[bot] commented on pull request #12909: [BEAM-9372][BEAM-9980] Configure Python versions for Spark Postcommit suite and Portable runner precommit suite.

codecov[bot] commented on pull request #12909: URL: https://github.com/apache/beam/pull/12909#issuecomment-697088493 # [Codecov](https://codecov.io/gh/apache/beam/pull/12909?src=pr=h1) Report > Merging [#12909](https://codecov.io/gh/apache/beam/pull/12909?src=pr=desc) into

[GitHub] [beam] TheNeuralBit merged pull request #12908: [BEAM-10871] Fix FhirLROIT tests (again)

TheNeuralBit merged pull request #12908: URL: https://github.com/apache/beam/pull/12908 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12909: [BEAM-9372][BEAM-9980] Configure Python versions for Spark Postcommit suite and Portable runner precommit suite.

codecov[bot] edited a comment on pull request #12909: URL: https://github.com/apache/beam/pull/12909#issuecomment-697088493 # [Codecov](https://codecov.io/gh/apache/beam/pull/12909?src=pr=h1) Report > Merging [#12909](https://codecov.io/gh/apache/beam/pull/12909?src=pr=desc) into

[GitHub] [beam] amaliujia commented on a change in pull request #12904: Add link issue for OrderedListState.

amaliujia commented on a change in pull request #12904: URL: https://github.com/apache/beam/pull/12904#discussion_r493188303 ## File path: runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java ## @@ -2044,6 +2044,7 @@ static

[GitHub] [beam] TheNeuralBit merged pull request #12882: [BEAM-10814][BEAM-10570] DataframeTransform outputs elements

TheNeuralBit merged pull request #12882: URL: https://github.com/apache/beam/pull/12882 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] ibzib commented on pull request #12910: Revert "[BEAM-9547] Raise NotImplementedError and WontImplementError …

ibzib commented on pull request #12910: URL: https://github.com/apache/beam/pull/12910#issuecomment-697068865 Filed BEAM-10954 for what looks like a new test flake This is an automated message from the Apache Git Service. To

[GitHub] [beam] tvalentyn merged pull request #12638: [BEAM-10769] Clarify Avro IO documentation.

tvalentyn merged pull request #12638: URL: https://github.com/apache/beam/pull/12638 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] TheNeuralBit merged pull request #12910: Revert "[BEAM-9547] Raise NotImplementedError and WontImplementError …

TheNeuralBit merged pull request #12910: URL: https://github.com/apache/beam/pull/12910 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] tvalentyn commented on pull request #12911: [BEAM-9372][BEAM-7372] Remove Py2 and Py35 support.

tvalentyn commented on pull request #12911: URL: https://github.com/apache/beam/pull/12911#issuecomment-697131756 Run Seed Job This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] ibzib commented on a change in pull request #12898: [BEAM-7372][BEAM-9980] Cleans up Flink precommit VR suite definition and makes Python version configurable.

ibzib commented on a change in pull request #12898: URL: https://github.com/apache/beam/pull/12898#discussion_r492443736 ## File path: sdks/python/test-suites/gradle.properties ## @@ -27,3 +27,7 @@ dataflow_chicago_taxi_example_task_py_versions=3.7 # direct test-suites

[GitHub] [beam] codecov[bot] commented on pull request #12762: Ensuring that BigQuery jobs are tagged with the Dataflow step that launches them

codecov[bot] commented on pull request #12762: URL: https://github.com/apache/beam/pull/12762#issuecomment-696459985 # [Codecov](https://codecov.io/gh/apache/beam/pull/12762?src=pr=h1) Report > Merging [#12762](https://codecov.io/gh/apache/beam/pull/12762?src=pr=desc) into

[GitHub] [beam] chamikaramj merged pull request #12853: [BEAM-3083] Sets sdk_harness_container_images property for all Dataflow Runner V2 jobs

chamikaramj merged pull request #12853: URL: https://github.com/apache/beam/pull/12853 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] tvalentyn merged pull request #12895: [BEAM-9372][BEAM-9980] Switches Flink VR suite to Py36 and makes the version configurable.

tvalentyn merged pull request #12895: URL: https://github.com/apache/beam/pull/12895 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] pabloem commented on pull request #12799: [BEAM-10603] Add record_pipeline, clear to RM and fix duration limiter

pabloem commented on pull request #12799: URL: https://github.com/apache/beam/pull/12799#issuecomment-696905097 thanks Sam! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] udim commented on a change in pull request #9907: [BEAM-4091] Pass type hints in ptransform_fn

udim commented on a change in pull request #9907: URL: https://github.com/apache/beam/pull/9907#discussion_r492965241 ## File path: sdks/python/apache_beam/options/pipeline_options.py ## @@ -476,6 +499,26 @@ def _add_argparse_args(cls, parser): 'time. NOTE: only

[GitHub] [beam] aromanenko-dev merged pull request #11459: [BEAM-2546] Add InfluxDbIO

aromanenko-dev merged pull request #11459: URL: https://github.com/apache/beam/pull/11459 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12806: [BEAM-10869] Make WriteToPubsub output serialized PubsubMessage proto bytes when using runner v2

codecov[bot] edited a comment on pull request #12806: URL: https://github.com/apache/beam/pull/12806#issuecomment-692876818 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem commented on pull request #12762: Ensuring that BigQuery jobs are tagged with the Dataflow step that launches them

pabloem commented on pull request #12762: URL: https://github.com/apache/beam/pull/12762#issuecomment-696374290 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] chamikaramj commented on a change in pull request #12888: [BEAM-10861]Moves PubSub Runner API encoding to Read/Write transforms

chamikaramj commented on a change in pull request #12888: URL: https://github.com/apache/beam/pull/12888#discussion_r492976506 ## File path: sdks/python/apache_beam/io/iobase.py ## @@ -992,6 +1012,43 @@ def expand(self, pcoll): 'A sink must inherit iobase.Sink,

[GitHub] [beam] dpmills commented on a change in pull request #12864: [BEAM-10650] Windmill implementation for TimestampOrderedState

dpmills commented on a change in pull request #12864: URL: https://github.com/apache/beam/pull/12864#discussion_r492927734 ## File path: runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/WindmillStateInternals.java ## @@ -470,81

[GitHub] [beam] codecov[bot] edited a comment on pull request #12877: Upgrade GCS IO to 2.1.5 and Google OAuth to 1.31.0

codecov[bot] edited a comment on pull request #12877: URL: https://github.com/apache/beam/pull/12877#issuecomment-695130274 # [Codecov](https://codecov.io/gh/apache/beam/pull/12877?src=pr=h1) Report > Merging [#12877](https://codecov.io/gh/apache/beam/pull/12877?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12762: Ensuring that BigQuery jobs are tagged with the Dataflow step that launches them

codecov[bot] edited a comment on pull request #12762: URL: https://github.com/apache/beam/pull/12762#issuecomment-696459985 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12800: [BEAM-10603] Add the ib.recordings API

codecov[bot] edited a comment on pull request #12800: URL: https://github.com/apache/beam/pull/12800#issuecomment-696921394 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] rezarokni commented on a change in pull request #12864: [BEAM-10650] Windmill implementation for TimestampOrderedState

rezarokni commented on a change in pull request #12864: URL: https://github.com/apache/beam/pull/12864#discussion_r492447897 ## File path: runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/WindmillStateInternals.java ## @@ -470,81

[GitHub] [beam] lostluck commented on pull request #12903: [BEAM-9616] Add RegisterDoFn

lostluck commented on pull request #12903: URL: https://github.com/apache/beam/pull/12903#issuecomment-696839567 R: @youngoli @tysonjh This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on pull request #12906: Fix apache_beam.typehints.schemas docstring

TheNeuralBit commented on pull request #12906: URL: https://github.com/apache/beam/pull/12906#issuecomment-696968226 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] commented on pull request #12896: Update indexing skips for pandas 1.x

codecov[bot] commented on pull request #12896: URL: https://github.com/apache/beam/pull/12896#issuecomment-696398122 # [Codecov](https://codecov.io/gh/apache/beam/pull/12896?src=pr=h1) Report > Merging [#12896](https://codecov.io/gh/apache/beam/pull/12896?src=pr=desc) into

[GitHub] [beam] y1chi commented on a change in pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

y1chi commented on a change in pull request #12727: URL: https://github.com/apache/beam/pull/12727#discussion_r492888461 ## File path: sdks/python/apache_beam/runners/portability/sdk_container_builder.py ## @@ -0,0 +1,274 @@ +# +# Licensed to the Apache Software Foundation

[GitHub] [beam] pabloem commented on pull request #12800: [BEAM-10603] Add the ib.recordings API

pabloem commented on pull request #12800: URL: https://github.com/apache/beam/pull/12800#issuecomment-696944786 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] edited a comment on pull request #12881: [BEAM-7746] Get mypy passing on runners.worker

codecov[bot] edited a comment on pull request #12881: URL: https://github.com/apache/beam/pull/12881#issuecomment-696540479 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] lukecwik commented on pull request #12874: [BEAM-10930] Use dense JSON responses for BigQueryIO interactions

lukecwik commented on pull request #12874: URL: https://github.com/apache/beam/pull/12874#issuecomment-696381583 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] chadrik commented on a change in pull request #12881: [BEAM-7746] Get mypy passing on runners.worker

chadrik commented on a change in pull request #12881: URL: https://github.com/apache/beam/pull/12881#discussion_r492493751 ## File path: sdks/python/apache_beam/runners/worker/data_plane.py ## @@ -81,7 +85,11 @@ class ClosableOutputStream(OutputStream): """A Outputstream

[GitHub] [beam] codecov[bot] commented on pull request #12800: [BEAM-10603] Add the ib.recordings API

codecov[bot] commented on pull request #12800: URL: https://github.com/apache/beam/pull/12800#issuecomment-696921394 # [Codecov](https://codecov.io/gh/apache/beam/pull/12800?src=pr=h1) Report > Merging [#12800](https://codecov.io/gh/apache/beam/pull/12800?src=pr=desc) into

[GitHub] [beam] tvalentyn commented on pull request #12896: Update indexing skips for pandas 1.x

tvalentyn commented on pull request #12896: URL: https://github.com/apache/beam/pull/12896#issuecomment-696457581 > That's unexpected.. I wonder if it was disabled accidentally (perhaps because of Python version removals?) Yes, sorry about that - I was testing my changes and ran a

[GitHub] [beam] tvalentyn commented on pull request #12895: [BEAM-9372][BEAM-9980] Switches Flink VR suite to Py36 and makes the version configurable.

tvalentyn commented on pull request #12895: URL: https://github.com/apache/beam/pull/12895#issuecomment-696386431 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tvalentyn merged pull request #12898: [BEAM-7372][BEAM-9980] Cleans up Flink precommit VR suite definition and makes Python version configurable.

tvalentyn merged pull request #12898: URL: https://github.com/apache/beam/pull/12898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] robertwb commented on a change in pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

robertwb commented on a change in pull request #12727: URL: https://github.com/apache/beam/pull/12727#discussion_r492422441 ## File path: sdks/python/apache_beam/runners/portability/stager.py ## @@ -119,6 +119,7 @@ def create_job_resources(options, # type: PipelineOptions

[GitHub] [beam] robinyqiu merged pull request #12730: [BEAM-10532] convert NUMERIC field in TableSchema

robinyqiu merged pull request #12730: URL: https://github.com/apache/beam/pull/12730 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] aromanenko-dev commented on pull request #11459: [BEAM-2546] Add InfluxDbIO

aromanenko-dev commented on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-696671630 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] codecov[bot] edited a comment on pull request #12905: [BEAM-8660] Use PortableOptions.artifact_endpoint if provided over value reported from jobserver

codecov[bot] edited a comment on pull request #12905: URL: https://github.com/apache/beam/pull/12905#issuecomment-696946990 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12782: Overriding Dataflow Native BQSource.

codecov[bot] edited a comment on pull request #12782: URL: https://github.com/apache/beam/pull/12782#issuecomment-696899540 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] trucleduc commented on pull request #12721: [BEAM-10871] Add deidentify for FhirIO connector

trucleduc commented on pull request #12721: URL: https://github.com/apache/beam/pull/12721#issuecomment-696408469 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] edited a comment on pull request #12880: [BEAM-10933] Adjust GBK and Flatten types before creating the pipeline proto

codecov[bot] edited a comment on pull request #12880: URL: https://github.com/apache/beam/pull/12880#issuecomment-695346831 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] lukecwik commented on pull request #12877: Upgrade GCS IO to 2.1.5 and Google OAuth to 1.31.0

lukecwik commented on pull request #12877: URL: https://github.com/apache/beam/pull/12877#issuecomment-696791824 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] commented on pull request #12899: [BEAM-8024] Add JPMS E2E test

codecov[bot] commented on pull request #12899: URL: https://github.com/apache/beam/pull/12899#issuecomment-696883419 # [Codecov](https://codecov.io/gh/apache/beam/pull/12899?src=pr=h1) Report > Merging [#12899](https://codecov.io/gh/apache/beam/pull/12899?src=pr=desc) into

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12906: Fix apache_beam.typehints.schemas docstring

TheNeuralBit commented on a change in pull request #12906: URL: https://github.com/apache/beam/pull/12906#discussion_r493105830 ## File path: sdks/python/apache_beam/typehints/schemas.py ## @@ -17,36 +17,42 @@ """ Support for mapping python types to proto Schemas and back

[GitHub] [beam] pabloem commented on a change in pull request #12782: Overriding Dataflow Native BQSource.

pabloem commented on a change in pull request #12782: URL: https://github.com/apache/beam/pull/12782#discussion_r493031855 ## File path: sdks/python/apache_beam/io/gcp/bigquery_test.py ## @@ -168,7 +168,8 @@ def test_invalid_json_neg_inf(self): @unittest.skipIf(HttpError is

[GitHub] [beam] ibzib commented on a change in pull request #12637: [BEAM-10768] Don't assert the order in which elements are received.

ibzib commented on a change in pull request #12637: URL: https://github.com/apache/beam/pull/12637#discussion_r492386778 ## File path: sdks/python/apache_beam/runners/worker/data_plane_test.py ## @@ -108,16 +106,28 @@ def send(instruction_id, transform_id, data): ])

[GitHub] [beam] TheNeuralBit merged pull request #12858: [BEAM-9547] Raise NotImplementedError and WontImplementError throughout DeferredDataframe

TheNeuralBit merged pull request #12858: URL: https://github.com/apache/beam/pull/12858 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] aaltay commented on a change in pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

aaltay commented on a change in pull request #12727: URL: https://github.com/apache/beam/pull/12727#discussion_r492448750 ## File path: sdks/python/setup.py ## @@ -215,6 +215,8 @@ def get_version(): 'google-cloud-language>=1.3.0,<2',

[GitHub] [beam] tvalentyn commented on pull request #12638: [BEAM-10769] Clarify Avro IO documentation.

tvalentyn commented on pull request #12638: URL: https://github.com/apache/beam/pull/12638#issuecomment-697037986 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] sambvfx commented on pull request #12905: [BEAM-8660] Use PortableOptions.artifact_endpoint if provided over value reported from jobserver

sambvfx commented on pull request #12905: URL: https://github.com/apache/beam/pull/12905#issuecomment-696859781 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] commented on pull request #12900: [BEAM-10941] Use standard sharding conventions for fileio writes.

codecov[bot] commented on pull request #12900: URL: https://github.com/apache/beam/pull/12900#issuecomment-696448479 # [Codecov](https://codecov.io/gh/apache/beam/pull/12900?src=pr=h1) Report > Merging [#12900](https://codecov.io/gh/apache/beam/pull/12900?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12853: [BEAM-3083] Sets sdk_harness_container_images property for all Dataflow Runner V2 jobs

codecov[bot] edited a comment on pull request #12853: URL: https://github.com/apache/beam/pull/12853#issuecomment-693256374 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] tvalentyn commented on pull request #12898: [BEAM-7372][BEAM-9980] Cleans up Flink precommit VR suite definition and makes Python version configurable.

tvalentyn commented on pull request #12898: URL: https://github.com/apache/beam/pull/12898#issuecomment-696385996 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] ibzib commented on a change in pull request #12905: [BEAM-8660] Use PortableOptions.artifact_endpoint if provided over value reported from jobserver

ibzib commented on a change in pull request #12905: URL: https://github.com/apache/beam/pull/12905#discussion_r493004974 ## File path: sdks/python/apache_beam/runners/portability/portable_runner.py ## @@ -105,9 +106,11 @@ def submit(self, proto_pipeline): Submit and run

[GitHub] [beam] chamikaramj merged pull request #12880: [BEAM-10933] Adjust GBK type before creating the pipeline proto

chamikaramj merged pull request #12880: URL: https://github.com/apache/beam/pull/12880 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12830: [BEAM-10716] TestPubsub/TestPubsubSignal clean up subscriptions

TheNeuralBit commented on a change in pull request #12830: URL: https://github.com/apache/beam/pull/12830#discussion_r492339081 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/TestPubsubSignal.java ## @@ -239,6 +245,12 @@

[GitHub] [beam] codecov[bot] commented on pull request #12882: [BEAM-10814] DataframeTransform outputs elements

codecov[bot] commented on pull request #12882: URL: https://github.com/apache/beam/pull/12882#issuecomment-696913901 # [Codecov](https://codecov.io/gh/apache/beam/pull/12882?src=pr=h1) Report > Merging [#12882](https://codecov.io/gh/apache/beam/pull/12882?src=pr=desc) into

[GitHub] [beam] ibzib merged pull request #12637: [BEAM-10768] Don't assert the order in which elements are received.

ibzib merged pull request #12637: URL: https://github.com/apache/beam/pull/12637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] ibzib commented on pull request #12906: Fix apache_beam.typehints.schemas docstring

ibzib commented on pull request #12906: URL: https://github.com/apache/beam/pull/12906#issuecomment-697046441 > Failures look like known flakes in MacOS FYI I _think_ I fixed the flake in data_plane_test in #12637, so let me know if you see it again.

[GitHub] [beam] tvalentyn commented on pull request #12909: [DO NOT MERGE] Py235 cleanup portable precommits

tvalentyn commented on pull request #12909: URL: https://github.com/apache/beam/pull/12909#issuecomment-697052566 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] rohdesamuel commented on pull request #12800: [BEAM-10603] Add the ib.recordings API

rohdesamuel commented on pull request #12800: URL: https://github.com/apache/beam/pull/12800#issuecomment-696374567 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] lostluck merged pull request #12861: [BEAM-9680] Add Aggregation Min and Max lessons to Go SDK katas

lostluck merged pull request #12861: URL: https://github.com/apache/beam/pull/12861 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] codecov[bot] commented on pull request #12906: Fix apache_beam.typehints.schemas docstring

codecov[bot] commented on pull request #12906: URL: https://github.com/apache/beam/pull/12906#issuecomment-696986120 # [Codecov](https://codecov.io/gh/apache/beam/pull/12906?src=pr=h1) Report > Merging [#12906](https://codecov.io/gh/apache/beam/pull/12906?src=pr=desc) into

[GitHub] [beam] chamikaramj commented on a change in pull request #12880: [BEAM-10933] Adjust GBK and Flatten types before creating the pipeline proto

chamikaramj commented on a change in pull request #12880: URL: https://github.com/apache/beam/pull/12880#discussion_r492380763 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -488,12 +497,15 @@ def run_pipeline(self, pipeline, options): #

[GitHub] [beam] codecov[bot] commented on pull request #12888: [BEAM-10861]Moves PubSub Runner API encoding to Read/Write transforms

codecov[bot] commented on pull request #12888: URL: https://github.com/apache/beam/pull/12888#issuecomment-696562704 # [Codecov](https://codecov.io/gh/apache/beam/pull/12888?src=pr=h1) Report > Merging [#12888](https://codecov.io/gh/apache/beam/pull/12888?src=pr=desc) into

[GitHub] [beam] robertwb merged pull request #12885: [BEAM-7746] Add type checking to runners.pipeline_context

robertwb merged pull request #12885: URL: https://github.com/apache/beam/pull/12885 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] chamikaramj commented on pull request #12888: [BEAM-10861]Moves PubSub Runner API encoding to Read/Write transforms

chamikaramj commented on pull request #12888: URL: https://github.com/apache/beam/pull/12888#issuecomment-696556942 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tysonjh commented on pull request #12904: Add link issue for OrderedListState.

tysonjh commented on pull request #12904: URL: https://github.com/apache/beam/pull/12904#issuecomment-696852402 R: @reuvenlax This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] codecov[bot] edited a comment on pull request #12899: [BEAM-8024] Add JPMS E2E test

codecov[bot] edited a comment on pull request #12899: URL: https://github.com/apache/beam/pull/12899#issuecomment-696883419 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] timclemons removed a comment on pull request #12850: [BEAM-10481] Ensure registration of the accumulator occurs.

timclemons removed a comment on pull request #12850: URL: https://github.com/apache/beam/pull/12850#issuecomment-696380555 R: @aromanenko-dev This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] udim commented on pull request #9907: [BEAM-4091] Pass type hints in ptransform_fn

udim commented on pull request #9907: URL: https://github.com/apache/beam/pull/9907#issuecomment-696465531 PTAL, changes are in the last commit. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] lukecwik commented on pull request #12794: [BEAM-10865] Support for Kafka deserialization API with headers (since Kafka API 2.1.0)

lukecwik commented on pull request #12794: URL: https://github.com/apache/beam/pull/12794#issuecomment-696393557 > Thanks for the feedback and the merge Luke. I'll address the updates in a PR. > > I agree all tests makes more sense as one can never have enough coverage. That said,

[GitHub] [beam] pabloem merged pull request #12900: [BEAM-10941] Use standard sharding conventions for fileio writes.

pabloem merged pull request #12900: URL: https://github.com/apache/beam/pull/12900 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] codecov[bot] commented on pull request #12884: [BEAM-7746] Add type checking to coders

codecov[bot] commented on pull request #12884: URL: https://github.com/apache/beam/pull/12884#issuecomment-696510544 # [Codecov](https://codecov.io/gh/apache/beam/pull/12884?src=pr=h1) Report > Merging [#12884](https://codecov.io/gh/apache/beam/pull/12884?src=pr=desc) into

[GitHub] [beam] ibzib commented on a change in pull request #12906: Fix apache_beam.typehints.schemas docstring

ibzib commented on a change in pull request #12906: URL: https://github.com/apache/beam/pull/12906#discussion_r493100617 ## File path: sdks/python/apache_beam/typehints/schemas.py ## @@ -17,36 +17,42 @@ """ Support for mapping python types to proto Schemas and back again.

[GitHub] [beam] kennknowles merged pull request #12877: Upgrade GCS IO to 2.1.5 and Google OAuth to 1.31.0

kennknowles merged pull request #12877: URL: https://github.com/apache/beam/pull/12877 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] robertwb commented on a change in pull request #12881: [BEAM-7746] Get mypy passing on runners.worker

robertwb commented on a change in pull request #12881: URL: https://github.com/apache/beam/pull/12881#discussion_r492466948 ## File path: sdks/python/apache_beam/runners/worker/bundle_processor.py ## @@ -119,10 +125,10 @@ class RunnerIOOperation(operations.Operation): def

[GitHub] [beam] codecov[bot] edited a comment on pull request #12637: [BEAM-10768] Don't assert the order in which elements are received.

codecov[bot] edited a comment on pull request #12637: URL: https://github.com/apache/beam/pull/12637#issuecomment-695098854 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] tvalentyn commented on a change in pull request #12895: [BEAM-9372][BEAM-9980] Switches Flink VR suite to Py36 and makes the version configurable.

tvalentyn commented on a change in pull request #12895: URL: https://github.com/apache/beam/pull/12895#discussion_r492360722 ## File path: sdks/python/test-suites/gradle.properties ## @@ -27,3 +27,6 @@ dataflow_chicago_taxi_example_task_py_versions=3.7 # direct test-suites

  1   2   3   4   5   >