[GitHub] [beam] stale[bot] closed pull request #11456: [BEAM-7554] Add MillisInstant logical type to replace DATETIME

2020-09-12 Thread GitBox
stale[bot] closed pull request #11456: URL: https://github.com/apache/beam/pull/11456 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] stale[bot] commented on pull request #11456: [BEAM-7554] Add MillisInstant logical type to replace DATETIME

2020-09-12 Thread GitBox
stale[bot] commented on pull request #11456: URL: https://github.com/apache/beam/pull/11456#issuecomment-691570158 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

[GitHub] [beam] codecov[bot] edited a comment on pull request #12758: [BEAM-9898] Move snowflake.py from apache_beam.io to apache_beam.io.external for backwards compatibility

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12758: URL: https://github.com/apache/beam/pull/12758#issuecomment-685598683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] yifanmai commented on pull request #12787: [BEAM-10641] Add eliminate_common_key_with_none graph optimizer

2020-09-12 Thread GitBox
yifanmai commented on pull request #12787: URL: https://github.com/apache/beam/pull/12787#issuecomment-691274909 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] TheNeuralBit commented on pull request #12824: [DO NOT MERGE][BEAM-10884] Add support for Proto in Pubsub table provider

2020-09-12 Thread GitBox
TheNeuralBit commented on pull request #12824: URL: https://github.com/apache/beam/pull/12824#issuecomment-691174361 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] scwhittle commented on pull request #12825: [BEAM-9399] Change DataflowWorkerLoggingHandler to report errors to t…

2020-09-12 Thread GitBox
scwhittle commented on pull request #12825: URL: https://github.com/apache/beam/pull/12825#issuecomment-691048364 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tvalentyn commented on pull request #12833: Updates Dataflow containers used by unreleased SDKs.

2020-09-12 Thread GitBox
tvalentyn commented on pull request #12833: URL: https://github.com/apache/beam/pull/12833#issuecomment-691345888 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] commented on pull request #12821: Bump versions of protobuf, shadow, other gradle plugins.

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12821: URL: https://github.com/apache/beam/pull/12821#issuecomment-690950398 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] lostluck commented on pull request #12816: [BEAM-10874 Support v2 protos.

2020-09-12 Thread GitBox
lostluck commented on pull request #12816: URL: https://github.com/apache/beam/pull/12816#issuecomment-691189127 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] tvalentyn commented on pull request #12811: [BEAM-10705] Fixes a bug when passing whl files in --sdk_location from https locations

2020-09-12 Thread GitBox
tvalentyn commented on pull request #12811: URL: https://github.com/apache/beam/pull/12811#issuecomment-691312707 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] emilymye commented on pull request #12505: [WIP][BEAM-8106] Add version to java container image name

2020-09-12 Thread GitBox
emilymye commented on pull request #12505: URL: https://github.com/apache/beam/pull/12505#issuecomment-691357778 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] lukecwik commented on pull request #12617: [BEAM-10670] Update Samza to be opt-out for SplittableDoFn powering the Read transform.

2020-09-12 Thread GitBox
lukecwik commented on pull request #12617: URL: https://github.com/apache/beam/pull/12617#issuecomment-691375678 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] angoenka merged pull request #12817: [BEAM-10876] Fix TypeError in dataflow_metrics when distribution sum …

2020-09-12 Thread GitBox
angoenka merged pull request #12817: URL: https://github.com/apache/beam/pull/12817 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] lukecwik merged pull request #12708: [BEAM-10670] Update Flink to be opt-out for SplittableDoFn powering the Read transform.

2020-09-12 Thread GitBox
lukecwik merged pull request #12708: URL: https://github.com/apache/beam/pull/12708 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] codecov[bot] commented on pull request #12832: Add basic ToRows transform.

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12832: URL: https://github.com/apache/beam/pull/12832#issuecomment-691348838 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] edited a comment on pull request #12760: [BEAM-10861] Adds URNs and payloads to PubSub transforms to allow runner-native overrides

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12760: URL: https://github.com/apache/beam/pull/12760#issuecomment-689053328 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] arvindram03 commented on pull request #12779: [BEAM-10856] Support for NestedValueProvider for Python SDK

2020-09-12 Thread GitBox
arvindram03 commented on pull request #12779: URL: https://github.com/apache/beam/pull/12779#issuecomment-691354649 Hi @epicfaace , We agree the startup time with flex template python jobs is an issue. We are are working towards reducing the overall startup time to 3-4 mins by end

[GitHub] [beam] jayendra13 commented on a change in pull request #12540: [BEAM-10620] Eliminate nullability errors from :sdks:java:extensions:sql:perf-tests

2020-09-12 Thread GitBox
jayendra13 commented on a change in pull request #12540: URL: https://github.com/apache/beam/pull/12540#discussion_r487353928 ## File path: sdks/java/io/common/src/test/java/org/apache/beam/sdk/io/common/IOTestPipelineOptions.java ## @@ -45,19 +45,16 @@ void

[GitHub] [beam] codecov[bot] edited a comment on pull request #12787: [BEAM-10641] Add eliminate_common_key_with_none graph optimizer

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12787: URL: https://github.com/apache/beam/pull/12787#issuecomment-689105076 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] TheNeuralBit merged pull request #12826: [BEAM-7523] Enable KafkaCSVTableIT using KafkaContainer

2020-09-12 Thread GitBox
TheNeuralBit merged pull request #12826: URL: https://github.com/apache/beam/pull/12826 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] codecov[bot] commented on pull request #12829: [BEAM-10868] Fix build (docker run) concurrency issue when building golang license dependencies

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12829: URL: https://github.com/apache/beam/pull/12829#issuecomment-691241918 # [Codecov](https://codecov.io/gh/apache/beam/pull/12829?src=pr=h1) Report > Merging [#12829](https://codecov.io/gh/apache/beam/pull/12829?src=pr=desc) into

[GitHub] [beam] lostluck commented on pull request #12588: [BEAM-7009] Add Go SDK Standard Coders yaml tests.

2020-09-12 Thread GitBox
lostluck commented on pull request #12588: URL: https://github.com/apache/beam/pull/12588#issuecomment-690891253 Thanks! I appreciate that. On Thu, Sep 10, 2020, 10:46 PM Daniel Oliveira wrote: > Progress update: Started reviewing this today, about 2/3 of the way >

[GitHub] [beam] TheNeuralBit merged pull request #12560: [BEAM-9561] Fix issue with pickling in doctests.

2020-09-12 Thread GitBox
TheNeuralBit merged pull request #12560: URL: https://github.com/apache/beam/pull/12560 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] kkucharc merged pull request #12435: [BEAM-10616] Added Python Pardo load tests for streaming on Dataflow

2020-09-12 Thread GitBox
kkucharc merged pull request #12435: URL: https://github.com/apache/beam/pull/12435 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] epicfaace edited a comment on pull request #12779: [BEAM-10856] Support for NestedValueProvider for Python SDK

2020-09-12 Thread GitBox
epicfaace edited a comment on pull request #12779: URL: https://github.com/apache/beam/pull/12779#issuecomment-691350944 Hmm, I did try using Flex Templates initially, but it took way too long -- maybe 7-8 minutes -- for the job to initialize, and it appears that the bottleneck is with

[GitHub] [beam] codecov[bot] edited a comment on pull request #12764: [BEAM-10009] Add beam:logical_type:micros_instant:v1

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12764: URL: https://github.com/apache/beam/pull/12764#issuecomment-686100810 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] robinyqiu commented on a change in pull request #12764: [BEAM-10009] Add beam:logical_type:micros_instant:v1

2020-09-12 Thread GitBox
robinyqiu commented on a change in pull request #12764: URL: https://github.com/apache/beam/pull/12764#discussion_r487248777 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/logicaltypes/MicrosInstant.java ## @@ -0,0 +1,72 @@ +/* + * Licensed to the

[GitHub] [beam] TheNeuralBit merged pull request #12828: [BEAM-10678] Split up assertion for clarity

2020-09-12 Thread GitBox
TheNeuralBit merged pull request #12828: URL: https://github.com/apache/beam/pull/12828 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] youngoli commented on a change in pull request #12588: [BEAM-7009] Add Go SDK Standard Coders yaml tests.

2020-09-12 Thread GitBox
youngoli commented on a change in pull request #12588: URL: https://github.com/apache/beam/pull/12588#discussion_r486767704 ## File path: sdks/go/pkg/beam/core/runtime/exec/coder.go ## @@ -81,24 +82,82 @@ func MakeElementEncoder(c *coder.Coder) ElementEncoder {

[GitHub] [beam] codecov[bot] commented on pull request #12822: [BEAM-10880] Log error counts to debug BigQuery streaming insert requ…

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12822: URL: https://github.com/apache/beam/pull/12822#issuecomment-690950662 # [Codecov](https://codecov.io/gh/apache/beam/pull/12822?src=pr=h1) Report > Merging [#12822](https://codecov.io/gh/apache/beam/pull/12822?src=pr=desc) into

[GitHub] [beam] lukecwik commented on a change in pull request #12637: [BEAM-10768] Don't assert the order in which elements are received.

2020-09-12 Thread GitBox
lukecwik commented on a change in pull request #12637: URL: https://github.com/apache/beam/pull/12637#discussion_r487190235 ## File path: sdks/python/apache_beam/runners/worker/data_plane_test.py ## @@ -99,35 +100,33 @@ def send(instruction_id, transform_id, data): #

[GitHub] [beam] youngoli commented on pull request #12588: [BEAM-7009] Add Go SDK Standard Coders yaml tests.

2020-09-12 Thread GitBox
youngoli commented on pull request #12588: URL: https://github.com/apache/beam/pull/12588#issuecomment-690889052 Progress update: Started reviewing this today, about 2/3 of the way through. Wanted to let you know I was working on it, so you don't just get radio silence.

[GitHub] [beam] robertwb commented on pull request #12815: [BEAM-9561] Improve WontImplement reporting.

2020-09-12 Thread GitBox
robertwb commented on pull request #12815: URL: https://github.com/apache/beam/pull/12815#issuecomment-691260441 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] edited a comment on pull request #12819: [BEAM-9561] Initial framework for testing pandas website docs.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12819: URL: https://github.com/apache/beam/pull/12819#issuecomment-691336298 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12808: add readme file to python nexmark

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12808: URL: https://github.com/apache/beam/pull/12808#issuecomment-690009424 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12812: [BEAM-10873] Stronger testing of dataframe partitioning declarations.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12812: URL: https://github.com/apache/beam/pull/12812#issuecomment-690611762 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] chamikaramj commented on pull request #12760: [BEAM-10861] Adds URNs and payloads to PubSub transforms to allow runner-native overrides

2020-09-12 Thread GitBox
chamikaramj commented on pull request #12760: URL: https://github.com/apache/beam/pull/12760#issuecomment-691198263 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] TheNeuralBit commented on pull request #12828: [BEAM-10678] Split up assertion for clarity

2020-09-12 Thread GitBox
TheNeuralBit commented on pull request #12828: URL: https://github.com/apache/beam/pull/12828#issuecomment-691277907 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] lukecwik commented on a change in pull request #12617: [BEAM-10670] Update Samza to be opt-out for SplittableDoFn powering the Read transform.

2020-09-12 Thread GitBox
lukecwik commented on a change in pull request #12617: URL: https://github.com/apache/beam/pull/12617#discussion_r487349793 ## File path: runners/samza/src/main/java/org/apache/beam/runners/samza/runtime/SplittableParDoProcessKeyedElementsOp.java ## @@ -0,0 +1,251 @@ +/* + *

[GitHub] [beam] codecov[bot] edited a comment on pull request #12656: [BEAM-10781] Add PTransformOverride.get_replacement_transform_for_applied_ptransform()

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12656: URL: https://github.com/apache/beam/pull/12656#issuecomment-683610379 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] stale[bot] commented on pull request #11650: [BEAM-9272] Remove obsolete SDF URNs

2020-09-12 Thread GitBox
stale[bot] commented on pull request #11650: URL: https://github.com/apache/beam/pull/11650#issuecomment-691200086 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] iindyk commented on a change in pull request #12802: Deprecate obsolete CombineFn.add_inputs.

2020-09-12 Thread GitBox
iindyk commented on a change in pull request #12802: URL: https://github.com/apache/beam/pull/12802#discussion_r487285999 ## File path: sdks/python/apache_beam/transforms/core.py ## @@ -988,10 +991,14 @@ def apply(self, elements, *args, **kwargs): *args: Additional

[GitHub] [beam] boyuanzz commented on pull request #12678: [BEAM-10703] Add a step property for shardable states during Dataflow graph translation (Java)

2020-09-12 Thread GitBox
boyuanzz commented on pull request #12678: URL: https://github.com/apache/beam/pull/12678#issuecomment-691312842 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] commented on pull request #12826: [BEAM-7523] Enable KafkaCSVTableIT using KafkaContainer

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12826: URL: https://github.com/apache/beam/pull/12826#issuecomment-691185066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] TheNeuralBit merged pull request #12764: [BEAM-10009] Add beam:logical_type:micros_instant:v1

2020-09-12 Thread GitBox
TheNeuralBit merged pull request #12764: URL: https://github.com/apache/beam/pull/12764 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] zeidoo commented on pull request #12748: [BEAM-8715] update avro - extract avro to it's own module [WIP]

2020-09-12 Thread GitBox
zeidoo commented on pull request #12748: URL: https://github.com/apache/beam/pull/12748#issuecomment-690946531 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] yifanmai commented on a change in pull request #12787: [BEAM-10641] Add eliminate_common_key_with_none graph optimizer

2020-09-12 Thread GitBox
yifanmai commented on a change in pull request #12787: URL: https://github.com/apache/beam/pull/12787#discussion_r487204174 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/translations.py ## @@ -704,6 +705,71 @@ def fix_side_input_pcoll_coders(stages,

[GitHub] [beam] chamikaramj commented on pull request #12656: [BEAM-10781] Add PTransformOverride.get_replacement_transform_for_applied_ptransform()

2020-09-12 Thread GitBox
chamikaramj commented on pull request #12656: URL: https://github.com/apache/beam/pull/12656#issuecomment-691240594 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] y1chi commented on a change in pull request #12817: [BEAM-10876] Fix TypeError in dataflow_metrics when distribution sum …

2020-09-12 Thread GitBox
y1chi commented on a change in pull request #12817: URL: https://github.com/apache/beam/pull/12817#discussion_r487177713 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_metrics.py ## @@ -210,6 +210,14 @@ def _get_metric_value(self, metric): dist_sum =

[GitHub] [beam] pabloem commented on pull request #12721: [BEAM-10871] Add deidentify for FhirIO connector

2020-09-12 Thread GitBox
pabloem commented on pull request #12721: URL: https://github.com/apache/beam/pull/12721#issuecomment-690864594 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] youngoli commented on pull request #12792: [DO NOT MERGE] Run Python RC Validation Tests

2020-09-12 Thread GitBox
youngoli commented on pull request #12792: URL: https://github.com/apache/beam/pull/12792#issuecomment-691339867 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] robertwb merged pull request #12802: Deprecate obsolete CombineFn.add_inputs.

2020-09-12 Thread GitBox
robertwb merged pull request #12802: URL: https://github.com/apache/beam/pull/12802 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] piotr-szuberski commented on pull request #12780: [BEAM-10857] Add Pubsub Avro table provider

2020-09-12 Thread GitBox
piotr-szuberski commented on pull request #12780: URL: https://github.com/apache/beam/pull/12780#issuecomment-690924009 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12686: Removing dead code from Interactive Beam.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12686: URL: https://github.com/apache/beam/pull/12686#issuecomment-680768761 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] chamikaramj merged pull request #12760: [BEAM-10861] Adds URNs and payloads to PubSub transforms to allow runner-native overrides

2020-09-12 Thread GitBox
chamikaramj merged pull request #12760: URL: https://github.com/apache/beam/pull/12760 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] TheNeuralBit commented on pull request #12764: [BEAM-10009] Add beam:logical_type:micros_instant:v1

2020-09-12 Thread GitBox
TheNeuralBit commented on pull request #12764: URL: https://github.com/apache/beam/pull/12764#issuecomment-691173231 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] edited a comment on pull request #12834: Document GroupBy transform.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12834: URL: https://github.com/apache/beam/pull/12834#issuecomment-691369145 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] stale[bot] commented on pull request #7949: [BEAM-3713] Add pytest testing infrastructure

2020-09-12 Thread GitBox
stale[bot] commented on pull request #7949: URL: https://github.com/apache/beam/pull/7949#issuecomment-690839304 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

[GitHub] [beam] codecov[bot] edited a comment on pull request #12826: [BEAM-7523] Enable KafkaCSVTableIT using KafkaContainer

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12826: URL: https://github.com/apache/beam/pull/12826#issuecomment-691185066 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] robertwb commented on pull request #12814: [BEAM-9547] A couple trivial but common dataframe methods.

2020-09-12 Thread GitBox
robertwb commented on pull request #12814: URL: https://github.com/apache/beam/pull/12814#issuecomment-691260060 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] ihji commented on pull request #12822: [BEAM-10880] Log error counts to debug BigQuery streaming insert requ…

2020-09-12 Thread GitBox
ihji commented on pull request #12822: URL: https://github.com/apache/beam/pull/12822#issuecomment-691380407 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [beam] codecov[bot] edited a comment on pull request #12832: Add basic ToRows transform.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12832: URL: https://github.com/apache/beam/pull/12832#issuecomment-691348838 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] boyuanzz commented on a change in pull request #12806: [BEAM-10869] Use PubsubMessagePayloadOnlyCoder when writing to Pubsub.

2020-09-12 Thread GitBox
boyuanzz commented on a change in pull request #12806: URL: https://github.com/apache/beam/pull/12806#discussion_r487310176 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java ## @@ -1012,6 +1012,8 @@ public PDone

[GitHub] [beam] lukecwik merged pull request #12706: [BEAM-6868, BEAM-10670] Add support for bundle finalization to DoFnOperator for non-portable streaming pipelines.

2020-09-12 Thread GitBox
lukecwik merged pull request #12706: URL: https://github.com/apache/beam/pull/12706 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12711: Support read/write ZetaSQL DATETIME/NUMERIC types from/to BigQuery

2020-09-12 Thread GitBox
TheNeuralBit commented on a change in pull request #12711: URL: https://github.com/apache/beam/pull/12711#discussion_r487193734 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java ## @@ -257,10 +263,9 @@

[GitHub] [beam] aaltay commented on pull request #12596: [BEAM-10498] [WIP] Eliminate nullability errors from :sdks:java:extensions:sql:zetasql

2020-09-12 Thread GitBox
aaltay commented on pull request #12596: URL: https://github.com/apache/beam/pull/12596#issuecomment-691254372 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] kennknowles commented on a change in pull request #12596: [BEAM-10498] [WIP] Eliminate nullability errors from :sdks:java:extensions:sql:zetasql

2020-09-12 Thread GitBox
kennknowles commented on a change in pull request #12596: URL: https://github.com/apache/beam/pull/12596#discussion_r487239063 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/SqlOperators.java ## @@ -132,6

[GitHub] [beam] epicfaace commented on pull request #12779: [BEAM-10856] Support for NestedValueProvider for Python SDK

2020-09-12 Thread GitBox
epicfaace commented on pull request #12779: URL: https://github.com/apache/beam/pull/12779#issuecomment-691342588 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] boyuanzz commented on a change in pull request #12726: [BEAM-10475] Add max buffering duration to GroupIntoBatches (Java)

2020-09-12 Thread GitBox
boyuanzz commented on a change in pull request #12726: URL: https://github.com/apache/beam/pull/12726#discussion_r487313819 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/GroupIntoBatches.java ## @@ -66,25 +68,49 @@ * } * }})); *

[GitHub] [beam] leiyiz commented on a change in pull request #12813: write to file ability for java suite

2020-09-12 Thread GitBox
leiyiz commented on a change in pull request #12813: URL: https://github.com/apache/beam/pull/12813#discussion_r486767972 ## File path: sdks/java/testing/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkConfiguration.java ## @@ -42,6 +42,9 @@ /** Where events come

[GitHub] [beam] robertwb commented on pull request #12835: [BEAM-10889] Add a note about BatchElements on GroupIntoBatches pages.

2020-09-12 Thread GitBox
robertwb commented on pull request #12835: URL: https://github.com/apache/beam/pull/12835#issuecomment-691368129 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] piotr-szuberski commented on pull request #12826: [BEAM-7523] Enable KafkaCSVTableIT using KafkaContainer

2020-09-12 Thread GitBox
piotr-szuberski commented on pull request #12826: URL: https://github.com/apache/beam/pull/12826#issuecomment-691174313 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12817: [BEAM-10876] Fix TypeError in dataflow_metrics when distribution sum …

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12817: URL: https://github.com/apache/beam/pull/12817#issuecomment-690788920 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] amaliujia commented on a change in pull request #12766: [BEAM-10459][BEAM-9514] Fix AssertionError type mismatch from AggregateScanConverter

2020-09-12 Thread GitBox
amaliujia commented on a change in pull request #12766: URL: https://github.com/apache/beam/pull/12766#discussion_r487307937 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/AggregateScanConverter.java ## @@

[GitHub] [beam] amaliujia merged pull request #12532: [Beam-9543] support MATCH_RECOGNIZE with NFA

2020-09-12 Thread GitBox
amaliujia merged pull request #12532: URL: https://github.com/apache/beam/pull/12532 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] TheNeuralBit commented on pull request #12826: [BEAM-7523] Enable KafkaCSVTableIT using KafkaContainer

2020-09-12 Thread GitBox
TheNeuralBit commented on pull request #12826: URL: https://github.com/apache/beam/pull/12826#issuecomment-691270912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] piotr-szuberski commented on pull request #12824: [BEAM-10884] Add support for Proto in Pubsub table provider

2020-09-12 Thread GitBox
piotr-szuberski commented on pull request #12824: URL: https://github.com/apache/beam/pull/12824#issuecomment-690995481 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12822: [BEAM-10880] Log error counts to debug BigQuery streaming insert requ…

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12822: URL: https://github.com/apache/beam/pull/12822#issuecomment-690950662 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] tvalentyn commented on pull request #12779: [BEAM-10856] Support for NestedValueProvider for Python SDK

2020-09-12 Thread GitBox
tvalentyn commented on pull request #12779: URL: https://github.com/apache/beam/pull/12779#issuecomment-691339409 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tvalentyn merged pull request #12756: [BEAM-10824] [BEAM-7654] Change hash function in ApproximateUniqueCombineFn

2020-09-12 Thread GitBox
tvalentyn merged pull request #12756: URL: https://github.com/apache/beam/pull/12756 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12829: [BEAM-10868] Fix build (docker run) concurrency issue when building golang license dependencies

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12829: URL: https://github.com/apache/beam/pull/12829#issuecomment-691241918 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] mxm merged pull request #12810: [BEAM-9456] Update Gradle Wrapper

2020-09-12 Thread GitBox
mxm merged pull request #12810: URL: https://github.com/apache/beam/pull/12810 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] codecov[bot] commented on pull request #12834: Document GroupBy transform.

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12834: URL: https://github.com/apache/beam/pull/12834#issuecomment-691369145 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] y1chi commented on a change in pull request #12813: write to file ability for java suite

2020-09-12 Thread GitBox
y1chi commented on a change in pull request #12813: URL: https://github.com/apache/beam/pull/12813#discussion_r487169637 ## File path: sdks/java/testing/nexmark/src/main/java/org/apache/beam/sdk/nexmark/NexmarkLauncher.java ## @@ -922,6 +922,11 @@ private void

[GitHub] [beam] kennknowles commented on pull request #12825: [BEAM-9399] Change DataflowWorkerLoggingHandler to report errors to t…

2020-09-12 Thread GitBox
kennknowles commented on pull request #12825: URL: https://github.com/apache/beam/pull/12825#issuecomment-691258077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] happygiraffe commented on pull request #12816: [BEAM-10874 Support v2 protos.

2020-09-12 Thread GitBox
happygiraffe commented on pull request #12816: URL: https://github.com/apache/beam/pull/12816#issuecomment-690940954 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] codecov[bot] edited a comment on pull request #12748: [BEAM-8715] update avro - extract avro to it's own module [WIP]

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12748: URL: https://github.com/apache/beam/pull/12748#issuecomment-684999675 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] purbanow commented on pull request #12823: [BEAM-10882] Update Snowflake docs

2020-09-12 Thread GitBox
purbanow commented on pull request #12823: URL: https://github.com/apache/beam/pull/12823#issuecomment-691014169 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] codecov[bot] edited a comment on pull request #12821: Bump versions of protobuf, shadow, other gradle plugins.

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12821: URL: https://github.com/apache/beam/pull/12821#issuecomment-690950398 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] kennknowles commented on pull request #12505: [WIP][BEAM-8106] Add version to java container image name

2020-09-12 Thread GitBox
kennknowles commented on pull request #12505: URL: https://github.com/apache/beam/pull/12505#issuecomment-691239957 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tvalentyn edited a comment on pull request #12833: Updates Dataflow containers used by unreleased SDKs.

2020-09-12 Thread GitBox
tvalentyn edited a comment on pull request #12833: URL: https://github.com/apache/beam/pull/12833#issuecomment-691345960 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] boyuanzz commented on a change in pull request #12760: [BEAM-10861] Adds URNs and payloads to PubSub transforms to allow runner-native overrides

2020-09-12 Thread GitBox
boyuanzz commented on a change in pull request #12760: URL: https://github.com/apache/beam/pull/12760#discussion_r487332677 ## File path: model/pipeline/src/main/proto/beam_runner_api.proto ## @@ -650,6 +656,54 @@ message WriteFilesPayload { map side_inputs = 5; } +//

[GitHub] [beam] codecov[bot] commented on pull request #12833: Updates Dataflow containers used by unreleased SDKs.

2020-09-12 Thread GitBox
codecov[bot] commented on pull request #12833: URL: https://github.com/apache/beam/pull/12833#issuecomment-691350342 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] kkucharc commented on pull request #12435: [BEAM-10616] Added Python Pardo load tests for streaming on Dataflow

2020-09-12 Thread GitBox
kkucharc commented on pull request #12435: URL: https://github.com/apache/beam/pull/12435#issuecomment-691020465 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] robertwb commented on pull request #12834: Document GroupBy transform.

2020-09-12 Thread GitBox
robertwb commented on pull request #12834: URL: https://github.com/apache/beam/pull/12834#issuecomment-691365247 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] nehsyc commented on pull request #12726: [BEAM-10475] Add max buffering duration to GroupIntoBatches (Java)

2020-09-12 Thread GitBox
nehsyc commented on pull request #12726: URL: https://github.com/apache/beam/pull/12726#issuecomment-691330023 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] y1chi commented on a change in pull request #12815: [BEAM-9561] Improve WontImplement reporting.

2020-09-12 Thread GitBox
y1chi commented on a change in pull request #12815: URL: https://github.com/apache/beam/pull/12815#discussion_r486672602 ## File path: sdks/python/apache_beam/dataframe/doctests.py ## @@ -319,25 +319,24 @@ def run(self, test, **kwargs): # Don't fail doctests that

[GitHub] [beam] codecov[bot] edited a comment on pull request #12811: [BEAM-10705] Fixes a bug when passing whl files in --sdk_location from https locations

2020-09-12 Thread GitBox
codecov[bot] edited a comment on pull request #12811: URL: https://github.com/apache/beam/pull/12811#issuecomment-690521374 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] nehsyc commented on a change in pull request #12726: [BEAM-10475] Add max buffering duration to GroupIntoBatches (Java)

2020-09-12 Thread GitBox
nehsyc commented on a change in pull request #12726: URL: https://github.com/apache/beam/pull/12726#discussion_r487443109 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/GroupIntoBatches.java ## @@ -150,70 +185,96 @@ public long apply(long left, long

[GitHub] [beam] stale[bot] commented on pull request #11582: [BEAM-9650] Add ReadAllFromBigQuery PTransform

2020-09-12 Thread GitBox
stale[bot] commented on pull request #11582: URL: https://github.com/apache/beam/pull/11582#issuecomment-691533545 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

  1   2   3   4   >