[GitHub] [beam] robertwb commented on pull request #12819: [BEAM-9561] Initial framework for testing pandas website docs.

2020-09-17 Thread GitBox
robertwb commented on pull request #12819: URL: https://github.com/apache/beam/pull/12819#issuecomment-694586974 Same test_flatten_no_pcollections failure. This is an automated message from the Apache Git Service. To

[GitHub] [beam] udim commented on a change in pull request #12805: [BEAM-10867] Add file generation to GcsPath

2020-09-17 Thread GitBox
udim commented on a change in pull request #12805: URL: https://github.com/apache/beam/pull/12805#discussion_r490652676 ## File path: sdks/java/extensions/google-cloud-platform-core/src/test/java/org/apache/beam/sdk/extensions/gcp/util/gcsfs/GcsPathTest.java ## @@ -175,6

[GitHub] [beam] lukecwik commented on pull request #12603: [WIP][BEAM-10670] Make SparkRunner opt-out for using an SDF powered Read transform.

2020-09-17 Thread GitBox
lukecwik commented on pull request #12603: URL: https://github.com/apache/beam/pull/12603#issuecomment-694659139 @iemejia I have updated the code and added a `SparkProcessedKeyedElements` using `updateStateByKey` to evaluate a splittable DoFn. I based the logic off of the

[GitHub] [beam] aromanenko-dev merged pull request #12862: [BEAM-10816] Make KinesisClientThrottledException public

2020-09-17 Thread GitBox
aromanenko-dev merged pull request #12862: URL: https://github.com/apache/beam/pull/12862 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] codecov[bot] edited a comment on pull request #12841: [BEAM-10894] Basic CSV reading and writing.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12841: URL: https://github.com/apache/beam/pull/12841#issuecomment-692395796 # [Codecov](https://codecov.io/gh/apache/beam/pull/12841?src=pr=h1) Report > Merging [#12841](https://codecov.io/gh/apache/beam/pull/12841?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12841: [BEAM-10894] Basic CSV reading and writing.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12841: URL: https://github.com/apache/beam/pull/12841#issuecomment-692395796 # [Codecov](https://codecov.io/gh/apache/beam/pull/12841?src=pr=h1) Report > Merging [#12841](https://codecov.io/gh/apache/beam/pull/12841?src=pr=desc) into

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12857: [BEAM-9547] Add not_implemented_ok

2020-09-17 Thread GitBox
TheNeuralBit commented on a change in pull request #12857: URL: https://github.com/apache/beam/pull/12857#discussion_r490376616 ## File path: sdks/python/apache_beam/dataframe/doctests.py ## @@ -316,31 +354,39 @@ def run(self, test, **kwargs): example.source = 'pass'

[GitHub] [beam] ibzib merged pull request #12859: [BEAM-10915] Fix error hint for AVG(INT64).

2020-09-17 Thread GitBox
ibzib merged pull request #12859: URL: https://github.com/apache/beam/pull/12859 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] robertwb commented on a change in pull request #12857: [BEAM-9547] Add not_implemented_ok

2020-09-17 Thread GitBox
robertwb commented on a change in pull request #12857: URL: https://github.com/apache/beam/pull/12857#discussion_r490019398 ## File path: sdks/python/apache_beam/dataframe/doctests.py ## @@ -316,31 +354,39 @@ def run(self, test, **kwargs): example.source = 'pass'

[GitHub] [beam] codecov[bot] edited a comment on pull request #12841: [BEAM-10894] Basic CSV reading and writing.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12841: URL: https://github.com/apache/beam/pull/12841#issuecomment-692395796 # [Codecov](https://codecov.io/gh/apache/beam/pull/12841?src=pr=h1) Report > Merging [#12841](https://codecov.io/gh/apache/beam/pull/12841?src=pr=desc) into

[GitHub] [beam] mwalenia commented on pull request #12809: [BEAM-10870] Add raw private key param to snowflake cross-language python wrapper

2020-09-17 Thread GitBox
mwalenia commented on pull request #12809: URL: https://github.com/apache/beam/pull/12809#issuecomment-694119415 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] codecov[bot] edited a comment on pull request #12809: [BEAM-10870] Add raw private key param to snowflake cross-language python wrapper

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12809: URL: https://github.com/apache/beam/pull/12809#issuecomment-690248992 # [Codecov](https://codecov.io/gh/apache/beam/pull/12809?src=pr=h1) Report > Merging [#12809](https://codecov.io/gh/apache/beam/pull/12809?src=pr=desc) into

[GitHub] [beam] robertwb commented on a change in pull request #12841: [BEAM-10894] Basic CSV reading and writing.

2020-09-17 Thread GitBox
robertwb commented on a change in pull request #12841: URL: https://github.com/apache/beam/pull/12841#discussion_r490351481 ## File path: sdks/python/apache_beam/dataframe/io.py ## @@ -0,0 +1,178 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] [beam] robertwb merged pull request #12835: [BEAM-10889] Add a note about BatchElements on GroupIntoBatches pages.

2020-09-17 Thread GitBox
robertwb merged pull request #12835: URL: https://github.com/apache/beam/pull/12835 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] robertwb commented on pull request #12835: [BEAM-10889] Add a note about BatchElements on GroupIntoBatches pages.

2020-09-17 Thread GitBox
robertwb commented on pull request #12835: URL: https://github.com/apache/beam/pull/12835#issuecomment-694319323 Thanks. I agree we'd want to consolidate the transforms, but they have different enough capabilities that at least leaving a breadcrumb from one to the other is worth it in the

[GitHub] [beam] robertwb commented on pull request #12841: [BEAM-10894] Basic CSV reading and writing.

2020-09-17 Thread GitBox
robertwb commented on pull request #12841: URL: https://github.com/apache/beam/pull/12841#issuecomment-694320048 Updated to use the new fileio framework. (As an aside, I noticed that it's still marked experimental, should that be dropped.) PTAL

[GitHub] [beam] robertwb commented on pull request #12819: [BEAM-9561] Initial framework for testing pandas website docs.

2020-09-17 Thread GitBox
robertwb commented on pull request #12819: URL: https://github.com/apache/beam/pull/12819#issuecomment-694320474 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] bipinupd commented on a change in pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
bipinupd commented on a change in pull request #11459: URL: https://github.com/apache/beam/pull/11459#discussion_r490297111 ## File path: .test-infra/kubernetes/influxdb/influxdb.yml ## @@ -0,0 +1,76 @@ +#Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] reuvenlax opened a new pull request #12864: Windmill implementation for TimestampOrderedState

2020-09-17 Thread GitBox
reuvenlax opened a new pull request #12864: URL: https://github.com/apache/beam/pull/12864 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #11459: [BEAM-2546] Add InfluxDbIO

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #11459: URL: https://github.com/apache/beam/pull/11459#issuecomment-684976918 # [Codecov](https://codecov.io/gh/apache/beam/pull/11459?src=pr=h1) Report > Merging [#11459](https://codecov.io/gh/apache/beam/pull/11459?src=pr=desc) into

[GitHub] [beam] kennknowles merged pull request #12540: [BEAM-10620] Eliminate nullability errors from :sdks:java:extensions:sql:perf-tests

2020-09-17 Thread GitBox
kennknowles merged pull request #12540: URL: https://github.com/apache/beam/pull/12540 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] TheNeuralBit opened a new pull request #12865: [DO NOT MERGE] Revert "Merge pull request #12704 from [BEAM-10603] Implement the new…

2020-09-17 Thread GitBox
TheNeuralBit opened a new pull request #12865: URL: https://github.com/apache/beam/pull/12865 Testing if rolling back this change fixes flakiness in Windows tests. Post-Commit Tests Status (on master branch)

[GitHub] [beam] codecov[bot] edited a comment on pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12727: URL: https://github.com/apache/beam/pull/12727#issuecomment-683229966 # [Codecov](https://codecov.io/gh/apache/beam/pull/12727?src=pr=h1) Report > Merging [#12727](https://codecov.io/gh/apache/beam/pull/12727?src=pr=desc) into

[GitHub] [beam] TheNeuralBit merged pull request #12860: Minor GroupBy doc fixes

2020-09-17 Thread GitBox
TheNeuralBit merged pull request #12860: URL: https://github.com/apache/beam/pull/12860 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] codecov[bot] commented on pull request #12865: [DO NOT MERGE] Revert "Merge pull request #12704 from [BEAM-10603] Implement the new…

2020-09-17 Thread GitBox
codecov[bot] commented on pull request #12865: URL: https://github.com/apache/beam/pull/12865#issuecomment-694375859 # [Codecov](https://codecov.io/gh/apache/beam/pull/12865?src=pr=h1) Report > Merging [#12865](https://codecov.io/gh/apache/beam/pull/12865?src=pr=desc) into

[GitHub] [beam] TheNeuralBit commented on pull request #12704: [BEAM-10603] Implement the new Large Source Recording API.

2020-09-17 Thread GitBox
TheNeuralBit commented on pull request #12704: URL: https://github.com/apache/beam/pull/12704#issuecomment-694379028 It looks like this made the windows tests in Python very flaky, I don't think all three have passed in any runs since (BEAM-10921). I tested in a rollback

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12704: [BEAM-10603] Implement the new Large Source Recording API.

2020-09-17 Thread GitBox
TheNeuralBit commented on a change in pull request #12704: URL: https://github.com/apache/beam/pull/12704#discussion_r490431373 ## File path: sdks/python/apache_beam/runners/interactive/display/pcoll_visualization.py ## @@ -407,13 +392,7 @@ def _display_dataframe(self, data,

[GitHub] [beam] codecov[bot] edited a comment on pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12727: URL: https://github.com/apache/beam/pull/12727#issuecomment-683229966 # [Codecov](https://codecov.io/gh/apache/beam/pull/12727?src=pr=h1) Report > Merging [#12727](https://codecov.io/gh/apache/beam/pull/12727?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12865: [BEAM-10921] Revert "Merge pull request #12704 from [BEAM-10603] Implement the new…

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12865: URL: https://github.com/apache/beam/pull/12865#issuecomment-694375859 # [Codecov](https://codecov.io/gh/apache/beam/pull/12865?src=pr=h1) Report > Merging [#12865](https://codecov.io/gh/apache/beam/pull/12865?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12865: [BEAM-10921] Revert "Merge pull request #12704 from [BEAM-10603] Implement the new…

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12865: URL: https://github.com/apache/beam/pull/12865#issuecomment-694375859 # [Codecov](https://codecov.io/gh/apache/beam/pull/12865?src=pr=h1) Report > Merging [#12865](https://codecov.io/gh/apache/beam/pull/12865?src=pr=desc) into

[GitHub] [beam] codecov[bot] edited a comment on pull request #12727: [BEAM-10844] Add experiment option prebuild_sdk_container to prebuild python sdk container with dependencies.

2020-09-17 Thread GitBox
codecov[bot] edited a comment on pull request #12727: URL: https://github.com/apache/beam/pull/12727#issuecomment-683229966 # [Codecov](https://codecov.io/gh/apache/beam/pull/12727?src=pr=h1) Report > Merging [#12727](https://codecov.io/gh/apache/beam/pull/12727?src=pr=desc) into

[GitHub] [beam] rohdesamuel commented on pull request #12799: [BEAM-10603] Add record_pipeline, clear to RM and fix duration limiter

2020-09-17 Thread GitBox
rohdesamuel commented on pull request #12799: URL: https://github.com/apache/beam/pull/12799#issuecomment-694388520 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

<    1   2