[GitHub] [beam] kamilwu opened a new pull request #11248: Reduce element size while executing CoGroupByKey operation

2020-03-27 Thread GitBox
kamilwu opened a new pull request #11248: Reduce element size while executing CoGroupByKey operation URL: https://github.com/apache/beam/pull/11248 A `beam.Map(lambda x: (x, x))` step in co_group_by_key_test.py was introducing a significant memory overhead by duplicating all input data.

[GitHub] [beam] kamilwu commented on issue #11248: Reduce element size while executing CoGroupByKey operation

2020-03-27 Thread GitBox
kamilwu commented on issue #11248: Reduce element size while executing CoGroupByKey operation URL: https://github.com/apache/beam/pull/11248#issuecomment-604924671 Run Load Tests Python CoGBK Dataflow Batch This is an

[GitHub] [beam] kamilwu removed a comment on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu removed a comment on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604908152 Run Python Load Tests Combine Flink Batch This

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604929753 Run Seed Job This is an automated message from the

[GitHub] [beam] alexvanboxel merged pull request #11218: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder

2020-03-27 Thread GitBox
alexvanboxel merged pull request #11218: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder URL: https://github.com/apache/beam/pull/11218 This is an automated message from the Apache Git Service. To

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604906637 Run Python Load Tests ParDo Flink Batch This is an

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604906681 Run Python Load Tests Combine Flink Batch This is an

[GitHub] [beam] iemejia commented on issue #11210: [WIP] [BEAM-8949] SpannerIO Read integration tests

2020-03-27 Thread GitBox
iemejia commented on issue #11210: [WIP] [BEAM-8949] SpannerIO Read integration tests URL: https://github.com/apache/beam/pull/11210#issuecomment-604913319 Run Python PostCommit This is an automated message from the Apache

[GitHub] [beam] iemejia commented on issue #11209: update/remove LTS policy

2020-03-27 Thread GitBox
iemejia commented on issue #11209: update/remove LTS policy URL: https://github.com/apache/beam/pull/11209#issuecomment-604915010 Mmmm it seems there are other mentions of LTS in more pages, can you please remove/update those too @brucearctor. Thanks!

[GitHub] [beam] mxm merged pull request #11220: [BEAM-9573][release-2.20] Correct computing of watermark hold for timer output timestamp

2020-03-27 Thread GitBox
mxm merged pull request #11220: [BEAM-9573][release-2.20] Correct computing of watermark hold for timer output timestamp URL: https://github.com/apache/beam/pull/11220 This is an automated message from the Apache Git

[GitHub] [beam] mxm commented on issue #11220: [BEAM-9573][release-2.20] Correct computing of watermark hold for timer output timestamp

2020-03-27 Thread GitBox
mxm commented on issue #11220: [BEAM-9573][release-2.20] Correct computing of watermark hold for timer output timestamp URL: https://github.com/apache/beam/pull/11220#issuecomment-604880488 Awesome. Thanks for the patience!

[GitHub] [beam] mszb commented on issue #11210: [WIP] [BEAM-8949] SpannerIO Read integration tests

2020-03-27 Thread GitBox
mszb commented on issue #11210: [WIP] [BEAM-8949] SpannerIO Read integration tests URL: https://github.com/apache/beam/pull/11210#issuecomment-604885922 @iemejia @aaltay. Could you please run the post-commit tests as well! `Run Python PostCommit` Thanks!

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604905471 Run Load Tests Python GBK Flink Batch This is an

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604934554 Run Load Tests Python GBK Flink Batch This is an

[GitHub] [beam] mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server.

2020-03-27 Thread GitBox
mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server. URL: https://github.com/apache/beam/pull/11189#discussion_r399108204 ## File path: sdks/python/apache_beam/options/pipeline_options.py ## @@ -285,10

[GitHub] [beam] mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server.

2020-03-27 Thread GitBox
mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server. URL: https://github.com/apache/beam/pull/11189#discussion_r399107521 ## File path: sdks/python/apache_beam/options/pipeline_options.py ## @@ -285,10

[GitHub] [beam] echauchot commented on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner

2020-03-27 Thread GitBox
echauchot commented on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner URL: https://github.com/apache/beam/pull/11055#issuecomment-604900507 > I think the point of the comment (or at least on my case on OOM) was not about this PR solving it or not but more about

[GitHub] [beam] kamilwu removed a comment on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu removed a comment on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604906681 Run Python Load Tests Combine Flink Batch This

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604908152 Run Python Load Tests Combine Flink Batch This is an

[GitHub] [beam] Hannah-Jiang commented on issue #11243: [BEAM-9136]Add licenses for dependencies for Java

2020-03-27 Thread GitBox
Hannah-Jiang commented on issue #11243: [BEAM-9136]Add licenses for dependencies for Java URL: https://github.com/apache/beam/pull/11243#issuecomment-604866764 R: @robertwb, @alanmyrvold Cc: @tvalentyn This is an

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-604877826 Run Seed Job This is an automated message from the

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-605016809 Unfortunately, I have no stack traces or error messages. I had to cancel the jobs manually after a long period of

[GitHub] [beam] echauchot edited a comment on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner

2020-03-27 Thread GitBox
echauchot edited a comment on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner URL: https://github.com/apache/beam/pull/11055#issuecomment-605020089 > Yes, I agree that materialisation and out of memory should be addressed in different Jira/PR > Could you post

[GitHub] [beam] echauchot commented on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner

2020-03-27 Thread GitBox
echauchot commented on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner URL: https://github.com/apache/beam/pull/11055#issuecomment-605020089 > Yes, I agree that materialisation and out of memory should be addressed in different Jira/PR > Could you post the

[GitHub] [beam] lukecwik commented on issue #11184: [BEAM-4374] Update protos related to MonitoringInfo.

2020-03-27 Thread GitBox
lukecwik commented on issue #11184: [BEAM-4374] Update protos related to MonitoringInfo. URL: https://github.com/apache/beam/pull/11184#issuecomment-605020500 Run Java PreCommit This is an automated message from the Apache

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605031722 Run Python PreCommit This is an automated message from the

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605031824 Run Python2_PVR_Flink PreCommit This is an automated

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605032008 Run Portable_Python PreCommit This is an automated message

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605031622 Run Java PreCommit This is an automated message from the

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605031496 Run Java PreCommi This is an automated message from the

[GitHub] [beam] y1chi commented on issue #11104: Update BigQuery source in bigquery_tornadoes example

2020-03-27 Thread GitBox
y1chi commented on issue #11104: Update BigQuery source in bigquery_tornadoes example URL: https://github.com/apache/beam/pull/11104#issuecomment-605042187 Run Python PreCommit This is an automated message from the Apache

[GitHub] [beam] echauchot edited a comment on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner

2020-03-27 Thread GitBox
echauchot edited a comment on issue #11055: [BEAM-9436] Improve GBK in spark structured streaming runner URL: https://github.com/apache/beam/pull/11055#issuecomment-605020089 > Yes, I agree that materialisation and out of memory should be addressed in different Jira/PR > Could you post

[GitHub] [beam] alexvanboxel commented on issue #11249: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder

2020-03-27 Thread GitBox
alexvanboxel commented on issue #11249: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder URL: https://github.com/apache/beam/pull/11249#issuecomment-604973298 As this was an oversight of a forgotten refactor, merging in.

[GitHub] [beam] kamilwu closed pull request #11248: Reduce element size while executing CoGroupByKey operation

2020-03-27 Thread GitBox
kamilwu closed pull request #11248: Reduce element size while executing CoGroupByKey operation URL: https://github.com/apache/beam/pull/11248 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
kamilwu commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-605009385 @mxm Thanks, the option names are now correct and properly recognized by Flink. I had one more problem. GroupByKey

[GitHub] [beam] coheigea commented on issue #11191: [BEAM-9570] Harden deserialization in SerializableCoder

2020-03-27 Thread GitBox
coheigea commented on issue #11191: [BEAM-9570] Harden deserialization in SerializableCoder URL: https://github.com/apache/beam/pull/11191#issuecomment-604978096 I'll close this PR due to the comments above, and update the JIRA to reflect instead the proposals on the mailing list.

[GitHub] [beam] coheigea closed pull request #11191: [BEAM-9570] Harden deserialization in SerializableCoder

2020-03-27 Thread GitBox
coheigea closed pull request #11191: [BEAM-9570] Harden deserialization in SerializableCoder URL: https://github.com/apache/beam/pull/11191 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] alexvanboxel merged pull request #11249: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder

2020-03-27 Thread GitBox
alexvanboxel merged pull request #11249: [BEAM-9605] BIP-1: Rename setRowOption to setOption on Option builder URL: https://github.com/apache/beam/pull/11249 This is an automated message from the Apache Git Service. To

[GitHub] [beam] mxm commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors.

2020-03-27 Thread GitBox
mxm commented on issue #11193: [BEAM-9550] Increase JVM Metaspace size for the TaskExecutors. URL: https://github.com/apache/beam/pull/11193#issuecomment-605011286 > @mxm Thanks, the option names are now correct and properly recognized by Flink. Nice. > I had one more

[GitHub] [beam] alexvanboxel commented on issue #10883: [BEAM-9331] Add better Row builders

2020-03-27 Thread GitBox
alexvanboxel commented on issue #10883: [BEAM-9331] Add better Row builders URL: https://github.com/apache/beam/pull/10883#issuecomment-605200678 > @alexvanboxel I would rather not in this PR, because the RowUtils API wasn't designed for public usage. If we were to make it public, I would

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605201208 Run Python PreCommit This

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605201122 Python pre commit failed with an unrelated error: 11:24:10 > Failed to list

[GitHub] [beam] amaliujia opened a new pull request #11252: [BEAM-9557] Fix timer window boundary checking

2020-03-27 Thread GitBox
amaliujia opened a new pull request #11252: [BEAM-9557] Fix timer window boundary checking URL: https://github.com/apache/beam/pull/11252 R @aaltay @reuvenlax @steveniemitz Sorry for sending Reuven's change #11226 in this PR. I am just trying to help to solve this release blocker

[GitHub] [beam] Ardagan commented on issue #11182: Add Heartbeat Transform and slowly changing side input documentation

2020-03-27 Thread GitBox
Ardagan commented on issue #11182: Add Heartbeat Transform and slowly changing side input documentation URL: https://github.com/apache/beam/pull/11182#issuecomment-605283633 Run Python PreCommit This is an automated message

[GitHub] [beam] amaliujia commented on issue #11252: [BEAM-9557] Fix timer window boundary checking

2020-03-27 Thread GitBox
amaliujia commented on issue #11252: [BEAM-9557] Fix timer window boundary checking URL: https://github.com/apache/beam/pull/11252#issuecomment-605283852 retest this please This is an automated message from the Apache Git

[GitHub] [beam] brucearctor commented on issue #11209: update/remove LTS policy

2020-03-27 Thread GitBox
brucearctor commented on issue #11209: update/remove LTS policy URL: https://github.com/apache/beam/pull/11209#issuecomment-605287368 will do This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] amaliujia commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
amaliujia commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605323799 @aaltay I will take care of this PR to get it merged.

[GitHub] [beam] Hannah-Jiang commented on issue #11240: [BEAM-8466] Make strip_iterable more strict

2020-03-27 Thread GitBox
Hannah-Jiang commented on issue #11240: [BEAM-8466] Make strip_iterable more strict URL: https://github.com/apache/beam/pull/11240#issuecomment-605213341 PythonDocker is a new job added temporary yesterday to test the scripts. It was disabled now and you can ignore it.

[GitHub] [beam] ihji commented on a change in pull request #10055: [BEAM-8603] Add Python SqlTransform

2020-03-27 Thread GitBox
ihji commented on a change in pull request #10055: [BEAM-8603] Add Python SqlTransform URL: https://github.com/apache/beam/pull/10055#discussion_r399496783 ## File path: buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy ## @@ -1779,6 +1779,33 @@

[GitHub] [beam] chamikaramj commented on issue #11254: [BEAM-7961] Refactors X-Lang test pipelines.

2020-03-27 Thread GitBox
chamikaramj commented on issue #11254: [BEAM-7961] Refactors X-Lang test pipelines. URL: https://github.com/apache/beam/pull/11254#issuecomment-605309808 Run XVR_Flink PostCommit This is an automated message from the Apache

[GitHub] [beam] chamikaramj commented on issue #11254: [BEAM-7961] Refactors X-Lang test pipelines.

2020-03-27 Thread GitBox
chamikaramj commented on issue #11254: [BEAM-7961] Refactors X-Lang test pipelines. URL: https://github.com/apache/beam/pull/11254#issuecomment-605310044 R: @ihji This is an automated message from the Apache Git Service. To

[GitHub] [beam] chamikaramj opened a new pull request #11254: [BEAM-] Refactors X-Lang test pipelines.

2020-03-27 Thread GitBox
chamikaramj opened a new pull request #11254: [BEAM-] Refactors X-Lang test pipelines. URL: https://github.com/apache/beam/pull/11254 This will allow us to re-use these pipelines in other tests without copying. Thank you for your contribution! Follow

[GitHub] [beam] amaliujia opened a new pull request #11253: Rw beam 9557

2020-03-27 Thread GitBox
amaliujia opened a new pull request #11253: Rw beam 9557 URL: https://github.com/apache/beam/pull/11253 R @aaltay cherry-pick https://github.com/apache/beam/pull/11252 Thank you for your contribution! Follow this checklist to help us

[GitHub] [beam] lostluck commented on issue #11197: [BEAM-8292] Portable Reshuffle for Go SDK

2020-03-27 Thread GitBox
lostluck commented on issue #11197: [BEAM-8292] Portable Reshuffle for Go SDK URL: https://github.com/apache/beam/pull/11197#issuecomment-605211109 Retest this please This is an automated message from the Apache Git Service.

[GitHub] [beam] amaliujia commented on issue #11253: Rw beam 9557

2020-03-27 Thread GitBox
amaliujia commented on issue #11253: Rw beam 9557 URL: https://github.com/apache/beam/pull/11253#issuecomment-605210774 O actually this is not right way to create cherry-pick PR. closing now. This is an automated message from

[GitHub] [beam] aaltay commented on issue #11240: [BEAM-8466] Make strip_iterable more strict

2020-03-27 Thread GitBox
aaltay commented on issue #11240: [BEAM-8466] Make strip_iterable more strict URL: https://github.com/apache/beam/pull/11240#issuecomment-605210924 > Ignoring PythonDocker error. Looks like a new job @Hannah-Jiang - do you know what this error is?

[GitHub] [beam] amaliujia closed pull request #11253: Rw beam 9557

2020-03-27 Thread GitBox
amaliujia closed pull request #11253: Rw beam 9557 URL: https://github.com/apache/beam/pull/11253 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [beam] lukecwik commented on issue #11184: [BEAM-4374] Update protos related to MonitoringInfo.

2020-03-27 Thread GitBox
lukecwik commented on issue #11184: [BEAM-4374] Update protos related to MonitoringInfo. URL: https://github.com/apache/beam/pull/11184#issuecomment-605299101 https://builds.apache.org/job/beam_PreCommit_Java_Examples_Dataflow_Commit/7318/ passed, merging

[GitHub] [beam] lukecwik merged pull request #11184: [BEAM-4374] Update protos related to MonitoringInfo.

2020-03-27 Thread GitBox
lukecwik merged pull request #11184: [BEAM-4374] Update protos related to MonitoringInfo. URL: https://github.com/apache/beam/pull/11184 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment

2020-03-27 Thread GitBox
chamikaramj commented on issue #11039: [BEAM-9383] Staging Dataflow artifacts from environment URL: https://github.com/apache/beam/pull/11039#issuecomment-605298889 Run Python PreCommit This is an automated message from the

[GitHub] [beam] reuvenlax commented on issue #11226: [BEAM-9557] Fix timer window boundary checking

2020-03-27 Thread GitBox
reuvenlax commented on issue #11226: [BEAM-9557] Fix timer window boundary checking URL: https://github.com/apache/beam/pull/11226#issuecomment-605313456 @aaltay fixing this now This is an automated message from the Apache

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570601 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570204 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570251 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570217 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570237 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
pabloem commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399570655 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py

[GitHub] [beam] lukecwik commented on issue #11203: [BEAM-9577] Define and implement dependency-aware artifact staging service.

2020-03-27 Thread GitBox
lukecwik commented on issue #11203: [BEAM-9577] Define and implement dependency-aware artifact staging service. URL: https://github.com/apache/beam/pull/11203#issuecomment-605204144 Run PythonDocker PreCommit This is an

[GitHub] [beam] lukecwik commented on issue #11203: [BEAM-9577] Define and implement dependency-aware artifact staging service.

2020-03-27 Thread GitBox
lukecwik commented on issue #11203: [BEAM-9577] Define and implement dependency-aware artifact staging service. URL: https://github.com/apache/beam/pull/11203#issuecomment-605204087 Run JavaPortabilityApi PreCommit This is

[GitHub] [beam] pabloem commented on issue #11151: [BEAM-9468] Hl7v2 io

2020-03-27 Thread GitBox
pabloem commented on issue #11151: [BEAM-9468] Hl7v2 io URL: https://github.com/apache/beam/pull/11151#issuecomment-605212812 retest this please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] Ardagan commented on issue #11182: Add Heartbeat Transform and slowly changing side input documentation

2020-03-27 Thread GitBox
Ardagan commented on issue #11182: Add Heartbeat Transform and slowly changing side input documentation URL: https://github.com/apache/beam/pull/11182#issuecomment-605213297 Run Python PreCommit This is an automated message

[GitHub] [beam] aaltay removed a comment on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay removed a comment on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605295380 Run Python PreCommit

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605295558 Run Python PreCommit This

[GitHub] [beam] aaltay removed a comment on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay removed a comment on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605295207 Run Python PreCommit

[GitHub] [beam] angoenka commented on issue #10870: [BEAM-9263] Bump up sdk dataflow environment major versions

2020-03-27 Thread GitBox
angoenka commented on issue #10870: [BEAM-9263] Bump up sdk dataflow environment major versions URL: https://github.com/apache/beam/pull/10870#issuecomment-605295774 Retest this please This is an automated message from the

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605295380 Run Python PreCommit This

[GitHub] [beam] mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server.

2020-03-27 Thread GitBox
mxm commented on a change in pull request #11189: [BEAM-9446] Retain unknown arguments when using uber jar job server. URL: https://github.com/apache/beam/pull/11189#discussion_r399538469 ## File path: sdks/python/apache_beam/options/pipeline_options.py ## @@ -285,10

[GitHub] [beam] reuvenlax commented on issue #10883: [BEAM-9331] Add better Row builders

2020-03-27 Thread GitBox
reuvenlax commented on issue #10883: [BEAM-9331] Add better Row builders URL: https://github.com/apache/beam/pull/10883#issuecomment-605320135 run sql postcommit This is an automated message from the Apache Git Service. To

[GitHub] [beam] robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support URL: https://github.com/apache/beam/pull/11232#discussion_r399553756 ## File path: website/src/documentation/sdks/python-type-safety.md ## @@ -23,38 +23,58 @@ Python

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605330242 > @aaltay I will take care of this PR to get it merged. Thank you!

[GitHub] [beam] robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support URL: https://github.com/apache/beam/pull/11232#discussion_r399554700 ## File path: website/src/documentation/sdks/python-type-safety.md ## @@ -64,22 +84,75 @@ To

[GitHub] [beam] robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11232: [BEAM-8280] Document Python 3 annotations support URL: https://github.com/apache/beam/pull/11232#discussion_r399554554 ## File path: website/src/documentation/sdks/python-type-safety.md ## @@ -64,22 +84,75 @@ To

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399557293 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399556279 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399558218 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399555388 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] steveniemitz commented on issue #11226: [BEAM-9557] Fix timer window boundary checking

2020-03-27 Thread GitBox
steveniemitz commented on issue #11226: [BEAM-9557] Fix timer window boundary checking URL: https://github.com/apache/beam/pull/11226#issuecomment-605334008 looks great! These tests will be really helpful to ensure we don't have more regressions in the future. Thanks!

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399556846 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399558954 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py

[GitHub] [beam] robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11229: [BEAM-9608] Increasing scope of context managers for FnApiRunner URL: https://github.com/apache/beam/pull/11229#discussion_r399557974 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py

[GitHub] [beam] chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs

2020-03-27 Thread GitBox
chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs URL: https://github.com/apache/beam/pull/11185#discussion_r398932730 ## File path: sdks/python/apache_beam/pvalue.py

[GitHub] [beam] chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs

2020-03-27 Thread GitBox
chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs URL: https://github.com/apache/beam/pull/11185#discussion_r398161343 ## File path: sdks/python/apache_beam/pvalue.py

[GitHub] [beam] lostluck merged pull request #11239: Update the Go SDK roadmap for April 2020

2020-03-27 Thread GitBox
lostluck merged pull request #11239: Update the Go SDK roadmap for April 2020 URL: https://github.com/apache/beam/pull/11239 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs

2020-03-27 Thread GitBox
chamikaramj commented on a change in pull request #11185: [BEAM-8019] Updates Python SDK to handle remote SDK coders and preserve tags added by remote SDKs URL: https://github.com/apache/beam/pull/11185#discussion_r397946718 ## File path: sdks/python/apache_beam/coders/coders.py

[GitHub] [beam] y1chi commented on issue #11104: Update BigQuery source in bigquery_tornadoes example

2020-03-27 Thread GitBox
y1chi commented on issue #11104: Update BigQuery source in bigquery_tornadoes example URL: https://github.com/apache/beam/pull/11104#issuecomment-605294895 @pabloem do you mind merge this? This is an automated message from

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605295207 Run Python PreCommit This

[GitHub] [beam] jaketf commented on a change in pull request #11151: [BEAM-9468] Hl7v2 io

2020-03-27 Thread GitBox
jaketf commented on a change in pull request #11151: [BEAM-9468] Hl7v2 io URL: https://github.com/apache/beam/pull/11151#discussion_r399452501 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/HL7v2IO.java ## @@ -0,0

[GitHub] [beam] aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0

2020-03-27 Thread GitBox
aaltay commented on issue #11251: Merge pull request #11245 - Update the range for pyarrow to support new pyarrow version 0.16.0 URL: https://github.com/apache/beam/pull/11251#issuecomment-605296166 Run Python PreCommit This

[GitHub] [beam] reuvenlax commented on issue #11226: [BEAM-9557] Fix timer window boundary checking

2020-03-27 Thread GitBox
reuvenlax commented on issue #11226: [BEAM-9557] Fix timer window boundary checking URL: https://github.com/apache/beam/pull/11226#issuecomment-605321717 @aaltay added new unit tests and fixed the broken one. However I'm noticing that test triggering seems broken on a number of PRs now.

[GitHub] [beam] robertwb commented on a change in pull request #11060: [BEAM-9454] Create Deduplication transform based on user timer/state

2020-03-27 Thread GitBox
robertwb commented on a change in pull request #11060: [BEAM-9454] Create Deduplication transform based on user timer/state URL: https://github.com/apache/beam/pull/11060#discussion_r399559906 ## File path: sdks/python/apache_beam/transforms/deduplicate.py ## @@ -0,0

  1   2   3   >