[GitHub] [beam] kennknowles commented on pull request #12254: Add note on zetaSQL dependencies

2020-07-15 Thread GitBox
kennknowles commented on pull request #12254: URL: https://github.com/apache/beam/pull/12254#issuecomment-659152184 JFYI "Beam-" is mean to refer to a specific Jira id, in case you are fixing a bug. In this case there is no bug (and none needed) so we can leave it off.

[GitHub] [beam] kennknowles commented on a change in pull request #12271: [BEAM-10496] Improve nullability analysis for :sdks:java:core

2020-07-15 Thread GitBox
kennknowles commented on a change in pull request #12271: URL: https://github.com/apache/beam/pull/12271#discussion_r455494897 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/options/PipelineOptionsFactory.java ## @@ -609,24 +604,34 @@ public static void

[GitHub] [beam] robinyqiu commented on a change in pull request #12266: [BEAM-10494] PubsubSchemaCapableIOProvider config inner class rather than row

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12266: URL: https://github.com/apache/beam/pull/12266#discussion_r455494296 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaCapableIOProvider.java ## @@ -155,16

[GitHub] [beam] robinyqiu commented on a change in pull request #12266: [BEAM-10494] PubsubSchemaCapableIOProvider config inner class rather than row

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12266: URL: https://github.com/apache/beam/pull/12266#discussion_r455492426 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaCapableIOProvider.java ## @@ -264,4

[GitHub] [beam] lukecwik commented on pull request #12275: [BEAM-10420] Add support for per window invocation of beam:transform:sdf_process_sized_element_and_restrictions:v1

2020-07-15 Thread GitBox
lukecwik commented on pull request #12275: URL: https://github.com/apache/beam/pull/12275#issuecomment-659135889 R: @youngoli @boyuanzz CC: @robertwb This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] robinyqiu commented on a change in pull request #12271: [BEAM-10496] Improve nullability analysis for :sdks:java:core

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12271: URL: https://github.com/apache/beam/pull/12271#discussion_r455483223 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/util/common/ReflectHelpers.java ## @@ -74,16 +74,12 @@ public String apply(@Nonnull

[GitHub] [beam] youngoli commented on pull request #12215: [BEAM-10310] Adding thread-safe restriction tracker wrapper.

2020-07-15 Thread GitBox
youngoli commented on pull request #12215: URL: https://github.com/apache/beam/pull/12215#issuecomment-659134956 Run Go PostCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lukecwik opened a new pull request #12275: [BEAM-10420] Add support for per window invocation of beam:transform:sdf_process_sized_element_and_restrictions:v1

2020-07-15 Thread GitBox
lukecwik opened a new pull request #12275: URL: https://github.com/apache/beam/pull/12275 This removes the unused window from pair with restriction allowing for window observing splittable dofns to be exercised. Thank you for your contribution! Follow

[GitHub] [beam] kennknowles merged pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles merged pull request #12272: URL: https://github.com/apache/beam/pull/12272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] robinyqiu commented on pull request #12274: [WIP] testing

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12274: URL: https://github.com/apache/beam/pull/12274#issuecomment-659117349 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] ibzib merged pull request #12243: [BEAM-10460] Increase SparkPortableExecutionTest.testExecution timeout to 10 minutes

2020-07-15 Thread GitBox
ibzib merged pull request #12243: URL: https://github.com/apache/beam/pull/12243 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] ibzib commented on pull request #12243: [BEAM-10460] Increase SparkPortableExecutionTest.testExecution timeout to 10 minutes

2020-07-15 Thread GitBox
ibzib commented on pull request #12243: URL: https://github.com/apache/beam/pull/12243#issuecomment-659098051 Java precommit flakes (of course). BEAM-10472 and BEAM-10508 (new one) This is an automated message from

[GitHub] [beam] ZijieSong946 commented on pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
ZijieSong946 commented on pull request #12174: URL: https://github.com/apache/beam/pull/12174#issuecomment-659090461 > Internally we got 398 tests passing. > > Note that this PR turned on `LanguageFeature.FEATURE_NUMERIC_TYPE` so there are new tests enabled but are not currently

[GitHub] [beam] ZijieSong946 edited a comment on pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
ZijieSong946 edited a comment on pull request #12174: URL: https://github.com/apache/beam/pull/12174#issuecomment-659090461 > Internally we got 398 tests passing. > > Note that this PR turned on `LanguageFeature.FEATURE_NUMERIC_TYPE` so there are new tests enabled but are not

[GitHub] [beam] chamikaramj commented on a change in pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
chamikaramj commented on a change in pull request #12164: URL: https://github.com/apache/beam/pull/12164#discussion_r455446367 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -864,7 +867,7 @@ def run_GroupByKey(self, transform_node, options):

[GitHub] [beam] ihji commented on a change in pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
ihji commented on a change in pull request #12164: URL: https://github.com/apache/beam/pull/12164#discussion_r455446568 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -864,7 +867,7 @@ def run_GroupByKey(self, transform_node, options):

[GitHub] [beam] robertwb commented on a change in pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
robertwb commented on a change in pull request #12164: URL: https://github.com/apache/beam/pull/12164#discussion_r455444790 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -864,7 +867,7 @@ def run_GroupByKey(self, transform_node, options):

[GitHub] [beam] chamikaramj merged pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
chamikaramj merged pull request #12164: URL: https://github.com/apache/beam/pull/12164 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] chamikaramj commented on a change in pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
chamikaramj commented on a change in pull request #12164: URL: https://github.com/apache/beam/pull/12164#discussion_r455441379 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -864,7 +867,7 @@ def run_GroupByKey(self, transform_node, options):

[GitHub] [beam] ihji commented on pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
ihji commented on pull request #12164: URL: https://github.com/apache/beam/pull/12164#issuecomment-659084291 @chamikaramj @robertwb Any other feedback before we merge this? This is an automated message from the Apache Git

[GitHub] [beam] robinyqiu opened a new pull request #12274: [WIP] testing

2020-07-15 Thread GitBox
robinyqiu opened a new pull request #12274: URL: https://github.com/apache/beam/pull/12274 Post-Commit Tests Status (on master branch) Lang | SDK | Dataflow | Flink | Samza |

[GitHub] [beam] robertwb commented on a change in pull request #12164: [BEAM-10397] add missing environment in windowing strategy for Dataflow

2020-07-15 Thread GitBox
robertwb commented on a change in pull request #12164: URL: https://github.com/apache/beam/pull/12164#discussion_r455430204 ## File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py ## @@ -864,7 +867,7 @@ def run_GroupByKey(self, transform_node, options):

[GitHub] [beam] kennknowles commented on pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles commented on pull request #12273: URL: https://github.com/apache/beam/pull/12273#issuecomment-659071343 The level of flakiness right now is quite bad. This PR clearly did not cause those known flakes, and it unblocks other value adding work. I don't think kicking the build a

[GitHub] [beam] kennknowles merged pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles merged pull request #12273: URL: https://github.com/apache/beam/pull/12273 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] kennknowles commented on pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles commented on pull request #12273: URL: https://github.com/apache/beam/pull/12273#issuecomment-659070317 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] kennknowles commented on pull request #12243: [BEAM-10460] Increase SparkPortableExecutionTest.testExecution timeout to 10 minutes

2020-07-15 Thread GitBox
kennknowles commented on pull request #12243: URL: https://github.com/apache/beam/pull/12243#issuecomment-659067344 Is it still deadlocking? I've actually just been doing other things and didn't even read the logs the last few times.

[GitHub] [beam] kennknowles commented on pull request #12243: [BEAM-10460] Increase SparkPortableExecutionTest.testExecution timeout to 10 minutes

2020-07-15 Thread GitBox
kennknowles commented on pull request #12243: URL: https://github.com/apache/beam/pull/12243#issuecomment-659067153 Re-opening because why not also just bump this up and eliminate it from consideration. This is an automated

[GitHub] [beam] aaltay merged pull request #12252: [BEAM-7390] Add combineglobally code snippets

2020-07-15 Thread GitBox
aaltay merged pull request #12252: URL: https://github.com/apache/beam/pull/12252 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] aaltay merged pull request #12269: Updated output tags

2020-07-15 Thread GitBox
aaltay merged pull request #12269: URL: https://github.com/apache/beam/pull/12269 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] apilloud merged pull request #12240: [BEAM-10462] transforms handle Double.NaN

2020-07-15 Thread GitBox
apilloud merged pull request #12240: URL: https://github.com/apache/beam/pull/12240 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] kennknowles commented on pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles commented on pull request #12272: URL: https://github.com/apache/beam/pull/12272#issuecomment-659050891 Flakes in this run: - https://issues.apache.org/jira/browse/BEAM-10460 `SparkPortableExecutionTest` - https://issues.apache.org/jira/browse/BEAM-10471

[GitHub] [beam] robinyqiu merged pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
robinyqiu merged pull request #12174: URL: https://github.com/apache/beam/pull/12174 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] robinyqiu commented on pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12174: URL: https://github.com/apache/beam/pull/12174#issuecomment-659049262 Internally we got 398 tests passing. Note that this PR turned on `LanguageFeature.FEATURE_NUMERIC_TYPE` so there are new tests enabled but are not currently supported.

[GitHub] [beam] robinyqiu commented on pull request #12261: [BEAM-10490] Support read/write ZetaSQL DATE/TIME types from/to BigQuery

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12261: URL: https://github.com/apache/beam/pull/12261#issuecomment-659048335 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] kennknowles commented on pull request #12271: [BEAM-10496] Improve nullability analysis for :sdks:java:core

2020-07-15 Thread GitBox
kennknowles commented on pull request #12271: URL: https://github.com/apache/beam/pull/12271#issuecomment-659040809 Based on the quality of null handling in zetasketch, pinging you on other similar PRs @robinyqiu This is

[GitHub] [beam] kennknowles merged pull request #12126: Update docs for Reshuffle to remove the reference for deduplication

2020-07-15 Thread GitBox
kennknowles merged pull request #12126: URL: https://github.com/apache/beam/pull/12126 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] amaliujia commented on a change in pull request #12232: [Beam-9543] Support Match Recognition in Beam SQL

2020-07-15 Thread GitBox
amaliujia commented on a change in pull request #12232: URL: https://github.com/apache/beam/pull/12232#discussion_r455392148 ## File path: sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/rel/BeamMatchRelTest.java ## @@ -0,0 +1,75 @@ +/* + *

[GitHub] [beam] amaliujia commented on pull request #12232: [Beam-9543] Support Match Recognition in Beam SQL

2020-07-15 Thread GitBox
amaliujia commented on pull request #12232: URL: https://github.com/apache/beam/pull/12232#issuecomment-659039166 @Mark-Zeng thanks for your update on this PR. Let me know when you think this PR is ready for review again.

[GitHub] [beam] apilloud commented on pull request #12240: [BEAM-10462] transforms handle Double.NaN

2020-07-15 Thread GitBox
apilloud commented on pull request #12240: URL: https://github.com/apache/beam/pull/12240#issuecomment-659037813 Failure is BEAM-9187 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] apilloud commented on pull request #12240: [BEAM-10462] transforms handle Double.NaN

2020-07-15 Thread GitBox
apilloud commented on pull request #12240: URL: https://github.com/apache/beam/pull/12240#issuecomment-659037902 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tysonjh commented on a change in pull request #8558: [BEAM-7131] Spark: cache executable stage output to prevent re-computation

2020-07-15 Thread GitBox
tysonjh commented on a change in pull request #8558: URL: https://github.com/apache/beam/pull/8558#discussion_r455362373 ## File path: runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkTranslationContext.java ## @@ -17,6 +17,7 @@ */ package

[GitHub] [beam] kennknowles commented on pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles commented on pull request #12273: URL: https://github.com/apache/beam/pull/12273#issuecomment-659028721 Added illegal import to checkstyle configuration. Confirmed that with the commit reverted it fails: https://gradle.com/s/5dv5sua4hj2n6

[GitHub] [beam] kennknowles commented on pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles commented on pull request #12273: URL: https://github.com/apache/beam/pull/12273#issuecomment-659026632 I imagine if javax Nullable did the trick, then the checker folks would not have created their own. This is

[GitHub] [beam] kennknowles commented on pull request #12273: Replace com.sun.istack.Nullable with checkframework Nullable

2020-07-15 Thread GitBox
kennknowles commented on pull request #12273: URL: https://github.com/apache/beam/pull/12273#issuecomment-659026520 @tysonjh yea you cannot use javax Nullable at "type use" so you cannot have e.g. `List<@Nullable Foo>`. And there are a few other cases.

[GitHub] [beam] tysonjh commented on a change in pull request #8558: [BEAM-7131] Spark: cache executable stage output to prevent re-computation

2020-07-15 Thread GitBox
tysonjh commented on a change in pull request #8558: URL: https://github.com/apache/beam/pull/8558#discussion_r455362373 ## File path: runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkTranslationContext.java ## @@ -17,6 +17,7 @@ */ package

[GitHub] [beam] robinyqiu commented on a change in pull request #12267: [WIP][BEAM-10408] Schema capable io wrapper pubsub

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12267: URL: https://github.com/apache/beam/pull/12267#discussion_r455362415 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/pubsub/PubsubJsonTableProvider.java ## @@ -17,63

[GitHub] [beam] ibzib commented on pull request #12270: [BEAM-10025] [Samza] Exclude UsesUnboundedPCollections tests.

2020-07-15 Thread GitBox
ibzib commented on pull request #12270: URL: https://github.com/apache/beam/pull/12270#issuecomment-659021482 testMultiOutputParDoWithSideInputsIsCumulative is an unrelated flake. This is an automated message from the Apache

[GitHub] [beam] ibzib merged pull request #12270: [BEAM-10025] [Samza] Exclude UsesUnboundedPCollections tests.

2020-07-15 Thread GitBox
ibzib merged pull request #12270: URL: https://github.com/apache/beam/pull/12270 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] kennknowles commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
kennknowles commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-659022248 There's a real build break. #12273 to fix it and/or you can cherrypick the commit here. This is an

[GitHub] [beam] kennknowles commented on a change in pull request #8558: [BEAM-7131] Spark: cache executable stage output to prevent re-computation

2020-07-15 Thread GitBox
kennknowles commented on a change in pull request #8558: URL: https://github.com/apache/beam/pull/8558#discussion_r455360189 ## File path: runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkTranslationContext.java ## @@ -17,6 +17,7 @@ */ package

[GitHub] [beam] kennknowles edited a comment on pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles edited a comment on pull request #12272: URL: https://github.com/apache/beam/pull/12272#issuecomment-659014899 And may I say @robinyqiu very nice work. This is the cleanest module I have encountered probably in my career. All I did was add trivial annotations, and the module

[GitHub] [beam] kennknowles edited a comment on pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles edited a comment on pull request #12272: URL: https://github.com/apache/beam/pull/12272#issuecomment-659014899 And may I say @robinyqiu very nice work. This is the cleanest module I have encountered probably in my career. All I did was add trivial annotations, and the module

[GitHub] [beam] kennknowles commented on pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles commented on pull request #12272: URL: https://github.com/apache/beam/pull/12272#issuecomment-659014899 And may I say @robinyqiu very nice work. This is the cleanest module I have encountered probably in my career. All I did was add trivial annotations, and the module was

[GitHub] [beam] kennknowles opened a new pull request #12272: [BEAM-10502] Enable checker in zetasketch extension

2020-07-15 Thread GitBox
kennknowles opened a new pull request #12272: URL: https://github.com/apache/beam/pull/12272 This enables the checker analyzer in the Zetasketch extension, preventing nullability errors in this module. In this PR is an independent commit that prepares `Combine` for other modules to

[GitHub] [beam] robinyqiu commented on a change in pull request #12267: [WIP][BEAM-10408] Schema capable io wrapper pubsub

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12267: URL: https://github.com/apache/beam/pull/12267#discussion_r455351279 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/SchemaCapableIOTableProviderWrapper.java ## @@

[GitHub] [beam] robinyqiu commented on a change in pull request #12267: [WIP][BEAM-10408] Schema capable io wrapper pubsub

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12267: URL: https://github.com/apache/beam/pull/12267#discussion_r455351279 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/SchemaCapableIOTableProviderWrapper.java ## @@

[GitHub] [beam] robinyqiu commented on pull request #12247: [BEAM-9179] Refactor: move Java function implementations to a sub-module

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12247: URL: https://github.com/apache/beam/pull/12247#issuecomment-659010570 Tested internally. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] udim commented on a change in pull request #12009: [BEAM-10258] Support type hint annotations on PTransform's expand()

2020-07-15 Thread GitBox
udim commented on a change in pull request #12009: URL: https://github.com/apache/beam/pull/12009#discussion_r455342332 ## File path: website/www/site/content/en/documentation/sdks/python-type-safety.md ## @@ -90,6 +91,15 @@ The following code declares an `int` input and a

[GitHub] [beam] robinyqiu commented on pull request #12261: [BEAM-10490] Support read/write ZetaSQL DATE/TIME types from/to BigQuery

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12261: URL: https://github.com/apache/beam/pull/12261#issuecomment-659008094 Ah, thanks for catching that. Test added. This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] kennknowles opened a new pull request #12271: [BEAM-10496] Improve nullability analysis for :sdks:java:core

2020-07-15 Thread GitBox
kennknowles opened a new pull request #12271: URL: https://github.com/apache/beam/pull/12271 The total number of nullability issues in `:sdks:java:core` is very high. These are some baby steps towards embracing nullability typing. While not discovering any latent NPE this time, it did

[GitHub] [beam] kennknowles commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
kennknowles commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658995800 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] kennknowles commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
kennknowles commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658994369 Oddly enough, the test failure did not get uploaded in the gradle scan. The scan is just for the license pull.

[GitHub] [beam] ibzib commented on pull request #12270: [BEAM-10025] [Samza] Exclude UsesUnboundedPCollections tests.

2020-07-15 Thread GitBox
ibzib commented on pull request #12270: URL: https://github.com/apache/beam/pull/12270#issuecomment-658993658 Run Samza ValidatesRunner This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #12262: [BEAM-10491] Simplify PeriodicSequence generator to use OffsetRanges with whole whole numbers

2020-07-15 Thread GitBox
pabloem commented on pull request #12262: URL: https://github.com/apache/beam/pull/12262#issuecomment-658991901 thanks Luke! It looks nice! : P This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] pabloem merged pull request #12262: [BEAM-10491] Simplify PeriodicSequence generator to use OffsetRanges with whole whole numbers

2020-07-15 Thread GitBox
pabloem merged pull request #12262: URL: https://github.com/apache/beam/pull/12262 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] iemejia merged pull request #12265: [BEAM-8727] Bump software.amazon.awssdk to 2.13.54

2020-07-15 Thread GitBox
iemejia merged pull request #12265: URL: https://github.com/apache/beam/pull/12265 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] ibzib opened a new pull request #12270: [BEAM-10025] [Samza] Exclude UsesUnboundedPCollections tests.

2020-07-15 Thread GitBox
ibzib opened a new pull request #12270: URL: https://github.com/apache/beam/pull/12270 The Samza runner is already excluding all the other tests annotated `UsesUnboundedPCollections`. Before: 226 tests completed, 1 failed, 2 skipped After: 225 tests completed, 0 failed, 2 skipped

[GitHub] [beam] lukecwik commented on pull request #12262: [BEAM-10491] Simplify PeriodicSequence generator to use OffsetRanges with whole whole numbers

2020-07-15 Thread GitBox
lukecwik commented on pull request #12262: URL: https://github.com/apache/beam/pull/12262#issuecomment-658980867 Run Python2_PVR_Flink PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] tysonjh commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
tysonjh commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658979464 R: @kennknowles I added some license comments just to be cautious. This is an automated message from the

[GitHub] [beam] kennknowles commented on a change in pull request #12254: [BEAM-XXXX] Add note on zetaSQL dependencies

2020-07-15 Thread GitBox
kennknowles commented on a change in pull request #12254: URL: https://github.com/apache/beam/pull/12254#discussion_r455302615 ## File path: website/www/site/content/en/documentation/dsls/sql/overview.md ## @@ -55,8 +55,12 @@ For more information on the ZetaSQL features in

[GitHub] [beam] tysonjh commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
tysonjh commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658963802 Run JavaPortabilityApiJava11 PreCommit This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] tysonjh commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
tysonjh commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658963480 Run Java_Examples_Dataflow_Java11 PreCommit This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] tysonjh commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
tysonjh commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658963276 Run Java_Examples_Dataflow_Java11 PreCommit please This is an automated message from the Apache Git Service. To

[GitHub] [beam] robertwb closed pull request #12259: [BEAM-9561] Run Pandas tests on Beam.

2020-07-15 Thread GitBox
robertwb closed pull request #12259: URL: https://github.com/apache/beam/pull/12259 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] robertwb commented on pull request #12259: [BEAM-9561] Run Pandas tests on Beam.

2020-07-15 Thread GitBox
robertwb commented on pull request #12259: URL: https://github.com/apache/beam/pull/12259#issuecomment-658956391 R: @ibzib Could you take a look at this? This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] davidcavazos edited a comment on pull request #12252: [BEAM-7390] Add combineglobally code snippets

2020-07-15 Thread GitBox
davidcavazos edited a comment on pull request #12252: URL: https://github.com/apache/beam/pull/12252#issuecomment-658939252 I also noticed that the output tags were a little misleading now since we are showing the stdout instead of an output PCollection. Opened #12269 for that

[GitHub] [beam] davidcavazos opened a new pull request #12269: Updated output tags

2020-07-15 Thread GitBox
davidcavazos opened a new pull request #12269: URL: https://github.com/apache/beam/pull/12269 **No content changes** Now that we are displaying the `stdout` content instead of the `PCollection` contents, the previous output tag was a little misleading. This just goes through all

[GitHub] [beam] tysonjh commented on pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency.

2020-07-15 Thread GitBox
tysonjh commented on pull request #12268: URL: https://github.com/apache/beam/pull/12268#issuecomment-658940970 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] davidcavazos commented on pull request #12252: [BEAM-7390] Add combineglobally code snippets

2020-07-15 Thread GitBox
davidcavazos commented on pull request #12252: URL: https://github.com/apache/beam/pull/12252#issuecomment-658939252 I also noticed that the output tags were a little misleading now since we are showing the stdout instead of an output PCollection

[GitHub] [beam] davidcavazos commented on pull request #12252: [BEAM-7390] Add combineglobally code snippets

2020-07-15 Thread GitBox
davidcavazos commented on pull request #12252: URL: https://github.com/apache/beam/pull/12252#issuecomment-658937924 @aaltay I've addressed the comments This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] tysonjh opened a new pull request #12268: [BEAM-10090] Add JAXB core/impl as test dependency for XmlIO.

2020-07-15 Thread GitBox
tysonjh opened a new pull request #12268: URL: https://github.com/apache/beam/pull/12268 Add JAXB core/impl as test dependency. In Java 9 many EE modules were removed from core Java. This change reintroduces the JAXB modules, updates their minor versions, in preparation for

[GitHub] [beam] robinyqiu commented on pull request #12247: [BEAM-9179] Remove dead code: Java implementation of ZetaSQL functions

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12247: URL: https://github.com/apache/beam/pull/12247#issuecomment-658934753 > I know of at least one customer use case where they are disabling BeamZetaSqlCalcRel so they can avoid JNI. We also have plans to turn BeamCalcRel back on for simple

[GitHub] [beam] lukecwik commented on pull request #12262: [BEAM-10491] Simplify PeriodicSequence generator to use OffsetRanges with whole whole numbers

2020-07-15 Thread GitBox
lukecwik commented on pull request #12262: URL: https://github.com/apache/beam/pull/12262#issuecomment-658934055 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] aaltay merged pull request #12222: Gate GH actions so it only runs in main/upstream repo

2020-07-15 Thread GitBox
aaltay merged pull request #1: URL: https://github.com/apache/beam/pull/1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] aaltay commented on pull request #12222: Gate GH actions so it only runs in main/upstream repo

2020-07-15 Thread GitBox
aaltay commented on pull request #1: URL: https://github.com/apache/beam/pull/1#issuecomment-658930446 LGTM. Let's merge this. Thank you. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] aaltay commented on pull request #12252: [BEAM-7390] Add combineglobally code snippets

2020-07-15 Thread GitBox
aaltay commented on pull request #12252: URL: https://github.com/apache/beam/pull/12252#issuecomment-658929492 (Please ping me once the open comments are addressed.) This is an automated message from the Apache Git Service.

[GitHub] [beam] aaltay merged pull request #12217: [BEAM-7390] Add cogroupbykey code snippets

2020-07-15 Thread GitBox
aaltay merged pull request #12217: URL: https://github.com/apache/beam/pull/12217 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] sclukas77 opened a new pull request #12267: [WIP][BEAM-10408] Schema capable io wrapper pubsub

2020-07-15 Thread GitBox
sclukas77 opened a new pull request #12267: URL: https://github.com/apache/beam/pull/12267 Created generalized table and tableprovider wrappers in Beam SQL, implementing for Pubsub. Additional info on project:

[GitHub] [beam] robinyqiu commented on pull request #12261: [BEAM-10490] Support read/write ZetaSQL DATE/TIME types from/to BigQuery

2020-07-15 Thread GitBox
robinyqiu commented on pull request #12261: URL: https://github.com/apache/beam/pull/12261#issuecomment-658919794 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] davidcavazos commented on pull request #12118: [BEAM-7705] Add BigQuery Java samples

2020-07-15 Thread GitBox
davidcavazos commented on pull request #12118: URL: https://github.com/apache/beam/pull/12118#issuecomment-658918522 There are some errors saying `SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".` Does anyone know what they mean and how to fix them?

[GitHub] [beam] aaltay commented on pull request #12233: [BEAM-10465] Add checksum for Python source distribution and wheels

2020-07-15 Thread GitBox
aaltay commented on pull request #12233: URL: https://github.com/apache/beam/pull/12233#issuecomment-658916388 > @aaltay thanks for merging :) > > Actually I was wrong with statement: "workflows are run only when they merged to master". > It is possible to run workflows not

[GitHub] [beam] pabloem commented on pull request #12074: [BEAM-10313] Add without_defaults to built-in Combiners in Python

2020-07-15 Thread GitBox
pabloem commented on pull request #12074: URL: https://github.com/apache/beam/pull/12074#issuecomment-658915637 Run Python2_PVR_Flink PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] robinyqiu commented on a change in pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12174: URL: https://github.com/apache/beam/pull/12174#discussion_r455235874 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ExpressionConverter.java ## @@

[GitHub] [beam] ZijieSong946 commented on a change in pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
ZijieSong946 commented on a change in pull request #12174: URL: https://github.com/apache/beam/pull/12174#discussion_r455234860 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ExpressionConverter.java ## @@

[GitHub] [beam] robinyqiu commented on a change in pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12174: URL: https://github.com/apache/beam/pull/12174#discussion_r455233394 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/ExpressionConverter.java ## @@

[GitHub] [beam] robinyqiu commented on a change in pull request #12174: [BEAM-10239] Support ZetaSQL NUMERIC type in BeamSQL

2020-07-15 Thread GitBox
robinyqiu commented on a change in pull request #12174: URL: https://github.com/apache/beam/pull/12174#discussion_r455231610 ## File path: sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSqlTypesUtils.java ## @@ -0,0 +1,42 @@ +/*

[GitHub] [beam] saavannanavati commented on a change in pull request #12009: [BEAM-10258] Support type hint annotations on PTransform's expand()

2020-07-15 Thread GitBox
saavannanavati commented on a change in pull request #12009: URL: https://github.com/apache/beam/pull/12009#discussion_r455230574 ## File path: website/www/site/content/en/documentation/sdks/python-type-safety.md ## @@ -90,6 +91,15 @@ The following code declares an `int` input

[GitHub] [beam] Mark-Zeng commented on a change in pull request #12232: [Beam-9543] Support Match Recognition in Beam SQL

2020-07-15 Thread GitBox
Mark-Zeng commented on a change in pull request #12232: URL: https://github.com/apache/beam/pull/12232#discussion_r455218522 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/cep/CEPTypeName.java ## @@ -0,0 +1,33 @@ +/* + * Licensed

[GitHub] [beam] Mark-Zeng commented on a change in pull request #12232: [Beam-9543] Support Match Recognition in Beam SQL

2020-07-15 Thread GitBox
Mark-Zeng commented on a change in pull request #12232: URL: https://github.com/apache/beam/pull/12232#discussion_r455218522 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/cep/CEPTypeName.java ## @@ -0,0 +1,33 @@ +/* + * Licensed

[GitHub] [beam] Mark-Zeng commented on a change in pull request #12232: [Beam-9543] Support Match Recognition in Beam SQL

2020-07-15 Thread GitBox
Mark-Zeng commented on a change in pull request #12232: URL: https://github.com/apache/beam/pull/12232#discussion_r455213949 ## File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/cep/CEPTypeName.java ## @@ -0,0 +1,33 @@ +/* + * Licensed

  1   2   >