[GitHub] [beam] apilloud merged pull request #11758: Old Fastjson has a serious security problem

2020-06-05 Thread GitBox
apilloud merged pull request #11758: URL: https://github.com/apache/beam/pull/11758 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] lostluck commented on pull request #11927: [BEAM-9615] finish standardizing proto import names

2020-06-05 Thread GitBox
lostluck commented on pull request #11927: URL: https://github.com/apache/beam/pull/11927#issuecomment-639664788 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] amaliujia merged pull request #11934: [BEAM-10205] @Ignore:BYTES can work with UNION ALL

2020-06-05 Thread GitBox
amaliujia merged pull request #11934: URL: https://github.com/apache/beam/pull/11934 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] reuvenlax commented on a change in pull request #11924: [BEAM-8543] Dataflow streaming timers are not strictly time ordered when set earlier mid-bundle

2020-06-05 Thread GitBox
reuvenlax commented on a change in pull request #11924: URL: https://github.com/apache/beam/pull/11924#discussion_r436147265 ## File path: runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/StreamingModeExecutionContext.java ## @@

[GitHub] [beam] amaliujia opened a new pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia opened a new pull request #11933: URL: https://github.com/apache/beam/pull/11933 See https://issues.apache.org/jira/browse/BEAM-10204 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly

[GitHub] [beam] lostluck commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436076913 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8.go ## @@ -0,0 +1,83 @@ +// Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] lostluck commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436077202 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8_test.go ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] lostluck commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436090722 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8.go ## @@ -0,0 +1,83 @@ +// Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] tysonjh commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
tysonjh commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436090874 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8.go ## @@ -0,0 +1,83 @@ +// Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] lostluck commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436095065 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8_test.go ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] lostluck merged pull request #11927: [BEAM-9615] finish standardizing proto import names

2020-06-05 Thread GitBox
lostluck merged pull request #11927: URL: https://github.com/apache/beam/pull/11927 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] amaliujia commented on a change in pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia commented on a change in pull request #11933: URL: https://github.com/apache/beam/pull/11933#discussion_r436101952 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -837,7 +834,6

[GitHub] [beam] lostluck merged pull request #11937: [BEAM-9615] Remove LP indicator on string methods.

2020-06-05 Thread GitBox
lostluck merged pull request #11937: URL: https://github.com/apache/beam/pull/11937 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] TobKed commented on a change in pull request #11877: [BEAM-10184] Build python wheels on GitHub Actions for Linux/MacOS

2020-06-05 Thread GitBox
TobKed commented on a change in pull request #11877: URL: https://github.com/apache/beam/pull/11877#discussion_r436068238 ## File path: .github/workflows/build_wheels.yml ## @@ -0,0 +1,141 @@ +name: Build python wheels + +on: + push: +branches: + - master + -

[GitHub] [beam] TobKed commented on a change in pull request #11877: [BEAM-10184] Build python wheels on GitHub Actions for Linux/MacOS

2020-06-05 Thread GitBox
TobKed commented on a change in pull request #11877: URL: https://github.com/apache/beam/pull/11877#discussion_r436068604 ## File path: .github/workflows/build_wheels.yml ## @@ -0,0 +1,141 @@ +name: Build python wheels + +on: + push: +branches: + - master + -

[GitHub] [beam] TobKed commented on a change in pull request #11877: [BEAM-10184] Build python wheels on GitHub Actions for Linux/MacOS

2020-06-05 Thread GitBox
TobKed commented on a change in pull request #11877: URL: https://github.com/apache/beam/pull/11877#discussion_r436068410 ## File path: .github/workflows/build_wheels.yml ## @@ -0,0 +1,141 @@ +name: Build python wheels + +on: + push: +branches: + - master + -

[GitHub] [beam] tysonjh commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
tysonjh commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436092337 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8_test.go ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] kennknowles commented on pull request #11820: [BEAM-10093] ZetaSql Nexmark variant

2020-06-05 Thread GitBox
kennknowles commented on pull request #11820: URL: https://github.com/apache/beam/pull/11820#issuecomment-639689286 PTAL. The first commit is unchanged, the second is a total rewrite (or unwrite, if you like). - Modified each `SqlQuery2`, etc, class to have just the amount of

[GitHub] [beam] lostluck opened a new pull request #11937: [BEAM-9615] Remove LP indicator on string methods.

2020-06-05 Thread GitBox
lostluck opened a new pull request #11937: URL: https://github.com/apache/beam/pull/11937 Missed commit from PR 11925. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] [beam] lostluck commented on pull request #11937: [BEAM-9615] Remove LP indicator on string methods.

2020-06-05 Thread GitBox
lostluck commented on pull request #11937: URL: https://github.com/apache/beam/pull/11937#issuecomment-639718856 R: @tysonjh This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] y1chi commented on pull request #11916: [BEAM-10189] Add ValueState user state to python sdk

2020-06-05 Thread GitBox
y1chi commented on pull request #11916: URL: https://github.com/apache/beam/pull/11916#issuecomment-639789507 > Yes, the plan was to consider changing Java too, though that's harder due to backwards compatibility issues. Renamed to ReadModifyWriteState.

[GitHub] [beam] amaliujia opened a new pull request #11934: [BEAM-10205] @Ignore:BYTES can work with UNION ALL

2020-06-05 Thread GitBox
amaliujia opened a new pull request #11934: URL: https://github.com/apache/beam/pull/11934 See: https://jira.apache.org/jira/browse/BEAM-10205 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and

[GitHub] [beam] robertwb opened a new pull request #11935: [BEAM-9577] Remove use of legacy artifact service in Python.

2020-06-05 Thread GitBox
robertwb opened a new pull request #11935: URL: https://github.com/apache/beam/pull/11935 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose

[GitHub] [beam] lukecwik commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436113097 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -296,6 +299,12 @@ public void accept(WindowedValue

[GitHub] [beam] chamikaramj merged pull request #11846: [BEAM-9869] adding self-contained Kafka service jar for testing

2020-06-05 Thread GitBox
chamikaramj merged pull request #11846: URL: https://github.com/apache/beam/pull/11846 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] KevinGG commented on pull request #11884: [BEAM-7923] Initialize an empty Jupyter labextension with README

2020-06-05 Thread GitBox
KevinGG commented on pull request #11884: URL: https://github.com/apache/beam/pull/11884#issuecomment-639670746 > There's a lot of files there that don't seem relevant; I think we should go through and figure out what's needed for the actual plugin vs. what's "extras" that just got copied

[GitHub] [beam] chamikaramj commented on pull request #11846: [BEAM-9869] adding self-contained Kafka service jar for testing

2020-06-05 Thread GitBox
chamikaramj commented on pull request #11846: URL: https://github.com/apache/beam/pull/11846#issuecomment-639725186 LGTM. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TobKed commented on a change in pull request #11877: [BEAM-10184] Build python wheels on GitHub Actions for Linux/MacOS

2020-06-05 Thread GitBox
TobKed commented on a change in pull request #11877: URL: https://github.com/apache/beam/pull/11877#discussion_r436067638 ## File path: .github/workflows/build_wheels.yml ## @@ -0,0 +1,141 @@ +name: Build python wheels + +on: + push: +branches: + - master + -

[GitHub] [beam] boyuanzz commented on a change in pull request #11894: [BEAM-7074] Enable test_pardo_timers_clear for fn_runner

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11894: URL: https://github.com/apache/beam/pull/11894#discussion_r436068037 ## File path: sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py ## @@ -377,11 +377,6 @@ def process_timer(

[GitHub] [beam] tysonjh commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
tysonjh commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436016818 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8.go ## @@ -0,0 +1,83 @@ +// Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [beam] amaliujia commented on a change in pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia commented on a change in pull request #11933: URL: https://github.com/apache/beam/pull/11933#discussion_r436094165 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -837,7 +834,6

[GitHub] [beam] robertwb commented on pull request #11932: [BEAM-9577] Migrate PortablePipelineJarCreator to new artifact service.

2020-06-05 Thread GitBox
robertwb commented on pull request #11932: URL: https://github.com/apache/beam/pull/11932#issuecomment-639691021 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lostluck merged pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck merged pull request #11925: URL: https://github.com/apache/beam/pull/11925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] saavan-google-intern opened a new pull request #11939: [BEAM-10197] Support typehints for Python's frozenset

2020-06-05 Thread GitBox
saavan-google-intern opened a new pull request #11939: URL: https://github.com/apache/beam/pull/11939 This PR improves Beam's parameterized type hint coverage by adding support for Python's frozenset container. Type annotations should now work with frozenset, typing.FrozenSet, and

[GitHub] [beam] saavan-google-intern commented on pull request #11939: [BEAM-10197] Support typehints for Python's frozenset

2020-06-05 Thread GitBox
saavan-google-intern commented on pull request #11939: URL: https://github.com/apache/beam/pull/11939#issuecomment-639824517 @udim This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tysonjh commented on pull request #11927: [BEAM-9615] finish standardizing proto import names

2020-06-05 Thread GitBox
tysonjh commented on pull request #11927: URL: https://github.com/apache/beam/pull/11927#issuecomment-639668226 > @lukecwik There probably is, but I'm not shaving that yak today. The gradle commands don't meaningfully work for Go, and not when I'm ripping them apart in the next two months

[GitHub] [beam] lostluck commented on pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on pull request #11925: URL: https://github.com/apache/beam/pull/11925#issuecomment-639698549 Ah dang it. I thought I had pushed the commit with the rename, but it was waiting on a password. I'll have that as another PR.

[GitHub] [beam] kennknowles commented on a change in pull request #11924: [BEAM-8543] Dataflow streaming timers are not strictly time ordered when set earlier mid-bundle

2020-06-05 Thread GitBox
kennknowles commented on a change in pull request #11924: URL: https://github.com/apache/beam/pull/11924#discussion_r436173779 ## File path: sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/ParDoTest.java ## @@ -3938,10 +3939,11 @@ public void

[GitHub] [beam] amaliujia commented on pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia commented on pull request #11933: URL: https://github.com/apache/beam/pull/11933#issuecomment-639656091 Run SQL PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tysonjh commented on a change in pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
tysonjh commented on a change in pull request #11933: URL: https://github.com/apache/beam/pull/11933#discussion_r436071355 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -837,7 +834,6

[GitHub] [beam] lukecwik commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r43686 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -577,26 +586,83 @@ public Instant timestamp(DoFn

[GitHub] [beam] lukecwik commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436111296 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -577,26 +586,83 @@ public Instant timestamp(DoFn

[GitHub] [beam] lukecwik commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436111838 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -632,6 +698,17 @@ public Object restriction() {

[GitHub] [beam] lukecwik commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436112241 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -941,20 +1047,59 @@ private Progress getProgress() {

[GitHub] [beam] boyuanzz commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436116972 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -577,26 +586,83 @@ public Instant timestamp(DoFn

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r436123330 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache

[GitHub] [beam] lukecwik commented on pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik commented on pull request #11922: URL: https://github.com/apache/beam/pull/11922#issuecomment-639757431 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lukecwik merged pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
lukecwik merged pull request #11922: URL: https://github.com/apache/beam/pull/11922 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r436177315 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java ## @@ -949,45 +1077,6 @@ public void

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r436179356 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java ## @@ -1055,29 +1144,6 @@ public void

[GitHub] [beam] ihji opened a new pull request #11942: [BEAM-10208] add cross-language KafkaIO integration test

2020-06-05 Thread GitBox
ihji opened a new pull request #11942: URL: https://github.com/apache/beam/pull/11942 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose

[GitHub] [beam] ihji commented on pull request #11942: [BEAM-10208] add cross-language KafkaIO integration test

2020-06-05 Thread GitBox
ihji commented on pull request #11942: URL: https://github.com/apache/beam/pull/11942#issuecomment-639965704 R: @chamikaramj This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] TobKed commented on pull request #11877: [BEAM-10184] Build python wheels on GitHub Actions for Linux/MacOS

2020-06-05 Thread GitBox
TobKed commented on pull request #11877: URL: https://github.com/apache/beam/pull/11877#issuecomment-639667163 cc @potiuk This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] aaltay merged pull request #11882: [BEAM-10112] Add state and timer python examples to website

2020-06-05 Thread GitBox
aaltay merged pull request #11882: URL: https://github.com/apache/beam/pull/11882 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] aaltay merged pull request #11805: Add documentation for python apache-beam[aws] installation

2020-06-05 Thread GitBox
aaltay merged pull request #11805: URL: https://github.com/apache/beam/pull/11805 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] damondouglas opened a new pull request #11936: [BEAM-9679] Add CombinePerKey to Core Transforms Go Katas

2020-06-05 Thread GitBox
damondouglas opened a new pull request #11936: URL: https://github.com/apache/beam/pull/11936 This pull requests adds a Combine/CombinePerKey lesson to the Go SDK katas. I would like to request the following reviewers: (R: @lostluck ) (R: @henryken ) If accepted by both

[GitHub] [beam] lostluck commented on a change in pull request #11925: [BEAM-9615] Add string coder utility functions.

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11925: URL: https://github.com/apache/beam/pull/11925#discussion_r436091546 ## File path: sdks/go/pkg/beam/core/graph/coder/stringutf8_test.go ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [beam] boyuanzz commented on a change in pull request #11922: [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the correct window when processing a splittable dofn

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11922: URL: https://github.com/apache/beam/pull/11922#discussion_r436072548 ## File path: sdks/java/harness/src/main/java/org/apache/beam/fn/harness/FnApiDoFnRunner.java ## @@ -296,6 +299,12 @@ public void accept(WindowedValue

[GitHub] [beam] amaliujia commented on a change in pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia commented on a change in pull request #11933: URL: https://github.com/apache/beam/pull/11933#discussion_r436094165 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -837,7 +834,6

[GitHub] [beam] robertwb opened a new pull request #11938: [BEAM-9577] Remove uses of legacy artifact service in Java.

2020-06-05 Thread GitBox
robertwb opened a new pull request #11938: URL: https://github.com/apache/beam/pull/11938 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose

[GitHub] [beam] robertwb opened a new pull request #11940: [BEAM-6215] Additional tests for FlatMap label.

2020-06-05 Thread GitBox
robertwb opened a new pull request #11940: URL: https://github.com/apache/beam/pull/11940 This does not appear to be broken, but additional tests are good. Also cleaned up unneeded use of raw strings. Thank you for your contribution! Follow

[GitHub] [beam] robertwb commented on pull request #11626: Cleanup ToString transforms.

2020-06-05 Thread GitBox
robertwb commented on pull request #11626: URL: https://github.com/apache/beam/pull/11626#issuecomment-639845882 R: @y1chi This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-05 Thread GitBox
pabloem commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-639885325 @epicfaace lmk what are your plans for this PR This is an automated message from the Apache Git Service. To

[GitHub] [beam] lukecwik commented on pull request #11941: [BEAM-2939] Fix splittable DoFn lifecycle.

2020-06-05 Thread GitBox
lukecwik commented on pull request #11941: URL: https://github.com/apache/beam/pull/11941#issuecomment-639964771 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] robertwb commented on pull request #11940: [BEAM-6215] Additional tests for FlatMap label.

2020-06-05 Thread GitBox
robertwb commented on pull request #11940: URL: https://github.com/apache/beam/pull/11940#issuecomment-639844043 R: @pabloem This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] robinyqiu commented on a change in pull request #11868: [BEAM-9363] Support HOP and SESSION as TVF

2020-06-05 Thread GitBox
robinyqiu commented on a change in pull request #11868: URL: https://github.com/apache/beam/pull/11868#discussion_r436178923 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -4805,6

[GitHub] [beam] ibzib commented on a change in pull request #11932: [BEAM-9577] Migrate PortablePipelineJarCreator to new artifact service.

2020-06-05 Thread GitBox
ibzib commented on a change in pull request #11932: URL: https://github.com/apache/beam/pull/11932#discussion_r436178918 ## File path: runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/artifact/ArtifactRetrievalService.java ## @@ -89,34 +92,41 @@

[GitHub] [beam] epicfaace commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-05 Thread GitBox
epicfaace commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-639946797 I'll be making changes soon. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] amaliujia commented on a change in pull request #11868: [BEAM-9363] Support HOP and SESSION as TVF

2020-06-05 Thread GitBox
amaliujia commented on a change in pull request #11868: URL: https://github.com/apache/beam/pull/11868#discussion_r436188166 ## File path: sdks/java/extensions/sql/zetasql/src/test/java/org/apache/beam/sdk/extensions/sql/zetasql/ZetaSQLDialectSpecTest.java ## @@ -4805,6

[GitHub] [beam] udim commented on pull request #11939: [BEAM-10197] Support typehints for Python's frozenset

2020-06-05 Thread GitBox
udim commented on pull request #11939: URL: https://github.com/apache/beam/pull/11939#issuecomment-639864241 random comment to trigger tests This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] udim edited a comment on pull request #11939: [BEAM-10197] Support typehints for Python's frozenset

2020-06-05 Thread GitBox
udim edited a comment on pull request #11939: URL: https://github.com/apache/beam/pull/11939#issuecomment-639864241 arbitrary comment to trigger tests This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] pabloem commented on pull request #11940: [BEAM-6215] Additional tests for FlatMap label.

2020-06-05 Thread GitBox
pabloem commented on pull request #11940: URL: https://github.com/apache/beam/pull/11940#issuecomment-639884926 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-05 Thread GitBox
pabloem commented on pull request #11929: URL: https://github.com/apache/beam/pull/11929#issuecomment-639885056 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on a change in pull request #11702: [BEAM-9990] Add Conditional Update and Conditional Create to FhirIO

2020-06-05 Thread GitBox
pabloem commented on a change in pull request #11702: URL: https://github.com/apache/beam/pull/11702#discussion_r436210077 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java ## @@ -1173,4 +1276,339 @@ public void

[GitHub] [beam] aaltay commented on pull request #8457: [BEAM-3342] Create a Cloud Bigtable IO connector for Python

2020-06-05 Thread GitBox
aaltay commented on pull request #8457: URL: https://github.com/apache/beam/pull/8457#issuecomment-639912763 > There are still failing tests on #11295. @mf2199 - What is the next step for this PR? PIng on this? What is our plan for this PR?

[GitHub] [beam] pabloem commented on pull request #11923: [BEAM-10176] Support STRUCT, FLOAT64, INT64 BigQuery types

2020-06-05 Thread GitBox
pabloem commented on pull request #11923: URL: https://github.com/apache/beam/pull/11923#issuecomment-639949346 Run Python 3.7 PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] ihji commented on pull request #11942: [BEAM-10208] add cross-language KafkaIO integration test

2020-06-05 Thread GitBox
ihji commented on pull request #11942: URL: https://github.com/apache/beam/pull/11942#issuecomment-639966084 Please also run "Run Python 2 PostCommit" and "Run Python 3.7 PostCommit" This is an automated message from the

[GitHub] [beam] amaliujia merged pull request #11933: [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.

2020-06-05 Thread GitBox
amaliujia merged pull request #11933: URL: https://github.com/apache/beam/pull/11933 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-05 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r436187245 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache

[GitHub] [beam] apilloud commented on a change in pull request #11820: [BEAM-10093] ZetaSql Nexmark variant

2020-06-05 Thread GitBox
apilloud commented on a change in pull request #11820: URL: https://github.com/apache/beam/pull/11820#discussion_r436191652 ## File path: sdks/java/testing/nexmark/src/test/java/org/apache/beam/sdk/nexmark/queries/sql/SqlBoundedSideInputJoinTest.java ## @@ -48,166 +47,182 @@

[GitHub] [beam] pabloem commented on pull request #11923: [BEAM-10176] Support STRUCT, FLOAT64, INT64 BigQuery types

2020-06-05 Thread GitBox
pabloem commented on pull request #11923: URL: https://github.com/apache/beam/pull/11923#issuecomment-639882291 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] udim commented on a change in pull request #11939: [BEAM-10197] Support typehints for Python's frozenset

2020-06-05 Thread GitBox
udim commented on a change in pull request #11939: URL: https://github.com/apache/beam/pull/11939#discussion_r436187871 ## File path: sdks/python/apache_beam/typehints/typehints_test.py ## @@ -612,54 +613,70 @@ def test_match_type_variables(self):

[GitHub] [beam] pabloem merged pull request #11931: [BEAM-10145] Delete persistent disks after every KafkaIO performance test run

2020-06-05 Thread GitBox
pabloem merged pull request #11931: URL: https://github.com/apache/beam/pull/11931 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] ihji commented on pull request #11942: [BEAM-10208] add cross-language KafkaIO integration test

2020-06-05 Thread GitBox
ihji commented on pull request #11942: URL: https://github.com/apache/beam/pull/11942#issuecomment-639983521 CC: @robertwb This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] lukecwik commented on pull request #11941: [BEAM-2939] Fix splittable DoFn lifecycle.

2020-06-05 Thread GitBox
lukecwik commented on pull request #11941: URL: https://github.com/apache/beam/pull/11941#issuecomment-639897770 R: @boyuanzz @youngoli This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] lukecwik opened a new pull request #11941: [BEAM-2939] Fix splittable DoFn lifecycle.

2020-06-05 Thread GitBox
lukecwik opened a new pull request #11941: URL: https://github.com/apache/beam/pull/11941 getInitialRestriction/splitAndSize should not be wrapped with startBundle/FinishBundle invocations. Instead of copying the stateAccessor initialization (used for side inputs) I made it so that it

[GitHub] [beam] pabloem commented on pull request #11923: [BEAM-10176] Support STRUCT, FLOAT64, INT64 BigQuery types

2020-06-05 Thread GitBox
pabloem commented on pull request #11923: URL: https://github.com/apache/beam/pull/11923#issuecomment-639911150 Run Python 3.7 PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on a change in pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-05 Thread GitBox
pabloem commented on a change in pull request #11929: URL: https://github.com/apache/beam/pull/11929#discussion_r436215155 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/JsonToRow.java ## @@ -116,4 +157,65 @@ private ObjectMapper objectMapper() {

[GitHub] [beam] pabloem commented on a change in pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-05 Thread GitBox
pabloem commented on a change in pull request #11929: URL: https://github.com/apache/beam/pull/11929#discussion_r436214157 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/JsonToRow.java ## @@ -116,4 +157,65 @@ private ObjectMapper objectMapper() {

[GitHub] [beam] reuvenlax commented on a change in pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-05 Thread GitBox
reuvenlax commented on a change in pull request #11929: URL: https://github.com/apache/beam/pull/11929#discussion_r436220739 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/JsonToRow.java ## @@ -72,10 +79,44 @@ @Experimental(Kind.SCHEMAS) public

[GitHub] [beam] robertwb merged pull request #11766: [BEAM-10036] More flexible dataframes partitioning.

2020-06-05 Thread GitBox
robertwb merged pull request #11766: URL: https://github.com/apache/beam/pull/11766 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] robertwb merged pull request #11835: Various fixes to allow Java PAssert to run on Python

2020-06-05 Thread GitBox
robertwb merged pull request #11835: URL: https://github.com/apache/beam/pull/11835 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] lostluck commented on a change in pull request #11926: [BEAM-9615] Additional coder unit tests

2020-06-05 Thread GitBox
lostluck commented on a change in pull request #11926: URL: https://github.com/apache/beam/pull/11926#discussion_r436032240 ## File path: sdks/go/pkg/beam/coder_test.go ## @@ -63,3 +64,57 @@ func TestJSONCoder(t *testing.T) { } } } + +func TestCoders(t

[GitHub] [beam] lostluck merged pull request #11926: [BEAM-9615] Additional coder unit tests

2020-06-05 Thread GitBox
lostluck merged pull request #11926: URL: https://github.com/apache/beam/pull/11926 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] naipath commented on pull request #11799: [BEAM-10066] Added support for ValueProvider in RedisConnectionConfiguration

2020-06-05 Thread GitBox
naipath commented on pull request #11799: URL: https://github.com/apache/beam/pull/11799#issuecomment-639283676 @iemejia Thanks for the tips and taking the time to help me out! I ran spotlessApply, for some reason I forgot to do it . The commit title now includes the ticket

[GitHub] [beam] robertwb commented on pull request #11835: Various fixes to allow Java PAssert to run on Python

2020-06-05 Thread GitBox
robertwb commented on pull request #11835: URL: https://github.com/apache/beam/pull/11835#issuecomment-639289851 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] steveniemitz commented on a change in pull request #11919: [BEAM-10114] Copy Pub/Sub Lite IO from Pub/Sub Lite github to beam.

2020-06-05 Thread GitBox
steveniemitz commented on a change in pull request #11919: URL: https://github.com/apache/beam/pull/11919#discussion_r435965759 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/DeduplicationFn.java ## @@ -0,0 +1,111 @@ +/* +

[GitHub] [beam] ocworld commented on pull request #10560: BEAM-9094: Support setting some options such as endpoint_url and credential infos for AWS S3 Filesystem in Python SDKs

2020-06-05 Thread GitBox
ocworld commented on pull request #10560: URL: https://github.com/apache/beam/pull/10560#issuecomment-639541505 @barrettpoth-eog Not yet. I'm sorry for no update about it. I have plan to add options about it. This is an

[GitHub] [beam] ibzib merged pull request #11921: [BEAM-10194] Call println() in Katas test failures.

2020-06-05 Thread GitBox
ibzib merged pull request #11921: URL: https://github.com/apache/beam/pull/11921 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] ihji commented on pull request #11930: [BEAM-10202] make cross-language testing scripts OSX-compatible

2020-06-05 Thread GitBox
ihji commented on pull request #11930: URL: https://github.com/apache/beam/pull/11930#issuecomment-639352431 R: @chamikaramj This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   >