[GitHub] [beam] youngoli opened a new pull request #12008: [BEAM-9951] Fixing some lint bugs.

2020-06-12 Thread GitBox
youngoli opened a new pull request #12008: URL: https://github.com/apache/beam/pull/12008 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [x] [**Choose

[GitHub] [beam] rezarokni commented on pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-12 Thread GitBox
rezarokni commented on pull request #11929: URL: https://github.com/apache/beam/pull/11929#issuecomment-643561830 @pabloem Fixed checkstyle in test, sorry about that. This is an automated message from the Apache Git Service.

[GitHub] [beam] lostluck commented on pull request #11989: [BEAM-9615] Add String UTF8 coder.

2020-06-12 Thread GitBox
lostluck commented on pull request #11989: URL: https://github.com/apache/beam/pull/11989#issuecomment-643546739 That's been filed as https://issues.apache.org/jira/browse/BEAM-7009 And I have the rest of schemas to finish up which will definely require not putting that off any

[GitHub] [beam] lostluck edited a comment on pull request #11989: [BEAM-9615] Add String UTF8 coder.

2020-06-12 Thread GitBox
lostluck edited a comment on pull request #11989: URL: https://github.com/apache/beam/pull/11989#issuecomment-643546739 @lukecwik That's been filed as https://issues.apache.org/jira/browse/BEAM-7009 And I have the rest of schemas to finish up which will definely require not

[GitHub] [beam] lazylynx commented on pull request #11970: [BEAM-7672] add cp37 wheel to acceptableWhlSpecs

2020-06-12 Thread GitBox
lazylynx commented on pull request #11970: URL: https://github.com/apache/beam/pull/11970#issuecomment-643530809 > it would be more reliable to check the python version. @tvalentyn Sorry, I misunderstood your comment. I'll update.

[GitHub] [beam] stale[bot] commented on pull request #11405: [BEAM-9747] Deprecate RedisIO.readAll() and add RedisIO.readKeyPatterns as a replacement

2020-06-12 Thread GitBox
stale[bot] commented on pull request #11405: URL: https://github.com/apache/beam/pull/11405#issuecomment-643527359 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

[GitHub] [beam] ibzib commented on a change in pull request #11821: [BEAM-10097, BEAM-5982, BEAM-3080] Use primitive views directly instead of transforming KV> to the view type via a

2020-06-12 Thread GitBox
ibzib commented on a change in pull request #11821: URL: https://github.com/apache/beam/pull/11821#discussion_r439607449 ## File path: sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/View.java ## @@ -157,7 +166,10 @@ private View() {} * PCollectionView} mapping

[GitHub] [beam] jfarr commented on pull request #9899: [BEAM-8511] [WIP] KinesisIO.Read enhanced fanout

2020-06-12 Thread GitBox
jfarr commented on pull request #9899: URL: https://github.com/apache/beam/pull/9899#issuecomment-643525635 > @jfarr Kind ping on this PR. Would you have a time to finish this one? @aromanenko-dev Sure, I'm just waiting for a resolution on BEAM-9702. Did you still want to merge that

[GitHub] [beam] udim commented on pull request #12007: [BEAM-10254] Fix exception with typing.Pattern

2020-06-12 Thread GitBox
udim commented on pull request #12007: URL: https://github.com/apache/beam/pull/12007#issuecomment-643518902 Hopefully tests will run if I make this comment? This is an automated message from the Apache Git Service. To

[GitHub] [beam] udim commented on pull request #12007: [BEAM-10254] Fix exception with typing.Pattern

2020-06-12 Thread GitBox
udim commented on pull request #12007: URL: https://github.com/apache/beam/pull/12007#issuecomment-643518795 R: @tvalentyn This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] udim opened a new pull request #12007: [BEAM-10254] Fix exception with typing.Pattern

2020-06-12 Thread GitBox
udim opened a new pull request #12007: URL: https://github.com/apache/beam/pull/12007 Fixes `convert_to_beam_type` on `typing.Pattern` and `typing.Match` (both of type `typing._TypeAlias`) to not throw an exception. Only Python versions 3.6.{8,9} are known to be affected. Also

[GitHub] [beam] ibzib opened a new pull request #12006: [BEAM-10257] Add option defaults for Spark Python tests

2020-06-12 Thread GitBox
ibzib opened a new pull request #12006: URL: https://github.com/apache/beam/pull/12006 Same as #11711, I have no idea why it didn't occur to me to look at Spark too. R: @robertwb @annaqin418 Thank you for your contribution! Follow this

[GitHub] [beam] udim commented on a change in pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
udim commented on a change in pull request #11982: URL: https://github.com/apache/beam/pull/11982#discussion_r439674896 ## File path: sdks/python/apache_beam/options/pipeline_options_validator_test.py ## @@ -93,7 +93,7 @@ def test_missing_required_options(self):

[GitHub] [beam] udim commented on a change in pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
udim commented on a change in pull request #11982: URL: https://github.com/apache/beam/pull/11982#discussion_r439674768 ## File path: sdks/python/apache_beam/options/pipeline_options_validator_test.py ## @@ -93,7 +93,7 @@ def test_missing_required_options(self):

[GitHub] [beam] JustineKoa edited a comment on pull request #11964: [BEAM-9987] added instruction for converting maven project to gradle

2020-06-12 Thread GitBox
JustineKoa edited a comment on pull request #11964: URL: https://github.com/apache/beam/pull/11964#issuecomment-641651721 R: @angoenka This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] lukecwik commented on pull request #11989: [BEAM-9615] Add String UTF8 coder.

2020-06-12 Thread GitBox
lukecwik commented on pull request #11989: URL: https://github.com/apache/beam/pull/11989#issuecomment-643512623 Can go add a test which imports standard_coders.yaml and ensures the encoding matches the bytes and vice versa?

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643512286 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] lukecwik commented on pull request #12003: [BEAM-10251] Adds transform id to TestStream step

2020-06-12 Thread GitBox
lukecwik commented on pull request #12003: URL: https://github.com/apache/beam/pull/12003#issuecomment-643511813 Confirmed that this is unused in Go SDK. This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] lukecwik commented on pull request #12003: [BEAM-10251] Adds transform id to TestStream step

2020-06-12 Thread GitBox
lukecwik commented on pull request #12003: URL: https://github.com/apache/beam/pull/12003#issuecomment-643511556 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643511451 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11943: [BEAM-10209] Add without_defaults to Mean combiner in Python

2020-06-12 Thread GitBox
pabloem commented on pull request #11943: URL: https://github.com/apache/beam/pull/11943#issuecomment-643510656 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643510550 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643510455 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643510430 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11943: [BEAM-10209] Add without_defaults to Mean combiner in Python

2020-06-12 Thread GitBox
pabloem commented on pull request #11943: URL: https://github.com/apache/beam/pull/11943#issuecomment-643510332 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] InigoSJ commented on pull request #11943: [BEAM-10209] Add without_defaults to Mean combiner in Python

2020-06-12 Thread GitBox
InigoSJ commented on pull request #11943: URL: https://github.com/apache/beam/pull/11943#issuecomment-643510251 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643509531 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643507056 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-12 Thread GitBox
pabloem commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-643507084 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] pabloem commented on pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-06-12 Thread GitBox
pabloem commented on pull request #11086: URL: https://github.com/apache/beam/pull/11086#issuecomment-643505543 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-12 Thread GitBox
pabloem commented on pull request #11929: URL: https://github.com/apache/beam/pull/11929#issuecomment-643505627 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem merged pull request #11969: Remove a hack used to retrieve schematized data from HL7v2 messages, …

2020-06-12 Thread GitBox
pabloem merged pull request #11969: URL: https://github.com/apache/beam/pull/11969 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] pabloem merged pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
pabloem merged pull request #11998: URL: https://github.com/apache/beam/pull/11998 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] JustineKoa commented on pull request #11964: [BEAM-9987] added instruction for converting maven project to gradle

2020-06-12 Thread GitBox
JustineKoa commented on pull request #11964: URL: https://github.com/apache/beam/pull/11964#issuecomment-643499673 @angoenka Thanks! It is ready to merge now. This is an automated message from the Apache Git Service. To

[GitHub] [beam] angoenka commented on pull request #11964: [BEAM-9987] added instruction for converting maven project to gradle

2020-06-12 Thread GitBox
angoenka commented on pull request #11964: URL: https://github.com/apache/beam/pull/11964#issuecomment-643498758 Thanks @JustineKoa This looks good to me. Let me know if i should merge it. This is an automated message

[GitHub] [beam] aaltay commented on pull request #11996: [BEAM-10247] Pin google-api-core to 1.17.0

2020-06-12 Thread GitBox
aaltay commented on pull request #11996: URL: https://github.com/apache/beam/pull/11996#issuecomment-643493248 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #12005: Update screen_diff deps and goldens as stable Chrome version advances.

2020-06-12 Thread GitBox
pabloem commented on pull request #12005: URL: https://github.com/apache/beam/pull/12005#issuecomment-643479856 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-12 Thread GitBox
pabloem commented on pull request #11929: URL: https://github.com/apache/beam/pull/11929#issuecomment-643479659 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] amaliujia commented on pull request #11967: [BEAM-9992] | use Sets transform in BeamSQL

2020-06-12 Thread GitBox
amaliujia commented on pull request #11967: URL: https://github.com/apache/beam/pull/11967#issuecomment-643479230 @darshanj could you rebase this PR please? This is an automated message from the Apache Git Service. To

[GitHub] [beam] KevinGG commented on pull request #12005: Update screen_diff deps and goldens as stable Chrome version advances.

2020-06-12 Thread GitBox
KevinGG commented on pull request #12005: URL: https://github.com/apache/beam/pull/12005#issuecomment-643476941 R: @rohdesamuel R: @pabloem PTAL, thx! This is an automated message from the Apache Git Service. To

[GitHub] [beam] pabloem commented on pull request #11929: [BEAM-10201] Add deadletter support to JsonToRow

2020-06-12 Thread GitBox
pabloem commented on pull request #11929: URL: https://github.com/apache/beam/pull/11929#issuecomment-643476319 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] ibzib commented on pull request #11972: [BEAM-9852] Do not create data channel for empty timer descriptor.

2020-06-12 Thread GitBox
ibzib commented on pull request #11972: URL: https://github.com/apache/beam/pull/11972#issuecomment-643473716 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] ibzib commented on a change in pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on a change in pull request #12002: URL: https://github.com/apache/beam/pull/12002#discussion_r439631658 ## File path: sdks/python/test-suites/portable/common.gradle ## @@ -99,34 +101,110 @@ task flinkTriggerTranscript() { } } + +task createProcessWorker

[GitHub] [beam] ihji commented on pull request #11995: [BEAM-10245] block rsa>4.0 for python2 SDK

2020-06-12 Thread GitBox
ihji commented on pull request #11995: URL: https://github.com/apache/beam/pull/11995#issuecomment-643472344 Looks like the author of the library released the fix. This is an automated message from the Apache Git Service. To

[GitHub] [beam] ihji closed pull request #11995: [BEAM-10245] block rsa>4.0 for python2 SDK

2020-06-12 Thread GitBox
ihji closed pull request #11995: URL: https://github.com/apache/beam/pull/11995 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] pabloem commented on pull request #11824: [BEAM-10101] Add HttpIO / HttpFileSystem (Python)

2020-06-12 Thread GitBox
pabloem commented on pull request #11824: URL: https://github.com/apache/beam/pull/11824#issuecomment-643471642 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] pabloem commented on pull request #11838: [BEAM-9322] Modify the TestStream to output a dict when no output_tags are specified

2020-06-12 Thread GitBox
pabloem commented on pull request #11838: URL: https://github.com/apache/beam/pull/11838#issuecomment-643471534 Run Portable_Python PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] pabloem commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
pabloem commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643470778 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-06-12 Thread GitBox
pabloem commented on pull request #11086: URL: https://github.com/apache/beam/pull/11086#issuecomment-643470635 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] pabloem commented on pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-06-12 Thread GitBox
pabloem commented on pull request #11086: URL: https://github.com/apache/beam/pull/11086#issuecomment-643470728 Run Python2_PVR_Flink PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] ibzib commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643469436 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem commented on pull request #11995: [BEAM-10245] block rsa>4.0 for python2 SDK

2020-06-12 Thread GitBox
pabloem commented on pull request #11995: URL: https://github.com/apache/beam/pull/11995#issuecomment-643459669 let's merge this to unblock others while the new RSA fix comes out? This is an automated message from the Apache

[GitHub] [beam] pabloem commented on pull request #11959: refactor HCLS IO ITs to support stores in other projects

2020-06-12 Thread GitBox
pabloem commented on pull request #11959: URL: https://github.com/apache/beam/pull/11959#issuecomment-643458605 fyi @jaketf This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] ibzib commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643457693 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] ibzib commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643454864 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem commented on pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
pabloem commented on pull request #11998: URL: https://github.com/apache/beam/pull/11998#issuecomment-643453548 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
pabloem commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643452551 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
pabloem commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643450395 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] perkss commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
perkss commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643446840 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11943: [BEAM-10209] Add without_defaults to Mean combiner in Python

2020-06-12 Thread GitBox
pabloem commented on pull request #11943: URL: https://github.com/apache/beam/pull/11943#issuecomment-643446115 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11969: Remove a hack used to retrieve schematized data from HL7v2 messages, …

2020-06-12 Thread GitBox
pabloem commented on pull request #11969: URL: https://github.com/apache/beam/pull/11969#issuecomment-643445960 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11969: Remove a hack used to retrieve schematized data from HL7v2 messages, …

2020-06-12 Thread GitBox
pabloem commented on pull request #11969: URL: https://github.com/apache/beam/pull/11969#issuecomment-643445786 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
pabloem commented on pull request #11998: URL: https://github.com/apache/beam/pull/11998#issuecomment-643444118 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TheNeuralBit commented on pull request #11570: [BEAM-10047] Merge the stages 'Gather and Sort' and 'Create Batches'

2020-06-12 Thread GitBox
TheNeuralBit commented on pull request #11570: URL: https://github.com/apache/beam/pull/11570#issuecomment-643442999 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] sabhyankar commented on pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
sabhyankar commented on pull request #11998: URL: https://github.com/apache/beam/pull/11998#issuecomment-643442493 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem commented on pull request #11982: [BEAM-6892] Supporting bucket auto-creation for Dataflow.

2020-06-12 Thread GitBox
pabloem commented on pull request #11982: URL: https://github.com/apache/beam/pull/11982#issuecomment-643442446 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] stale[bot] commented on pull request #10487: [BEAM-5504] Introduce PubsubAvroTable

2020-06-12 Thread GitBox
stale[bot] commented on pull request #10487: URL: https://github.com/apache/beam/pull/10487#issuecomment-643437807 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

[GitHub] [beam] pabloem commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
pabloem commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643436010 RAT Precommit - can you please add an Apache License header to any new files? (you can copy the header from other kotlin files)

[GitHub] [beam] pabloem commented on a change in pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-06-12 Thread GitBox
pabloem commented on a change in pull request #11086: URL: https://github.com/apache/beam/pull/11086#discussion_r439592297 ## File path: CHANGES.md ## @@ -58,6 +58,10 @@ * Support for X source added (Java/Python) ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). *

[GitHub] [beam] pabloem commented on a change in pull request #11086: [BEAM-8910] Make custom BQ source read from Avro

2020-06-12 Thread GitBox
pabloem commented on a change in pull request #11086: URL: https://github.com/apache/beam/pull/11086#discussion_r439592201 ## File path: sdks/python/apache_beam/io/gcp/bigquery.py ## @@ -78,6 +72,12 @@ or a table. Pipeline construction will fail with a validation error if

[GitHub] [beam] ibzib commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643426877 Run Python Spark ValidatesRunner This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] pabloem commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
pabloem commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643424085 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
pabloem commented on pull request #11998: URL: https://github.com/apache/beam/pull/11998#issuecomment-643423576 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] pabloem opened a new pull request #12004: Enabling custom retry strategy for BQ streaming inserts.

2020-06-12 Thread GitBox
pabloem opened a new pull request #12004: URL: https://github.com/apache/beam/pull/12004 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution

[GitHub] [beam] InigoSJ commented on a change in pull request #11943: [BEAM-10209] Add without_defaults to Mean combiner in Python

2020-06-12 Thread GitBox
InigoSJ commented on a change in pull request #11943: URL: https://github.com/apache/beam/pull/11943#discussion_r439507508 ## File path: sdks/python/apache_beam/transforms/combiners.py ## @@ -66,8 +66,21 @@ class Mean(object): """Combiners for computing arithmetic means of

[GitHub] [beam] pskevin commented on pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
pskevin commented on pull request #11999: URL: https://github.com/apache/beam/pull/11999#issuecomment-643419296 Thanks! My first PR ever actually. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] lostluck edited a comment on pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
lostluck edited a comment on pull request #11999: URL: https://github.com/apache/beam/pull/11999#issuecomment-643415498 Congratulations, you've contributed your first Go SDK PR :D Don't forget to mark the JIRA issue as Resolved.

[GitHub] [beam] lostluck merged pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
lostluck merged pull request #11999: URL: https://github.com/apache/beam/pull/11999 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] lostluck commented on pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
lostluck commented on pull request #11999: URL: https://github.com/apache/beam/pull/11999#issuecomment-643415498 Congratulations, you've contributed your first Go SDK PR :D This is an automated message from the Apache Git

[GitHub] [beam] ibzib commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
ibzib commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643412087 run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439566281 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache

[GitHub] [beam] aromanenko-dev commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
aromanenko-dev commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439565391 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the

[GitHub] [beam] aromanenko-dev commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
aromanenko-dev commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439565391 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the

[GitHub] [beam] acrites opened a new pull request #12003: [BEAM-10244] Adds transform id to TestStream step

2020-06-12 Thread GitBox
acrites opened a new pull request #12003: URL: https://github.com/apache/beam/pull/12003 This is done for the Dataflow runner for both Python and Java. We need the transform id so we can look up relevant info (like environment) in the pipeline proto. @lukecwik

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439562951 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache

[GitHub] [beam] annaqin418 commented on pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
annaqin418 commented on pull request #12002: URL: https://github.com/apache/beam/pull/12002#issuecomment-643406436 Run Python Spark ValidatesRunner This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] annaqin418 opened a new pull request #12002: [BEAM-9872] Moved Spark validates tests to shared file

2020-06-12 Thread GitBox
annaqin418 opened a new pull request #12002: URL: https://github.com/apache/beam/pull/12002 R: @ibzib @robertwb Moved Spark Python validates tests to shared file to support all versions of Python. (Only tested build with py37 locally. There also may be duplicate code that can

[GitHub] [beam] pskevin commented on a change in pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
pskevin commented on a change in pull request #11999: URL: https://github.com/apache/beam/pull/11999#discussion_r439556128 ## File path: sdks/go/pkg/beam/testing/passert/sum.go ## @@ -22,9 +22,9 @@ import ( "github.com/apache/beam/sdks/go/pkg/beam/internal/errors" )

[GitHub] [beam] aromanenko-dev commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
aromanenko-dev commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439547427 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the

[GitHub] [beam] lostluck merged pull request #11989: [BEAM-9615] Add String UTF8 coder.

2020-06-12 Thread GitBox
lostluck merged pull request #11989: URL: https://github.com/apache/beam/pull/11989 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] lostluck commented on a change in pull request #11989: [BEAM-9615] Add String UTF8 coder.

2020-06-12 Thread GitBox
lostluck commented on a change in pull request #11989: URL: https://github.com/apache/beam/pull/11989#discussion_r439546660 ## File path: sdks/go/pkg/beam/core/runtime/coderx/string.go ## @@ -23,6 +23,8 @@ import ( // NewString returns a coder for the string type. It uses

[GitHub] [beam] lostluck commented on a change in pull request #11999: [BEAM-7163] Correcting godoc for passert.Sum

2020-06-12 Thread GitBox
lostluck commented on a change in pull request #11999: URL: https://github.com/apache/beam/pull/11999#discussion_r439544557 ## File path: sdks/go/pkg/beam/testing/passert/sum.go ## @@ -22,9 +22,9 @@ import ( "github.com/apache/beam/sdks/go/pkg/beam/internal/errors" )

[GitHub] [beam] pabloem commented on pull request #11998: [BEAM-10250]: Update io_matrix with new SplunkIO

2020-06-12 Thread GitBox
pabloem commented on pull request #11998: URL: https://github.com/apache/beam/pull/11998#issuecomment-643384507 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tvalentyn commented on pull request #11996: [BEAM-10247] Pin google-api-core to 1.17.0

2020-06-12 Thread GitBox
tvalentyn commented on pull request #11996: URL: https://github.com/apache/beam/pull/11996#issuecomment-643382060 I don't know why Jenkins lags. Tests are not triggered: https://builds.apache.org/job/beam_PostCommit_Python37_PR/. PR LGTM but we need to test before merge.

[GitHub] [beam] tvalentyn commented on pull request #11996: [BEAM-10247] Pin google-api-core to 1.17.0

2020-06-12 Thread GitBox
tvalentyn commented on pull request #11996: URL: https://github.com/apache/beam/pull/11996#issuecomment-643381750 Run Python 3.7 PostCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] boyuanzz commented on a change in pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

2020-06-12 Thread GitBox
boyuanzz commented on a change in pull request #11749: URL: https://github.com/apache/beam/pull/11749#discussion_r439531254 ## File path: sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ReadFromKafkaViaSDF.java ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache

[GitHub] [beam] tvalentyn commented on pull request #11970: [BEAM-7672] add cp37 wheel to acceptableWhlSpecs

2020-06-12 Thread GitBox
tvalentyn commented on pull request #11970: URL: https://github.com/apache/beam/pull/11970#issuecomment-643375238 Run Python Dataflow ValidatesContainer This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] tvalentyn commented on pull request #11970: [BEAM-7672] add cp37 wheel to acceptableWhlSpecs

2020-06-12 Thread GitBox
tvalentyn commented on pull request #11970: URL: https://github.com/apache/beam/pull/11970#issuecomment-643374850 Run Python Dataflow ValidatesContainer This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] tvalentyn commented on pull request #11970: [BEAM-7672] add cp37 wheel to acceptableWhlSpecs

2020-06-12 Thread GitBox
tvalentyn commented on pull request #11970: URL: https://github.com/apache/beam/pull/11970#issuecomment-643374545 LGTM. This improves the situation, however, as I mentioned it would be more reliable to check the python version.

[GitHub] [beam] perkss commented on pull request #12000: BEAM-10221: Add in example tests cases of Kotlin cookbook

2020-06-12 Thread GitBox
perkss commented on pull request #12000: URL: https://github.com/apache/beam/pull/12000#issuecomment-643373391 @pabloem could you please take a look? This is an automated message from the Apache Git Service. To respond to

  1   2   >