Re: [VOTE] JupyterLab Sidepanel extension release v1.0.0 for BEAM-10545 RC #1

2020-10-09 Thread Ning Kang
To Pablo, The public key in use by NPM can be found in this blog "[3] https://blog.npmjs.org/post/172999548390/new-pgp-machinery;. A direct link: https://keybase.io/npmregistry/pgp_keys.asc Quoted from the blog: > We’ve also chosen to use Keybase >

Re: [VOTE] JupyterLab Sidepanel extension release v1.0.0 for BEAM-10545 RC #1

2020-10-09 Thread Pablo Estrada
+1 I installed the extension and reviewed it as well. I have a question: You mention that NPM will sign the package. What key will it use? We may need to upload your pgp key to the Beam list of keys? Thanks Ning! -P. On Tue, Oct 6, 2020 at 2:57 PM Ning Kang wrote: > Please review the release

Requesting contributor permissions for jira tickets

2020-10-09 Thread Dominik Schöneweiß
Hi everyone, my name is Dominik and I’m working on different beam projects at my day job. I would like to contribute to the code base and wanted to request jira permissions. username: nomnom Thanks! -- advanced store GmbH Alte Jakobstraße 79/80 D-10179 Berlin www.advanced-store.com

Re: Dataflow updates fail with "Coder has changed" error using KafkaIO with SchemaCoder

2020-10-09 Thread Brian Hulette
Hi Cameron, Thanks for bringing this up on the dev list. I'm quite familiar with Beam schemas, but I should be clear I'm not that familiar with Dataflow's pipeline update. +Reuven Lax may need to check me there. > I am curious if it has been determined what makes a Schema the same as another

Re: [BEAM-10587] Support Maps in BigQuery #12389

2020-10-09 Thread Andrew Pilloud
BigQuery has no native support for Map types, but I agree that we should be consistent with how other tools import maps into BigQuery. Is this something Dataflow templates do? What other tools are there? Beam ZetaSQL also lacks support for Map types. I like the idea of adding a configuration

Re: [BEAM-10587] Support Maps in BigQuery #12389

2020-10-09 Thread Jeff Klukas
It's definitely desirable to be able to get back Map types from BQ, and it's nice that BQ is consistent in representing maps as repeated key/value structs. Inferring maps from that specific structure is preferable to inventing some new naming convention for the fields, which would hinder

[BEAM-10587] Support Maps in BigQuery #12389

2020-10-09 Thread Worley, Ryan
https://github.com/apache/beam/pull/12389 Hi everyone, in the above pull request I am attempting to add support for writing Avro records with maps to a BigQuery table (via Beam Schema). The write portion is fairly straightforward - we convert the map to an array of structs with key and value

Re: Jenkins CI down

2020-10-09 Thread Ismaël Mejía
Sure, I was not clear if this had changed after the Jenkins migration. I thought we could control Jenkins master without INFRA. If someone detects issues or reports them to infra please remember to post this to dev@ too for everyone awareness. On Wed, Oct 7, 2020 at 8:56 PM Tyson Hamilton