Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [X] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish Le mer. 20 nov. 2019 à 03:43, Kenneth Knowles a écrit : > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congratulations! On Wed, Nov 20, 2019, 7:56 PM Chamikara Jayalath wrote: > Congrats!! > > On Wed, Nov 20, 2019 at 5:21 PM Daniel Oliveira > wrote: > >> Thank you everyone! I won't let you down. o7 >> >> On Wed, Nov 20, 2019 at 2:12 PM Ruoyun Huang wrote: >> >>> Congrats Daniel! >>> >>> On

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats!! On Wed, Nov 20, 2019 at 5:21 PM Daniel Oliveira wrote: > Thank you everyone! I won't let you down. o7 > > On Wed, Nov 20, 2019 at 2:12 PM Ruoyun Huang wrote: > >> Congrats Daniel! >> >> On Wed, Nov 20, 2019 at 1:58 PM Robert Burke wrote: >> >>> Congrats Daniel! Much deserved. >>>

Re: [PROPOSAL] Preparing for Beam 2.18 release

Thank you for response. On Wed, Nov 20, 2019 at 16:49 Chamikara Jayalath wrote: > > > On Wed, Nov 20, 2019 at 1:04 PM Tomo Suzuki wrote: > >> Hi Udi, >> >> (Question) I started learning how Beam dependencies are maintained >> through releases. https://beam.apache.org/contribute/dependencies/

Re: [ANNOUNCE] New committer: Daniel Oliveira

Thank you everyone! I won't let you down. o7 On Wed, Nov 20, 2019 at 2:12 PM Ruoyun Huang wrote: > Congrats Daniel! > > On Wed, Nov 20, 2019 at 1:58 PM Robert Burke wrote: > >> Congrats Daniel! Much deserved. >> >> On Wed, Nov 20, 2019, 12:49 PM Udi Meiri wrote: >> >>> Congrats Daniel! >>>

Re: GCP libraries up-to-date versions in Java

I took a look at the linkage checker and have opened up this PR[1] to allow contributors to aid in performing dependency analysis within Apache Beam during upgrades. The current PR works by compiling and publishing all the Java artifacts to your local maven repo and then runs the linkage checker

Contributor permission for Beam Jira tickets

Hello Beam developers, This is Chun from Cruise. I would like to make some contributions to the Python SDK for Beam. Can someone add me as a contributor in the Beam Jira? My username is cccyang. Thanks! Chun -- *Confidentiality Note:* We care about protecting our proprietary information, 

Re: [spark structured streaming runner] available on master

Cool, cool! Love to see Nexmark on Spark structured streaming runner perfkit dashboard On Wed, Nov 20, 2019 at 2:12 PM Pablo Estrada wrote: > Very cool! : ) Thanks to everyone involved moving this forward. > Best > -P. > > On Wed, Nov 20, 2019 at 8:50 AM Etienne Chauchot > wrote: > >> Forgot

Re: [spark structured streaming runner] available on master

Very cool! : ) Thanks to everyone involved moving this forward. Best -P. On Wed, Nov 20, 2019 at 8:50 AM Etienne Chauchot wrote: > Forgot to say thanks everyone for their contribution to this especially > Alexey, Ryan and Ismael. > > Etienne > On 20/11/2019 17:12, Etienne Chauchot wrote: > > Hi

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats Daniel! On Wed, Nov 20, 2019 at 1:58 PM Robert Burke wrote: > Congrats Daniel! Much deserved. > > On Wed, Nov 20, 2019, 12:49 PM Udi Meiri wrote: > >> Congrats Daniel! >> >> On Wed, Nov 20, 2019 at 12:42 PM Kyle Weaver wrote: >> >>> Congrats Dan! Keep up the good work :) >>> >>> On

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats Daniel! Much deserved. On Wed, Nov 20, 2019, 12:49 PM Udi Meiri wrote: > Congrats Daniel! > > On Wed, Nov 20, 2019 at 12:42 PM Kyle Weaver wrote: > >> Congrats Dan! Keep up the good work :) >> >> On Wed, Nov 20, 2019 at 12:41 PM Cyrus Maden wrote: >> >>> Congratulations! This is

Re: [PROPOSAL] Preparing for Beam 2.18 release

On Wed, Nov 20, 2019 at 1:04 PM Tomo Suzuki wrote: > Hi Udi, > > (Question) I started learning how Beam dependencies are maintained through > releases. https://beam.apache.org/contribute/dependencies/ says > > > *Beam community has agreed on following policies regarding upgrading >

Re: [PROPOSAL] Preparing for Beam 2.18 release

Hi Udi, (Question) I started learning how Beam dependencies are maintained through releases. https://beam.apache.org/contribute/dependencies/ says *Beam community has agreed on following policies regarding upgrading dependencies.* ... *A significantly outdated dependency (identified manually

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [x] Hedgehog [x] Lemur [x] Owl [ ] Salmon [ ] Trout [x] Robot dinosaur [x] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 12:05 PM Eduardo Soldera < eduardo.sold...@arquivei.com.br> wrote: > [X ] Beaver > [] Hedgehog > [ ] Lemur > [ ] Owl > [ ] Salmon

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats Daniel! On Wed, Nov 20, 2019 at 12:42 PM Kyle Weaver wrote: > Congrats Dan! Keep up the good work :) > > On Wed, Nov 20, 2019 at 12:41 PM Cyrus Maden wrote: > >> Congratulations! This is great news. >> >> On Wed, Nov 20, 2019 at 3:24 PM Rui Wang wrote: >> >>> Congrats! >>> >>> >>>

[PROPOSAL] Preparing for Beam 2.18 release

Hi all, The next (2.18) release branch cut is scheduled for Dec 4, according to the calendar . I would like to volunteer myself to do this release. The plan is to cut the branch on that date,

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats Dan! Keep up the good work :) On Wed, Nov 20, 2019 at 12:41 PM Cyrus Maden wrote: > Congratulations! This is great news. > > On Wed, Nov 20, 2019 at 3:24 PM Rui Wang wrote: > >> Congrats! >> >> >> -Rui >> >> On Wed, Nov 20, 2019 at 11:48 AM Valentyn Tymofieiev >> wrote: >> >>>

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congratulations! This is great news. On Wed, Nov 20, 2019 at 3:24 PM Rui Wang wrote: > Congrats! > > > -Rui > > On Wed, Nov 20, 2019 at 11:48 AM Valentyn Tymofieiev > wrote: > >> Congrats, Daniel! >> >> On Wed, Nov 20, 2019 at 11:47 AM Kenneth Knowles wrote: >> >>> Hi all, >>> >>> Please join

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats! -Rui On Wed, Nov 20, 2019 at 11:48 AM Valentyn Tymofieiev wrote: > Congrats, Daniel! > > On Wed, Nov 20, 2019 at 11:47 AM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Daniel Oliveira >> >> Daniel introduced

Re: GCP libraries up-to-date versions in Java

On Wed, Nov 20, 2019 at 4:05 AM Elliotte Rusty Harold wrote: > BOM or no BOM is an implementation detail. Agreed for the most part. > Using com.google.cloud:libraries-bom would make dependency management > simpler for developers, but the real issue is whether Beam can continue to > work with

Re: [discuss] Using a logger hierarchy in Python

Based on my recent debugging experience for https://issues.apache.org/jira/browse/BEAM-8651, I think it may be helpful to include thread IDs, into the log entries, or have an option to easily enable this. I imagine that having process ID may also be helpful in other situations. On Tue, Nov 19,

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [X] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [X] Cuttlefish [ ] Dumbo Octopus [X] Angler fish [X] Capybara Em ter., 19 de nov. de 2019 às 23:43, Kenneth Knowles escreveu: > Please cast your votes of approval [1] for animals you would support as >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[X ] Beaver [] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [X ] Robot dinosaur [ ] Firefly [] Cuttlefish [ ] Dumbo Octopus [] Angler fish [X] Capybara Em qua., 20 de nov. de 2019 às 17:03, Leonardo Miguel < leonardo.mig...@arquivei.com.br> escreveu: > [ ] Beaver > [X] Hedgehog > [ ] Lemur >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

On Tue, Nov 19, 2019 at 6:43 PM Kenneth Knowles wrote: > > Please cast your votes of approval [1] for animals you would support as Beam > mascot. The animal with the most approval will be identified as the favorite. > > *** Vote for as many as you like, using this checklist as a template >

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats, Daniel! On Wed, Nov 20, 2019 at 11:47 AM Kenneth Knowles wrote: > Hi all, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Daniel Oliveira > > Daniel introduced himself to dev@ over two years ago and has contributed > in many ways since then. Daniel has

[ANNOUNCE] New committer: Daniel Oliveira

Hi all, Please join me and the rest of the Beam PMC in welcoming a new committer: Daniel Oliveira Daniel introduced himself to dev@ over two years ago and has contributed in many ways since then. Daniel has contributed to general project health, the portability framework, and all three

Re: GCP libraries up-to-date versions in Java

On Wed, Nov 20, 2019 at 1:43 PM Luke Cwik wrote: > > Minor note that Gradle 5 added support for BOMs[1]. > > I think attempting to perform the upgrade (whether to use BOM or not) will be > a concerted effort every time to minimize the amount of breakage to users > while maximizing compatibility

Re: Portable runner bundle scheduling (Streaming/Python/Flink)

Dataflow has run into this issue as well. Dataflow has "work items" that are converted into bundles that are executed on the SDK. Each work item does a greedy assignment to the SDK worker with the fewest work items assigned. As you surmised, we use SDF splitting in batch pipelines to balance work.

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [x ] Salmon [x ] Trout [x ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Tue, Nov 19, 2019 at 6:43 PM Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

On 2019/11/20 02:43:42, Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The animal with the most approval will be identified as the > favorite. > > *** Vote for as many as you like, using this checklist as a template > >

Portable runner bundle scheduling (Streaming/Python/Flink)

We found a problem with uneven utilization of SDK workers causing excessive latency with Streaming/Python/Flink. Remember that with Python, we need to execute multiple worker processes on a machine instead of relying on threads in a single worker, which requires the runner to make a decision to

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [] Hedgehog [ ] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [x] Firefly [ ] Cuttlefish [x] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 10:38 AM wrote: > [ ] Beaver > [x] Hedgehog > [ ] Lemur > [x] Owl > [ ] Salmon > [ ] Trout > [ ] Robot dinosaur > [ ] Firefly >

Re: GCP libraries up-to-date versions in Java

Minor note that Gradle 5 added support for BOMs[1]. I think attempting to perform the upgrade (whether to use BOM or not) will be a concerted effort every time to minimize the amount of breakage to users while maximizing compatibility with the OSS ecosystem. Unfortunately I'm not aware of any

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [x] Hedgehog [ ] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [x] Cuttlefish [x] Dumbo Octopus [ ] Angler fish On 2019/11/20 02:43:42, Kenneth Knowles http://apache.org/>> wrote: > Please cast your votes of approval [1] for animals you would support as> > Beam

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [x] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 10:27 AM Mia Gil Epner wrote: > [x] Beaver > [x] Hedgehog > [x] Lemur > [x] Owl > [ ] Salmon > [ ] Trout > [x] Robot dinosaur >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[x] Beaver [x] Hedgehog [x] Lemur [x] Owl [ ] Salmon [ ] Trout [x] Robot dinosaur [ ] Firefly [ ] Cuttlefish [x] Dumbo Octopus [ ] Angler fish On Tue, Nov 19, 2019 at 6:43 PM Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [X] Cuttlefish [ ] Dumbo Octopus [X] Angler fish On Wed, Nov 20, 2019 at 10:08 AM Eugene Kirpichov wrote: > [ ] Beaver > [ ] Hedgehog > [X] Lemur > [X] Owl > [ ] Salmon > [ ] Trout > [ ] Robot dinosaur

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [X] Lemur [X] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [X] Firefly [X] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 9:47 AM Valentyn Tymofieiev wrote: > [ ] Beaver > [X] Hedgehog > [ ] Lemur > [ ] Owl > [ ] Salmon > [ ] Trout > [ ] Robot

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [X] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [X] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Tue, Nov 19, 2019 at 6:44 PM Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ x] Beaver [ x] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ x] Firefly [ x] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 9:28 AM Sam Rohde wrote: > [ ] Beaver > [ ] Hedgehog > [ ] Lemur > [ ] Owl > [ ] Salmon > [ ] Trout > [x] Robot dinosaur > [

Re: Library to Parse Thrift Files for ThriftIO

Thanks Reuven and Ryan. Unfortunately the drift library doesn't include the parser that was created in the original which is why we were thinking about updating the older library which does include the parser. As far as a better supported library we haven't found anything in pure Java that

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [x] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 9:22 AM Alex Amato wrote: > [ ] Beaver > [ ] Hedgehog > [ ] Lemur > [ ] Owl > [ ] Salmon > [ ] Trout > [X] Robot dinosaur > [ ]

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [X] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 9:15 AM Kirill Kozlov wrote: > [ ] Beaver > [ ] Hedgehog > [X] Lemur > [X] Owl > [ ] Salmon > [ ] Trout > [ ] Robot dinosaur >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [X] Lemur [X] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [X] Angler fish On Wed, Nov 20, 2019, 08:38 Cyrus Maden wrote: > Here's my vote, but I'm curious about the distinction between salmon and > trout mascots :) > > [ ]

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [X] Robot dinosaur [X] Firefly [X] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 8:38 AM Cyrus Maden wrote: > Here's my vote, but I'm curious about the distinction between salmon and > trout mascots :) > > [

Re: [spark structured streaming runner] available on master

Forgot to say thanks everyone for their contribution to this especially Alexey, Ryan and Ismael. Etienne On 20/11/2019 17:12, Etienne Chauchot wrote: Hi all, I'm glad to announce that the new Spark runner based on Spark structured streaming framework has been merged into master ! It is

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

Here's my vote, but I'm curious about the distinction between salmon and trout mascots :) [ ] Beaver [ ] Hedgehog [ X] Lemur [ ] Owl [ X] Salmon [ ] Trout [ ] Robot dinosaur [ X] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ X] Angler fish On Wed, Nov 20, 2019 at 11:24 AM Allan Wilson wrote: > >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

On 11/20/19, 8:44 AM, "Ryan Skraba" wrote: *** Vote for as many as you like, using this checklist as a template [] Beaver [X] Hedgehog [X ] Lemur [ ] Owl [ ] Salmon [] Trout [ ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

On Wed, Nov 20, 2019 at 3:43 AM Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The animal with the most approval will be identified as the > favorite. > > *** Vote for as many as you like, using this checklist as a template >

[spark structured streaming runner] available on master

Hi all, I'm glad to announce that the new Spark runner based on Spark structured streaming framework has been merged into master ! It is not based on RDD/DStream API. See https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html It is still experimental, its coverage

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

*** Vote for as many as you like, using this checklist as a template [X] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [X] Trout [ ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [x] Hedgehog [ ] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [x] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On 11/20/19 3:01 PM, Robin Qiu wrote: [ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ X] Firefly [ ] Cuttlefish [ ]

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ X] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ X] Angler fish On Wed, Nov 20, 2019 at 2:45 PM Alexey Romanenko wrote: > [ ] Beaver > [x] Hedgehog > [ ] Lemur > [x] Owl > [ ] Salmon > [ ] Trout > [ ] Robot

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [x] Hedgehog [ ] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [x] Firefly [ ] Cuttlefish [x] Dumbo Octopus [ ] Angler fish > On 20 Nov 2019, at 14:38, Manu Zhang wrote: > > [] Beaver > [] Hedgehog > [x] Lemur > [x] Owl > [ ] Salmon > [ ] Trout > [ ] Robot dinosaur > [ ]

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[] Beaver [] Hedgehog [x] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Wed, Nov 20, 2019 at 8:38 PM Maximilian Michels wrote: > [ ] Beaver > [ ] Hedgehog > [x] Lemur > [ ] Owl > [ ] Salmon > [ ] Trout > [ ] Robot dinosaur

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [x] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [x] Firefly [x] Cuttlefish [ ] Dumbo Octopus [x] Angler fish On 20.11.19 08:18, Alex Van Boxel wrote: [ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ X] Firefly [ ] Cuttlefish [

Re: GCP libraries up-to-date versions in Java

BOM or no BOM is an implementation detail. Using com.google.clou:libraries-bom would make dependency management simpler for developers, but the real issue is whether Beam can continue to work with very old versions of the many libraries it depends on. Even if this is acceptable for Beam, it's

Re: [Discuss] Beam mascot

Thanks for following up with this Kenn. -Max On 16.11.19 00:05, Alex Van Boxel wrote: I like the "Angler fish" as well... it certainly faster then a cuttlefish  _/ _/ Alex Van Boxel On Fri, Nov 15, 2019 at 9:57 PM Kirill Kozlov > wrote: Angler