Re: Requesting Beam JIRA Permissions

2020-11-10 Thread Kyle Weaver
What is your JIRA username? On Tue, Nov 10, 2020 at 1:28 PM Vachan Shetty wrote: > Hello, > I have recently joined the BigQuery Read API team and will be working on > new features in the Beam connector. Consequently, could I get JIRA > contribution access? > > Regards, > Vachan >

Requesting Beam JIRA Permissions

2020-11-10 Thread Vachan Shetty
Hello, I have recently joined the BigQuery Read API team and will be working on new features in the Beam connector. Consequently, could I get JIRA contribution access? Regards, Vachan

Re: [blog about Beam]

2020-11-10 Thread Pablo Estrada
Thanks Etienne! I read your post on why we can't have multiple aggregations in Spark Streaming. It was informative. Thanks for writing these! Best -P. On Tue, Nov 10, 2020 at 3:39 AM Etienne Chauchot wrote: > Hi all, > > In case anyone is interested, I started a blog [1] this year about big >

Re: Bigtable for BeamSQL - question about the schema design

2020-11-10 Thread Brian Hulette
On Tue, Nov 10, 2020 at 5:46 AM Piotr Szuberski wrote: > Unfortunately according to the documentation, BeamSQL doesn't work well > with ARRAY, like ARRAY> which I confirmed empirically. > > Is there a jira for this issue? > The only way to retrieve array's values was to get it by index, e.g. >

Re: Issues building/running 2.25 on java 8

2020-11-10 Thread Ismaël Mejía
> I see. We do iterate over all configurations and try to force it to our dep > version [1]. Clearly this does not work as intended, perhaps when the dep is > only transitive and not immediate? Is that what you mean Ismaël? I was not aware of that forcing until yesterday for a different issue.

Re: Bigtable for BeamSQL - question about the schema design

2020-11-10 Thread Piotr Szuberski
Unfortunately according to the documentation, BeamSQL doesn't work well with ARRAY, like ARRAY> which I confirmed empirically. The only way to retrieve array's values was to get it by index, e.g. SELECT t.complex_array[1].row_field from some_table t; Unnest and just taking an array doesn't

[blog about Beam]

2020-11-10 Thread Etienne Chauchot
Hi all, In case anyone is interested, I started a blog [1] this year about big data technologies. There are 8 articles so far and they are mainly related to Beam even if some are related to Spark (but with the knowledge acquired while working on the Beam Spark runner). I just published the