Re: AssertionError: Job did not reach to a terminal state after waiting indefinitely.

2018-05-10 Thread Prabeesh K.
please somebody have a look. On 7 May 2018 at 21:31, Driesprong, Fokko <fo...@driesprong.frl> wrote: > I'm sorry, on too many mailinglists > > 2018-05-07 19:28 GMT+02:00 Prabeesh K. <prabsma...@gmail.com>: > >> This is regarding Apache beam not regarding Airflow.

Re: AssertionError: Job did not reach to a terminal state after waiting indefinitely.

2018-05-07 Thread Prabeesh K.
ace? It looks like there is missing a part (I don't see any > references to Airflow). > > Cheers, Fokko > > 2018-05-07 6:42 GMT+02:00 Prabeesh K. <prabsma...@gmail.com>: > >> Hi, >> >> Please help me to fix this error. The job seems running in the dataflow >> c

AssertionError: Job did not reach to a terminal state after waiting indefinitely.

2018-05-06 Thread Prabeesh K.
runner.py", line 989, in wait_until_finish 'Job did not reach to a terminal state after waiting indefinitely.') AssertionError: Job did not reach to a terminal state after waiting indefinitely. Regards, Prabeesh K.

Re: [VOTE] [DISCUSSION] Remove support for Java 7

2017-10-18 Thread Prabeesh K.
+1 On 18 October 2017 at 05:16, Griselda Cuevas wrote: > +1 > > On 17 October 2017 at 16:36, Robert Bradshaw wrote: > >> +1 to removing Java 7 support, pending no major user outcry to the >> contrary. >> >> In terms of versioning, I fall into the camp that

Re: Left join

2017-08-15 Thread Prabeesh K.
Hi Manu, It is helpful. Thanks, Prabeesh K. On 16 August 2017 at 08:25, Manu Zhang <owenzhang1...@gmail.com> wrote: > Hi Prabeesh, > > You may checkout https://github.com/apache/beam/blob/master/sdks/ > java/extensions/join-library/src/main/java/org/apache/beam/ > sdk/e

Re: Left join

2017-07-31 Thread Prabeesh K.
pcoll1 = [('key1', [values]), ('key2', [values])] pcoll2 = [('key1', value), ('key3', value)] On 31 July 2017 at 11:21, Prabeesh K. <prabsma...@gmail.com> wrote: > Hi, > > help me to improve the left Joiner. Is this the right way to join the > Pcollection in the b

Left join

2017-07-31 Thread Prabeesh K.
Hi, help me to improve the left Joiner. Is this the right way to join the Pcollection in the beam ? pcoll1 = .. pcoll2 = .. left_joined = ( {'left': pcoll1, 'right': pcoll2} | 'LeftJoiner: Combine' >> beam.CoGroupByKey() | 'LeftJoiner: ExtractValues' >>

Re: Sample Data

2017-05-24 Thread Prabeesh K.
Hi Vilhelm, This is what exactly what I am looking for. Thank you so much. Regards, Prabeesh K. On 24 May 2017 at 17:26, Vilhelm von Ehrenheim <vonehrenh...@gmail.com> wrote: > Hi! > Have you tried beam.combiners.Sample.FixedSizeGlobally(n)? There is also > a Sample f

Sample Data

2017-05-24 Thread Prabeesh K.
How to we can take sample data in Python?

Re: BigQuery table backed by Google Sheet

2017-05-18 Thread Prabeesh K.
. Regards, Prabeesh K. On 19 May 2017 at 02:28, Dan Halperin <dhalp...@google.com> wrote: > Hi Prabeesh, > > I believe to read from a sheet you have to use a fromQuery("SELECT * FROM > [sheet]"). This is because federated tables are really views and cannot be > exported t

Re: BigQuery table backed by Google Sheet

2017-05-18 Thread Prabeesh K.
for this operation because of its type. Try using a different table that is of type TABLE. Anybody help to fix this issue. Regards, Parbeesh K. On 5 May 2017 at 13:05, Prabeesh K. <prabsma...@gmail.com> wrote: > Hi Davor, > > Thank for your prompt reply. > > Regards, > Prabe

Re: Apache Beam publishes the first stable release

2017-05-17 Thread Prabeesh K.
awesome.  On 17 May 2017 at 15:33, Davor Bonaci wrote: > The Apache Beam community is pleased to announce the availability of > version 2.0.0. This is the first stable release of Apache Beam, signifying > a statement from the community that it intends to maintain API

Re: BigQuery join in Apache beam

2017-05-03 Thread Prabeesh K.
Hi Dan Thank you for your prompt reply. Regards, Prabeesh K. On 3 May 2017 at 19:23, Dan Halperin <dhalp...@google.com> wrote: > Hi Prabeesh, > > The underlying Beam primitive you use for Join is CoGroupByKey – this > takes N different collections KV<K, V1> ,

Re: BigQuery join in Apache beam

2017-05-03 Thread Prabeesh K.
Hi Dan, Sorry for the late response. I agreed with you for the use cases that you mentioned. Advice me and please share if there is any sample code to join two data sets in Beam that are sharing some common keys. Regards, Prabeesh K. On 6 February 2017 at 10:38, Dan Halperin <dh

BigQuery table backed by Google Sheet

2017-05-03 Thread Prabeesh K.
ss Denied: BigQuery BigQuery: Permission denied while globbing file pattern.", "locationType": "other", "location": "/gdrive/id/--" } ], "code": 403, "message": "Access Denied: BigQuery BigQuery: Permission denied while globbing file pattern." } } Help to fix this issue. Regards, Prabeesh K.

Re: Slack Channel Request

2017-03-25 Thread Prabeesh K.
Hi Jean, Thank you for your reply. I am eagerly waiting for the other options. Regards, Prabeesh K. On 25 March 2017 at 10:08, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: > Unfortunately we reached the max number of people on Slack (90). > > Let me see what we can do. &

Slack Channel Request

2017-03-24 Thread Prabeesh K.
Hi, Can someone please add me to the Apache Beam slack channel? Regards, Prabeesh K.