Hi Beam devs,
I'd like to change the Python ReadFromBigQuery IO to submit queries
with batch priority by default to 1) enable queries to not count
toward the BQ concurrent rate limit and 2) allow queries to wait for
available idle resources. This was the default behavior when using the
now
raries only
>> supported)
>> * a bunch of documentation and trivial plumbing issues
>>
>> On Fri, May 14, 2021 at 5:33 PM Ahmet Altay wrote:
>>>
>>> +Valentyn Tymofieiev might have an idea.
>>>
>>> On Mon, May 3, 2021 at 4:12 PM Chuck Yang
Hi Beam devs,
I saw there has been some previous discussion [1][2] around removing
the deprecated oauth2client dependency and using the supported
google-auth dependency instead. A portion of this work seems to
involve migrating off of google-apitools since this call [3] is not
supported by
Hi Beam devs,
Could I have reviews on the following two PRs?
* [BEAM-11884] Pass destination as str rather than TableReference
within BigQueryBatchFileLoads #14112 [1]
* [BEAM-11277] Respect schemaUpdateOptions during BigQuery load with
temporary tables #14113 [2]
The first PR fixes a bug I
Hi Devs,
I was able to get around to working on Avro file loads to BigQuery in
Python SDK and now have a PR available at
https://github.com/apache/beam/pull/10979 . Comments appreciated :)
Thanks,
Chuck
On Wed, Nov 27, 2019 at 10:10 AM Chuck Yang wrote:
>
> I would love
I would love to fix this, but not sure if I have the bandwidth at the
moment. Anyway, created the jira here:
https://jira.apache.org/jira/browse/BEAM-8841
Thanks!
Chuck
--
*Confidentiality Note:* We care about protecting our proprietary
information, confidential material, and trade secrets.
Hello Beam developers,
This is Chun from Cruise. I would like to make some contributions to
the Python SDK for Beam. Can someone add me as a contributor in the
Beam Jira? My username is cccyang.
Thanks!
Chun
--
*Confidentiality Note:* We care about protecting our proprietary
information,
IMO returning the input PCollection in a PTransform should be a valid
albeit trivial use case. I have put a suggested fix for supporting
these kinds of transforms in the interactive runner here:
https://github.com/apache/beam/pull/9865 . I'm also new to beam dev so
if there's something I'm missing
