Hello!

My name is Paweł and I am a developer from Warsaw/Poland. I'd like to contribute to beam project therefore I am kindly asking for JIRA permissions. Regards Paweł

Re: [DISCUSS] BIP reloaded

Hi Jan, I think this is more pretty much what we currently do, just a little bit more transparent for the community. If the process is standardized, it can open doors for bigger contributions from people not familiar with the process. Also it's way easier to track progress of BIPs, than documents

Re: Python: pytest migration update

On Mon, Dec 9, 2019 at 6:34 PM Udi Meiri wrote: > Valentyn, the speedup is due to parallelization. > > On Mon, Dec 9, 2019 at 6:12 PM Chad Dombrova wrote: > >> >> On Mon, Dec 9, 2019 at 5:36 PM Udi Meiri wrote: >> >>> I have given this some thought honestly don't know if splitting into >>>

Re: Python: pytest migration update

Valentyn, the speedup is due to parallelization. On Mon, Dec 9, 2019 at 6:12 PM Chad Dombrova wrote: > > On Mon, Dec 9, 2019 at 5:36 PM Udi Meiri wrote: > >> I have given this some thought honestly don't know if splitting into >> separate jobs will help. >> - I have seen race conditions with

Re: Python: pytest migration update

Thanks a lot for your work on pytest, Udi! Is the speedup due to running more tests in parallel or pytest spends less time orchestrating the run? On Mon, Dec 9, 2019 at 5:59 PM Valentyn Tymofieiev wrote: > > > On Mon, Dec 9, 2019 at 5:36 PM Udi Meiri wrote: > >> I have given this some thought

Re: Python: pytest migration update

I have given this some thought honestly don't know if splitting into separate jobs will help. - I have seen race conditions with running setuptools in parallel, so more isolation is better. OTOH, if 2 setuptools scripts run at the same time on the same machine they might still race (same homedir,

request for access: pypi and dockerhub

Hi, I'm following the release guide , and it says I need access to a couple of repos: - apache_beam pypi project, need maintainer or owner grant, user: udim - DockerHub Push Permission, need to be part of "maintainer team", user: udim Thanks!

Re: Python: pytest migration update

After this PR goes in should we revisit breaking up the python tests into separate jenkins jobs by python version? One of the problems with that plan originally was that we lost the parallelism that gradle provides because we were left with only one tox task per jenkins job, and so the total time

Re: Precommits fire for wrong PRs

One reason it would trigger is that it modified buildSrc/.../BeamModulePlugin.groovy Edits there are rare. But if it is a problem, each of the "applyXYZNature" methods could and probably should be moved to a separate plugin, maybe with a little work. Kenn On Thu, Dec 5, 2019 at 2:38 AM Michał

Quota limitation for Java tests

Hello everyone! It looks like JavaPostCommit Jenkins tests [1] are failing due to CPU quota limitations. Could someone please look into this? [1]

Hello Beam Developers!

My name is Daniel, I'm a developer on the Cloud Pub/Sub Team at Google in New York. I'm looking to make some contributions to the Cloud Pub/Sub integration with beam. I was hoping that I could be added to the JIRA as a contributor. Looking forward to working with everyone!

Re: Poor Python 3.x performance on Dataflow?

For now we should run Py3 and Py2 tests alongside each other to get a side-by-side comparison. I suggest we open a Jira ticket to investigate the difference in performance . We have limited performance test coverage on Python 3 in Beam, so more Py3 tests would help a lot here, thanks for adding

Python: pytest migration update

This PR (in review) migrates py27-gcp to using pytest. It reduces the testPy2Gcp task down to ~13m (from ~45m). This speedup will probably be lower once all 8 tasks are using

Re: Support alias in ElasticsearchIO

+j...@nanthrax.net Do you have thoughts on this JB? On Sun, Dec 1, 2019 at 1:12 AM Jing Chen wrote: > Hi folks, > afaik, the existing ElasticsearchIO doesn't support alias, all operations > are based on index name at the moment. > > While alias is a powerful feature to manage indices (at least

Beam Dependency Check Report (2019-12-09)

High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue google-cloud-datastore 1.7.4 1.10.0