Re: JDK11 support?

wrote: >> >>> Our work (mostly done by Michal), consisted on testing that Beam >>> artifacts built with Java 8 can run in a Java 11 environment in the >>> DirectRunner and Dataflow. We have not planned other work in this area. >>> >>> On Tue, Apr 9, 20

JDK 11 compatibility testing

suggestions and discussion. Which of those new features should be included in the DoFn applied in the test? I will be grateful for any input. Have a good day Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E:

Re: [ANNOUNCE] New PMC Member: Pablo Estrada

gt;>>>> Woohoo! Well deserved. >>>>>>>> > > >>>>> >>>>>>>> > > >>>>> On Tue, May 14, 2019, 8:34 PM Reuven Lax < >>>>>>>> re...@google.com >>>>>>>> > <mailto:re...@google.com>> wrote: >>>>>>>> > > >>>>>> >>>>>>>> > > >>>>>> Congratulations! >>>>>>>> > > >>>>>> >>>>>>>> > > >>>>>> From: Mikhail Gryzykhin < >>>>>>>> gryzykhin.mikh...@gmail.com >>>>>>>> > <mailto:gryzykhin.mikh...@gmail.com>> >>>>>>>> > > >>>>>> Date: Tue, May 14, 2019 at 8:32 PM >>>>>>>> > > >>>>>> To: >>>>>>> dev@beam.apache.org>> >>>>>>>> > > >>>>>> >>>>>>>> > > >>>>>>> Congratulations Pablo! >>>>>>>> > > >>>>>>> >>>>>>>> > > >>>>>>> On Tue, May 14, 2019, 20:25 Kenneth Knowles >>>>>>>> > mailto:k...@apache.org>> wrote: >>>>>>>> > > >>>>>>>> >>>>>>>> > > >>>>>>>> Hi all, >>>>>>>> > > >>>>>>>> >>>>>>>> > > >>>>>>>> Please join me and the rest of the Beam PMC in >>>>>>>> welcoming >>>>>>>> > Pablo Estrada to join the PMC. >>>>>>>> > > >>>>>>>> >>>>>>>> > > >>>>>>>> Pablo first picked up BEAM-722 in October of 2016 >>>>>>>> and >>>>>>>> > has been a steady part of the Beam community since then. In >>>>>>>> addition >>>>>>>> > to technical work on Beam Python & Java & runners, I would >>>>>>>> highlight >>>>>>>> > how Pablo grows Beam's community by helping users, working on >>>>>>>> GSoC, >>>>>>>> > giving talks at Beam Summits and other OSS conferences >>>>>>>> including >>>>>>>> > Flink Forward, and holding training workshops. I cannot do >>>>>>>> justice >>>>>>>> > to Pablo's contributions in a single paragraph. >>>>>>>> > > >>>>>>>> >>>>>>>> > > >>>>>>>> Thanks Pablo, for being a part of Beam. >>>>>>>> > > >>>>>>>> >>>>>>>> > > >>>>>>>> Kenn >>>>>>>> > >>>>>>>> >>>>>>> >>>> >>>> -- >>>> >>>> Ruoyun Huang >>>> >>>> > > -- > Rose Thị Nguyễn > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com We create human & business stories through technology. Check out our projects! <https://www.polidea.com/our-work>

Re: Phrase triggering jobs problem

y action on our part. >>>>>>> >>>>>>> On Wed, Jul 10, 2019 at 10:28 AM Katarzyna Kucharczyk < >>>>>>> ka.kucharc...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>>

Circular dependencies between DataflowRunner and google cloud IO

c/main/java/org/apache/beam/runners/dataflow/util/DefaultCoderCloudObjectTranslatorRegistrar.java#L45> Best regards Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech

Re: Phrase triggering jobs problem

k to conversation >> <https://lists.apache.org/thread.html/0a0cdb7ef91754ae78dd228359266f979a60778b336918ab7720f18f@%3Cbuilds.apache.org%3E> >> about the new plugin. >> >> Kasia >> >> On Fri, Jul 12, 2019 at 10:47 AM Michał Walenia < >> michal.wale...@p

Re: Circular dependencies between DataflowRunner and google cloud IO

oogle-cloud-dataflow-java/build.gradle#L318 > > On Fri, Jul 12, 2019 at 5:17 AM Michał Walenia > wrote: > >> Hi all, >> recently when I was trying to implement a performance test of BigQueryIO, >> I ran into an issue when trying to run the test on Dataflow. >>

Re: [ANNOUNCE] New committer: Robert Burke

bert, for your contributions and looking forward to many >>> more! >>> >>> Ahmet, on behalf of the Apache Beam PMC >>> >>> [1] >>> https://lists.apache.org/thread.html/8f729da2d3009059d7a8b2d8624446be161700dcfa953939dd3530c6@%3Cdev.beam.apach

Re: Circular dependencies between DataflowRunner and google cloud IO

apoKF5MEC1wKps4A5tFbIPKE > 6: > https://docs.google.com/document/d/1Cb7XVmqe__nA_WCrriAifL-3WCzbZzV4Am5W_SkQLeA > > On Mon, Jul 15, 2019 at 8:03 AM Michał Walenia > wrote: > >> Thanks for the information. I don't think that the task you mentioned >> fits my case - I want to run a

Re: Phrase triggering jobs problem

n. I'm going to be unavailable for the next week, so if anyone else wants to take the JIRA issue, feel free to do it. Have a good weekend Michal On Fri, Jul 12, 2019 at 5:11 PM Michał Walenia wrote: > Thanks for the heads up, I'll get in touch with him so that I don't >

Java 11 compatibility question

://builds.apache.org/job/beam_PostCommit_Java11_Examples_Dataflow/ [5] https://builds.apache.org/job/beam_PostCommit_Java11_Examples_Dataflow_Portability/ -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com

Re: Java 11 compatibility question

gt;>>> >>>> On Wed, Aug 7, 2019 at 2:25 PM Lukasz Cwik wrote: >>>> > >>>> > Since java8 -> java11 is similar to python2 -> python3 migration, >>>> what was the acceptance criteria there? >>>> >>> >>

Problems with KafkaIOIT in Beam

at something is wrong with the Kafka cluster configuration, but unfortunately, I lack experience with this tool to know what could be missing here. I would be very grateful for your help, Kafka config hints or anything else you can add. Thanks and have a good day, Michal -- Michał W

Re: Problems with KafkaIOIT in Beam

here if you want your input to be easier to search and access in the future. Michal On Wed, Sep 4, 2019 at 7:04 PM Chamikara Jayalath wrote: > > > On Wed, Sep 4, 2019 at 4:23 AM Michał Walenia > wrote: > >> Hi all, >> recently I've been struggling to adapt Java&

Beam JIRA contributor permissions

Hi all, I’d like to take on BEAM-6207 issue, but I lack JIRA permissions to assign tickets to myself Can anyone add me as a contributor? My username is mwalenia. Thanks and have a great day Michal

Re: New contributor: Michał Walenia

HI all, thanks for a warm welcome :) Michał > Wiadomość napisana przez Ahmet Altay w dniu 30.01.2019, o > godz. 21:32: > > Welcome Michał! > > On Wed, Jan 30, 2019 at 11:38 AM Kenneth Knowles > wrote: > Welcome Michał! > > Kenn > > *And maybe your system uses a comp

Resizing Beam IOITs

(eg. "testConfigName=XML_1GB" instead of "numberOfRecords=100"). What in general do you think about this approach? Do you think that 1GB test datasets are reasonable? Thanks, Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M

Re: Resizing Beam IOITs

Hi, thanks for the suggestion. I think it's reasonable to include a small configuration for fast testing. I'll add such a config to the PR. Have a good day, Michal On Wed, Oct 9, 2019 at 5:05 AM Chamikara Jayalath wrote: > > > On Tue, Oct 8, 2019 at 6:52 AM Michał Walenia &

Re: Question related to running unit tests in IDE

va: cannot find symbol > symbol: class PCollection > location: class org.apache.beam.sdk.transforms.Watch > > Error:(169, 59) java: cannot find symbol > symbol: class KV > location: class org.apache.beam.sdk.transforms.Watch > > Please let me know if you have feedback. > > Regards,

Java PortableRunner package name

pull request with the refactor. Have a good day, Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: Java PortableRunner package name

nners/portability. Maybe > > > PortableRunner.java should be moved to somewhere under sdks/java, > as > > > it's not actually a runner itself. The nomenclature is > > > confusing, PortableRunner could be more aptly named something like > >

Re: Java PortableRunner package name

he name change. For users, the current name "PortableRunner" > reflects best what it does, running portable pipelines. The details of > the translation and the submission process do not have to be reflected > in the name. > > Cheers, > Max > > On 28.10.19 13:06, M

Jenkins workflow improvement question

testable, which could further improve the job creation and modification process. What do you think about this? Have a good day, Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Te

Re: (Question) SQL integration tests for MongoDb

> provideIntegrationTestingDependencies() > enableJavaPerformanceTesting() > > Sql build file already has a task with the name 'integrationTest' defined > and does not let us do `enableJavaPerformanceTesting()`. > > I would really appreciate if someone could provide me

Re: (Question) SQL integration tests for MongoDb

ider/mongodb). > I cannot simply use `enableJavaPerformanceTesting()`, because tests for > all adapters are run via the same build file, which has a custom task > "integrationTest". > > I hope this better explains the problem I am trying to tackle. > > - > Kirill >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

l >>>> >>be identified as the favorite. >>>> >>*** Vote for as many as you like, using this checklist as a >>>> >>template >>>> >>[ ] Beaver >>>> >>[ ] Hedgeh

Re: Exception at testing DataFlow with preCommitLegacyWorker

l.jackson.databind.deser.std.StringArrayDeserializer.deserialize(StringArrayDeserializer.java:145) > > > > Any help would be appreciable. > > > > *Thanks & Regards* > > > *Rehman Murad Ali* > > Software Engineer > Mobile: +92 3452076766 > Skype: rehm

Re: Exception at testing DataFlow with preCommitLegacyWorker

ut the string inside the quotes needs to be a valid JSON array of strings. >>> If you change it to something like -DbeamTestPipelineOptions >>> '["--project=apache-beam-testing",...]' you should get past that error. >>> >>> Agree with Michał t

Re: Exception at testing DataFlow with preCommitLegacyWorker

TE > > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > > Task > :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava > UP-TO-DATE > > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes > UP-TO-DATE > > Task :runners:google-

Re: Exception at testing DataFlow with preCommitLegacyWorker

; Window's CMD. See the attached screenshots. > > > > > *Thanks & Regards* > > > *Rehman Murad Ali* > > Software Engineer > Mobile: +92 3452076766 > Skype: rehman,muradali > > <http://venturedive.com/> > > > On Thu, Nov 28, 2019 at 4:29 PM Michał Wa

Re: Exception at testing DataFlow with preCommitLegacyWorker

mp; Regards* > > > *Rehman Murad Ali* > > Software Engineer > Mobile: +92 3452076766 > Skype: rehman,muradali > > <http://venturedive.com/> > > > On Thu, Nov 28, 2019 at 5:29 PM Michał Walenia > wrote: > >> It seems that Windows CMD doesn't play ni

Precommits fire for wrong PRs

27;^gradle.bat$', '^settings.gradle$' What I don't understand is why they both triggered for Łukasz's PR <https://github.com/apache/beam/pull/10268>, which touches some Java files, Jenkins scripts and two non top-level gradle files. Can anyone shed some

Java PortableRunner GBK load test fails

sist me? I created a JIRA for this: BEAM-8980 <https://issues.apache.org/jira/browse/BEAM-8980> Thanks! Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: Java PortableRunner GBK load test fails

. On Tue, Dec 17, 2019 at 8:10 PM Ankur Goenka wrote: > The connection closing is a red herring as that error gets printed when > SDK Harness dies. > More logs/jenkins link would be useful to understand what going on with > the pipeline. > > On Tue, Dec 17, 2019 at 5:53 AM Micha

Re: [ANNOUNCE] New committer: Kasia Kucharczyk

eam PMC in welcoming a new >>>>>>> committer: Kasia Kucharczyk >>>>>>> >>>>>>> Kasia has contributed to Beam in many ways, including the >>>>>>> performance testing infrastructure, and has even spoken at events about >>>&g

Re: Jenkins jobs not running for my PR 10438

>>>>>> > >>>>>> > Same here. Even the phrase trigger doesn't work. >>>>>> > >>>>>> > On Fri, Dec 20, 2019 at 10:16 AM Luke Cwik >>>>>> wrote: >>>>>> >> >>>>&g

Re: Jenkins jobs not running for my PR 10438

tware Engineer >>> Mobile: +92 3452076766 <+92%20345%202076766> >>> Skype: rehman.muradali >>> >>> >>> On Sat, Jan 4, 2020 at 6:10 AM Heejong Lee wrote: >>> >>>> +1: https://github.com/apache/beam/pull/10051 >>>> &g

Re: Jenkins jobs not running for my PR 10438

Streaming Performance Test Java >>>>>>> Run Dataflow ValidatesRunner >>>>>>> Run Spark ValidatesRunner >>>>>>> Run SQL Postcommit >>>>>>> >>>>>>> Regards, >>>>>>> Tomo >>

Jenkins job execution policy

read https://issues.apache.org/jira/browse/INFRA-19670 is viable. The questions are: do we want to implement this idea and what needs to be done to do it? Regards Michał -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: mich

Re: Jenkins job execution policy

;>> documentation for the .asf.yaml file[2], as well as the relevant >>>>>>>> section >>>>>>>> for our case[3]. >>>>>>>> >>>>>>>> I'll check the docs in [2] well before pushing to merge, just

Re: Fwd: Error while running jenkins feature from .asf.yaml in beam!

or occurred while running jenkins feature in .asf.yaml!: > > GitHub whitelist cannot be more than 10 people! > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: [DISCUSS] Integrate Google Cloud AI functionalities

P dependencies. >>>>>>> One >>>>>>> of our ideas is a separate library, that depends on Beam and that can be >>>>>>> installed optionally, stored somewhere in the beam repository (e.g. in >>>>>>> the >>>>

Re: [DISCUSS] Autoformat python code with Black

;>>>> > >>>>>>> >>>>>> > > Reformatted lines don't allow quick access to the Git >>>>>>> history. This >>>>>>> >>>>>> > > effect is still visible in the Java

Re: [ANNOUNCE] New committer: Hannah Jiang

t;>>>>>>>> >>>>>>>>>>>>>>> On Tue, Jan 28, 2020 at 3:21 PM Luke Cwik >>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi everyone, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Please join me and the rest of the Beam PMC in welcoming a >>>>>>>>>>>>>>>> new committer: Hannah Jiang >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hannah has contributed to Beam in many ways, including work >>>>>>>>>>>>>>>> on building and releasing the Apache Beam SDK containers. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> In consideration of their contributions, the Beam PMC >>>>>>>>>>>>>>>> trusts them with the responsibilities of a Beam committer[1]. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks for your contributions Hannah! >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Luke, on behalf of the Apache Beam PMC. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [1] >>>>>>>>>>>>>>>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>> >>>>> -- >>>>> >>>>> This email may be confidential and privileged. If you received this >>>>> communication by mistake, please don't forward it to anyone else, please >>>>> erase all copies and attachments, and please let me know that it has gone >>>>> to the wrong person. >>>>> >>>>> The above terms reflect a potential business arrangement, are provided >>>>> solely as a basis for further discussion, and are not intended to be and >>>>> do >>>>> not constitute a legally binding obligation. No legally binding >>>>> obligations >>>>> will be created, implied, or inferred until an agreement in final form is >>>>> executed in writing by all parties involved. >>>>> >>>> -- >>> >>> Best, >>> Jincheng >>> - >>> Twitter: https://twitter.com/sunjincheng121 >>> - >>> >> -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Problems with Flink cluster running load tests

hat it works. Thanks and have a good day! Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: Jenkins jobs not running for my PR 10438

t;>> Run Java PreCommit >>>>>>>> Run JavaPortabilityApi PreCommit >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Rui, >>>>>>>>> (Thank you for quick response) >>>>>>>>> >>>>>>>>> Would you run one command per one comment? I don't think Jenkins >>>>>>>>> recognizes multiple at once. >>>>>>>>> >>>>>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang >>>>>>>>> wrote: >>>>>>>>> > >>>>>>>>> > Done >>>>>>>>> > >>>>>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki >>>>>>>>> wrote: >>>>>>>>> >> >>>>>>>>> >> Hi Beam Committers, >>>>>>>>> >> >>>>>>>>> >> I appreciate if you can run precommit checks for >>>>>>>>> >> https://github.com/apache/beam/pull/10674 >>>>>>>>> >> plus the following 6 extra commands: >>>>>>>>> >> >>>>>>>>> >> Run Java PostCommit >>>>>>>>> >> Run Java HadoopFormatIO Performance Test >>>>>>>>> >> Run BigQueryIO Streaming Performance Test Java >>>>>>>>> >> Run Dataflow ValidatesRunner >>>>>>>>> >> Run Spark ValidatesRunner >>>>>>>>> >> Run SQL Postcommit >>>>>>>>> >> >>>>>>>>> >> Regards, >>>>>>>>> >> Tomo >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Regards, >>>>>>>>> Tomo >>>>>>>>> >>>>>>>> -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: Jenkins jobs not running for my PR 10438

; *Rehman Murad Ali* > Software Engineer > Mobile: +92 3452076766 > Skype: rehman.muradali > > > On Wed, Jan 29, 2020 at 5:10 PM Michał Walenia > wrote: > >> Sure, I'll trigger it >> >> On Wed, Jan 29, 2020 at 12:56 PM Rehman Murad Ali < >> r

Re: Jenkins jobs not running for my PR 10438

bile: +92 3452076766 > Skype: rehman.muradali > > > On Wed, Jan 29, 2020 at 5:10 PM Michał Walenia > wrote: > >> Sure, I'll trigger it >> >> On Wed, Jan 29, 2020 at 12:56 PM Rehman Murad Ali < >> rehman.murad...@venturedive.com> wrote: >> >

2nd Apache Beam Meetup in Warsaw

ation :) here's the Meetup link: https://www.meetup.com/pl-PL/Warsaw-Apache-Beam-Meetup/events/268293892/ Have a good day and see you in Warsaw! Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@p

Re: [DISCUSS] Autoformat python code with Black

gt;> $ git diff --stat master >> >> > >>>> ... >> >> > >>>> 547 files changed, 22118 insertions(+), 21129 deletions(-) >> >> > >>>> >> >> > >>>> For reference >> >

Jenkins outage

Hi there, it seems that our Jenkins is experiencing some issues and the jobs are getting stuck in the queue despite the executors being idle. Here's the JIRA issue for this: https://issues.apache.org/jira/browse/INFRA-19830 Let's hope it will be resolved soon. -- Michał Walenia Poli

Re: Jenkins outage

Everything looks fine now, the jobs are triggering correctly again On Fri, Feb 7, 2020 at 10:06 AM Michał Walenia wrote: > Hi there, > it seems that our Jenkins is experiencing some issues and the jobs are > getting stuck in the queue despite the executors being idle. > Here'

No space left on apache-beam-jenkins-7

Hi there, it seems we have an error on one of the Jenkins workers, I created a Jira to track this. Who can take care of this? https://issues.apache.org/jira/browse/BEAM-9302 Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791

Re: Jenkins jobs not running for my PR 10438

Mobile +48 784518487 > > Google Poland sp. z o.o. > ul. Emilii Plater 53, 00-113 Warszawa > Sąd Rejonowy dla m. st. Warszawy w Warszawie, > XII Wydział Gospodarczy Krajowego Rejestru Sądowego, KRS 240611. > NIP: 525-23-44-078, Kapitał zakładowy Spółki 400 000, 00 zł. > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: Beam Postcommit SQL broken RESOURCE_EXHAUSTED pubsub topics

gt; Can somebody take a look and remove all the unused topics. Is there any > reason > we need 1 topics for our tests? or is this just a mistake in our code > that can > be fixed. > > Thanks, > Ismaël > > -- Michał Walenia Polidea <https://www.polidea.com/> | S

Re: [ANNOUNCE] New committer: Alex Van Boxel

gt; >>>>>>>>> On Tue, Feb 18, 2020 at 5:10 PM Gleb Kanterov >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>> Congratulations! >>>>>>>>> >>>>>>>>> On Tue, Feb 18, 2020 at 5:02 P

Re: [ANNOUNCE] New Committer: Kamil Wasilewski

;>>>>> Kamil has contributed to Beam in many ways, including the >>>>>>> performance testing infrastructure, and a custom BQ source, along with >>>>>>> other contributions. >>>>>>> >>>>>>> In consideration o

Re: Jenkins jobs not running for my PR 10438

ce Test > Run BigQueryIO Streaming Performance Test Java > Run Dataflow ValidatesRunner > Run Spark ValidatesRunner > Run SQL Postcommit > > Regards, > Tomo > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002&

No space left on device - beam-jenkins 1 and 7

e frequent recently and I'd like to discuss how can this be remedied. Can a cleanup task be automated on Jenkins somehow? Regards Michal -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique

Re: Upcoming Apache Beam meetups in Warsaw

0 PM Karolina Rosół > wrote: > >> Hi everyone, >> >> I'm Project Manager at Polidea and work closely with three Apache Beam >> committers (Katarzyna Kucharczyk, Kamil Wasilewski and Michał Walenia). >> >> Together with folks from Polidea we'd like

Beam dependency check failing

Hi, two last builds of Beam Dependency Check job failed with errors related to Python grpc_tools dependency. https://issues.apache.org/jira/browse/BEAM-9507 here's the issue I created to track this. -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48

CommunityMetrics precommit failing

g/job/beam_PreCommit_CommunityMetrics_Phrase/65/console Does anyone know how to fix this? I think we need to patch the Jenkins workers somehow. Have a good one! -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique T

Re: Jenkins job execution policy

ge behaviours? Or do you have any > solution how phrase trigger so it would behave correctly? > > Thanks, > Kasia > > On Wed, Jan 15, 2020 at 9:48 AM Michał Walenia > wrote: > >> Thanks for adding the whitelist! >> I have the same issue as Kirill, the tests run when I p

Re: [ANNOUNCE] New PMC Member: Alexey Romanenko

;>>>> Alexey has significantly contributed to the project in different >>>>>>> ways: new >>>>>>> features and improvements in the Spark runner(s) as well as >>>>>>> maintenance of >>>>>>> multiple IO con

Re: [ANNOUNCE] New committer: Aizhamal Nurmamat kyzy

g%3E >>>> [7] >>>> >>>> https://lists.apache.org/thread.html/r872ba2860319cbb5ca20de953c43ed7d750155ca805cfce3b70085b0%40%3Cdev.beam.apache.org%3E >>>> [8] >>>> >>>> https://lists.apache.org/thread.html/rfab4cc1411318c3f4667bee051df68f37be11846ada877f3576c41a9%40%3Cdev.beam.apache.org%3E >>>> [9] >>>> >>>> https://lists.apache.org/thread.html/r4df2e596751e263a83300818776fbb57cb1e84171c474a9fd016ec10%40%3Cdev.beam.apache.org%3E >>>> [10] >>>> >>>> https://lists.apache.org/thread.html/r81b93d700fedf3012b9f02f56b5d693ac4c1aac1568edf9e0767b15f%40%3Cuser.beam.apache.org%3E >>>> [11] >>>> >>>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer >>>> >>> -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: subscribe

I think you wanted to send the mail to dev-subscr...@beam.apache.org Have a good day! Michal On Wed, Jul 1, 2020 at 10:43 AM Ayeshmantha Perera wrote: > > > -- > *Software Engineer* > *Salzburg Research Forschungsgesellschaft * > *Salzburg, Austria* > -- Michał W

Re: Monitoring performance for releases

> >> > We recently saw an increase in latency > > migrating from Beam > > > 2.18.0 to > > > >> > 2.21.0 (Python SDK with Flink Runner). This > > proofed very > > > hard to debug > > > >> > and it looks like each version in between > > the two versions > > > let to > > > >> > increased latency. > > > >> > > > > >> > This is not the first time we saw issues > > when migrating, > > > another > > > >> > time we > > > >> > had a decline in checkpointing performance > > and thus added a > > > >> > checkpointing test [1] and dashboard [2] > (see > > > checkpointing widget). > > > >> > > > > >> > That makes me wonder if we should monitor > > performance > > > (throughput / > > > >> > latency) for basic use cases as part of the > > release > > > testing. Currently, > > > >> > our release guide [3] mentions running > > examples but not > > > evaluating the > > > >> > performance. I think it would be good > > practice to check > > > relevant charts > > > >> > with performance measurements as part of of > > the release > > > process. The > > > >> > release guide should reflect that. > > > >> > > > > >> > WDYT? > > > >> > > > > >> > -Max > > > >> > > > > >> > PS: Of course, this requires tests and > > metrics to be > > > available. This PR > > > >> > adds latency measurements to the load tests > > [4]. > > > >> > > > > >> > > > > >> > [1] > https://github.com/apache/beam/pull/11558 > > > >> > [2] > > > >> > > > > > > > https://apache-beam-testing.appspot.com/explore?dashboard=5751884853805056 > > > >> > [3] > > https://beam.apache.org/contribute/release-guide/ > > > >> > [4] > https://github.com/apache/beam/pull/12065 > > > >> > > > > > > > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: [ANNOUNCE] New committer: Reza Ardeshir Rokni

t;>>>>>> >> >>>>>>>>>>> On Thu, Sep 10, 2020 at 10:35 AM Kenneth Knowles < >> k...@apache.org> wrote: >> >>>>>>>>>>>> >> >>>>>>>>>>>> Hi all, >> >>>>>>>>>>>> >> >>>>>>>>>>>> Please join me

Re: Jenkins CI down

Hi, which URL are you trying to access? https://ci-beam.apache.org works for me. On Wed, Oct 7, 2020 at 8:06 AM Ismaël Mejía wrote: > Can somebody please check in what is going on? It seems our jenkins > instance is down (503 Service Unavailable). > > -- Michał Walenia Po

Re: Gradle Build issue

.4 or newer, this > was 4.4.1* > > *Any idea about this?* > > > *Thank you!*-- > > Regards, > *Sonam* > Software Engineer > Mobile: +92 3088337296 > > <http://venturedive.com/> > -- Michał Walenia Polidea <https://www.polidea.com/> | Software Engineer M: +48 791 432 002 <+48791432002> E: michal.wale...@polidea.com Unique Tech Check out our projects! <https://www.polidea.com/our-work>

Re: [ANNOUNCE] New PMC Member: Chamikara Jayalath

gt;>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Congratulations! That's fantastic news. >>>>>>>>>>>> >>>>>>>>>>>> On Thu, Jan 21, 2021, 2:59 PM Rez

Re: [ANNOUNCE] New committer: Piotr Szuberski

at 5:33 PM Alexey Romanenko >>>>>>>>>>>> wrote: >>>>>>>>>>>> > >>>>>>>>>>>> > Hi everyone, >>>>>>>>>>>> > >>>>>>>>>&