Re: Brief of interactive Beam

2019-08-23 Thread Ning Kang
Great! I’ve added some proposals. And to clarify, we want to use explicit name “Interactive Beam” instead of the short name “iBeam”. Sorry for the confusion. > On Aug 23, 2019, at 3:09 PM, Robert Bradshaw wrote: > > Cool, sounds like we're getting closer to the same page. Some more replies > b

Re: Python question about save_main_session

2019-08-23 Thread Udi Meiri
Yeah that sounds like the sanest way forward. Lots of these tests are running standalone examples so they might need SMS if you run them directly. (example streaming_wordcount_it_test.py running streaming_wordcount.py) On Fri, Aug 23, 2019 at 3:17 PM Robert Bradshaw wrote: > I suggest re-writing

Re: Python question about save_main_session

2019-08-23 Thread Robert Bradshaw
I suggest re-writing the test to avoid save_main_session. On Fri, Aug 23, 2019 at 11:57 AM Udi Meiri wrote: > Hi, > I'm trying to get pytest with the xdist plugin to run Beam tests. The > issue is with save_main_session and a dependency of pytest-xdist called > execnet, which triggers this error

Re: Brief of interactive Beam

2019-08-23 Thread Robert Bradshaw
Cool, sounds like we're getting closer to the same page. Some more replies below. On Fri, Aug 23, 2019 at 1:47 PM Ning Kang wrote: > Thanks for the feedback, Robert! I think I got your idea. > Let me summarize it to see if it’s correct: > 1. You want everything about > > standard Beam concepts >

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Kenneth Knowles
Nice work! On Fri, Aug 23, 2019 at 11:26 AM Charles Chen wrote: > Thank you Yifan! > > On Fri, Aug 23, 2019 at 11:12 AM Hannah Jiang > wrote: > >> Thank you Yifan! >> >> On Fri, Aug 23, 2019 at 11:09 AM Yichi Zhang wrote: >> >>> Thank you Yifan! >>> >>> On Fri, Aug 23, 2019 at 11:06 AM Robin Q

Re: Brief of interactive Beam

2019-08-23 Thread Ning Kang
Thanks for the feedback, Robert! I think I got your idea. Let me summarize it to see if it’s correct: 1. You want everything about > >> standard Beam concepts to follow existing pattern: so we can shot down create_pipeline() and keep the InteractiveRunner notion when constructing pipeline, I

Python question about save_main_session

2019-08-23 Thread Udi Meiri
Hi, I'm trying to get pytest with the xdist plugin to run Beam tests. The issue is with save_main_session and a dependency of pytest-xdist called execnet, which triggers this error: *apache_beam/examples/complete/tfidf.py*:212: in run*output | 'write' >> WriteToText(known_args.output)**apache_

Re: Brief of interactive Beam

2019-08-23 Thread Robert Bradshaw
On Wed, Aug 21, 2019 at 3:33 PM GMAIL wrote: > Thanks for the input, Robert! > > On Aug 21, 2019, at 11:49 AM, Robert Bradshaw wrote: > > On Wed, Aug 14, 2019 at 11:29 AM Ning Kang wrote: > >> Ahmet, thanks for forwarding! >> >> >>> My main concern at this point is the introduction of new conce

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Charles Chen
Thank you Yifan! On Fri, Aug 23, 2019 at 11:12 AM Hannah Jiang wrote: > Thank you Yifan! > > On Fri, Aug 23, 2019 at 11:09 AM Yichi Zhang wrote: > >> Thank you Yifan! >> >> On Fri, Aug 23, 2019 at 11:06 AM Robin Qiu wrote: >> >>> Thank you Yifan! >>> >>> On Fri, Aug 23, 2019 at 11:05 AM Rui Wa

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Hannah Jiang
Thank you Yifan! On Fri, Aug 23, 2019 at 11:09 AM Yichi Zhang wrote: > Thank you Yifan! > > On Fri, Aug 23, 2019 at 11:06 AM Robin Qiu wrote: > >> Thank you Yifan! >> >> On Fri, Aug 23, 2019 at 11:05 AM Rui Wang wrote: >> >>> Thank you Yifan! >>> >>> -Rui >>> >>> On Fri, Aug 23, 2019 at 9:21 A

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Yichi Zhang
Thank you Yifan! On Fri, Aug 23, 2019 at 11:06 AM Robin Qiu wrote: > Thank you Yifan! > > On Fri, Aug 23, 2019 at 11:05 AM Rui Wang wrote: > >> Thank you Yifan! >> >> -Rui >> >> On Fri, Aug 23, 2019 at 9:21 AM Pablo Estrada wrote: >> >>> Thanks Yifan! >>> >>> On Fri, Aug 23, 2019 at 8:54 AM Co

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Robin Qiu
Thank you Yifan! On Fri, Aug 23, 2019 at 11:05 AM Rui Wang wrote: > Thank you Yifan! > > -Rui > > On Fri, Aug 23, 2019 at 9:21 AM Pablo Estrada wrote: > >> Thanks Yifan! >> >> On Fri, Aug 23, 2019 at 8:54 AM Connell O'Callaghan >> wrote: >> >>> >>> +1 thank you Yifan!!! >>> >>> On Fri, Aug 23,

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Rui Wang
Thank you Yifan! -Rui On Fri, Aug 23, 2019 at 9:21 AM Pablo Estrada wrote: > Thanks Yifan! > > On Fri, Aug 23, 2019 at 8:54 AM Connell O'Callaghan > wrote: > >> >> +1 thank you Yifan!!! >> >> On Fri, Aug 23, 2019 at 8:49 AM Ahmet Altay wrote: >> >>> Thank you Yifan! >>> >>> On Fri, Aug 23, 20

Re: Mentorship Program

2019-08-23 Thread Pablo Estrada
Hmmm that's an interesting idea. Yeah, you're right that emailing the big public dev@ list is intimidating, and people aren't always in the mindset to help someone new. I still remember one of my first questions was answered with a link to a Google search for that question. Having a new mailing li

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Pablo Estrada
Thanks Yifan! On Fri, Aug 23, 2019 at 8:54 AM Connell O'Callaghan wrote: > > +1 thank you Yifan!!! > > On Fri, Aug 23, 2019 at 8:49 AM Ahmet Altay wrote: > >> Thank you Yifan! >> >> On Fri, Aug 23, 2019 at 8:00 AM Yifan Zou wrote: >> >>> The Apache Beam team is pleased to announce the release

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Connell O'Callaghan
+1 thank you Yifan!!! On Fri, Aug 23, 2019 at 8:49 AM Ahmet Altay wrote: > Thank you Yifan! > > On Fri, Aug 23, 2019 at 8:00 AM Yifan Zou wrote: > >> The Apache Beam team is pleased to announce the release of version 2.15.0. >> >> Apache Beam is an open source unified programming model to defin

Re: [ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Ahmet Altay
Thank you Yifan! On Fri, Aug 23, 2019 at 8:00 AM Yifan Zou wrote: > The Apache Beam team is pleased to announce the release of version 2.15.0. > > Apache Beam is an open source unified programming model to define and > execute data processing pipelines, including ETL, batch and stream > (continu

[ANNOUNCE] Beam 2.15.0 Released!

2019-08-23 Thread Yifan Zou
The Apache Beam team is pleased to announce the release of version 2.15.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release her

[PROPOSAL] Storing, displaying and detecting anomalies in test results

2019-08-23 Thread Kamil Wasilewski
Hi all, Recently we did some research on how to visualize IO performance tests, Nexmark and Load test results better and how to detect regressions automatically in an easy way using tools dedicated for the job. We'd like to share a proposal with you: