Re: Discussion: Scheduling across runner and SDKHarness in Portability framework

I managed to write a small document based on the discussion. Please take a look at https://docs.google.com/document/d/1oAXVPbJ0dzj2_8LXEWFAgqCP5Tpld3q5B3QU254PQ6A/edit?usp=sharing On Tue, Aug 21, 2018 at 11:01 PM Henning Rohde wrote: > Sending bundles that cannot be executed, i.e., the

Re: Get SSL certificate for dashboards

That sounds fine to me:) On Wed, Aug 29, 2018, 2:00 PM Mikhail Gryzykhin wrote: > Looking deeper into this I found following: > > If we want to add Ssl, we need much more configuration than I anticipated. > 1. We need to request hostname for dashboards to obtain proper ssl cert. I > believe

Re: Get SSL certificate for dashboards

Looking deeper into this I found following: If we want to add Ssl, we need much more configuration than I anticipated. 1. We need to request hostname for dashboards to obtain proper ssl cert. I believe current approach is to request it from Infra team. 2. We need to set up proper certificate

Re: Beam Schemas: current status

The work you've done to generalize and expand Schemas has significantly simplified what we need to do for SQL, I hope they are valuable to everyone else too. What work remains before we can drop the Experimental designation? Andrew On Wed, Aug 29, 2018 at 5:31 AM Eugene Kirpichov wrote: > Wow,

Re: Accessing attempted metrics from within a DoFn

Adding Andrea as she may have thoughts on this. On Wed, Aug 29, 2018 at 10:43 AM Robin Qiu wrote: > Hi everyone, > > I am writing a test [1] for the support of @RequiresStableInput annotation > in Java SDK [2]. In the test I need to have a ParDo make some side effects > and then fail.

Re: [PROPOSAL] Prepare Beam 2.7.0 release

It sounds good to me. I'm late on my PRs, but not release blocker anyway. I will wait the next release cycle ;) Regards JB On 29/08/2018 21:18, Charles Chen wrote: > I have cut the release branch for 2.7.0, since there continue to be no > blockers listed in JIRA.  I will build the first release

Re: [PROPOSAL] Prepare Beam 2.7.0 release

I have cut the release branch for 2.7.0, since there continue to be no blockers listed in JIRA. I will build the first release candidate soon. On Mon, Aug 27, 2018 at 10:38 PM Charles Chen wrote: > Hey everyone, I want to highlight again to those who missed it that if you > are aware of any

Re: Get SSL certificate for dashboards

Thank you Andrew, I've got same suggestion from Udi. Will follow that way. Regards, --Mikhail Have feedback ? On Wed, Aug 29, 2018 at 11:11 AM Andrew Pilloud wrote: > You should move your endpoint from port 80 to port 443 (which is the > default for https). You

Re: Get SSL certificate for dashboards

You should move your endpoint from port 80 to port 443 (which is the default for https). You also need a hostname for a CA signed certificate. Once you have those things setup, you should be able to get a certificate from Let's Encrypt using certbot: https://certbot.eff.org/ Happy to help you get

Accessing attempted metrics from within a DoFn

Hi everyone, I am writing a test [1] for the support of @RequiresStableInput annotation in Java SDK [2]. In the test I need to have a ParDo make some side effects and then fail. Currently, the only way to persist the side effect during retries without depending on external states is using

Get SSL certificate for dashboards

Hi everyone, I have set up dashboards at https://104.154.241.245:80/d/D81lW0pmk/post-commit-jobs However now I want to add https for it. Can someone share knowledge on how can I get valid certificates? The self-signed one causes browser to show security alert. Regards, --Mikhail Have feedback

Re: Should we allow ValidatesRunner tests to have access to file systems?

Hi Alan and Luke, Thanks for your comments! I agree on your suggestions, and now I have made the test into an integration test. Please take a look at the PR when you have time. Luke's suggestion on using metrics sounds promising. I will open a separate email thread to ask people's idea on making

Re: BigqueryIO field clustering

+dev@beam.apache.org Wout, I assigned this task to you since it seems like your interested in contributing. The Apache Beam contribution guide[1] is a good place to start for answering questions on how to contribute. If you need help in getting stuff reviewed or having questions, feel free to

Re: builds.apache.org refused connections since last night

Thank you Andrew! On Wed, Aug 29, 2018 at 9:17 AM Andrew Pilloud wrote: > Down for me too. It sounds like the disk failed and it will be down for a > while: https://status.apache.org/ > > Andrew > > On Wed, Aug 29, 2018 at 9:13 AM Boyuan Zhang wrote: > >> Hey all, >> >> It seems like that

Re: builds.apache.org refused connections since last night

Down for me too. It sounds like the disk failed and it will be down for a while: https://status.apache.org/ Andrew On Wed, Aug 29, 2018 at 9:13 AM Boyuan Zhang wrote: > Hey all, > > It seems like that builds.apache.org cannot be reached from last night. > Does anyone have the sam e connection

builds.apache.org refused connections since last night

Hey all, It seems like that builds.apache.org cannot be reached from last night. Does anyone have the sam e connection problem? Any idea what can we do? Boyuan Zhang

Re: Beam Schemas: current status

Wow, this is really coming together, congratulations and thanks for the great work! On Wed, Aug 29, 2018 at 1:40 AM Reuven Lax wrote: > I wanted to send a quick note to the community about the current status of > schema-aware PCollections in Beam. As some might remember we had a good >