Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo

2019-01-04 Thread Sinny Kumari
On Fri, Jan 4, 2019 at 9:16 PM Mikolaj Izdebski  wrote:

> I've applied the patch and deployed it in production.
>

Thanks a lot Mikolaj!

On Thu, Jan 3, 2019 at 4:55 PM Sinny Kumari  wrote:
> >
> >
> >
> > On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe  wrote:
> >>
> >>
> >>
> >> On 1/3/19 10:40 AM, Sinny Kumari wrote:
> >> > Hi,
> >> >
> >> > Currently, we are using two different cloudfront distributions to CDN
> content for
> >> > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current
> setup we see
> >> > an issue https://github.com/ostreedev/ostree/issues/1541 . To
> overcome this
> >> > issue and provide faster delivery of ostree content, we have created a
> >> > cloudfront distribution where we CDN /atomic/repo/ .
> >> >
> >> > This patch (available in attachment) adds some redirect rules to use
> new
> >> > cloudfront urls for testing purpose and see how much improvement we
> get in
> >> > content delivery. This patch shouldn't impact existing infra setup.
> >> >
> >>
> >> I'd like to highlight this is for testing purposes only and should have
> a short
> >> life. We just wanted to make sure the "redirect penalty" that we
> experience with
> >> our prod redirects is also reflected in our testing so we can get more
> accurate
> >> results.
> >>
> >> Sinny,
> >>
> >> One thing we might want to do is use https for the cloudfron URLs like
> we are for
> >> the prod redirects. Otherwise LGTM.
> >
> >
> > Ah yes, nice catch. Updated patch is available in the attachment.
> > This is the sad part part of doing copy paste :/
> >
> >
> >>
> >> Dusty
> >>
> >>
> >
> >
> > --
> > http://sinny.io/
> > ___
> > infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> > To unsubscribe send an email to
> infrastructure-le...@lists.fedoraproject.org
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
> ___
> infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> To unsubscribe send an email to
> infrastructure-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
>


-- 
http://sinny.io/
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo

2019-01-04 Thread Mikolaj Izdebski
I've applied the patch and deployed it in production.

On Thu, Jan 3, 2019 at 4:55 PM Sinny Kumari  wrote:
>
>
>
> On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe  wrote:
>>
>>
>>
>> On 1/3/19 10:40 AM, Sinny Kumari wrote:
>> > Hi,
>> >
>> > Currently, we are using two different cloudfront distributions to CDN 
>> > content for
>> > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we 
>> > see
>> > an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this
>> > issue and provide faster delivery of ostree content, we have created a
>> > cloudfront distribution where we CDN /atomic/repo/ .
>> >
>> > This patch (available in attachment) adds some redirect rules to use new
>> > cloudfront urls for testing purpose and see how much improvement we get in
>> > content delivery. This patch shouldn't impact existing infra setup.
>> >
>>
>> I'd like to highlight this is for testing purposes only and should have a 
>> short
>> life. We just wanted to make sure the "redirect penalty" that we experience 
>> with
>> our prod redirects is also reflected in our testing so we can get more 
>> accurate
>> results.
>>
>> Sinny,
>>
>> One thing we might want to do is use https for the cloudfron URLs like we 
>> are for
>> the prod redirects. Otherwise LGTM.
>
>
> Ah yes, nice catch. Updated patch is available in the attachment.
> This is the sad part part of doing copy paste :/
>
>
>>
>> Dusty
>>
>>
>
>
> --
> http://sinny.io/
> ___
> infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: 
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo

2019-01-03 Thread Sinny Kumari
On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe  wrote:

>
>
> On 1/3/19 10:40 AM, Sinny Kumari wrote:
> > Hi,
> >
> > Currently, we are using two different cloudfront distributions to CDN
> content for
> > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup
> we see
> > an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome
> this
> > issue and provide faster delivery of ostree content, we have created a
> > cloudfront distribution where we CDN /atomic/repo/ .
> >
> > This patch (available in attachment) adds some redirect rules to use new
> > cloudfront urls for testing purpose and see how much improvement we get
> in
> > content delivery. This patch shouldn't impact existing infra setup.
> >
>
> I'd like to highlight this is for testing purposes only and should have a
> short
> life. We just wanted to make sure the "redirect penalty" that we
> experience with
> our prod redirects is also reflected in our testing so we can get more
> accurate
> results.
>
> Sinny,
>
> One thing we might want to do is use https for the cloudfron URLs like we
> are for
> the prod redirects. Otherwise LGTM.
>

Ah yes, nice catch. Updated patch is available in the attachment.
This is the sad part part of doing copy paste :/



> Dusty
>
>
>

-- 
http://sinny.io/
From 420894ee34e7561d134bc3713801c9ec3edde5cd Mon Sep 17 00:00:00 2001
From: Sinny Kumari 
Date: Thu, 3 Jan 2019 20:57:01 +0530
Subject: [PATCH] Add CDN testing cloudfront redirect for atomic repo

Signed-off-by: Sinny Kumari 
---
 roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf | 4 
 1 file changed, 4 insertions(+)

diff --git a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
index 1f39e6c5d..63c97568b 100644
--- a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
+++ b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
@@ -23,5 +23,9 @@ RedirectMatch 302 ^/atomic/repo/deltas/(.*) https://d14lrfjen188b1.cloudfront.ne
 RedirectMatch 302 ^/atomic/repo/objects/(.*) https://d2os45suu8yck8.cloudfront.net/$1
 RedirectMatch 302 ^/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1
 
+RedirectMatch 302 ^/cdn-testing/atomic/repo/deltas/(.*) https://d1dgksnh07m2j5.cloudfront.net/deltas/$1
+RedirectMatch 302 ^/cdn-testing/atomic/repo/objects/(.*) https://d1dgksnh07m2j5.cloudfront.net/objects/$1
+RedirectMatch 302 ^/cdn-testing/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1
+
 RedirectMatch 302 ^/iot/repo/objects/(.*) https://d35xkejx7yn5rc.cloudfront.net/$1
 RedirectMatch 302 ^/iot/repo/(.*) https://kojipkgs.fedoraproject.org/compose/iot/repo/$1
-- 
2.20.1

___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo

2019-01-03 Thread Dusty Mabe


On 1/3/19 10:40 AM, Sinny Kumari wrote:
> Hi,
> 
> Currently, we are using two different cloudfront distributions to CDN content 
> for
> /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we see
> an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this
> issue and provide faster delivery of ostree content, we have created a
> cloudfront distribution where we CDN /atomic/repo/ .
> 
> This patch (available in attachment) adds some redirect rules to use new
> cloudfront urls for testing purpose and see how much improvement we get in
> content delivery. This patch shouldn't impact existing infra setup.
>

I'd like to highlight this is for testing purposes only and should have a short
life. We just wanted to make sure the "redirect penalty" that we experience with
our prod redirects is also reflected in our testing so we can get more accurate
results.

Sinny,

One thing we might want to do is use https for the cloudfron URLs like we are 
for
the prod redirects. Otherwise LGTM. 

Dusty

___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


[PATCH] Add CDN testing cloudfront redirect for atomic repo

2019-01-03 Thread Sinny Kumari
Hi,

Currently, we are using two different cloudfront distributions to CDN
content for
/atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we
see
an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this
issue and provide faster delivery of ostree content, we have created a
cloudfront distribution where we CDN /atomic/repo/ .

This patch (available in attachment) adds some redirect rules to use new
cloudfront urls for testing purpose and see how much improvement we get in
content delivery. This patch shouldn't impact existing infra setup.

Thanks,
Sinny

-- 
http://sinny.io/
From e42132ff2f5d5935cd2b0124091201d6a6cf2a9f Mon Sep 17 00:00:00 2001
From: Sinny Kumari 
Date: Thu, 3 Jan 2019 20:57:01 +0530
Subject: [PATCH] Add CDN testing cloudfront redirect for atomic repo

Signed-off-by: Sinny Kumari 
---
 roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf | 4 
 1 file changed, 4 insertions(+)

diff --git a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
index 1f39e6c5d..8fa8a3420 100644
--- a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
+++ b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf
@@ -23,5 +23,9 @@ RedirectMatch 302 ^/atomic/repo/deltas/(.*) https://d14lrfjen188b1.cloudfront.ne
 RedirectMatch 302 ^/atomic/repo/objects/(.*) https://d2os45suu8yck8.cloudfront.net/$1
 RedirectMatch 302 ^/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1
 
+RedirectMatch 302 ^/cdn-testing/atomic/repo/deltas/(.*) http://d1dgksnh07m2j5.cloudfront.net/deltas/$1
+RedirectMatch 302 ^/cdn-testing/atomic/repo/objects/(.*) http://d1dgksnh07m2j5.cloudfront.net/objects/$1
+RedirectMatch 302 ^/cdn-testing/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1
+
 RedirectMatch 302 ^/iot/repo/objects/(.*) https://d35xkejx7yn5rc.cloudfront.net/$1
 RedirectMatch 302 ^/iot/repo/(.*) https://kojipkgs.fedoraproject.org/compose/iot/repo/$1
-- 
2.20.1

___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org