On 7/27/21 10:54, Vimal wrote:
> (Unsure if this is the right forum to ask this question, but here goes:)
>
> From what I understand, IP Anycast can be used to steer traffic into a
> server that's close to the client.
>
> I am curious if anyone here has/encountered a setup where they use
>
On Thu, Jul 29, 2021 at 4:58 PM Joe Maimon wrote:
>
>
> Vimal wrote:
> > (Unsure if this is the right forum to ask this question, but here goes:)
> >
> > From what I understand, IP Anycast can be used to steer traffic into a
> > server that's close to the client.
> >
> > I am curious if anyone
Vimal wrote:
(Unsure if this is the right forum to ask this question, but here goes:)
From what I understand, IP Anycast can be used to steer traffic into a
server that's close to the client.
I am curious if anyone here has/encountered a setup where they use
anycast IP on their
Great point. We don't need geo-diversity for websites with the IP address
issue, so we could design for that case specially on a one-off basis.
For throughput it shouldn't be an issue where we're located, but we often
find websites serving different content based on the source IP of the
traffic.
I'd had a similar thought/question, though keeping the geo diversity,
you manage the crawlers, and are making contact individually with these
sites from what you have stated (and so don't need a one size fit's all
list for public posting), so why not have a restricted subset of the
crawlers
On 7/28/21 17:09, Bill Woodcock wrote:
I was about to say something about us having equal success over 105 or so
countries, when I came to the realization that inviting quantitative
comparisons of manhood with Mark is the very definition of folly. :-)
Well, we are nowhere close to the
> On Jul 28, 2021, at 3:21 AM, Mark Tinka wrote:
> On 7/28/21 01:16, Daniel Corbe wrote:
>
>>> This is interesting... I wonder whether Anycast will still have some
>>> failure modes and break TCP connections if routing (configuration) were to
>>> change? I checked the PDF linked by Bill
> On Jul 27, 2021, at 6:15 PM, Vimal wrote:
>
> AWS Global Accelerator gives anycast IPs that's good for ingress, but my
> original question was about having predictable egress IPs.
>
> It looks like having a few EIPs/a contiguous network block is the way to go.
Yes. Predictable and
On Wed, Jul 28, 2021 at 6:04 AM Vimal wrote:
> My intention is to run a web-crawling service on a public cloud. This service
> is geographically distributed, and therefore will run in multiple regions
> around the world inside AWS... this means there will be multiple AWS VPCs,
> each with their
we, verio, did anycast tcp streaming (hour long) of the tony awards in
about '96. solid.
randy
---
ra...@psg.com
`gpg --locate-external-keys --auto-key-locate wkd ra...@psg.com`
signatures are back, thanks to dmarc header butchery
AWS Global Accelerator gives anycast IPs that's good for ingress, but my
original question was about having predictable egress IPs.
It looks like having a few EIPs/a contiguous network block is the way to go.
Thanks!
On Tue, Jul 27, 2021 at 4:30 PM Andras Toth wrote:
> Since you mentioned
On AWS once we purchase EIPs, they are allocated to our account and so we
can assign them to VPC NAT gateways. That's our current plan.
On Tue, Jul 27, 2021 at 4:16 PM Daniel Corbe wrote:
>
> > On Jul 27, 2021, at 17:20, Vimal wrote:
> >
> > Hi all, great replies. :) Let me clarify my initial
Hi all, great replies. :) Let me clarify my initial question, and then
respond one by one:
My intention is to run a web-crawling service on a public cloud. This
service is geographically distributed, and therefore will run in multiple
regions around the world inside AWS... this means there will
On 7/28/21 01:16, Daniel Corbe wrote:
This is interesting... I wonder whether Anycast will still have some failure
modes and break TCP connections if routing (configuration) were to change? I
checked the PDF linked by Bill Woodcock... while the methodology is the same
from 20y ago, would
Here is what I think would happen if you were to try this setup. Let's
assume you deployed in eu-west-2 (London) and eu-central-1 (Frankfurt). You
would find that you could successfully connect to a number of networks but
also that some of them would work from the "wrong" site. Eg. you would have
>
> > On Jul 27, 2021, at 17:20, Vimal wrote:
> > Yes, this makes sense as the destination can be anywhere around the
> world, and that routing is asymmetric as others mentioned. However, if the
> destination service is "close" (in the routing metric sense) to the
> initiating host, anycast
Since you mentioned AWS, have you tried AWS Global Accelerator? You get a pair
of globally anycasted static IPs.
https://aws.amazon.com/global-accelerator/
Another alternative is to request a contiguous IP range of EIPs (/28 or /24
etc) that you can use for your EC2 instances or VPC resources.
> On Jul 27, 2021, at 17:20, Vimal wrote:
>
> Hi all, great replies. :) Let me clarify my initial question, and then
> respond one by one:
>
> My intention is to run a web-crawling service on a public cloud. This service
> is geographically distributed, and therefore will run in multiple
On 7/27/21 20:48, Bill Woodcock wrote:
In practice, that means that services are bound to a common shared address (an
“anycast service address”) as those services are deployed on servers in
different locations. The service address is advertised into the BGP routing
infrastructure.
Without any sarcasm: to make it harder to block.
If, say, Google, always crawled your site from 8.8.1.2 (random made-up example)
then you would see a not-insignificant number of hosts and networks
null-routing that IP. I have no idea why someone would do so, but I've seen it
done many times.
Matt Harris|Infrastructure Lead
816-256-5446|Direct
Looking for help?
Helpdesk|Email Support
We build customized end-to-end technology solutions powered by NetFire Cloud.
On Tue, Jul 27, 2021 at 1:29 PM Vimal wrote:
> (Unsure if this is the right forum to ask this question, but here goes:)
>
>
> On Jul 27, 2021, at 10:54 AM, Vimal wrote:
>
> (Unsure if this is the right forum to ask this question
Sure, why not… There isn’t anywhere more appropriate, really.
> From what I understand, IP Anycast can be used to steer traffic into a server
> that's close to the client.
That’s the
> On Jul 27, 2021, at 12:54, Vimal wrote:
>
> (Unsure if this is the right forum to ask this question, but here goes:)
>
> From what I understand, IP Anycast can be used to steer traffic into a server
> that's close to the client.
>
> I am curious if anyone here has/encountered a setup
> On Jul 27, 2021, at 10:54 , Vimal wrote:
>
> (Unsure if this is the right forum to ask this question, but here goes:)
>
> From what I understand, IP Anycast can be used to steer traffic into a server
> that's close to the client.
>
> I am curious if anyone here has/encountered a setup
24 matches
Mail list logo
