Hi all,
I apologise if this is the wrong place to ask but I was recommended
reaching out to the UKNOF lists after not getting very far in other
lists/forums.
I work for a UK company with a satellite office in Northern India
served by BSNL. About 4 weeks ago our inter office latency doubled to
approximately 750ms. After some investigation on various UK ISPs I
realised that they're all being routed via London -> New York -> Palo
Alto -> Tokyo -> Singapore -> Chennai.
The return route from India was still Mumbai -> London fairly directly
as it always has been.
Some time on Wednesday (27th) the route changed again. Now the UK is
bouncing from London -> Egypt -> Mumbai. This is almost normal but I'm
still averaging about 100ms higher latency than normal (I could get
under 250ms on a good day but more usually it was about 300ms).
At about the same time the return route from India changed completely
(its now going Mumbai -> Chennai -> Singapore -> Tokyo -> Palo Alto ->
New York -> London).
I'm fairly convinced its a BSNL issue but they're doing the usual telco
thing of "it must be your fault." Is there anything I can use to prove
one way or the other where the fault lies?
I have a handful of trace routes (attached) that didn't convince them,
so where should I go next?
Any advice even if its to tell me to try elsewhere would be much
appreciated.
Regards,
Wayne
Ludhiana, India -> West Bromwich, UK
Tracing route to host217-41-15-69.in-addr.btopenworld.com [217.41.15.69]
over a maximum of 30 hops:
1 <1 ms <1 ms <1 ms 10.91.5.1
2 5 ms 6 ms 9 ms 117.240.161.18
3 88 ms 88 ms 88 ms 115.114.89.17.static-mumbai.vsnl.net.in
[115.114.89.17]
4 309 ms 308 ms 309 ms if-2-590.tcore2.l78-london.as6453.net
[80.231.131.113]
5 319 ms 298 ms 298 ms if-2-2.tcore1.l78-london.as6453.net
[80.231.131.2]
6 449 ms * * vlan704.icore1.ldn-london.as6453.net
[80.231.130.10]
7 417 ms 414 ms 423 ms t2a1.uk-lon1.eu.bt.net [195.66.224.108]
8 366 ms 367 ms 367 ms t2as1-v101.uk-lon1.eu.bt.net [166.49.135.16]
9 330 ms 333 ms 326 ms 166-49-211-142.eu.bt.net [166.49.211.142]
10 306 ms 307 ms 307 ms core1-pos0-1-4-0.ealing.ukcore.bt.net
[62.6.201.81]
11 333 ms 335 ms 334 ms host213-121-193-31.ukcore.bt.net
[213.121.193.31]
12 384 ms 382 ms 384 ms acc1-10gige-0-5-0-1.l-far.21cn-ipp.bt.net
[109.159.249.34]
13 309 ms 309 ms 311 ms 109.159.249.109
14 458 ms 459 ms * 217.41.168.106
15 * 310 ms 309 ms 217.41.168.42
16 476 ms 476 ms 477 ms 213.120.177.97
17 319 ms 319 ms 319 ms 213.120.178.131
18 * * * Request timed out.
19 431 ms 432 ms 427 ms host217-41-15-69.in-addr.btopenworld.com
[217.41.15.69]
West Bromwich, UK -> Ludhiana, India
traceroute to 117.240.161.18 (117.240.161.18), 30 hops max, 60 byte packets
1 10.43.0.1 (10.43.0.1) 0.272 ms 0.249 ms 0.239 ms
2 10.43.0.254 (10.43.0.254) 1.482 ms 2.809 ms 3.516 ms
3 host81-139-64-1.in-addr.btopenworld.com (81.139.64.1) 12.108 ms 12.657 ms
13.672 ms
4 213.120.178.141 (213.120.178.141) 14.996 ms 16.464 ms 16.803 ms
5 213.120.177.98 (213.120.177.98) 17.224 ms 18.184 ms *
6 * 217.41.168.43 (217.41.168.43) 13.466 ms 13.979 ms
7 217.41.168.107 (217.41.168.107) 15.426 ms 17.263 ms 18.112 ms
8 109.159.249.78 (109.159.249.78) 19.396 ms 20.421 ms
acc1-10GigE-0-2-0-6.l-far.21cn-ipp.bt.net (109.159.249.101) 20.975 ms
9 core2-te0-15-0-17.faraday.ukcore.bt.net (109.159.249.27) 27.687 ms
core2-te0-7-0-17.faraday.ukcore.bt.net (109.159.249.13) 26.631 ms
core2-te0-7-0-5.faraday.ukcore.bt.net (109.159.249.15) 27.040 ms
10 host213-121-193-56.ukcore.bt.net (213.121.193.56) 28.376 ms 28.800 ms
29.173 ms
11 transit2-pos9-0.telehouse.ukcore.bt.net (62.6.201.122) 29.175 ms 30.172
ms 207.068 ms
12 t2as2-tge4-3.uk-lon1.eu.bt.net (166.49.214.145) 84.279 ms 85.303 ms
14.389 ms
13 t2a1-ge4-0-0.uk-lon1.eu.bt.net (166.49.135.17) 14.542 ms 14.776 ms
16.549 ms
14 * * *
15 * Vlan1501.icore2.LDN-London.as6453.net (195.219.83.126) 31.227 ms *
16 * if-6-756.tcore2.L78-London.as6453.net (80.231.131.25) 30.171 ms 31.572
ms
17 if-20-2.tcore2.NYY-NewYork.as6453.net (216.6.99.13) 276.170 ms * *
18 if-11-2.tcore1.NYY-NewYork.as6453.net (216.6.99.2) 275.374 ms 262.572 ms
264.956 ms
19 if-1-2.tcore1.PDI-PaloAlto.as6453.net (66.198.127.5) 262.043 ms 264.510
ms 267.399 ms
20 if-2-2.tcore2.PDI-PaloAlto.as6453.net (66.198.127.2) 264.853 ms 264.490
ms 287.183 ms
21 if-9-2.tcore1.TV2-Tokyo.as6453.net (180.87.180.18) 288.083 ms 287.313 ms
279.838 ms
22 if-2-2.tcore2.TV2-Tokyo.as6453.net (180.87.180.2) 289.945 ms 295.448 ms
288.817 ms
23 if-6-2.tcore1.SVW-Singapore.as6453.net (180.87.12.109) 344.097 ms 348.759
ms 263.364 ms
24 if-5-2.tcore1.CXR-Chennai.as6453.net (180.87.12.54) 267.062 ms 273.407 ms
296.927 ms
25 180.87.36.58 (180.87.36.58) 303.725 ms 296.853 ms 302.776 ms
26 115.114.130.86.STATIC-Chennai.vsnl.net.in (115.114.130.86) 284.001 ms
316.402 ms 291.030 ms
27 218.248.255.49 (218.248.255.49) 282.731 ms 279.865 ms 283.097 ms
28 117.240.161.18 (117.240.161.18) 503.265 ms * *
Tracing route to inpix001.thevoiceasia.com [117.240.161.21]
over a maximum of 30 hops:
1 <1 ms <1 ms <1 ms 192.168.1.1
2 147 ms 137 ms 109 ms host-78-147-208-1.as13285.net [78.147.208.1]
3 93 ms 81 ms 137 ms host-78-151-225-49.static.as13285.net
[78.151.225.49]
4 89 ms 137 ms 164 ms host-78-151-225-164.static.as13285.net
[78.151.225.164]
5 42 ms 133 ms 110 ms xe-11-2-0-rt001.man.as13285.net [62.24.240.0]
6 128 ms 82 ms 109 ms xe-11-1-0-rt001.sov.as13285.net [62.24.240.14]
7 * * 165 ms host-78-144-1-65.as13285.net [78.144.1.65]
8 145 ms 56 ms 135 ms abovenet.killercreation.co.uk [79.141.38.129]
9 146 ms 109 ms 82 ms xe-8-1-1.mpr1.lhr1.uk.above.net [64.125.31.197]
10 198 ms 190 ms 137 ms bcr1-ge-4-3-0.Londonlnx.savvis.net
[195.66.224.39]
11 144 ms 191 ms 164 ms 204.70.206.65
12 285 ms 328 ms 327 ms cr1-pos-0-0-0-0.losangeles.savvis.net
[204.70.192.89]
13 388 ms 408 ms 436 ms 206.103.72.58
14 412 ms 327 ms 382 ms 218.248.255.69
15 453 ms 465 ms 435 ms 117.240.161.18
16 409 ms 439 ms 422 ms 117.240.161.21
Trace complete.
UK BT -> Ludhiana BSNL
traceroute to 117.240.161.18 (117.240.161.18), 30 hops max, 60 byte packets
1 10.43.0.1 (10.43.0.1) 0.217 ms 0.553 ms 0.549 ms
2 10.43.0.254 (10.43.0.254) 0.963 ms 1.744 ms 1.740 ms
3 host81-139-64-1.in-addr.btopenworld.com (81.139.64.1) 12.435 ms 13.770 ms
14.637 ms
4 213.120.178.141 (213.120.178.141) 15.509 ms 16.373 ms 17.971 ms
5 213.120.177.98 (213.120.177.98) 18.411 ms 19.128 ms 21.180 ms
6 217.41.168.43 (217.41.168.43) 21.567 ms 12.888 ms 19.745 ms
7 217.41.168.107 (217.41.168.107) 21.185 ms 21.613 ms 26.139 ms
8 acc1-10GigE-0-7-0-4.l-far.21cn-ipp.bt.net (109.159.249.74) 26.141 ms
109.159.249.112 (109.159.249.112) 26.535 ms
acc1-10GigE-0-1-0-7.l-far.21cn-ipp.bt.net (109.159.249.118) 26.540 ms
9 core2-te0-0-0-7.faraday.ukcore.bt.net (109.159.249.7) 30.505 ms
core1-te0-7-0-5.faraday.ukcore.bt.net (109.159.249.39) 29.758 ms
core1-te0-0-0-7.faraday.ukcore.bt.net (109.159.249.5) 34.739 ms
10 peer3-te0-5-0-11.telehouse.ukcore.bt.net (109.159.255.107) 32.244 ms
host213-121-193-133.ukcore.bt.net (213.121.193.133) 33.264 ms 33.666 ms
11 gw5.lax1.asianetcom.net (195.66.225.168) 175.119 ms 176.007 ms 176.862 ms
12 te0-0-0-0.wr2.sin0.asianetcom.net (61.14.157.10) 342.690 ms
te0-3-0-0.wr2.sin0.asianetcom.net (61.14.157.209) 358.022 ms 329.828 ms
13 te0-0-0-0.gw1.sin0.asianetcom.net (61.14.157.122) 331.379 ms 337.961 ms
333.848 ms
14 BHA-0013.asianetcom.net (203.192.163.74) 369.652 ms 374.583 ms 371.669 ms
15 125.21.167.118 (125.21.167.118) 371.249 ms * 374.447 ms
16 * 125.17.0.98 (125.17.0.98) 422.403 ms 418.169 ms
17 * * *
18 117.240.161.18 (117.240.161.18) 449.161 ms * *
Tracing route to host 217-41-15-69.in-addr.btopenworld.com [217.41.15.69]
over a maximum of 30 hops:
1 <1 ms 5 ms <1 ms 10.91.5.1
2 3 ms * 2 ms 117.240.161.18
3 67 ms 67 ms 82 ms 115.114.57.165.static-mumbai.vsnl.net.in
[115.114.57.165]
4 96 ms 69 ms 69 ms ix-0-100.tcore2.MLV-Mumbai.as6453.net
[180.87.39.25]
5 430 ms 440 ms 439 ms if-9-2.tcore2.CXR-Chennai.as6453.net
[180.87.37.9]
6 444 ms 443 ms 444 ms if-6-2.tcore2.SVW-Singapore.as6453.net
[180.87.37.14]
7 437 ms 438 ms 476 ms if-2-2.tcore1.SVW-Singapore.as6453.net
[180.87.12.1]
8 446 ms 445 ms * if-6-2.tcore2.TV2-Tokyo.as6453.net
[180.87.12.110]
9 446 ms * * if-2-2.tcore1.TV2-Tokyo.as6453.net
[180.87.180.1]
10 450 ms 444 ms 454 ms if-9-2.tcore2.PDI-PaloAlto.as6453.net
[180.87.180.17]
11 447 ms 449 ms 449 ms if-2-2.tcore1.PDI-PaloAlto.as6453.net
[66.198.127.1]
12 439 ms 439 ms 442 ms if-1-2.tcore1.NYY-NewYork.as6453.net
[66.198.127.6]
13 499 ms 456 ms 452 ms if-11-2.tcore2.NYY-NewYork.as6453.net
[216.6.99.1]
14 * 438 ms 437 ms if-20-2.tcore2.L78-London.as6453.net
[216.6.99.14]
15 449 ms 434 ms 434 ms if-2-2.tcore1.L78-London.as6453.net
[80.231.131.2]
16 * * * Request timed out.
17 429 ms 427 ms 421 ms t2a1.uk-lon1.eu.bt.net [195.66.224.108]
18 433 ms 434 ms 433 ms t2as1-v102.uk-lon1.eu.bt.net [166.49.135.48]
19 417 ms 417 ms 422 ms 166-49-211-142.eu.bt.net [166.49.211.142]
20 426 ms * 431 ms core1-pos0-1-4-0.ealing.ukcore.bt.net
[62.6.201.81]
21 425 ms 423 ms 421 ms host213-121-193-31.ukcore.bt.net
[213.121.193.31]
22 426 ms 423 ms 425 ms acc1-10GigE-0-2-0-2.l-far.21cn-ipp.bt.net
[109.159.249.28]
23 421 ms 422 ms * 109.159.249.89
24 457 ms 453 ms 454 ms 217.41.168.106
25 423 ms * 426 ms 217.41.168.42
26 422 ms 427 ms 427 ms 213.120.177.97
27 423 ms 427 ms 429 ms 213.120.178.131
28 * * * Request timed out.
29 468 ms 457 ms 443 ms host217-41-15-69.in-addr.btopenworld.com
[217.41.15.69]
Trace complete.
