Konflik perusahaan muncul ing 10.06.2019 Juni XNUMX amarga kenaikan biaya pengiriman SMS menyang pangguna jaringan VimpelCom dening Mail.RU Group. Minangka respon, Mail.RU Group mandheg "nglayani" saluran IP Rusia langsung menyang jaringan VimpelCom.
Ing ngisor iki ana analisis ringkes babagan kahanan saka sudut pandang insinyur jaringan.
Nganyari: 14.06.2019/18/45 XNUMX:XNUMX - emphasis ing rute Rusia menyang jaringan VimpelCom, kesimpulan didandani, panjelasan ditambahake Sergei Kubasov (CIO VKontakte).
Nganyari: 14.06.2019/19/48 XNUMX:XNUMX - katrangan wis ditambahake babagan cara kanggo mbatesi panyebaran rute ing rute "cekak" Rusia liwat Rostelecom, MTS, RETN.NET.
Pambuka:
VimpelCom duwe sistem otonom AS3216, kabeh liyane (8402 - Internet ngarep, 16345 - Internet seluler) ana ing mburi 3216.
Mail.RU Group - sistem otonom AS47541, AS47542 lan AS47764. Generator konten utama yaiku 47542, sing diarani. CDN VKONTAKTE (film, musik). Kabeh sistem otonom bebas saka siji liyane (saka posisi sistem otonom eksternal).
Pisanan, ayo goleki kahanan saka jaringan VimpelCom. Iki bakal mbantu kita .
Ayo katon ing sistem otonom pisanan - AS47541.
2914 47541
79.104.32.251 (metric 10500) (79.104.32.251)
Origin IGP, metric 30, localpref 87, valid, internal, best, group-best, import-candidate, import suspect
Received Path ID 0, Local Path ID 1, version 2865394342
Community: 2914:410 2914:1214 2914:2213 2914:3200 3216:3000 3216:3103 47541:1 47541:40000 47541:50078
AS-PATH ngandhut loro sistem otonom - 2914 (NTT) lan 47541 (VKONTAKTE-SPB-AS).
Metrik localpref disetel dadi 87, sing miturut katrangan ing RIPE DB kanggo obyek AS3216 cocog karo peering internasional.
...
ujar: rute peer International njaluk pilihan lokal ing
cathetan: sawetara 81-89.
...
Informasi sing padha dikonfirmasi dening komunitas 3216:3000 lan 3216:3103 (sumber: ):
...
komentar: 3216:3000 Ditampa saka uplink internasional utawa peer, khusus:
...
ujar: 3216:3103 AMS-IX
...
Yaiku, VimpelCom ndeleng rute menyang VKontakte liwat persimpangan Eropa.
Ayo katon ing jaringan VKontakte liyane - 47542 (VKONTAKTE-MSK-CDN-AS).
Kabeh padha.
2914 47541
79.104.32.251 (metric 10500) (79.104.32.251)
Origin IGP, metric 30, localpref 87, valid, internal, best, group-best, import-candidate, import suspect
Received Path ID 0, Local Path ID 1, version 2865394338
Community: 2914:410 2914:1214 2914:2213 2914:3200 3216:3000 3216:3103 47541:1 47541:40000 47541:50078Kepiye Mail.ru dhewe? Ayo katon ing AS47764 (mailru-as).
3356 47764
194.67.0.215 (metric 10501) (194.67.0.215)
Origin IGP, metric 0, localpref 77, valid, internal, best, group-best, import-candidate
Received Path ID 0, Local Path ID 1, version 2867605667
Community: 3216:3000 3216:3007 3356:2 3356:22 3356:100 3356:123 3356:519 3356:2094 47764:1 47764:40000 47764:50077 VimpelCom ndeleng Mail.ru liwat as3356 (uplink Level3, operator Tier1). Informasi iki dikonfirmasi dening localpref 77:
...
ujar: rute Uplink njaluk pilihan lokal ing sawetara 71-79.
komentar: Update Terakhir: Februari 2012β¦
lan komunitas (3216:3000 lan 3216:3007):
...
komentar: 3216:3000 Ditampa saka uplink internasional utawa peer, khusus:
...
ujar: 3216:3007 Level 3 Komunikasi
...
Saka informasi sing ditampa, jelas yen lalu lintas saka jaringan VimpelCom menyang VKontakte lan MailRu disebarake liwat persimpangan Eropa miturut rute sing ditampa liwat protokol BGP. Ora ana rute alternatif liwat sambungan Rusia domestik ing Looking Glass. Ora ana langkah sing ditemokake kanggo ngarahake lalu lintas sacara artifisial liwat rute sing luwih elek.
Kepiye Mail.ru Group ndeleng jaringan VimpelCom?
Ayo padha njupuk kauntungan .
Saka router saka AS47764 (mailru-as):
Path #6: Received by speaker 0
Advertised to peers (in unique update groups):
188.93.60.188
1299 1299 1273 3216 3216
217.20.147.250 (metric 100) from 217.20.147.250 (217.20.147.253)
Origin IGP, metric 500, localpref 200, valid, internal, best, group-best
Received Path ID 0, Local Path ID 0, version 1172721494
Community: 1299:20000 47764:701 47764:41100 47764:41108 47764:50077AS-PATH ngandhut AS1299 (Telia, operator Tier1, Mail.RU uplink) lan as1273 (Vodafon, operator Tier1, VimpelCom uplink).
LocalPreference 200 minangka standar kanggo sambungan eksternal Mail.ru (https://net.mail.ru/bgp.html), lan MED 500 cocog karo kabeh sing ora ditampa saka sambungan langsung, ora saka IXs, ora saka peerings. .
Nanging kok ora ana rute lokal liwat operator telekomunikasi Rusia???
Padha ana, nanging prioritas "non-standar"!
Iki rute liwat Rostelecom (as12389):
Path #1: Received by speaker 0
Not advertised to any peer
12389 3216
46.61.178.149 from 46.61.178.149 (213.59.207.79)
Origin IGP, metric 500, localpref 199, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 3216:2001 3216:2999 3216:4100 12389:5 12389:6 12389:1100 12389:1105 12389:1277 47764:701 47764:41100 47764:41104 47764:50077
Origin-AS validity: not-foundIki liwat Megafon (as31133):
Path #2: Received by speaker 0
Not advertised to any peer
31133 3216
78.25.77.41 from 78.25.77.41 (10.222.253.97)
Origin IGP, metric 500, localpref 199, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 3216:2001 3216:2999 3216:4100 31133:300 31133:46170 47764:701 47764:41100 47764:41105 47764:50077
Origin-AS validity: not-foundIki liwat RETN.NET:
Path #3: Received by speaker 0
Not advertised to any peer
9002 9002 3216
87.245.253.24 from 87.245.253.24 (87.245.225.1)
Origin IGP, metric 500, localpref 199, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 9002:9002 9002:64667 47764:701 47764:41100 47764:41101 47764:50077
Origin-AS validity: not-foundLan malah liwat MTS!
Path #5: Received by speaker 0
Not advertised to any peer
8359 3216
212.188.61.105 from 212.188.61.105 (195.34.52.77)
Origin IGP, metric 500, localpref 199, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 8359:200 8359:609 8359:5012 47764:701 47764:41100 47764:41103 47764:50077
Origin-AS validity: not-foundMetrik localpref kanggo rute Rusia iki diremehake, yaiku, rute kasebut luwih elek dibandhingake karo rute manca!
Salajengipun, ana larangan ing bagean Mail.Ru Group distribusi prefiks sampeyan menyang VimpelCom liwat operator Rusia!
RETN.NET (http://lg.retn.net/):
Announcements saka Mail.RU Group nuduhake masyarakat 3216:65535.
Penarikan saka LG RETN.NETinet.0: 762737 tujuan, 1734826 rute (762708 aktif, 222780 ditahan, 277 didhelikake)
94.100.176.0/20 (1 entri, 1 diumumake)
* Preferensi BGP: 170/-201
...
...
AS path: 47764 I
AS path: Direkam
Komunitas: 3216:65535 9002:64667 9002:65530
...
VimpelCom ora nampa rute sing ditandhani dening komunitas kasebut ing jaringan kasebut. Kutipan saka RIPE DB ing AS3216:
...
remarks: Internal comminuties are assigned only internally.
remarks: They are in range 3216:0000-3216:4999 and 3216:6000-3216:65535
remarks: and are always deleted from incoming updates at the border
remarks: routers.
...
Ing arah Rostelecom (http://lg.ip.rt.ru), Mail.RU Group menehi rute sing padha saka komunitas 12389:8350.
Penarikan saka LG Rostelecom94.100.176.0/20 liwat 217.107.65.1 ing eth0.9 [sr2 2019-06-13] * (100/?) [AS47764i]
Tipe: BGP unicast univ
BGP.asal: IGP
BGP.as_path: 47764
BGP.next_hop: 213.59.207.78
BGP.med: 0
BGP.local_pref: 850
BGP.komunitas: (12389,1) (12389,1100) (12389,1105) (12389,1277) (12389,8350) (12389,8380) (47764,1) (47764,40000).
BGP.originator_id: 213.59.207.78
BGP.cluster_list: 95.167.88.79 95.167.88.49 95.167.88.17
Miturut entri RIPE DB kanggo obyek as12389, komunitas iki tegese "aja ngiklanake jaringan as3216":...
remarks: | 12389:835y When advertising to GoldenTelecom (AS3216) |
...
remarks: | ...y=0 - do not advertise |
...
Semono uga menyang MTS (http://lg.mtu.ru):Penarikan saka LG MTSEntri tabel routing BGP kanggo 94.100.176.0/20, versi 161717219
Paths: (2 kasedhiya, paling apik #1, standar tabel)
Multipath: eBGP
Diiklanake kanggo nganyari-grup:
6
47764, (ditampa lan digunakake)
195.34.52.77 (metrik 16) saka 195.34.52.181 (195.34.52.181)
IGP asal, metrik 0, localpref 140, valid, internal, paling apik
Komunitas: 8359:2120 8359:2150 8359:5500 8359:55277
Asal: 195.34.52.77, Daftar Kluster: 83.59.83.59
47764, (ditampa lan digunakake)
195.34.52.77 (metrik 16) saka 195.34.52.182 (195.34.52.182)
Asal IGP, metrik 0, localpref 140, valid, internal
Komunitas: 8359:2120 8359:2150 8359:5500 8359:55277
Asal: 195.34.52.77, Daftar Kluster: 83.59.2.77
Komunitas 8359:2120 tegese:...
remarks: 8359:212x when announcing to Sovam (Beeline)
...
remarks: x=0 - do not announce
...
Sampeyan ora bisa ndeleng pengumuman Mail.RU Group ing arah Megafon - sing terakhir ora duwe Looking Glass.
Ayo katon ing AS47541 (VKONTAKTE-SPB-AS).
Outpute gedhe banget.
Router: a9922-e-5
Command: show ip bgp 81.211.56.202
Last switch-over Thu Apr 5 04:25:09 2018: 1 year, 10 weeks, 6 hours, 9 minutes ago
Fri Jun 14 10:34:20.791 MSK
BGP routing table entry for 81.211.0.0/17
Versions:
Process bRIB/RIB SendTblVer
Speaker 913059757 913059757
Last Modified: May 21 05:20:38.536 for 1y03w
Paths: (6 available, best #4)
Advertised to update-groups (with more than one peer):
0.2
Advertised to peers (in unique update groups):
188.93.60.188
Path #1: Received by speaker 0
Not advertised to any peer
1299 1273 3216 3216
87.240.191.235 (metric 31) from 87.240.191.235 (87.240.191.235)
Origin IGP, metric 5000, localpref 150, valid, internal
Received Path ID 0, Local Path ID 0, version 0
Community: 1273:12752 1299:431 1299:4000 1299:20000 1299:20002 1299:20200 3216:2001 3216:2999 3216:4100 47541:701 47541:41100 47541:41111 47541:50078
Path #2: Received by speaker 0
Not advertised to any peer
1299 1273 3216 3216
87.240.191.248 (metric 31) from 87.240.191.248 (87.240.191.248)
Origin IGP, metric 5000, localpref 150, valid, internal
Received Path ID 0, Local Path ID 0, version 0
Community: 1273:12752 1299:431 1299:4000 1299:20000 1299:20002 1299:20200 3216:2001 3216:2999 3216:4100 47541:701 47541:41100 47541:41111 47541:50078
Path #3: Received by speaker 0
Not advertised to any peer
174 6762 3216 3216
87.240.191.249 (metric 31) from 87.240.191.249 (87.240.191.249)
Origin IGP, metric 5000, localpref 150, valid, internal
Received Path ID 0, Local Path ID 0, version 0
Community: 174:21100 174:22005 47541:701 47541:41100 47541:41108 47541:50078
Path #4: Received by speaker 0
Advertised to update-groups (with more than one peer):
0.2
Advertised to peers (in unique update groups):
188.93.60.188
174 6762 3216 3216
149.6.169.113 from 149.6.169.113 (38.28.1.236)
Origin IGP, metric 5000, localpref 150, valid, external, best, group-best
Received Path ID 0, Local Path ID 0, version 913059757
Community: 174:21100 174:22005 47541:701 47541:41100 47541:41108 47541:50078
Origin-AS validity: not-found
Path #5: Received by speaker 0
Not advertised to any peer
1273 1273 3216 3216
195.89.114.197 from 195.89.114.197 (195.2.1.107)
Origin IGP, metric 5005, localpref 150, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 1273:12752 3216:2001 3216:2999 3216:4100 47541:701 47541:41100 47541:41110 47541:50078
Origin-AS validity: not-found
Path #6: Received by speaker 0
Not advertised to any peer
3356 3356 3216 3216 3216
213.242.69.69 from 213.242.69.69 (4.69.177.130)
Origin IGP, metric 5000, localpref 150, valid, external
Received Path ID 0, Local Path ID 0, version 0
Community: 3216:2001 3216:2999 3216:4100 3356:2 3356:22 3356:100 3356:123 3356:503 3356:2067 47541:701 47541:41100 47541:41107 47541:50078
Origin-AS validity: not-foundAS-PATH nuduhake AS174 - Cogent (Mail.RU uplink, Tier1), banjur AS6762 - Telecom Italia (VimpelCom uplink). Preferensi Lokal 150 nang endi wae, nanging iki ditrapake kanggo kabeh joints external, preduli saka .
Ayo katon ing AS47542 (VKONTAKTE-MSK-CDN-AS).
Router: mx960-m9-0
Command: op lg-sh-bgp prefix 81.211.56.202
0.0.0.0/0 LP:151 MED: NH:87.240.191.222 AS path: 47541 I
Communities:
Accepted Best
0.0.0.0/0 LP:151 MED: NH:95.142.204.251 AS path: 47541 I
Communities:
Accepted
Inactive-reason: Interior > Exterior > Exterior via InteriorLan saka router kapindho:
Router: mx960-m9-1
Command: op lg-sh-bgp prefix 81.211.56.202
0.0.0.0/0 LP:151 MED: NH:87.240.191.224 AS path: 47541 I
Communities:
Accepted Best
0.0.0.0/0 LP:151 MED: NH:95.142.204.250 AS path: 47541 I
Communities:
Accepted
Inactive-reason: Interior > Exterior > Exterior via InteriorMung rute standar (0.0.0.0/0). Kahanan iki diterangake dening karyawan Mail.RU Group , ingkang kula aturaken matur nuwun. Singkat: segmen Moscow saka jaringan VKontakte minangka bagean caching (lan ora ngasilake), sing tugase kanggo ngoptimalake kacepetan loading konten sing dikarepake. Ngurus pangguna, ya.
Yen ora ana rute menyang jaringan tartamtu, jaringan iki ora dilayani dening server caching. Iki tegese optimasi kacepetan download ora bisa digunakake, lan pangguna nandhang sangsara. Nanging ing kene kita kudu nandheske manawa pangguna ora mung duweke dhewe, nanging uga saka VimpelCom.
Kesimpulan:
- Saka VimpelCom, lalu lintas menyang Mail.RU Group disebarake kanthi alami. Ora ana pangalihan gawean liwat manipulasi Preferensi Lokal sing dideteksi
- Mail.RU Group ngamati manipulasi nganggo awalan VimpelCom. Rute sing ana menyang jaringan VimpelCom liwat operator Rusia nduweni prioritas sing luwih murah tinimbang rute liwat operator Tier1 asing.
- Manajer komunitas BGP wis ditambahake menyang rute sing dikirim menyang operator Rusia (MTS, Rostelecom, RETN.NET) dening Mail.RU Group kanggo mbatesi panyebaran menyang VimpelCom
Napa Mail.RU Group ngutamakake rute liwat Eropa? Napa Mail.RU Group nglarang sambungan Rusia domestik cendhak karo VimpelCom?
Apa luwih murah kanggo wong-wong mau? Nyopir lalu lintas liwat saluran manca lan mbayar Tirvans ing mata uang asing?
Utawa ana kepinginan kanggo drive lalu lintas luwih adoh supaya njupuk iku ora supaya trep, huh?
Iki ora dingerteni insinyur jaringan ...
Source: www.habr.com
