Yuav ua li cas peb tsoo lub Great Firewall ntawm Tuam Tshoj (Part 3)

Nyob zoo!
Txhua zaj dab neeg zoo los xaus. Thiab peb zaj dab neeg hais txog yuav ua li cas peb tuaj nrog kev daws kom sai dhau Suav Firewall tsis muaj qhov tshwj xeeb. Yog li ntawd, kuv maj mam qhia rau koj tus kawg, qhov kawg ntawm lub ncauj lus no.

Hauv ntu dhau los peb tau tham txog ntau lub rooj sib tw uas peb tau los nrog thiab cov txiaj ntsig lawv tau muab dab tsi. Thiab peb tau txiav txim siab dab tsi yuav zoo ntxiv CDN! rau viscosity rau hauv peb lub tswv yim.

Kuv mam li qhia koj seb peb tau sim Alibaba Cloud CDN, Tencent Cloud CDN thiab Akamai, thiab peb tau ua dab tsi. Thiab ntawm chav kawm, cia peb xaus.

Alibaba Huab CDN

Peb tau tuav ntawm Alibaba Huab thiab siv IPSEC thiab CEN los ntawm lawv. Nws yuav yog qhov xav tau los sim lawv cov kev daws ua ntej.

Alibaba Cloud muaj ob yam khoom uas yuav haum rau peb: CDN и DCDN. Thawj qhov kev xaiv yog CDN classic rau cov npe tshwj xeeb (subdomain). Qhov kev xaiv thib ob yog rau Dynamic Route rau CDN (Kuv hu nws dynamic CDN), nws tuaj yeem qhib rau hauv Full-site hom (rau wildcard domains), nws tseem caches cov ntsiab lus zoo li qub thiab nrawm cov ntsiab lus dynamic ntawm nws tus kheej, uas yog, qhov kev hloov pauv ntawm nplooj ntawv kuj tseem yuav thauj khoom los ntawm tus kws kho mob. ceev networks. Qhov no yog qhov tseem ceeb rau peb, vim tias peb lub vev xaib yog qhov muaj zog, nws siv ntau subdomains, thiab nws yooj yim dua los teeb tsa CDN ib zaug rau "asterisk" - *.semrushchina.cn.

Peb twb pom cov khoom no nyob rau theem ua ntej ntawm peb qhov project Suav, tab sis tom qab ntawd nws tseem tsis tau ua haujlwm, thiab cov neeg tsim khoom tau cog lus tias cov khoom yuav sai sai no rau txhua tus neeg siv khoom. Thiab nws tau ua.

Hauv DCDN koj tuaj yeem:

• configure SSL txiav nrog koj daim ntawv pov thawj,
• pab kom acceleration ntawm dynamic cov ntsiab lus,
• flexibly configure caching ntawm cov ntaub ntawv zoo li qub,
• ntxuav lub cache,
• xa mus rau lub web sockets,
• pab kom compression thiab txawm HTML Beautifier.

Feem ntau, txhua yam zoo ib yam nrog cov neeg laus thiab cov chaw muab kev pabcuam CDN loj.

Tom qab Keeb Kwm (qhov chaw uas CDN ntug servers yuav mus) tau teev tseg, txhua yam uas tseem tshuav yog tsim CNAME rau lub hnub qub, xa mus. all.semrushchina.cn.w.kunluncan.com (qhov CNAME no tau txais hauv Alibaba Cloud console) thiab CDN yuav ua haujlwm.

Raws li cov txiaj ntsig kev xeem, CDN no tau pab peb ntau heev. Cov txheeb cais tau qhia hauv qab no.

kev txiav txim siab
Uptime
theem nrab
75 Feem pua
95 Feem pua

Cloudflare
86.6
18s
30s
60s

IPsec
99.79
18s
21s
30s

CEN
99.75
16s
21s
27s

CEN/IPsec + GLB
99.79
13s
16s
25s

Ali CDN + CEN / IPsec + GLB
99.75
10s
12.8s
17.3s

Cov no yog cov txiaj ntsig zoo heev, tshwj xeeb tshaj yog tias koj muab piv nrog cov lej twg thaum pib. Tab sis peb paub tias qhov browser xeem ntawm Asmeskas version ntawm peb lub vev xaib www.semrush.com khiav los ntawm Tebchaws Meskas hauv qhov nruab nrab ntawm 8.3s (tus nqi kwv yees heev). Muaj chaw rau kev txhim kho. Ntxiv mus, kuj tseem muaj cov chaw muab kev pabcuam CDN uas txaus siab rau kev sim.

Yog li peb maj mam txav mus rau lwm qhov loj hauv Suav lag luam - Tencent.

Tencent Huab

Tencent tsuas yog tsim nws cov huab - qhov no tuaj yeem pom los ntawm cov khoom me me. Thaum siv nws, peb xav sim tsis yog lawv cov CDN nkaus xwb, tab sis kuj tseem muaj lawv lub network infrastructure tag nrho:

• lawv puas muaj tej yam zoo ib yam li CEN?
• IPSEC ua haujlwm li cas rau lawv? Nws puas ceev, dab tsi yog lub sijhawm uptime?
• lawv puas muaj Anycast?

Cia peb saib cov lus nug no nyias nyias.

Analogue CEN

Tencent muaj ib yam khoom Cloud Txuas Network (CCN), tso cai rau koj txuas VPCs los ntawm cov cheeb tsam sib txawv, suav nrog thaj chaw sab hauv thiab sab nraud Suav. Cov khoom tam sim no nyob hauv beta sab hauv, thiab koj yuav tsum tsim daim pib thov kom txuas mus rau nws. Peb tau kawm los ntawm kev txhawb nqa tias cov nyiaj thoob ntiaj teb (peb tsis tau hais txog cov pej xeem Suav lossis cov koom haum raug cai) tsis tuaj yeem koom nrog hauv kev sim beta thiab, feem ntau, txuas ib cheeb tsam hauv Suav teb nrog thaj tsam sab nraud. 1-0 hauv kev pom zoo ntawm Ali Huab

IPSEC

Tencent thaj av qab teb tshaj plaws yog Guangzhou. Peb tau sib sau ua ke ib qhov thiab txuas mus rau thaj tsam Hong Kong hauv GCP (ces thaj av no twb dhau los lawm). Qhov thib ob qhov hauv Ali Huab los ntawm Shenzhen mus rau Hong Kong kuj tau tsa tib lub sijhawm. Nws muab tawm tias los ntawm Tencent network qhov latency rau Hong Kong feem ntau zoo dua (10ms) dua li ntawm Shenzhen mus rau Hong Kong rau Ali (120ms - dab tsi?). Tab sis qhov no tsis nyob rau hauv ib txoj kev ua kom lub chaw ua hauj lwm ntawm lub site tsom mus rau kev ua hauj lwm los ntawm Tencent thiab lub qhov, uas nyob rau hauv nws tus kheej yog ib qho amazing fact thiab ib zaug dua ua pov thawj cov nram qab no: latency - rau Tuam Tshoj qhov no tsis yog ib qho qhia tias muaj nqis tiag tiag. them sai sai rau thaum tsim ib qho kev daws teeb meem rau kev hla Suav firewall.

Anycast Internet Acceleration

Lwm cov khoom uas tso cai rau koj ua haujlwm ntawm anycast IP yog AIA. Tab sis nws kuj tsis muaj nyob rau thoob ntiaj teb cov nyiaj, yog li kuv yuav tsis qhia koj txog nws, tab sis paub tias muaj cov khoom zoo li no yuav pab tau.

Tab sis qhov kev sim CDN tau pom qee qhov txiaj ntsig zoo nkauj. Tencent's CDN tsis tuaj yeem qhib rau ntawm qhov chaw puv, tsuas yog ntawm cov npe tshwj xeeb. Peb tsim domains thiab xa tsheb mus rau lawv:

Nws tau pom tias CDN no muaj cov haujlwm hauv qab no: Hla ciam teb kev ua kom zoo tshaj plaws. Qhov tshwj xeeb no yuav tsum txo cov nqi thaum tsheb hla dhau Suav firewall. Raws li Keeb kwm Tus IP chaw nyob ntawm Google GLB (GLB anycast) tau teev tseg. Yog li, peb xav kom yooj yim rau qhov project architecture.

Cov txiaj ntsig tau zoo heev - nyob rau theem ntawm Ali Cloud CDN, thiab hauv qee qhov chaw zoo dua. Qhov no yog qhov xav tsis thoob, vim tias yog tias qhov kev sim ua tiav, koj tuaj yeem tso tseg ib feem tseem ceeb ntawm kev tsim kho vaj tse, qhov av, CEN, tshuab virtual, thiab lwm yam.

Peb tsis zoo siab ntev, raws li qhov teeb meem tau tshwm sim: kev ntsuam xyuas hauv Catchpoint ua tsis tiav rau tus neeg muab kev pabcuam Is Taws Nem Tuam Tshoj Mobile. Los ntawm txhua qhov chaw peb tau txais lub sijhawm dhau los ntawm Tencent's CDN. Kev sib tham nrog kev txhawb nqa tsis tau ua rau muaj dab tsi. Peb sim daws qhov teeb meem no txog ib hnub, tab sis tsis muaj dab tsi ua haujlwm.

Kuv nyob hauv Suav teb thaum lub sijhawm ntawd, tab sis nrhiav tsis tau pej xeem Wi-Fi ntawm lub network ntawm tus neeg zov me nyuam los txheeb xyuas qhov teeb meem ntawm tus kheej. Tsis tas li ntawd, txhua yam ntsia nrawm thiab zoo.
Txawm li cas los xij, vim tias Tuam Tshoj Mobile yog ib qho ntawm peb tus neeg ua haujlwm loj tshaj plaws, peb raug yuam kom rov qab mus rau Ali CDN.
Tab sis zuag qhia tag nrho, qhov no yog ib qho kev daws teeb meem uas tsim nyog rau kev sim ntev dua thiab daws teeb meem ntawm qhov teeb meem no.

Akamai

Tus kws kho mob CDN kawg peb tau sim yog Akamai. Qhov no yog ib tug loj muab kev pab cuam uas muaj nws network nyob rau hauv Tuam Tshoj. Tau kawg, peb tsis tuaj yeem hla nws.

Txij thaum pib, peb tau pom zoo nrog Akamai rau lub sijhawm sim kom peb tuaj yeem hloov lub npe thiab saib seb nws yuav ua haujlwm li cas ntawm lawv lub network. Kuv yuav piav qhia txog qhov tshwm sim ntawm txhua qhov kev xeem hauv daim ntawv "Qhov kuv nyiam" thiab "Kuv tsis nyiam," thiab kuv yuav muab cov txiaj ntsig kev xeem.

Qhov kuv nyiam:

• Cov txiv neej los ntawm Akamai tau txais txiaj ntsig zoo hauv txhua nqe lus nug thiab nrog peb ntawm txhua theem ntawm kev sim. Peb pheej sim txhim kho qee yam ntawm peb sab. Lawv muab tswv yim zoo.
• Akamai yog li 10-15% qeeb dua li peb cov kev daws teeb meem ntawm Ali Cloud CDN. Dab tsi yog qhov zoo siab yog tias hauv Keeb Kwm rau Akamai peb tau teev GLB qhov chaw nyob IP, txhais tau tias kev khiav tsheb tsis dhau los ntawm peb txoj kev daws teeb meem (tej zaum peb tuaj yeem tso tseg ib feem ntawm cov txheej txheem). Tab sis tseem, cov txiaj ntsig kev sim tau pom tias qhov kev daws teeb meem no phem dua li peb cov qauv tam sim no (cov txiaj ntsig sib piv hauv qab).
• Kev sim ob qho tib si Keeb Kwm GLB thiab Keeb Kwm hauv Suav teb. Ob qho kev xaiv yog kwv yees li qub.
• muaj Tseeb Route (automatic routing optimization). Koj tuaj yeem tuav cov khoom sim ntawm Keeb Kwm, thiab Akamai Edge servers yuav sim khaws nws (tsis tu ncua GET). Rau cov kev thov no, kev ceev thiab lwm yam kev ntsuas yog ntsuas, raws li qhov Akamai network optimizes txoj kev kom cov tsheb khiav nrawm dua rau peb lub xaib thiab nws tau pom tseeb tias kev ua kom cov yam ntxwv no yeej muaj kev cuam tshuam rau qhov nrawm ntawm lub xaib.
• Versioning lub configuration nyob rau hauv lub web interface yog txias. Koj tuaj yeem ua piv rau versions, saib qhov txawv. Saib cov version yav dhau los.
• Koj tuaj yeem yob tawm ib qho tshiab ua ntej nkaus xwb ntawm Akamai Staging network - tib lub network raws li kev tsim khoom, tsuas yog txoj kev no yuav tsis cuam tshuam rau cov neeg siv tiag. Rau qhov kev xeem no, koj yuav tsum tau spoof DNS cov ntaub ntawv ntawm koj lub tshuab hauv zos.
• Heev ceev download ceev los ntawm lawv lub network rau cov ntaub ntawv zoo li qub, thiab, pom tseeb, lwm yam ntaub ntawv. Ib cov ntaub ntawv los ntawm "txias" cache tau muab ntau zaus sai dua li tib cov ntaub ntawv los ntawm "txias" cache ntawm Ali CDN. Los ntawm "kub" cache, qhov ceev yog tib yam, ntxiv lossis rho tawm.

Ali CDN xeem:

root@shenzhen1:~# curl -o /dev/null -w@curl_time https://en.semrushchina.cn/my_reports/build/scripts/simpleInit.js?v=1551879212
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5757k    0 5757k    0     0   513k      0 --:--:--  0:00:11 --:--:--  526k
time_namelookup:  0.004286
time_connect:  0.030107
time_appconnect:  0.117525
time_pretransfer:  0.117606
time_redirect:  0.000000
time_starttransfer:  0.840348
----------
time_total:  11.208119
----------
size_download:  5895467 Bytes
speed_download:  525999.000B/s

Kev xeem ntawv:

root@shenzhen1:~# curl -o /dev/null -w@curl_time https://www.semrushchina.cn/my_reports/build/scripts/simpleInit.js?v=1551879212
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5757k    0 5757k    0     0  1824k      0 --:--:--  0:00:03 --:--:-- 1825k
time_namelookup:  0.509005
time_connect:  0.528261
time_appconnect:  0.577235
time_pretransfer:  0.577324
time_redirect:  0.000000
time_starttransfer:  1.327013
----------
time_total:  3.154850
----------
size_download:  5895467 Bytes
speed_download:  1868699.000B/s

Peb pom tias qhov xwm txheej hauv qhov piv txwv saum toj no nyob ntawm ntau yam. Thaum lub sijhawm sau cov ntsiab lus no, kuv tau khiav qhov kev sim dua. Cov txiaj ntsig rau ob lub platform tau kwv yees li qub. Qhov no qhia peb tias Is Taws Nem hauv Suav teb, txawm tias rau cov tswv lag luam loj thiab cov neeg muab kev pabcuam huab, coj txawv txawv txhua lub sijhawm.

Txog rau lub ntsiab lus dhau los, kuv mam li ntxiv qhov loj ntxiv rau Akamai: yog tias Ali pom zoo li flashes ntawm kev ua haujlwm siab thiab kev ua haujlwm qis heev (qhov no siv rau Ali CDN, Ali CEN, thiab Ali IPSEC), ces Akamai, txhua zaus, tsis muaj teeb meem. cas kuv sim lawv lub network, txhua yam ua haujlwm ruaj khov.
Akamai muaj ntau qhov kev pab cuam hauv Suav teb thiab ua haujlwm los ntawm ntau tus neeg muab kev pabcuam.

Qhov kuv tsis nyiam:

• Kuv tsis nyiam lub web interface thiab txoj kev nws ua haujlwm - nws tsis zoo. Tab sis qhov yooj yim koj tau siv rau nws (tej zaum).
• Cov qhabnias xeem yog qhov phem tshaj peb qhov chaw.
• Muaj ntau qhov yuam kev thaum kuaj ntau dua li ntawm peb qhov chaw (uptime hauv qab).
• Peb tsis muaj peb tus kheej DNS servers hauv Suav teb. Li no muaj ntau qhov yuam kev hauv kev sim vim DNS daws lub sijhawm.
• Lawv tsis muab lawv qhov chaw IP -> tsis muaj txoj hauv kev los sau npe qhov tseeb set_real_ip_los ntawm ntawm peb cov servers.

Metrics (~ 3626 khiav; tag nrho cov ntsuas tshwj tsis yog Uptime, hauv ms; txheeb cais rau ib lub sijhawm):

CDN tus kws kho mob
theem nrab
75%
95%
Lo lus teb
Webpage teb
Uptime
DNS
Mus Txuas Lus
tos
load
SSL

AliCDN
9195
10749
17489
1,715
10,745
99.531
57
17
927
479
200

Akamai
9783
11887
19888
2,352
11,550
98.980
424
91
1408
381
50

Kev faib tawm los ntawm Percentile (hauv ms):

Feem pua
Akamai
AliCDN

10
7,092
6,942

20
7,775
7,583

30
8,446
8,092

40
9,146
8,596

50
9,783
9,195

60
10,497
9,770

70
11,371
10,383

80
12,670
11,255

90
15,882
13,165

100
91,592
91,596

Qhov xaus yog qhov no: qhov kev xaiv Akamai siv tau, tab sis tsis muab tib yam kev ruaj ntseg thiab ceev raws li peb tus kheej cov kev daws teeb meem nrog Ali CDN.

Cov ntawv me me

Qee lub sij hawm tsis suav nrog zaj dab neeg, tab sis kuv xav sau txog lawv thiab.

Beijing + Tokyo thiab Hong Kong

Raws li kuv tau hais saum toj no, peb tau sim IPSEC qhov mus rau Hong Kong (HK). Tab sis peb kuj tau sim CEN rau HK. Nws raug nqi me ntsis, thiab kuv xav tsis thoob li cas nws yuav ua haujlwm ntawm cov nroog nrog qhov deb ntawm ~ 100 km. Nws hloov tawm tias qhov latency ntawm cov nroog no yog 100ms siab dua hauv peb cov qauv qub (rau Taiwan). Kev nrawm, kev ruaj ntseg kuj zoo dua rau Taiwan. Raws li qhov tshwm sim, peb tawm HK ua thaj tsam IPSEC thaub qab.

Tsis tas li ntawd, peb tau sim nruab qhov kev teeb tsa hauv qab no:

• tshem tawm cov neeg siv khoom hauv Beijing,
• IPSEC thiab CEN rau Tokyo,
• hauv Ali CDN tus neeg rau zaub mov hauv Beijing tau qhia tias yog keeb kwm.

Cov tswv yim no tsis ruaj khov, txawm hais tias nyob rau hauv cov nqe lus ntawm ceev nws yog feem ntau tsis inferior rau peb cov kev daws teeb meem. Hais txog lub qhov av, kuv tau pom kev poob qis txawm tias CEN, uas yuav tsum tau ruaj khov. Yog li ntawd, peb rov qab mus rau qhov qub tswvyim thiab dismantled no staging.

Hauv qab no yog cov txheeb cais ntawm latency ntawm cov cheeb tsam sib txawv rau cov channel sib txawv. Tej zaum ib tug neeg yuav txaus siab rau nws.

IPsec
Ali cn-beijing <—> GCP asia-northeast1 — 193ms
Ali cn-shenzhen <—> GCP Asia-East2 — 91ms
Ali cn-shenzhen <—> GCP peb-east4 — 200ms

CEN
Ali cn-beijing <—> Ali ap-northeast-1 — 54ms (!)
Ali cn-shenzhen <—> Ali cn-hongkong — 6ms (!)
Ali cn-shenzhen <—> Ali us-east1 — 216ms

Cov ntaub ntawv dav dav txog Internet hauv Suav teb

Raws li ib qho ntxiv rau cov teeb meem nrog Is Taws Nem tau piav qhia thaum pib, hauv thawj ntu ntawm tsab xov xwm.

• Internet hauv Suav teb yog ceev heev hauv.
  • Qhov kev txiav txim siab tau ua los ntawm kev sim pej xeem Wi-Fi tes hauj lwm hauv ntau qhov chaw uas cov tes hauj lwm no tau siv los ntawm ntau tus neeg.
  • Kev rub tawm thiab rub tawm nrawm rau cov servers hauv Suav teb yog kwv yees li 20 Mbit / s thiab 5-10 Mbit / s, feem.
  • Kev ceev rau cov servers sab nraum Suav teb tsuas yog meager, tsawg dua 1 Mbit / s.
• Internet hauv Suav teb tsis ruaj khov heev.
  • Qee lub sij hawm cov chaw tuaj yeem qhib tau sai, qee zaum maj mam (nyob rau tib lub sijhawm ntawm hnub ntawm cov hnub sib txawv), muab qhov kev teeb tsa tsis hloov. Peb pom qhov no nrog piv txwv ntawm semrushchina.cn. Qhov no tuaj yeem raug ntaus nqi rau Ali CDN, uas kuj ua haujlwm li no thiab nyob ntawm lub sijhawm ntawm hnub, txoj haujlwm ntawm lub hnub qub, thiab lwm yam.
• Mobile Internet yuav luag txhua qhov chaw 4G lossis 4G +. Caw nws hauv subway, elevators - luv luv, txhua qhov chaw.
• Nws yog lus dab neeg hais tias Suav cov neeg siv tsuas yog tso siab rau hauv thaj tsam .cn. Peb kawm qhov no ncaj qha los ntawm cov neeg siv.
  • Koj pom tau li cas http://baidu.cn redirect mus rau www.baidu.com (hauv mainland Tuam Tshoj ib yam nkaus).
• Ntau qhov kev pab cuam yeej raug thaiv. Primitive: google.com, Facebook, Twitter. Tab sis ntau qhov kev pabcuam Google ua haujlwm (tau kawg, tsis yog ntawm txhua Wi-nkaus thiab VPN tsis siv (ntawm sab router ib yam nkaus, qhov tseeb).
• Ntau qhov "tshwj xeeb" ntawm cov tuam txhab thaiv kev lag luam kuj ua haujlwm. Qhov no txhais tau tias koj yuav tsum tsis txhob txiav tawm tag nrho Google thiab lwm yam zoo li thaiv cov peev txheej. Koj yuav tsum tau saib rau qee cov npe txwv txwv.
• Lawv tsuas muaj peb lub lag luam hauv Internet: China Unicom, China Telecom, China Mobile. Muaj txawm tias me me, tab sis lawv cov kev lag luam feem tsis tseem ceeb

Nyiaj tshwj xeeb: daim duab daws teeb meem kawg

Qhov no

Ib xyoos dhau los txij thaum pib ntawm qhov project. Peb pib nrog qhov tseeb tias peb qhov chaw feem ntau tsis kam ua haujlwm ib txwm los ntawm Tuam Tshoj, thiab tsuas yog GET curl coj 5.5 vib nas this.

Tom qab ntawd, nrog cov ntsuas no hauv thawj qhov kev daws teeb meem (Cloudflare):

kev txiav txim siab
Uptime
theem nrab
75 Feem pua
95 Feem pua

Cloudflare
86.6
18s
30s
60s

Thaum kawg peb tau mus txog cov txiaj ntsig hauv qab no (cov txheeb cais rau lub hli dhau los):

kev txiav txim siab
Uptime
theem nrab
75 Feem pua
95 Feem pua

Ali CDN + CEN / IPsec + GLB
99.86
8.8s
9.5s
13.7s

Raws li koj tuaj yeem pom, peb tseem tsis tau ua tiav 100% uptime, tab sis peb yuav los nrog qee yam, thiab tom qab ntawd peb yuav qhia koj txog cov txiaj ntsig hauv tsab xov xwm tshiab :)

Kev hwm rau cov neeg uas nyeem tag nrho peb ntu mus rau qhov kawg. Kuv vam tias koj pom txhua qhov no nthuav dav li kuv tau ua thaum kuv ua.

PS yav dhau los qhov chaw

Ib feem ntawm 1
Ib feem ntawm 2

Tau qhov twg los: www.hab.com