Ntau tshaj li ib txhiab tus IP chaw nyob dhau los ntawm Cloudflare Network txhua hnub; nws pab ntau tshaj 11 lab HTTP thov ib ob; nws nyob hauv 100ms ntawm 95% ntawm cov pej xeem hauv internet. Peb lub network nthuav dav 200 lub nroog hauv ntau dua 90 lub teb chaws, thiab peb pab pawg engineers tau tsim kom muaj kev txhim kho sai thiab txhim khu kev qha.
Peb txaus siab rau peb txoj haujlwm thiab tau cog lus tias yuav pab ua kom Is Taws Nem zoo dua thiab nyab xeeb dua. Cloudflare's hardware engineers muaj kev nkag siab tob txog cov servers thiab lawv cov khoom kom nkag siab thiab xaiv cov khoom siv zoo tshaj plaws los ua kom nws qhov kev ua tau zoo.
Peb cov software pawg tswj hwm kev suav cov khoom siv siab thiab yog CPU-dependent, xav kom peb cov engineers txuas ntxiv txhim kho Cloudflare qhov ua tau zoo thiab kev ntseeg siab ntawm txhua qib ntawm pawg. Ntawm sab server, txoj hauv kev yooj yim tshaj plaws los ua kom muaj zog ua haujlwm yog los ntawm kev ntxiv CPU cores. Qhov ntau cores ib tus neeg rau zaub mov tuaj yeem haum, cov ntaub ntawv ntau nws tuaj yeem ua tau. Qhov no yog qhov tseem ceeb rau peb vim tias ntau yam ntawm peb cov khoom thiab cov neeg siv khoom tau loj hlob nyob rau lub sijhawm, thiab kev loj hlob ntawm kev thov yuav tsum muaj kev ua tau zoo los ntawm cov servers. Txhawm rau kom lawv cov kev ua tau zoo, peb yuav tsum tau nce qhov ceev ntawm cov cores - thiab qhov no yog qhov peb ua tiav. Hauv qab no peb muab cov ntaub ntawv ntxaws ntxaws ntawm cov txheej txheem rau cov servers uas peb tau siv txij li xyoo 2015, suav nrog cov lej ntawm cov cores:
-
Gen 6
Gen 7
Gen 8
Gen 9
Pib
2015
2016
2017
2018
CPU
Intel Xeon E5-2630 v3
Intel Xeon E5-2630 v4
Intel Xeon Silver 4116
Intel Xeon Platinum 6162
Lub cev cores
2 x 8
2 x 10
2 x 12
2 x 24
TDP
2 x 85W
2 x 85W
2 x 85W
2 x 150W
TDP per core
10.65W
8.50W
7.08W
6.25W
Hauv xyoo 2018, peb tau ua ib qho loj leap ntawm tag nrho cov cores ib server nrog Gen 9. Qhov kev cuam tshuam ib puag ncig tau raug txo los ntawm 33% piv rau tiam 8th, muab lub sijhawm rau peb kom nce ntim thiab suav lub zog rau ib lub khib nyiab. Cov kev cai tsim qauv rau cov cua kub dissipation (, TDP) tau hais los qhia tias peb lub zog ua haujlwm tau nce ntxiv raws sijhawm. Qhov ntsuas no tseem ceeb rau peb: ua ntej, peb xav kom emit tsawg carbon rau hauv qhov chaw; thib ob, peb xav ua kom zoo tshaj plaws kev siv lub zog ntawm cov ntaub ntawv chaw. Tab sis peb paub tias peb muaj ib yam dab tsi los siv zog rau.
Peb lub ntsiab txhais metric yog tus naj npawb ntawm kev thov ib watt. Peb tuaj yeem nce tus naj npawb ntawm kev thov ib ob los ntawm kev ntxiv cov cores, tab sis peb yuav tsum nyob hauv peb cov peev nyiaj siv hluav taws xob. Peb raug txwv los ntawm cov ntaub ntawv chaw tsim hluav taws xob tsim hluav taws xob, uas, ua ke nrog peb cov kev xaiv hluav taws xob faib hluav taws xob, muab rau peb ib qho kev txwv siab rau txhua tus neeg rau zaub mov khib. Ntxiv cov servers rau lub khib yuav ua rau muaj zog siv zog. Cov nqi khiav lag luam yuav nce ntxiv yog tias peb tshaj qhov txwv ib-rack zog thiab yuav tsum tau ntxiv cov racks tshiab. Peb yuav tsum tau ua kom muaj zog ua haujlwm thaum nyob hauv tib lub zog siv ntau yam, uas yuav nce kev thov ib watt, peb cov metric tseem ceeb.
Raws li koj tau twv, peb ua tib zoo kawm txog kev siv hluav taws xob ntawm theem tsim. Cov lus saum toj no qhia tau hais tias peb yuav tsum tsis txhob nkim sij hawm siv ntau lub zog-tshaib plab CPUs yog tias TDP ib tus tub ntxhais siab dua cov tiam tam sim no - qhov no yuav cuam tshuam tsis zoo rau peb cov metric, thov ib watt. Peb ua tib zoo kawm txog kev npaj ua haujlwm rau peb tiam X ntawm kev ua lag luam thiab txiav txim siab. Peb tab tom txav los ntawm peb 48-core Intel Xeon Platinum 6162 dual-socket tsim rau 48-core AMD EPYC 7642 ib leeg-socket tsim.
-
Intel
AMD
CPU
Xeon Platinum 6162
EPYC 7642
Microarchitecture
"Skylake"
"Zen 2"
Codename
"Skylake SP"
"Rome"
Txheej txheem txheej txheem
14nm
7nm
cores
2 x 24
48
Zaus
1.9 GHz
2.4 GHz
L3 Cache/socket
24 x 1.375 MiB
16 x 16 MiB
Memory/socket
6 raws, mus txog DDR4-2400
8 raws, mus txog DDR4-3200
TDP
2 x 150W
225W
PCIe/socket
48 txoj kab
128 txoj kab
ISA
x86-64
x86-64
Los ntawm cov kev qhia tshwj xeeb nws tau pom tseeb tias cov nti ntawm AMD yuav tso cai rau peb khaws tib tus lej ntawm cov cores thaum txo TDP. Lub cim thib 9 muaj TDP ib qho tseem ceeb ntawm 6,25 W, thiab tiam X nws yuav yog 4,69 W. Txo los ntawm 25%. Ua tsaug rau qhov ntau zaus, thiab tej zaum ib qho yooj yim tsim nrog ib lub qhov (socket), nws tuaj yeem xav tias AMD nti yuav ua tau zoo dua hauv kev xyaum. Tam sim no peb tab tom khiav ntau yam kev sim thiab simulation kom pom tias AMD yuav ua tau zoo npaum li cas.
Txog tam sim no, cia peb nco ntsoov tias TDP yog qhov kev ntsuas yooj yim los ntawm cov chaw tsim khoom tshwj xeeb, uas peb tau siv nyob rau theem pib ntawm tus neeg rau zaub mov tsim thiab xaiv CPU. Kev tshawb nrhiav sai hauv Google qhia tias AMD thiab Intel muaj ntau txoj hauv kev los txhais TDP, ua rau qhov tshwj xeeb tsis ntseeg. Kev siv lub zog CPU tiag tiag, thiab qhov tseem ceeb tshaj plaws ntawm kev siv hluav taws xob server, yog qhov peb siv tiag tiag thaum peb txiav txim siab zaum kawg.
Kev npaj Ecosystem
Txhawm rau pib peb txoj kev xaiv peb cov txheej txheem tom ntej, peb tau saib ntau yam ntawm CPUs los ntawm cov tuam txhab sib txawv uas yog qhov zoo rau peb pawg software thiab cov kev pabcuam (sau hauv C, LuaJIT thiab Go). Peb twb tau piav qhia meej txog ib txheej ntawm cov cuab yeej rau kev ntsuas ceev . Hauv qhov no, peb siv tib lub teeb - nws tso cai rau peb los ntsuas qhov ua tau zoo ntawm CPU hauv lub sijhawm tsim nyog, tom qab ntawd peb cov engineers tuaj yeem pib hloov peb cov kev pabcuam rau ib lub processor tshwj xeeb.
Peb tau sim ntau yam processors nrog ntau yam tseem ceeb suav, suav qhov (socket) thiab zaus. Txij li cov kab lus no yog hais txog vim li cas peb tau txiav txim siab ntawm AMD EPYC 7642, tag nrho cov kab kos hauv qhov blog no tsom mus rau yuav ua li cas AMD processors ua piv rau Intel Xeon Platinum 6162 los ntawm .
Cov txiaj ntsig sib raug rau kev ntsuas ntawm ib tus neeg rau zaub mov nrog txhua tus txheej txheem sib txawv - uas yog, nrog ob 24-core processors los ntawm Intel, lossis nrog ib qho 48-core processor los ntawm AMD (server rau Intel nrog ob lub qhov (socket) thiab server rau AMD EPYC nrog ib qho) . Hauv BIOS peb teeb tsa qhov tsis sib xws rau cov servers khiav. Qhov no yog 3,03 GHz rau AMD thiab 2,5 GHz rau Intel. Ua kom yooj yim heev, peb cia siab tias nrog tib tus lej ntawm cov cores, AMD yuav ua tau 21% zoo dua Intel.
Cryptography
Zoo li pheej hmoo rau AMD. Nws ua tau 18% zoo dua ntawm pej xeem tus yuam sij cryptography. Nrog rau tus yuam sij symmetric, nws poob rau AES-128-GCM encryption xaiv, tab sis tag nrho ua tau zoo sib xws.
Ntsuas Siv
Ntawm ntug servers, peb compress ntau cov ntaub ntawv kom txuag tau ntawm bandwidth thiab ua kom ceev cov ntsiab lus xa. Peb dhau cov ntaub ntawv los ntawm C cov tsev qiv ntawv zlib thiab brotli. Txhua qhov kev xeem tau khiav ntawm blog.cloudflare.com HTML cov ntaub ntawv hauv lub cim xeeb.
AMD yeej los ntawm qhov nruab nrab ntawm 29% thaum siv gzip. Nyob rau hauv cov ntaub ntawv ntawm brotli, cov txiaj ntsig tau zoo dua ntawm kev ntsuam xyuas nrog qhov zoo 7, uas peb siv rau dynamic compression. Ntawm qhov kev xeem brotli-9 muaj qhov poob qis - peb piav qhia qhov no los ntawm qhov tseeb tias Brotli siv ntau lub cim xeeb thiab dhau lub cache. Txawm li cas los xij, AMD yeej los ntawm cov npoo loj.
Ntau ntawm peb cov kev pabcuam tau sau rau hauv Go. Nyob rau hauv cov duab nram qab no, peb muab ob npaug rau-xyuas qhov ceev ntawm cryptography thiab compression nyob rau hauv Go nrog RegExp ntawm 32 KB kab siv cov hlua cov tsev qiv ntawv.
Mus rau crypto txiaj
Mus Compression
Mus rau Regexp
Mus Strings
AMD ua tau zoo dua hauv txhua qhov kev sim nrog Go tshwj tsis yog ECDSA P256 Kos Npe, qhov twg nws yog 38% qab - uas yog qhov txawv, muab tias nws ua tau zoo 24% hauv C. Nws yog ib qho tsim nyog xav txog dab tsi tshwm sim nyob rau ntawd. Zuag qhia tag nrho, AMD tsis yeej ntau, tab sis tseem qhia tau zoo tshaj plaws.
LuaJIT
Peb feem ntau siv LuaJIT ntawm pawg. Qhov no yog cov kua nplaum uas tuav txhua qhov chaw ntawm Cloudflare ua ke. Thiab peb zoo siab tias AMD yeej ntawm no thiab.
Zuag qhia tag nrho, cov kev ntsuam xyuas qhia tau hais tias EPYC 7642 ua tau zoo dua li ob Xeon Platinum 6162. AMD poob ntawm ob peb qhov kev xeem - piv txwv li, AES-128-GCM thiab Go OpenSSL ECDSA-P256 Kos Npe - tab sis yeej ntawm txhua tus, los ntawm qhov nruab nrab. ntawm 25%.
Workload Simulation
Tom qab peb cov kev sim ceev, peb tau khiav cov servers los ntawm lwm txheej simulations uas cov khoom siv hluav taws xob siv rau cov software ntug pawg. Ntawm no peb simulate scenario workload nrog ntau hom kev thov uas tuaj yeem ntsib hauv kev ua haujlwm tiag tiag. Kev thov sib txawv hauv cov ntaub ntawv ntim, HTTP lossis HTTPS raws tu qauv, WAF qhov chaw, Cov neeg ua haujlwm, thiab lwm yam ntau yam sib txawv. Hauv qab no yog kev sib piv ntawm qhov kev sib tw ntawm ob lub CPUs rau hom kev thov uas peb ntsib feem ntau.
Cov txiaj ntsig hauv daim duab yog ntsuas tawm tsam lub hauv paus ntawm 9th tiam Intel-based tshuab, normalized rau tus nqi ntawm 1,0 ntawm x-axis. Piv txwv li, noj cov lus thov 10 KiB yooj yim dhau HTTPS, peb tuaj yeem pom tias AMD ua 1,5 npaug zoo dua Intel raws li qhov kev thov ib ob. Qhov nruab nrab, AMD ua tau 34% zoo dua Intel rau cov kev xeem no. Xav tias TDP rau ib qho AMD EPYC 7642 yog 225 W, thiab rau ob Intel processors yog 300 W, nws hloov tawm hais tias nyob rau hauv cov nqe lus ntawm "thov ib watt" AMD qhia 2 lub sij hawm zoo dua Intel!
Nyob rau ntawm lub sijhawm no, peb twb tau hais meej meej rau ntawm qhov kev xaiv ib lub qhov rau AMD EPYC 7642 raws li peb lub neej yav tom ntej Gen X CPUs. servers rau qee yam ntawm cov chaw zov me nyuam.
Ua haujlwm tiag
Thawj kauj ruam, ib txwm, yog los npaj cov servers rau kev ua haujlwm hauv cov xwm txheej tiag tiag. Txhua lub tshuab hauv peb lub nkoj ua haujlwm nrog tib cov txheej txheem thiab cov kev pabcuam, uas muab lub sijhawm zoo los sib piv kev ua tau zoo. Zoo li feem ntau cov chaw zov me nyuam, peb muaj ntau tiam neeg ntawm cov servers siv, thiab peb sau peb cov servers rau hauv pawg kom txhua chav kawm muaj cov servers ntawm kwv yees li tib tiam neeg. Qee qhov xwm txheej, qhov no yuav ua rau rov ua dua tshiab uas txawv ntawm pawg. Tab sis tsis nrog peb. Peb cov engineers tau ua kom zoo dua CPU siv rau txhua tiam neeg kom tsis hais seb lub tshuab twg CPU muaj 8 cores lossis 24, CPU siv feem ntau yog tib yam li lwm tus.
Daim duab qhia peb cov lus qhia txog qhov zoo sib xws ntawm kev siv - tsis muaj qhov sib txawv ntawm kev siv AMD CPUs hauv Gen X tiam servers thiab kev siv Intel processors hauv Gen 9 tiam servers. . Zoo heev. Qhov no yog qhov peb siv zog rau hauv peb cov servers, thiab peb xav tau qhov no rau kev sib piv ncaj ncees. Ob daim duab hauv qab no qhia cov naj npawb ntawm kev thov ua tiav los ntawm ib qho CPU core thiab tag nrho cov cores ntawm qib server.
Thov ib tug tseem ceeb
Thov rau lub server
Nws tuaj yeem pom tias qhov nruab nrab AMD ua haujlwm 23% ntau thov. Tsis phem kiag li! Peb tau sau ntau zaus hauv peb cov blog txog txoj hauv kev los ua kom qhov kev ua tau zoo ntawm Gen 9. Thiab tam sim no peb muaj tib tus lej ntawm cov cores, tab sis AMD ua haujlwm ntau dua nrog lub zog tsawg dua. Nws yog tam sim no meej meej los ntawm cov lus qhia tshwj xeeb rau tus naj npawb ntawm cov cores thiab TDP uas AMD muab kev nrawm dua nrog kev siv zog ntau dua.
Tab sis raws li peb twb tau hais lawm, TDP tsis yog tus qauv tshwj xeeb thiab nws tsis zoo ib yam rau txhua tus neeg tsim khoom, yog li cia peb saib qhov kev siv lub zog tiag tiag. Los ntawm kev ntsuas tus neeg rau zaub mov lub zog noj nyob rau hauv tib lub sijhawm nrog tus lej ntawm kev thov ib ob, peb tau txais cov duab hauv qab no:
Raws li kev thov ib ob ib watt siv, Gen X servers khiav ntawm AMD processors yog 28% ntau npaum. Ib tus tuaj yeem xav tau ntau dua, vim tias AMD's TDP yog 25% qis dua, tab sis nws yuav tsum nco ntsoov tias TDP yog tus yam ntxwv tsis meej. Peb tau pom tias AMD qhov kev siv hluav taws xob tiag tiag yuav luag zoo ib yam li TDP tau hais ntawm cov zaus ntau dua li lub hauv paus; Intel tsis muaj qhov ntawd. Qhov no yog lwm qhov laj thawj vim li cas TDP tsis yog qhov kev kwv yees ntawm kev siv hluav taws xob. CPUs los ntawm Intel hauv peb cov Gen 9 servers tau koom ua ke rau hauv ntau qhov system, thaum CPUs los ntawm AMD ua haujlwm hauv tus qauv 1U daim ntawv zoo servers. Qhov no tsis yog qhov kev pom zoo ntawm AMD, txij li cov servers multinode yuav tsum muab ntau dua nrog kev siv hluav taws xob tsawg dua ib lub ntawm, tab sis AMD tseem overtook Intel nyob rau hauv cov nqe lus ntawm kev siv hluav taws xob ib leeg.
Hauv kev sib piv feem ntau ntawm cov specs, simulations, thiab kev ua tau zoo hauv ntiaj teb, 1P AMD EPYC 7642 teeb tsa ua tau zoo dua li 2P Intel Xeon 6162. Hauv qee qhov xwm txheej, AMD tuaj yeem ua tau zoo dua 36%, thiab peb ntseeg tias los ntawm kev ua kom zoo dua. hardware thiab software, peb tuaj yeem ua tiav qhov kev txhim kho no tsis tu ncua.
Nws hloov tawm AMD yeej.
Cov duab ntxiv qhia qhov nruab nrab latency thiab p99 latency khiav NGINX nyob rau lub sijhawm 24-teev. Qhov nruab nrab, cov txheej txheem ntawm AMD khiav 25% sai dua. Ntawm p99 nws khiav 20-50% sai dua nyob ntawm lub sijhawm ntawm hnub.
xaus
Cloudflare's Hardware thiab Performance engineers ua qhov tseem ceeb ntawm kev sim thiab kev tshawb fawb los txiav txim siab qhov zoo tshaj plaws server configuration rau peb cov neeg siv khoom. Peb nyiam ua haujlwm ntawm no vim tias peb tuaj yeem daws cov teeb meem loj zoo li no, thiab peb tuaj yeem pab koj daws koj cov teeb meem nrog cov kev pabcuam zoo li serverless edge suav thiab cov kev daws teeb meem kev nyab xeeb xws li Magic Transit, Argo Tunnel, thiab DDoS tiv thaiv. . Tag nrho cov servers hauv Cloudflare network tau teeb tsa los ua kom ntseeg tau, thiab peb ib txwm sim ua kom txhua tiam tom ntej ntawm servers zoo dua li yav dhau los. Peb ntseeg tias AMD EPYC 7642 yog cov lus teb thaum nws los txog rau Gen X processors.
Siv Cloudflare Cov Neeg Ua Haujlwm, cov neeg tsim khoom siv lawv cov ntawv thov ntawm peb lub network nthuav dav thoob ntiaj teb. Peb txaus siab cia peb cov neeg siv khoom tsom rau kev sau cov lej thaum peb tsom mus rau kev nyab xeeb thiab kev ntseeg siab hauv huab. Thiab niaj hnub no peb zoo siab tshaj tshaj tawm tias lawv txoj haujlwm yuav raug xa mus rau ntawm peb Gen X tiam servers khiav thib ob tiam AMD EPYC processors.
EPYC 7642 processors, codename "Rome" [Rome]
Los ntawm kev siv AMD's EPYC 7642, peb muaj peev xwm ua kom peb cov kev ua tau zoo thiab ua kom yooj yim los nthuav peb lub network mus rau cov nroog tshiab. Rome tsis tau tsim nyob rau hauv ib hnub, tab sis tsis ntev nws yuav nyob ze rau ntau ntawm koj.
Ob peb xyoos dhau los peb tau sim nrog ntau x86 chips los ntawm Intel thiab AMD, nrog rau cov txheej txheem los ntawm ARM. Peb cia siab tias cov neeg tsim khoom CPU no txuas ntxiv ua haujlwm nrog peb yav tom ntej kom peb txhua tus tuaj yeem tsim kom muaj Internet zoo dua ua ke.
Tau qhov twg los: www.hab.com