Optimizing kev faib cov servers hla racks

Hauv ib qho kev sib tham kuv tau nug ib lo lus nug:

- Puas muaj ib yam dab tsi uas kuv tuaj yeem nyeem txog yuav ua li cas ntim cov servers hauv racks?

Kuv paub tias kuv tsis paub cov ntawv zoo li no, yog li kuv sau kuv tus kheej.

Ua ntej, cov ntawv no yog hais txog lub cev servers hauv lub cev cov ntaub ntawv chaw (DCs). Qhov thib ob, peb ntseeg tias muaj ntau cov servers: ntau pua-txhiab; rau tus lej tsawg dua cov ntawv no tsis muaj txiaj ntsig. Thib peb, peb xav tias peb muaj peb qhov kev txwv: qhov chaw lub cev nyob rau hauv lub racks, lub hwj chim mov ib racks, thiab cia cov racks sawv ntsug nyob rau hauv kab kom peb thiaj li siv tau ib tug ToR hloov mus cuag servers nyob rau hauv racks nyob ib sab.

Cov lus teb rau lo lus nug no heev nyob ntawm seb qhov parameter peb optimizing thiab peb tuaj yeem sib txawv kom ua tiav qhov zoo tshaj plaws. Piv txwv li, peb tsuas yog yuav tsum tau siv qhov tsawg kawg nkaus ntawm qhov chaw thiaj li tawm mus ntxiv rau kev loj hlob ntxiv. Los yog tej zaum peb muaj kev ywj pheej xaiv qhov siab ntawm cov racks, lub zog ntawm ib lub racks, qhov (socket) hauv PDU, tus naj npawb ntawm cov racks nyob rau hauv ib pawg ntawm cov keyboards (ib qho kev hloov rau 1, 2 lossis 3 racks), qhov ntev ntawm cov xov hlau thiab rub ua haujlwm ( Qhov no yog qhov tseem ceeb ntawm qhov kawg ntawm kab: nrog 10 racks nyob rau hauv kab thiab 3 racks rau ib qho kev hloov, koj yuav tsum rub cov xov hlau mus rau lwm kab lossis siv cov chaw nres nkoj hauv qhov hloov), thiab lwm yam. Cov dab neeg sib cais: xaiv cov servers thiab xaiv DCs, peb yuav xav tias lawv raug xaiv.

Nws yuav yog qhov zoo kom nkag siab qee qhov nuances thiab cov ntsiab lus, tshwj xeeb, qhov nruab nrab / siab tshaj ntawm cov servers, thiab qhov hluav taws xob muab rau peb li cas. Yog li, yog tias peb muaj Lavxias teb sab fais fab mov ntawm 230V thiab ib theem ntawm ib lub khib, ces lub tshuab 32A tuaj yeem ua tau ~ 7kW. Wb hais tias peb nominally them rau 6kW ib rack. Yog tias tus kws kho mob ntsuas peb qhov kev noj tsuas yog rau ib kab ntawm 10 racks, thiab tsis yog rau txhua lub khib, thiab yog tias lub tshuab tau teeb tsa ntawm qhov kev txiav tawm ntawm 7 kW, ces technically peb tuaj yeem haus 6.9 kW hauv ib lub khib, 5.1 kW hauv lwm qhov thiab txhua yam yuav zoo - tsis rau txim.

Feem ntau peb lub hom phiaj tseem ceeb yog kom txo tus nqi tsawg. Qhov kev ntsuas zoo tshaj plaws los ntsuas yog txo TCO (tag nrho tus nqi ntawm cov tswv cuab). Nws muaj cov khoom hauv qab no:

  • CAPEX: muas DC infrastructure, servers, network hardware thiab cabling
  • OPEX: DC xauj, kev siv hluav taws xob, kev saib xyuas. OPEX nyob ntawm kev pabcuam lub neej. Nws yog tsim nyog xav tias nws yog 3 xyoos.

Optimizing kev faib cov servers hla racks

Nyob ntawm seb qhov loj npaum li cas ntawm tus kheej cov khoom nyob rau hauv tag nrho cov ncuav qab zib, peb yuav tsum ua kom zoo tshaj qhov kim tshaj plaws, thiab cia tus so siv tag nrho cov khoom seem kom zoo li sai tau.

Cia peb hais tias peb muaj DC uas twb muaj lawm, muaj qhov siab ntawm H units (piv txwv li, H = 47), hluav taws xob ib lub khib Prack (Prack = 6kW), thiab peb txiav txim siab siv h = 2U ob-unit servers. Peb yuav tshem tawm 2..4 units ntawm lub khib rau keyboards, thaj panels thiab organizers. Cov. lub cev, peb muaj Sh = rounddown((H-2..4) / h) servers hauv peb khib (piv txwv li Sh = rounddown((47-4)/2) = 21 servers ib khib). Cia peb nco txog Sh.

Nyob rau hauv cov ntaub ntawv yooj yim, tag nrho cov servers nyob rau hauv ib lub khib yog zoo tib yam. Nyob rau hauv tag nrho, yog tias peb sau lub khib nrog servers, ces ntawm txhua tus neeg rau zaub mov peb tuaj yeem siv qhov nruab nrab ntawm lub zog Pserv = Prack / Sh (Pserv = 6000W / 21 = 287W). Rau kev yooj yim, peb tsis quav ntsej txog kev hloov pauv ntawm no.

Cia peb ua ib kauj ruam ib sab thiab txiav txim siab seb qhov siab tshaj plaws server noj Pmax yog dab tsi. Yog tias nws yooj yim heev, tsis muaj txiaj ntsig thiab muaj kev nyab xeeb tag nrho, ces peb nyeem dab tsi tau sau rau ntawm lub server lub zog - qhov no yog nws.

Yog tias nws nyuaj dua thiab ua tau zoo dua, ces peb muab TDP (cov qauv tsim hluav taws xob) ntawm txhua yam khoom thiab suav nrog (qhov no tsis muaj tseeb, tab sis nws muaj peev xwm).

Feem ntau peb tsis paub TDP ntawm cov khoom (tshwj tsis yog rau CPU), yog li peb coj qhov tseeb tshaj plaws, tab sis kuj yog txoj hauv kev nyuaj tshaj plaws (peb xav tau chav kuaj) - peb coj cov neeg siv khoom sim ntawm qhov xav tau teeb tsa thiab thauj khoom, Piv txwv li, nrog Linpack (CPU thiab nco) thiab fio (disks), peb ntsuas kev noj. Yog tias peb ua tiag tiag, peb kuj yuav tsum tsim kom muaj qhov chaw sov tshaj plaws nyob rau hauv txoj kev txias txias thaum lub sij hawm sim, vim qhov no yuav cuam tshuam rau ob qho tib si kiv cua noj thiab CPU noj. Peb tau txais qhov siab tshaj plaws ntawm cov neeg rau zaub mov tshwj xeeb nrog rau kev teeb tsa tshwj xeeb hauv cov xwm txheej tshwj xeeb hauv cov khoom tshwj xeeb no. Peb tsuas yog txhais tau hais tias qhov system firmware tshiab, ib qho software sib txawv, thiab lwm yam kev mob yuav cuam tshuam rau qhov tshwm sim.

Yog li, rov qab mus rau Pserv thiab peb piv nws li cas nrog Pmax. Nws yog ib qho teeb meem ntawm kev nkag siab tias cov kev pab cuam ua haujlwm li cas thiab muaj zog npaum li cas koj tus thawj coj ua haujlwm lub paj hlwb.

Yog tias peb tsis ua txhua yam txaus ntshai, peb ntseeg tias txhua tus servers ib txhij tuaj yeem pib siv lawv qhov siab tshaj plaws. Tib lub sijhawm, ib qho kev nkag mus rau hauv DC tuaj yeem tshwm sim. Txawm tias nyob rau hauv cov xwm txheej no, infra yuav tsum muab kev pabcuam, yog li Pserv ≑ Pmax. Qhov no yog ib txoj hauv kev uas kev ntseeg siab yog qhov tseem ceeb.

Yog tias tus thawj coj thev naus laus zis xav tsis yog tsuas yog hais txog kev ruaj ntseg zoo nkaus xwb, tab sis kuj hais txog lub tuam txhab nyiaj thiab ua siab tawv txaus, ces koj tuaj yeem txiav txim siab tias

  • Peb tab tom pib tswj hwm peb cov neeg muag khoom, tshwj xeeb tshaj yog, peb txwv tsis pub kev saib xyuas ntawm lub sijhawm ntawm kev npaj siab tshaj plaws kom txo qis hauv ib qho kev tawm tswv yim;
  • thiab/los yog peb cov architecture tso cai rau koj poob ib lub khib / kab / DC, tab sis cov kev pabcuam txuas ntxiv ua haujlwm;
  • thiab/los yog peb kis tau tus load zoo horizontally hla lub racks, yog li peb cov kev pab yuav tsis dhia mus rau siab tshaj plaws noj nyob rau hauv ib tug khib tag nrho ua ke.

Ntawm no nws yog ib qho tseem ceeb heev tsis yog tsuas yog kwv yees xwb, tab sis saib xyuas kev noj thiab paub tias cov servers tau siv hluav taws xob li cas raws li ib txwm muaj thiab siab kawg. Yog li ntawd, tom qab qee qhov kev tshuaj xyuas, tus thawj coj thev naus laus zis tau nyem txhua yam nws muaj thiab hais tias: "peb txiav txim siab qhov kev txiav txim siab tias qhov siab tshaj plaws ua tiav qhov nruab nrab ntawm qhov siab tshaj plaws ntawm cov neeg rau zaub mov noj ib lub khib yog ** ntau heev ** hauv qab qhov siab tshaj plaws noj," conditionally Pserv = 0.8 * Pmax.

Thiab tom qab ntawd lub 6kW khib tsis tuaj yeem ua rau 16 servers nrog Pmax = 375W, tab sis 20 servers nrog Pserv = 375W * 0.8 = 300W. Cov. 25% ntau servers. Qhov no yog qhov kev txuag loj heev - tom qab tag nrho, peb tam sim ntawd xav tau 25% tsawg racks (thiab peb tseem yuav txuag ntawm PDUs, keyboards thiab cables). Qhov tsis zoo ntawm qhov kev daws teeb meem no yog qhov peb yuav tsum tau saib xyuas tas li tias peb cov kev xav tau tseem raug. Tias tus tshiab firmware version tsis cuam tshuam qhov kev ua haujlwm ntawm cov kiv cua thiab noj, tias kev txhim kho dheev nrog qhov kev tso tawm tshiab tsis tau pib siv cov servers ntau npaum li cas (nyeem: lawv ua tiav ntau dua load thiab noj ntau dua ntawm lub server). Tom qab tag nrho, tom qab ntawd ob peb qhov kev xav thawj zaug thiab cov lus xaus tam sim ntawd ua tsis raug. Qhov no yog ib qho kev pheej hmoo uas yuav tsum tau ua lub luag haujlwm (lossis zam thiab tom qab ntawd them rau cov khoom siv tsis zoo).

Ib qho tseem ceeb - koj yuav tsum sim faib cov servers los ntawm cov kev pabcuam sib txawv kab rov tav hla racks, yog tias ua tau. Qhov no yog qhov tsim nyog kom tsis txhob muaj xwm txheej tshwm sim thaum ib pawg ntawm cov servers tuaj txog rau ib qho kev pabcuam, cov racks tau ntim nrog nws los ua kom "qhov ntom" (vim nws yooj yim dua li ntawd). Nyob rau hauv qhov tseeb, nws hloov tawm hais tias ib tug khib yog sau nrog ib tug zoo tib yam low-load servers ntawm tib cov kev pab cuam, thiab lwm yam yog sau nrog sib npaug high-load servers. Qhov tshwm sim ntawm lub caij nplooj zeeg thib ob yog qhov ntau dua, vim tias lub load profile yog tib yam, thiab tag nrho cov servers ua ke hauv cov khib nyiab no pib haus cov nyiaj tib yam vim tias muaj kev nce ntxiv.

Cia peb rov qab mus rau kev faib cov servers hauv racks. Peb tau saib ntawm qhov chaw khib nyiab lub cev thiab lub zog txwv, tam sim no cia saib ntawm lub network. Koj tuaj yeem siv cov keyboards nrog 24/32/48 N ports (piv txwv li, peb muaj 48-port ToR keyboards). Hmoov zoo, tsis muaj ntau txoj hauv kev yog tias koj tsis xav txog cov kab hluav taws xob tawg. Peb tab tom xav txog cov xwm txheej thaum peb muaj ib qho kev hloov ntawm ib lub khib, ib qho kev hloov rau ob lossis peb lub racks hauv Rnet pawg. Nws zoo nkaus li kuv tias ntau tshaj peb racks hauv ib pawg twb dhau lawm, vim tias ... Qhov teeb meem ntawm kev sib txuas ntawm cov racks yuav loj dua.

Yog li, rau txhua qhov xwm txheej network (1, 2 lossis 3 racks hauv ib pab pawg), peb faib cov servers ntawm cov racks:

Srack = min(Sh, rounddown(Prack/Pserv), rounddown(N/Rnet))

Yog li, rau kev xaiv nrog 2 racks hauv ib pab pawg:

Srack2 = min(21, rounddown(6000/300), rounddown(48/2)) = min(21, 20, 24) = 20 servers per rack.

Peb xav txog cov kev xaiv ntxiv nyob rau hauv tib txoj kev:

Txa1 = 20
Txa3 = 16

Thiab peb yuav luag muaj. Peb suav cov racks los faib tag nrho peb cov servers S (cia nws yog 1000):

R = roundup(S / (Srack * Rnet)) * Rnet

R1 = roundup (1000 / (20 * 1)) * 1 = 50 * 1 = 50 racks

R2 = roundup (1000 / (20 * 2)) * 2 = 25 * 2 = 50 racks

R3 = roundup (1000 / (16 * 3)) * 3 = 25 * 2 = 63 racks

Tom ntej no, peb xam TCO rau txhua qhov kev xaiv raws li tus naj npawb ntawm cov racks, tus lej xav tau ntawm cov keyboards, cabling, thiab lwm yam. Peb xaiv qhov kev xaiv uas TCO qis dua. Cov txiaj ntsig!

Nco ntsoov tias txawm hais tias qhov xav tau ntawm cov racks rau kev xaiv 1 thiab 2 yog tib yam, lawv cov nqi yuav txawv, vim tias tus naj npawb ntawm cov keyboards rau qhov kev xaiv thib ob yog ib nrab li ntau, thiab qhov ntev ntawm cov cables yuav tsum tau ntev dua.

PS Yog tias koj muaj sijhawm los ua si nrog lub zog ntawm ib lub khib thiab qhov siab ntawm lub khib, qhov sib txawv yuav nce. Tab sis cov txheej txheem tuaj yeem txo qis rau ib qho uas tau piav qhia saum toj no los ntawm tsuas yog mus los ntawm cov kev xaiv. Yog lawm, yuav muaj kev sib txuas ntxiv, tab sis tseem muaj tus lej tsawg heev - cov khoom siv hluav taws xob rau cov khib nyiab rau kev suav tuaj yeem nce ntxiv hauv cov kauj ruam ntawm 1 kW, cov racks raug cai tuaj nyob rau hauv cov qauv tsawg tsawg: 42U, 45U, 47U, 48U , 52 ua. Thiab ntawm no Excel's What-Yog tias kev tshuaj xyuas hauv Cov Ntaub Ntawv Table hom tuaj yeem pab nrog suav. Peb saib cov phiaj uas tau txais thiab xaiv qhov tsawg kawg nkaus.

Tau qhov twg los: www.hab.com

Ntxiv ib saib