Tapanga kapangidwe ka netiweki ya data yomwe imalola kutumizidwa kwamagulu apakompyuta okulirapo kuposa ma seva 100 zikwi okhala ndi bandwidth yayikulu yopitilira petabyte imodzi pamphindikati.
Kuchokera ku lipoti la Dmitry Afanasyev muphunzira za mfundo zazikuluzikulu za mapangidwe atsopano, makulitsidwe a topology, mavuto omwe amabwera ndi izi, njira zothetsera mavutowa, mawonekedwe oyendetsa ndi kukulitsa ntchito za ndege zotumizira zipangizo zamakono zamakono mu "zolumikizana kwambiri" ma topology okhala ndi njira zambiri za ECMP. Kuphatikiza apo, Dima adalankhula mwachidule za bungwe la kulumikizana kwakunja, kusanja kwakuthupi, kachitidwe ka cabling ndi njira zowonjezera mphamvu.
- Masana abwino nonse! Dzina langa ndine Dmitry Afanasyev, ndine womanga maukonde ku Yandex ndipo makamaka ndimapanga ma data center network.
Nkhani yanga ikhala yokhudza maukonde osinthidwa a Yandex data center. Ndizosintha kwambiri za mapangidwe omwe tinali nawo, koma nthawi yomweyo pali zinthu zina zatsopano. Uwu ndi ulaliki wachidule chifukwa panali zambiri zomwe ziyenera kuikidwa pakanthawi kochepa. Tiyamba ndikusankha topology yomveka. Ndiye padzakhala chithunzithunzi cha ndege yolamulira ndi mavuto ndi scalability ndege deta, kusankha zimene zidzachitike pa mlingo wa thupi, ndipo tiona mbali zina za zipangizo. Tiyeni tikhudze pang'ono zomwe zikuchitika mu data center ndi MPLS, zomwe tidakambirana kale.
Ndiye, Yandex ndi chiyani pankhani ya katundu ndi ntchito? Yandex ndi hyperscaler wamba. Ngati tiyang'ana ogwiritsa ntchito, timakonza zopempha za ogwiritsa ntchito. Komanso zosiyanasiyana kusonkhana misonkhano ndi kutengerapo deta, chifukwa tilinso yosungirako misonkhano. Ngati pafupi ndi kumbuyo, ndiye kuti katundu wa zomangamanga ndi ntchito zimawonekera pamenepo, monga kusungidwa kwa zinthu zogawidwa, kubwereza deta komanso, ndithudi, mizere yosalekeza. Chimodzi mwazinthu zazikulu zolemetsa ntchito ndi MapReduce ndi machitidwe ofanana, kukonza mitsinje, kuphunzira pamakina, ndi zina zambiri.
Kodi zomangamanga zili bwanji pamwamba pomwe zonsezi zimachitika? Apanso, ndife ma hyperscaler okongola, ngakhale mwina tili pafupi pang'ono ndi mbali yocheperako ya sipekitiramu. Koma ife tiri nazo zikhumbo zonse. Timagwiritsa ntchito zida zamtengo wapatali komanso makulitsidwe opingasa ngati kuli kotheka. Tili ndi zida zonse zogwirizanitsa: sitigwira ntchito ndi makina amtundu uliwonse, ma racks pawokha, koma timawaphatikiza kukhala dziwe lalikulu lazinthu zosinthika ndi zina zowonjezera zomwe zimakhudzana ndikukonzekera ndi kugawa, ndikugwira ntchito ndi dziwe lonseli.
Chifukwa chake tili ndi mulingo wotsatira - makina ogwiritsira ntchito pamlingo wamagulu apakompyuta. Ndikofunikira kwambiri kuti tiziwongolera mokwanira zaukadaulo zomwe timagwiritsa ntchito. Timawongolera ma endpoints (makamu), maukonde ndi mapulogalamu apulogalamu.
Tili ndi malo angapo akuluakulu a data ku Russia ndi kunja. Amalumikizidwa ndi msana womwe umagwiritsa ntchito ukadaulo wa MPLS. Zomangamanga zathu zamkati zimamangidwa kwathunthu pa IPv6, koma popeza tikufunika kugwiritsa ntchito magalimoto akunja omwe amabwerabe makamaka pa IPv4, tiyenera mwanjira inayake kupereka zopempha zomwe zikubwera pa IPv4 kumaseva akutsogolo, ndi zina zambiri kupita kunja kwa IPv4- Internet - chifukwa. Mwachitsanzo, kwa indexing.
Kubwereza pang'ono komaliza kwa mapangidwe a netiweki ya data center agwiritsa ntchito mitundu ingapo ya Clos topology ndipo ndi L3-only. Tinachoka ku L2 kanthawi kapitako ndikupumira. Pomaliza, zomanga zathu zikuphatikiza mazana masauzande a ma compute (seva). Kukula kwakukulu kwamagulu nthawi yayitali kunali pafupifupi ma seva 10 zikwi. Izi makamaka chifukwa cha momwe machitidwe omwewo a magulu ogwiritsira ntchito magulu, okonza mapulani, kugawidwa kwazinthu, ndi zina zotero. Tili ndi ntchito - kuti tithe kumanga mafakitale apaintaneti omwe amalola kugwirizanitsa zinthu moyenera m'magulu otere.
Kodi tikufuna chiyani kuchokera ku data center network? Choyamba, pali bandwidth yotsika mtengo komanso yogawidwa mofanana. Chifukwa netiweki ndiye msana womwe titha kugwirizanitsa zinthu. Kukula kwatsopano komwe mukufuna ndi pafupifupi ma seva 100 zikwi mugulu limodzi.
Ifenso, ndithudi, tikufuna ndege yoyendetsa scalable ndi yokhazikika, chifukwa pazitukuko zazikulu zoterezi mutu wambiri umabwera ngakhale kuchokera ku zochitika zachisawawa, ndipo sitikufuna kuti ndege yoyendetsa ndegeyo itibweretserenso mutu. Pa nthawi yomweyo, tikufuna kuchepetsa boma mmenemo. Zomwe zimakhala zochepa, zimakhala bwino komanso zokhazikika zonse zimagwira ntchito, ndipo zimakhala zosavuta kuzizindikira.
Zoonadi, timafunikira zokha, chifukwa n'zosatheka kuyendetsa zipangizo zoterezi pamanja, ndipo zakhala zosatheka kwa nthawi ndithu. Timafunikira chithandizo chogwira ntchito momwe tingathere komanso thandizo la CI / CD momwe lingaperekere.
Ndi kukula kwa malo opangira deta ndi magulu, ntchito yothandizira kutumizidwa kowonjezereka ndi kukulitsa popanda kusokoneza ntchito yakhala yovuta kwambiri. Ngati pamagulu a kukula kwa makina chikwi, mwina pafupi ndi makina zikwi khumi, akhoza kutulutsidwa ngati ntchito imodzi - ndiko kuti, tikukonzekera kukulitsa zomangamanga, ndipo makina zikwi zingapo akuwonjezeredwa ngati ntchito imodzi, ndiye gulu la kukula kwa makina zikwi zana silimatuluka nthawi yomweyo, limamangidwa pakapita nthawi. Ndipo ndizofunika kuti nthawi yonseyi zomwe zatulutsidwa kale, zowonongeka zomwe zakhala zikugwiritsidwa ntchito, ziyenera kupezeka.
Ndipo chofunikira chimodzi chomwe tinali nacho ndikuchisiya: kuthandizira kwa multitenancy, ndiko kuti, virtualization kapena segmentation network. Tsopano sitiyenera kuchita izi pamtundu wa nsalu za netiweki, chifukwa sharding yapita kwa makamu, ndipo izi zapangitsa kuti makulitsidwe kukhala osavuta kwa ife. Chifukwa cha IPv6 komanso malo ochezera ambiri, sitinafunikire kugwiritsa ntchito ma adilesi obwereza muzomangamanga zamkati; maadiresi onse anali apadera kale. Ndipo chifukwa chakuti tatenga zosefera ndi magawo a netiweki kwa omwe akukhala nawo, sitiyenera kupanga mabungwe aliwonse amtundu wapaintaneti mu data center network.
Chinthu chofunika kwambiri ndi chimene sitikusowa. Ngati ntchito zina zitha kuchotsedwa pamaneti, izi zimapangitsa moyo kukhala wosavuta, ndipo, monga lamulo, kumawonjezera kusankha kwa zida zomwe zilipo ndi mapulogalamu, kupanga diagnostics kukhala kosavuta.
Kotero, ndi chiyani chomwe sitikusowa, ndi chiyani chomwe takhala tikutha kusiya, osati nthawi zonse ndi chisangalalo panthawi yomwe zidachitika, koma ndi mpumulo waukulu pamene ndondomekoyo yatha?
Choyamba, kusiya L2. Sitikufuna L2, ngakhale yeniyeni kapena yotsanzira. Zosagwiritsidwa ntchito makamaka chifukwa chakuti timawongolera kuchuluka kwa mapulogalamu. Ntchito zathu ndizokhazikika, zimagwira ntchito ndi ma adilesi a L3, alibe nkhawa kuti chochitika china chatuluka, amangotulutsa chatsopano, sichiyenera kutulutsidwa pa adilesi yakale, chifukwa pali mulingo wosiyana wakupeza ntchito ndikuwunika makina omwe ali mgululi. Sitikupereka ntchitoyi ku netiweki. Ntchito ya netiweki ndikutumiza mapaketi kuchokera ku point A kupita kumalo B.
Sitikhalanso ndi zochitika zomwe maadiresi amasuntha mkati mwa intaneti, ndipo izi ziyenera kuyang'aniridwa. M'mapangidwe ambiri izi zimafunikira kuthandizira kuyenda kwa VM. Sitigwiritsa ntchito kuyenda kwa makina pafupifupi muzomangamanga zamkati za Yandex yayikulu, komanso, timakhulupirira kuti ngakhale izi zitachitika, siziyenera kuchitika ndi chithandizo cha maukonde. Ngati zikuyenera kuchitidwa, ziyenera kuchitidwa pamlingo wolandila, ndikukankhira maadiresi omwe angasunthike kupita ku zokutira, kuti asakhudze kapena kusintha kusintha kwakukulu pamakina owongolera a underlay yokha (network ya zoyendera) .
Ukadaulo wina womwe sitigwiritsa ntchito ndi multicast. Ngati mukufuna, ndikuuzeni mwatsatanetsatane chifukwa chake. Izi zimapangitsa moyo kukhala wosavuta, chifukwa ngati wina wathana nazo ndikuyang'ana ndendende momwe ndege yoyendetsera ma multicast imawonekera, m'mayikidwe osavuta, ichi ndi mutu waukulu. Ndipo zowonjezera, ndizovuta kupeza njira yotseguka yotseguka yogwira ntchito bwino, mwachitsanzo.
Pomaliza, timapanga maukonde athu kuti asasinthe kwambiri. Tikhoza kudalira kuti kutuluka kwa zochitika zakunja mumayendedwe oyendayenda ndi ochepa.
Ndi mavuto ati omwe amabwera ndi zoletsa ziti zomwe ziyenera kuganiziridwa tikapanga netiweki ya data center? Mtengo, ndithudi. Scalability, mlingo womwe tikufuna kukula. Kufunika kokulitsa popanda kuyimitsa ntchito. Bandwidth, kupezeka. Kuwonekera kwa zomwe zikuchitika pa netiweki kwa machitidwe oyang'anira, kwa magulu ogwira ntchito. Thandizo lodzichitira - kachiwiri, momwe mungathere, popeza ntchito zosiyanasiyana zimatha kuthetsedwa pamagulu osiyanasiyana, kuphatikizapo kuyambitsa zigawo zowonjezera. Chabwino, osati [mwina] kudalira ogulitsa. Ngakhale mu nthawi zosiyanasiyana za mbiriyakale, malingana ndi gawo lomwe mukuyang'ana, ufulu uwu unali wosavuta kapena wovuta kwambiri kukwaniritsa. Ngati titenga gawo lalikulu la tchipisi tating'onoting'ono, ndiye kuti mpaka posachedwapa zinali zovomerezeka kunena za kudziyimira pawokha kwa ogulitsa, ngati tinkafunanso tchipisi tokhala ndi zotulutsa zambiri.
Ndi mfundo zomveka zotani zomwe tidzagwiritse ntchito pomanga maukonde athu? Izi zidzakhala ma Clos amitundu yambiri. Ndipotu, palibe njira zina zenizeni pakali pano. Ndipo topology ya Clos ndiyabwino kwambiri, ngakhale poyerekeza ndi ma topology osiyanasiyana apamwamba omwe ali pachiwopsezo chamaphunziro tsopano, ngati tili ndi masiwichi akulu akulu.
Kodi netiweki yamitundu yambiri ya Clos imapangidwa bwanji ndipo ndi zinthu ziti zomwe zimatchedwa momwemo? Choyamba, mphepo inanyamuka kuti uloze kumene uli kumpoto, kumene kuli kumβmwera, kumene kuli kumβmawa, kumene kuli kumadzulo. Maukonde amtunduwu nthawi zambiri amamangidwa ndi omwe ali ndi magalimoto akulu kwambiri chakumadzulo chakum'mawa. Ponena za zinthu zotsalira, pamwamba pake pali chosinthira chenicheni chosonkhanitsidwa kuchokera ku masiwichi ang'onoang'ono. Ili ndiye lingaliro lalikulu pakumanga kobwerezabwereza kwa ma network a Clos. Timatenga zinthu zokhala ndi mtundu wina wa radix ndikuzilumikiza kuti zomwe timapeza zitha kuwonedwa ngati chosinthira chokhala ndi radix yayikulu. Ngati mukufuna zambiri, ndondomekoyi ikhoza kubwerezedwa.
Muzochitika, mwachitsanzo, ndi ma Clos awiri, pamene n'zotheka kuzindikira momveka bwino zigawo zomwe zili zowongoka muzithunzi zanga, nthawi zambiri zimatchedwa ndege. Ngati tikanati timange Clos yokhala ndi magawo atatu a masinthidwe a msana (zonse zomwe sizili malire kapena masinthidwe a ToR komanso omwe amagwiritsidwa ntchito podutsa), ndiye kuti ndege zimawoneka zovuta kwambiri; magawo awiri amawoneka chimodzimodzi. Timatcha chipika cha ToR kapena masiwichi amasamba ndi masiwichi amtundu woyamba omwe amalumikizidwa nawo kukhala Pod. Kusintha kwa msana kwa msinkhu wa msana-1 pamwamba pa Pod ndi pamwamba pa Pod, pamwamba pa Pod. Zosintha zomwe zili pamwamba pa fakitale yonse ndizomwe zimakhala pamwamba pa fakitale, Pamwamba pa nsalu.
Zachidziwikire, funso limabuka: Maukonde a Clos adamangidwa kwakanthawi; lingaliro lenilenilo nthawi zambiri limachokera ku nthawi zama foni akale, ma network a TDM. Mwina china chake chabwino chawoneka, mwina china chake chingachitike bwino? Inde ndi ayi. Mwachidziwitso inde, mukuchita posachedwapa ayi ndithu. Chifukwa pali zolemba zingapo zosangalatsa, zina zimagwiritsidwanso ntchito popanga, mwachitsanzo, Dragonfly imagwiritsidwa ntchito pamapulogalamu a HPC; Palinso ma topology osangalatsa monga Xpander, FatClique, Jellyfish. Mukayang'ana malipoti pamisonkhano ngati SIGCOMM kapena NSDI posachedwa, mutha kupeza ntchito zambiri pamatchulidwe ena omwe ali ndi katundu wabwinoko (mmodzi kapena wina) kuposa Clos.
Koma ma topology onsewa ali ndi chinthu chimodzi chosangalatsa. Zimalepheretsa kukhazikitsidwa kwawo mu ma data center network, omwe tikuyesera kumanga pa hardware yamtengo wapatali ndipo amawononga ndalama zokwanira. M'mitundu yonseyi, ma bandwidth ambiri mwatsoka sapezeka kudzera munjira zazifupi. Choncho, nthawi yomweyo timataya mwayi wogwiritsa ntchito ndege yoyendetsera chikhalidwe.
Mwamwayi, njira yothetsera vutoli imadziwika. Izi ndi, mwachitsanzo, zosintha za ulalo wa boma pogwiritsa ntchito njira yachidule ya k, koma, palibenso ma protocol omwe angatsatizidwe popanga komanso kupezeka pazida.
Komanso, popeza mphamvu zambiri sizipezeka kudzera munjira zazifupi, tifunika kusintha zambiri kuposa ndege yowongolera kuti tisankhe njira zonsezo (ndipo, izi ndizowonjezereka kwambiri mu ndege yowongolera). Tikufunikabe kusintha ndege yotumizira, ndipo, monga lamulo, zofunikira ziwiri zowonjezera zimafunikira. Uku ndikutha kupanga zisankho zonse zokhudzana ndi kutumiza paketi kamodzi, mwachitsanzo, pa wolandila. M'malo mwake, uku ndi njira yopangira magwero, nthawi zina m'mabuku olumikizana ndi ma network izi zimatchedwa zisankho zotumiza kamodzi. Ndipo kusintha kosinthika ndi ntchito yomwe timafunikira pazinthu zapaintaneti, zomwe zimagwera pansi, mwachitsanzo, kuti timasankha kadumphidwe kotsatira kutengera zambiri za katundu wochepera pamzere. Mwachitsanzo, zosankha zina ndizotheka.
Choncho, malangizowa ndi okondweretsa, koma, tsoka, sitingathe kuligwiritsa ntchito pakali pano.
Chabwino, tinakhazikika pa Clos logical topology. Kodi tidzachikulitsa bwanji? Tiyeni tiwone momwe zimagwirira ntchito ndi zomwe zingachitike.
Mu netiweki ya Clos pali magawo awiri akulu omwe titha kusiyanasiyana mwanjira ina ndikupeza zotsatira zina: ma radix a zinthu ndi kuchuluka kwa ma network. Ndili ndi chithunzi cha momwe zonse zimakhudzira kukula kwake. Moyenera, timaphatikiza zonse ziwiri.
Zitha kuwoneka kuti m'lifupi lomaliza la maukonde a Clos ndizomwe zimapangidwa ndi magawo onse a kusintha kwa msana kwa radix yakumwera, ndi maulalo angati omwe tili nawo, momwe amayambira. Umu ndi momwe timakulitsira kukula kwa netiweki.
Pankhani ya kuchuluka, makamaka pakusintha kwa ToR, pali njira ziwiri zokulira. Mwina titha, tikusunga ma topology, kugwiritsa ntchito maulalo othamanga, kapena titha kuwonjezera ndege zina.
Mukayang'ana mtundu wokulirapo wa netiweki ya Clos (pakona yakumanja yakumanja) ndikubwerera ku chithunzichi ndi netiweki ya Clos pansipa...
... ndiye izi ndizofanana ndendende ndi topology, koma pa slide iyi idagwa pang'onopang'ono ndipo ndege za fakitale zimayikidwa pamwamba pa wina ndi mnzake. Ndi chimodzimodzi.
Kodi kukulitsa netiweki ya Clos kumawoneka bwanji pamawerengero? Apa ndikupereka chidziwitso cha kuchuluka kwa ma network omwe angapezeke, kuchuluka kwa ma racks, masiwichi a ToR kapena masiwichi a masamba, ngati sali muzitsulo, titha kupeza kutengera ma switch omwe timagwiritsa ntchito pamsana, ndi timagwiritsa ntchito magawo angati.
Nawa ma rack angati omwe tingakhale nawo, ma seva angati komanso kuchuluka kwa zomwe zonsezi zitha kuwononga kutengera 20 kW pa rack. M'mbuyomu ndidanenapo kuti tikufuna kukula kwamagulu pafupifupi ma seva 100.
Zitha kuwoneka kuti mumapangidwe onsewa, zosankha ziwiri ndi theka ndizosangalatsa. Pali njira yokhala ndi zigawo ziwiri za spines ndi ma switch 64-port, omwe amagwera pang'ono. Ndiye pali zosankha zoyenera kwambiri za 128-port (yokhala ndi radix 128) masiwichi a msana okhala ndi magawo awiri, kapena masiwichi okhala ndi radix 32 okhala ndi magawo atatu. Ndipo nthawi zonse, komwe kuli ma radix ambiri ndi zigawo zambiri, mukhoza kupanga maukonde aakulu kwambiri, koma ngati muyang'ana zomwe zimayembekezeredwa, nthawi zambiri pali gigawatts. Ndizotheka kuyala chingwe, koma sitingathe kupeza magetsi ochulukirapo pamalo amodzi. Mukayang'ana ziwerengero ndi zidziwitso zapagulu pazida zama data, mutha kupeza ma data ochepa kwambiri omwe ali ndi mphamvu yopitilira 150 MW. Zokulirapo nthawi zambiri zimakhala ma data center campus, malo angapo akuluakulu a data omwe amakhala pafupi kwambiri.
Palinso chizindikiro china chofunikira. Ngati muyang'ana kumanzere, bandwidth yogwiritsidwa ntchito imalembedwa pamenepo. Ndizosavuta kuwona kuti mu network ya Clos gawo lalikulu la madoko limagwiritsidwa ntchito kulumikiza ma switch wina ndi mnzake. Kugwiritsidwa ntchito kwa bandwidth, mzere wothandiza, ndi chinthu chomwe chingaperekedwe kunja, kwa ma seva. Mwachilengedwe, ndikulankhula za madoko okhazikika komanso makamaka za gululo. Monga lamulo, maulalo mkati mwa intaneti ndi othamanga kuposa maulalo opita ku ma seva, koma pagawo la bandwidth, monga momwe tingatumizire ku zida zathu za seva, palinso bandwidth mkati mwamanetiwo. Ndipo pamene tipanga milingo yochulukira, ndiye kuti mtengo wake woperekera mzerewu umakulirakulira.
Komanso, ngakhale gulu lowonjezera ili siliri chimodzimodzi. Ngakhale kuti zotalikirana ndi zazifupi, titha kugwiritsa ntchito zina monga DAC (kulumikiza mwachindunji mkuwa, ndiko kuti, zingwe za twinax), kapena ma multimode optics, omwe amawononga ndalama zochulukirapo kapena zochepa. Tikangosunthira kumalo otalikirapo - monga lamulo, awa ndi optics single mode, ndipo mtengo wa bandwidth wowonjezerawu ukuwonjezeka kwambiri.
Ndipo kachiwiri, kubwerera ku slide yapitayi, ngati tipanga netiweki ya Clos popanda kulembetsa mopitilira muyeso, ndiye kuti ndizosavuta kuyang'ana chithunzicho, kuwona momwe maukonde amamangidwira - ndikuwonjezera gawo lililonse la masiwichi a msana, timabwereza mzere wonse womwe unali pansi. Mulingo wowonjezera - kuphatikiza gulu lomwelo, madoko omwewo pamasinthidwe monga analili pamlingo wam'mbuyomu, ndi ma transceivers omwewo. Chifukwa chake, ndikofunikira kwambiri kuchepetsa kuchuluka kwa masinthidwe a msana.
Kutengera chithunzichi, zikuwonekeratu kuti tikufunadi kumanga pa chinthu ngati masiwichi okhala ndi radix ya 128.
Apa, kwenikweni, zonse ndi zofanana ndi zomwe ndangonena; iyi ndi slide yoti tiganizire pambuyo pake.
Ndi zosankha ziti zomwe tingasankhe ngati masiwichi oterowo? Ndi nkhani yosangalatsa kwa ife kuti tsopano maukonde otere amatha kumangidwa pa ma switch a single-chip. Ndipo izi ndizabwino kwambiri, zili ndi mawonekedwe ambiri abwino. Mwachitsanzo, alibe pafupifupi dongosolo lamkati. Izi zikutanthauza kuti amathyoka mosavuta. Amathyola m'njira zosiyanasiyana, koma mwamwayi amasweka kwathunthu. Mu zipangizo zamakono pali zolakwa zambiri (zosasangalatsa kwambiri), pamene kuchokera kumbali ya oyandikana nawo ndi ndege yolamulira ikuwoneka kuti ikugwira ntchito, koma, mwachitsanzo, mbali ya nsalu yatayika ndipo sikugwira ntchito. pa mphamvu zonse. Ndipo kuchuluka kwa magalimoto kwa izo kumakhala koyenera kutengera kuti imagwira ntchito mokwanira, ndipo titha kuchulukitsidwa.
Kapena, mwachitsanzo, mavuto amadza ndi backplane, chifukwa chipangizo chosinthira chimakhalanso ndi ma SerDes othamanga kwambiri mkati - ndizovuta kwambiri mkati. Zizindikilo zapakati pa zinthu zotumizira zimalumikizidwa kapena osalumikizidwa. Nthawi zambiri, chipangizo chilichonse chopangira zinthu chomwe chimakhala ndi zinthu zambiri, monga lamulo, chimakhala ndi netiweki ya Clos mkati mwake, koma ndizovuta kwambiri kuzizindikira. Nthawi zambiri zimakhala zovuta kuti ngakhale wogulitsa mwiniyo azindikire.
Ndipo ili ndi zochitika zambiri zolephera zomwe chipangizocho chimanyozetsa, koma sichimatuluka mu topology kwathunthu. Popeza maukonde athu ndi akulu, kulinganiza pakati pa zinthu zofanana kumagwiritsidwa ntchito mwachangu, maukonde amakhala okhazikika, ndiye kuti, njira imodzi yomwe zonse zili mu dongosolo silili losiyana ndi njira ina, ndizopindulitsa kwambiri kuti tingotaya zina. zipangizo kuchokera topology kuposa kutha mu mkhalidwe umene ena a iwo akuwoneka ntchito, koma ena a iwo satero.
Chotsatira chabwino cha zida za single-chip ndikuti zimasintha bwino komanso mwachangu. Amakondanso kukhala ndi luso labwino. Ngati titenga zinyumba zazikulu zomwe tili nazo pabwalo, ndiye kuti mphamvu pa rack ya madoko omwe ali ndi liwiro lomwelo ndi yabwino kuwirikiza kawiri kuposa ya zida zama modular. Zipangizo zomangidwa mozungulira chip imodzi ndizotsika mtengo kwambiri kuposa zokhazikika ndipo zimawononga mphamvu zochepa.
Koma, ndithudi, zonsezi ndi chifukwa, palinso zovuta. Choyamba, radix nthawi zonse imakhala yaying'ono kuposa ya zida zama modular. Ngati titha kupeza chipangizo chomangidwa mozungulira chip chimodzi chokhala ndi madoko 128, ndiye kuti titha kupeza imodzi yokhala ndi madoko mazana angapo tsopano popanda vuto lililonse.
Ichi ndi kukula kochepa kwambiri kwa matebulo otumizira ndipo, monga lamulo, chirichonse chokhudzana ndi scalability ya data plane. Ma buffers osaya. Ndipo, monga lamulo, m'malo ochepa magwiridwe antchito. Koma zikuwonekeratu kuti ngati mukudziwa zoletsa izi ndikusamala kuti muzitha kuzipewa kapena kuziganizira, ndiye kuti izi sizowopsa. Mfundo yakuti radix ndi yaying'ono siilinso vuto pazida zokhala ndi radix ya 128 zomwe zawonekera posachedwa; titha kupanga magawo awiri a nsana. Koma ndizosatheka kupanga chilichonse chocheperako kuposa ziwiri chomwe chili chosangalatsa kwa ife. Ndi mulingo umodzi, masango ang'onoang'ono amapezedwa. Ngakhale mapangidwe athu am'mbuyomu ndi zofunikira zidapitilirabe.
Ndipotu, ngati mwadzidzidzi yankho lili penapake pamphepete, pali njira yowonjezera. Popeza omaliza (kapena oyamba), otsika kwambiri pomwe ma seva amalumikizidwa ndi masiwichi a ToR kapena masiwichi amasamba, sitiyenera kulumikiza rack imodzi kwa iwo. Chifukwa chake, ngati yankho likuchepera pafupifupi theka, mutha kuganiza zongogwiritsa ntchito chosinthira chokhala ndi radix yayikulu m'munsi ndikulumikiza, mwachitsanzo, ma rack awiri kapena atatu mu switch imodzi. Iyinso ndi njira, ili ndi ndalama zake, koma imagwira ntchito bwino ndipo ikhoza kukhala yankho labwino pamene mukufunikira kufika kuwirikiza kawiri.
Mwachidule, tikumanga pa topology yokhala ndi magawo awiri a misana, yokhala ndi magawo asanu ndi atatu a fakitale.
Kodi physics idzachitike ndi chiyani? Mawerengedwe osavuta kwambiri. Ngati tili ndi magawo awiri a spines, ndiye kuti tili ndi magawo atatu okha osinthika, ndipo tikuyembekeza kuti padzakhala zigawo zitatu za chingwe pamaneti: kuchokera ku maseva kupita ku masamba a masamba, ku msana 1, ku msana 2. Zosankha zomwe tingathe ntchito ndi - awa ndi twinax, multimode, single mode. Ndipo apa tikuyenera kuganizira za mzere womwe ulipo, mtengo wake, kukula kwake, ndi kutalika kotani komwe titha kuphimba, ndi momwe tingakwezerere.
Pankhani ya mtengo, chilichonse chikhoza kukonzedwa. Ma Twinaxes ndi otsika mtengo kwambiri kuposa optics yogwira, otsika mtengo kuposa ma transceivers a multimode, ngati mutenga ndege iliyonse kuchokera kumapeto, yotsika mtengo kuposa 100-gigabit switch port. Ndipo, chonde dziwani, zimawononga ndalama zochepa kuposa ma single mode optics, chifukwa pamaulendo apandege omwe amafunikira njira imodzi, m'malo opangira ma data pazifukwa zingapo ndizomveka kugwiritsa ntchito CWDM, pomwe ma parallel single mode (PSM) siwosavuta kugwira ntchito. ndi, mapaketi akulu kwambiri amapezedwa ulusi, ndipo ngati tiyang'ana pa matekinoloje awa, timapeza pafupifupi magawo otsatirawa amitengo.
Cholemba chinanso: mwatsoka, ndizosatheka kugwiritsa ntchito madoko osakanikirana 100 mpaka 4x25. Chifukwa cha mapangidwe a ma transceivers a SFP28, sizotsika mtengo kwambiri kuposa 28 Gbit QSFP100. Ndipo disassembly iyi ya multimode sikugwira ntchito bwino.
Cholepheretsa china ndi chakuti chifukwa cha kukula kwa magulu apakompyuta ndi kuchuluka kwa ma seva, malo athu a deta amakhala aakulu mwakuthupi. Izi zikutanthauza kuti ndege imodzi iyenera kuchitidwa ndi singlemod. Apanso, chifukwa cha kukula kwa ma Pods, sikutheka kuyendetsa magawo awiri a twinax (zingwe zamkuwa).
Chotsatira chake, ngati tikukonzekera mtengo ndikuganizira za geometry ya mapangidwe awa, timapeza nthawi imodzi ya twinax, nthawi imodzi ya multimode ndi imodzi ya singlemode pogwiritsa ntchito CWDM. Izi zimaganizira njira zowonjezera zomwe zingatheke.
Izi ndi momwe zimawonekera posachedwa, komwe tikulowera komanso zomwe zingatheke. Zikuwonekeratu, osachepera, momwe mungayendere ku 50-Gigabit SerDes kwa ma multimode ndi singlemode. Komanso, ngati muyang'ana zomwe zili mu ma transceivers amtundu umodzi tsopano ndi m'tsogolomu kwa 400G, nthawi zambiri ngakhale 50G SerDes ifika kuchokera kumbali yamagetsi, 100 Gbps pa msewu akhoza kale kupita ku optics. Choncho, ndizotheka kuti m'malo mosamukira ku 50, padzakhala kusintha kwa 100 Gigabit SerDes ndi 100 Gbps pamseu, chifukwa malinga ndi malonjezo a ogulitsa ambiri, kupezeka kwawo kumayembekezeredwa posachedwa. Nthawi yomwe 50G SerDes inali yofulumira kwambiri, zikuwoneka, sikhala yaitali kwambiri, chifukwa makope oyambirira a 100G SerDes adzatulutsidwa pafupifupi chaka chamawa. Ndipo pakapita nthawi pambuyo pake iwo adzakhala ofunika ndalama zokwanira.
Chinthu chinanso chokhudza kusankha kwafizikiki. M'malo mwake, titha kugwiritsa ntchito madoko a 400 kapena 200 Gigabit pogwiritsa ntchito 50G SerDes. Koma zikuwoneka kuti izi sizomveka, chifukwa, monga ndidanenera kale, tikufuna radix yayikulu pamasinthidwe, pachifukwa, inde. Tikufuna 128. Ndipo ngati tili ndi mphamvu zochepa za chip ndipo timawonjezera liwiro la chiyanjano, ndiye kuti radix imachepetsa mwachibadwa, palibe zozizwitsa.
Ndipo titha kuwonjezera kuchuluka kwa ndege pogwiritsa ntchito ndege, ndipo palibe mtengo wapadera; titha kuwonjezera kuchuluka kwa ndege. Ndipo ngati titaya radix, tidzayenera kuwonetsa mlingo wowonjezera, kotero muzochitika zamakono, ndi mphamvu zomwe zilipo panopa pa chip, zikuwoneka kuti ndizothandiza kwambiri kugwiritsa ntchito madoko a 100-gigabit, chifukwa amakulolani. kupeza radix yokulirapo.
Funso lotsatira ndi momwe fiziki imapangidwira, koma kuchokera kumalo owonetsera chingwe. Zikuoneka kuti bungwe m'malo oseketsa. Kuyika pakati pa masiwichi amasamba ndi ma spines oyamba - palibe maulalo ambiri pamenepo, chilichonse chimamangidwa mophweka. Koma ngati titenga ndege imodzi, zomwe zimachitika mkati ndizoti tiyenera kugwirizanitsa misana yonse ya msinkhu woyamba ndi misana yonse ya msinkhu wachiwiri.
Kuphatikiza apo, monga lamulo, pali zokhumba zina za momwe ziyenera kuwonekera mkati mwa data center. Mwachitsanzo, tinkafunadi kuphatikiza zingwe kuti zikhale mtolo ndikuzikoka kuti gulu limodzi lokhala ndi kachulukidwe kakang'ono lilowe kwathunthu pagawo limodzi, kotero kuti panalibe zoo potengera kutalika. Tinakwanitsa kuthetsa vutoli. Ngati poyamba muyang'ana pa topology yomveka, mukhoza kuona kuti ndege ndizodziimira, ndege iliyonse ikhoza kumangidwa yokha. Koma tikawonjezera kuphatikizika koteroko ndikufuna kukokera gulu lonse lachigamba mu gulu lachigamba, tiyenera kusakaniza ndege zosiyanasiyana mkati mwa mtolo umodzi ndikuyambitsa mawonekedwe apakati ngati mawonekedwe olumikizirana owoneka kuti awayikenso kuchokera momwe adasonkhanitsidwa. gawo lina, momwe adzasonkhanitsidwira ku gawo lina. Chifukwa cha izi, timapeza mawonekedwe abwino: kusintha konse kovuta sikudutsa ma racks. Mukafunika kulumikiza chinthu mwamphamvu kwambiri, "vumbulutsani ndege," monga nthawi zina zimatchedwa ma network a Clos, zonse zimakhazikika mkati mwa choyikapo chimodzi. Tilibe disassembled kwambiri, mpaka maulalo payekha, kusinthana pakati rack.
Umu ndi momwe zikuwonekera kuchokera kumalingaliro a bungwe lomveka la zomangamanga za chingwe. Pachithunzi chakumanzere, midadada yamitundu yosiyanasiyana ikuwonetsa midadada ya masiwichi amtundu woyamba, zidutswa zisanu ndi zitatu chilichonse, ndi mitolo inayi ya zingwe zomwe zimachokera kwa iwo, zomwe zimapita ndikudutsana ndi mitolo yomwe imachokera ku midadada ya spine-2 switch. .
Mabwalo ang'onoang'ono amasonyeza mphambano. Pamwamba kumanzere ndi kuwonongeka kwa mphambano iliyonse yotereyi, iyi ndi gawo la 512 ndi 512 doko lolumikizana ndi doko lomwe limabwezeretsanso zingwe kuti zibwere kwathunthu mu chipika chimodzi, pomwe pali ndege imodzi yokha ya msana-2. Ndipo kumanja, jambulani chithunzichi ndi tsatanetsatane pang'ono pokhudzana ndi ma Pods angapo pamtunda wa msana-1, ndi momwe amapangidwira pamtanda wolumikizana, momwe zimakhalira pamlingo wa spine-2.
Izi ndi momwe zimawonekera. Choyimira chomwe sichinasonkhanitsidwe kwathunthu chamsana-2 (kumanzere) ndi choyimira cholumikizira. Tsoka ilo, palibe zambiri zoti muwone pamenepo. Mapangidwe onsewa akugwiritsidwa ntchito pakali pano mu imodzi mwa malo athu akuluakulu a deta omwe akukulitsidwa. Iyi ndi ntchito yomwe ikuchitika, idzawoneka bwino, idzadzazidwa bwino.
Funso lofunikira: tidasankha topology yomveka ndikumanga fiziki. Kodi ndege yoyang'anira idzachitikira chiyani? Ndizodziwika bwino kuchokera kuzochitika zogwirira ntchito, pali malipoti angapo omwe amalumikizana ndi ma protocol a boma ndi abwino, ndizosangalatsa kugwira nawo ntchito, koma, mwatsoka, samakula bwino pa topology yolumikizidwa kwambiri. Ndipo pali chinthu chimodzi chachikulu chomwe chimalepheretsa izi - umu ndi momwe kusefukira kumagwirira ntchito pama protocol a boma. Mukangotenga ma aligorivimu osefukira ndikuyang'ana momwe maukonde athu amapangidwira, mutha kuwona kuti padzakhala fanout yayikulu kwambiri pa sitepe iliyonse, ndipo idzasefukira ndege yowongolera ndi zosintha. Mwachindunji, ma topology oterowo amasakanikirana bwino kwambiri ndi ma algorithm achikhalidwe akusefukira mu ma protocol a boma.
Kusankha ndiko kugwiritsa ntchito BGP. Momwe mungakonzekerere bwino ndikufotokozedwa mu RFC 7938 pakugwiritsa ntchito BGP m'malo akuluakulu a data. Mfundo zazikuluzikulu ndizosavuta: chiwerengero chocheperako cha ma prefixes pa wolandira ndipo nthawi zambiri chiwerengero chocheperako cha ma prefixes pa netiweki, gwiritsani ntchito kuphatikiza ngati nkotheka, ndi kupondereza kusaka njira. Tikufuna kugawa kosamala kwambiri, koyendetsedwa bwino kwa zosintha, zomwe zimatchedwa chigwa chaulere. Tikufuna kuti zosintha zizichitika kamodzi kokha zikadutsa pa netiweki. Ngati zimachokera pansi, zimakwera, osapitirira kamodzi. Pasakhale zigzag. Zigzags ndi zoipa kwambiri.
Kuti tichite izi, timagwiritsa ntchito mapangidwe omwe ndi osavuta kugwiritsa ntchito njira zomwe zili pansi pa BGP. Ndiko kuti, timagwiritsa ntchito eBGP yomwe ikuyenda pa ulalo wamba, ndipo machitidwe odziyimira pawokha amaperekedwa motere: dongosolo lodziyimira pawokha pa ToR, dongosolo lodziyimira pawokha pa block yonse ya spine-1 switch ya Pod imodzi, ndi dongosolo lodziyimira palokha Pamwamba ponse. wa Nsalu. Sizovuta kuyang'ana ndikuwona kuti ngakhale khalidwe labwino la BGP limatipatsa kugawa zosintha zomwe tikufuna.
Mwachilengedwe, maadiresi ndi kuphatikizika kwa maadiresi kuyenera kupangidwa kuti zigwirizane ndi njira yopangira njira, kuti zitsimikizire kukhazikika kwa ndege yowongolera. Kulankhula kwa L3 pamayendedwe kumalumikizidwa ndi topology, chifukwa popanda izi sizingatheke kukwaniritsa kuphatikizika; popanda izi, ma adilesi amunthu amalowera munjira. Ndipo chinthu chinanso ndikuti kuphatikizika, mwatsoka, sikusakanikirana bwino ndi njira zambiri, chifukwa tikakhala ndi njira zambiri ndipo tili ndi ma aggregation, zonse zili bwino, maukonde onse ali abwino, palibe zolephera mmenemo. Mwatsoka, mwamsanga pamene zolephera kuonekera mu maukonde ndi symmetry wa topology watayika, tikhoza kufika pa mfundo imene unit analengezedwa, amene sitingathe kupita patsogolo kumene tiyenera kupita. Chifukwa chake, ndibwino kuphatikizira pomwe palibe njira zina zambiri, kwa ife awa ndi masiwichi a ToR.
Ndipotu, n'zotheka kusonkhanitsa, koma mosamala. Ngati titha kuchita kugawanika kolamuliridwa pamene kulephera kwa maukonde kumachitika. Koma iyi ndi ntchito yovuta kwambiri, tidadzifunsanso ngati zingatheke kuchita izi, ngati zingatheke kuwonjezera makina owonjezera, ndi makina otsika omwe angakankhire bwino BGP kuti apeze khalidwe lomwe mukufuna. Tsoka ilo, kukonza milandu yamakona ndizosadziwikiratu komanso zovuta, ndipo ntchitoyi siyikuthetsedwa bwino polumikiza zolumikizira zakunja ku BGP.
Ntchito yosangalatsa kwambiri pankhaniyi yachitika mkati mwa dongosolo la RIFT protocol, lomwe lidzakambidwe mu lipoti lotsatira.
Chinthu chinanso chofunikira ndi momwe ndege za data zimakulira muzithunzithunzi zowuma, pomwe tili ndi njira zina zambiri. Pankhaniyi, zida zingapo zowonjezera zimagwiritsidwa ntchito: Magulu a ECMP, omwe amafotokozanso magulu a Next Hop.
Mu maukonde omwe amagwira ntchito nthawi zonse, popanda zolephera, tikakwera pamwamba pa Clos topology, ndikwanira kugwiritsa ntchito gulu limodzi lokha, chifukwa chirichonse chomwe sichili chapafupi chikufotokozedwa mwachisawawa, tikhoza kukwera. Tikachoka pamwamba mpaka pansi kupita kumwera, ndiye kuti njira zonse si ECMP, ndi njira imodzi. Zonse zili bwino. Vuto ndiloti, ndipo chodabwitsa cha classic Clos topology ndikuti ngati tiyang'ana Pamwamba pa nsalu, pa chinthu chilichonse, pali njira imodzi yokha yopita ku chinthu chilichonse pansipa. Ngati zolephera zichitika m'njira iyi, ndiye kuti chinthu chomwe chili pamwamba pa fakitale chimakhala chosavomerezeka kwa ma prefixes omwe ali kuseri kwa njira yosweka. Koma kwa ena onse ndizovomerezeka, ndipo tiyenera kusiyanitsa magulu a ECMP ndikuyambitsa dziko latsopano.
Kodi scalability ya data scalability imawoneka bwanji pazida zamakono? Ngati tichita LPM (machesi amtali kwambiri), chilichonse ndichabwino, kupitilira ma prefixes 100k. Ngati tikukamba za magulu a Next Hop, ndiye kuti zonse ndizoipa, 2-4 zikwi. Ngati tikukamba za tebulo lomwe lili ndi ndondomeko ya Next Hops (kapena adjacencies), ndiye kuti ndi penapake kuchokera 16k mpaka 64k. Ndipo izi zitha kukhala zovuta. Ndipo apa tidafika pakusiya kosangalatsa: zidachitikira MPLS m'malo opangira data? Kwenikweni, tinkafuna kutero.
Zinthu ziwiri zinachitika. Tidapanga magawo ang'onoang'ono pa makamu; sitinafunenso kutero pamaneti. Sizinali zabwino kwambiri ndi chithandizo chochokera kwa ogulitsa osiyanasiyana, komanso makamaka ndi kukhazikitsa kotseguka pamabokosi oyera okhala ndi MPLS. Ndipo MPLS, osachepera machitidwe ake achikhalidwe, mwatsoka, amaphatikizana bwino ndi ECMP. Ndi chifukwa chake.
Izi ndi momwe ECMP yotumizira ma IP imawonekera. Ma prefixes ambiri amatha kugwiritsa ntchito gulu lomwelo ndi chipika chofanana cha Next Hops (kapena ma adjacencies, izi zitha kutchedwa mosiyana muzolemba zosiyanasiyana za zida zosiyanasiyana). Chowonadi ndi chakuti izi zikufotokozedwa ngati doko lotuluka ndi zomwe mungalembenso adilesi ya MAC kuti mufike ku Next Hop yolondola. Kwa IP chirichonse chikuwoneka chophweka, mungagwiritse ntchito chiwerengero chachikulu cha ma prefixes a gulu lomwelo, chipika chofanana cha Next Hops.
Zomangamanga zapamwamba za MPLS zikutanthauza kuti, kutengera mawonekedwe omwe atuluka, chizindikirocho chikhoza kulembedwanso pamitundu yosiyanasiyana. Choncho, tiyenera kusunga gulu ndi Next Hops chipika pa lolowetsa aliyense. Ndipo izi, mwatsoka, sizimakula.
Ndizosavuta kuwona kuti pamapangidwe athu timafunikira masiwichi a 4000 ToR, m'lifupi mwake anali 64 ECMP njira, ngati tichoka ku msana-1 kupita ku msana-2. Sitimalowa patebulo limodzi lamagulu a ECMP, ngati chiyambi chimodzi chokha chokhala ndi ToR chikachoka, ndipo sitilowa mu tebulo la Next Hops konse.
Si zonse zopanda chiyembekezo, chifukwa zomanga ngati Segment Routing zimaphatikizapo zilembo zapadziko lonse lapansi. M'malo mwake, zitha kugwetsanso midadada yonseyi ya Next Hops. Kuti muchite izi, muyenera kugwiritsa ntchito mtundu wa khadi lakutchire: tengani chizindikiro ndikulembanso chimodzimodzi popanda mtengo wapadera. Koma mwatsoka, izi sizikupezeka muzokhazikitsidwa zomwe zilipo.
Ndipo potsiriza, tiyenera kubweretsa magalimoto akunja mu data center. Kodi kuchita izo? M'mbuyomu, magalimoto adayambitsidwa mu netiweki ya Clos kuchokera pamwamba. Ndiko kuti, panali ma routers am'mphepete omwe amalumikizana ndi zida zonse Pamwamba pa nsalu. Yankholi limagwira ntchito bwino pama size ang'onoang'ono mpaka apakatikati. Tsoka ilo, kuti titumize magalimoto molingana ndi maukonde onse motere, tiyenera kufika nthawi imodzi pazinthu zonse za Pamwamba pa nsalu, ndipo pakakhala zoposa zana, zimakhala kuti timafunikiranso lalikulu. radix m'mphepete mwa ma routers. Kawirikawiri, izi zimawononga ndalama, chifukwa ma routers a m'mphepete amagwira ntchito kwambiri, madoko pa iwo adzakhala okwera mtengo, ndipo mapangidwewo si okongola kwambiri.
Njira ina ndikuyambitsa magalimoto otere kuchokera pansipa. Ndizosavuta kutsimikizira kuti Clos topology imamangidwa m'njira yoti magalimoto obwera kuchokera pansi, ndiye kuti, kuchokera kumbali ya ToR, amagawidwa mofanana pakati pa milingo yonse ya Pamwamba pa nsalu ziwiri, ndikukweza maukonde onse. Chifukwa chake, tikuyambitsa mtundu wapadera wa Pod, Edge Pod, womwe umapereka kulumikizana kwakunja.
Pali njira inanso. Izi ndi zomwe Facebook imachita, mwachitsanzo. Amachitcha kuti Fabric Aggregator kapena HGRID. Mulingo wowonjezera wa msana ukuyambitsidwa kuti ulumikizane ndi ma data angapo. Mapangidwe awa ndi otheka ngati tilibe ntchito zowonjezera kapena kusintha kwa encapsulation pamawonekedwe. Ngati ali owonjezera kukhudza, ndi zovuta. Nthawi zambiri, pali ntchito zambiri komanso mtundu wa nembanemba wolekanitsa magawo osiyanasiyana a data center. Palibe chifukwa chopanga nembanemba yotereyi kukhala yayikulu, koma ngati ikufunikadi pazifukwa zina, ndiye kuti ndizomveka kulingalira kuthekera kochotsa, ndikupangitsa kuti ikhale yotakata ndikusamutsira kwa makamu. Izi zimachitika, mwachitsanzo, ndi ambiri ogwiritsa ntchito mitambo. Iwo ali ndi zokutira, amayambira makamu.
Ndi mwayi wanji wachitukuko womwe tikuwona? Choyamba, kukonza chithandizo cha payipi ya CI/CD. Tikufuna kuwuluka momwe timayesera ndikuyesa momwe timawulukira. Izi sizikuyenda bwino, chifukwa zomanga zake ndi zazikulu ndipo ndizosatheka kubwereza mayeso. Muyenera kumvetsetsa momwe mungayambitsire zinthu zoyesera muzopangapanga popanda kusiya.
Zida zabwinoko komanso kuyang'anira bwino sikukhala kofunikira. Funso lonse ndi kulinganiza khama ndi kubwerera. Ngati mungathe kuwonjezera ndi khama, zabwino kwambiri.
Tsegulani makina ogwiritsira ntchito pazida zamtaneti. Ma protocol abwinoko ndi njira zabwinoko zoyendera, monga RIFT. Kafukufuku amafunikiranso pakugwiritsa ntchito njira zabwino zowongolera kusokonekera komanso mwina kuyambitsa, mwina pazifukwa zina, kwa thandizo la RDMA mkati mwa tsango.
Kuyang'ana zamtsogolo, tikufunika ma topology apamwamba komanso mwina maukonde omwe amagwiritsa ntchito mopitilira muyeso. Pazinthu zatsopano, posachedwapa pakhala zofalitsa za teknoloji ya nsalu ya HPC Cray Slingshot, yomwe imachokera pa commodity Ethernet, koma ndi mwayi wogwiritsa ntchito mitu yaifupi kwambiri. Chifukwa chake, kuchuluka kwa shuga kumachepetsedwa.
Chilichonse chiyenera kukhala chophweka momwe zingathere, koma osati chophweka. Kuvuta ndi mdani wa scalability. Zosavuta komanso zokhazikika ndi anzathu. Ngati mungathe kukulitsa kwinakwake, chitani. Ndipo zambiri, ndikwabwino kutenga nawo gawo paukadaulo wapaintaneti tsopano. Pali zinthu zambiri zosangalatsa zomwe zikuchitika. Zikomo.
Source: www.habr.com