Rudzi rutsva rwekuchengetedza SSD runoderedza kushandiswa kwesimba munzvimbo yedata - kuti inoshanda sei

Iyo system ichaderedza mari yemagetsi nehafu.

Rudzi rutsva rwekuchengetedza SSD runoderedza kushandiswa kwesimba munzvimbo yedata - kuti inoshanda sei
/ mufananidzo Andy Melton CC BY-SA

Sei tichida chivakwa chitsva?

Zvinoenderana neData Center Dynamics fungidziroPakazosvika 2030, zvigadzirwa zvemagetsi zvichapedza 40% yesimba rose rinogadzirwa panyika. Inenge 20% yevhoriyamu iyi ichauya kubva kuIT sector uye data centers. By kupihwa Maererano nevaongorori veEurope, nzvimbo dze data dzatove "dzinobvisa" 1,4% yemagetsi ose. Zvinotarisirwa kuti izvi huwandu huchakwira kusvika ku5% panosvika 2020.

SSD kuchengetedza inoshandisa chikamu chakakosha chemagetsi. Munguva kubva 2012 kusvika 2017, chikamu cheyakasimba-state madhiraivha munzvimbo dzedata. yakawedzera kubva pa8 kusvika ku22%.. Kunyangwe maSSD achidya rechitatu simba shoma (PDF, peji 13) kupfuura HDD, mabhiri emagetsi anoramba akakura pachiyero che data data.

Kudzikisa mashandisirwo emagetsi eakasimba-nyika madhiraivha munzvimbo yedata, mainjiniya kubva kuMIT vakagadzira itsva SSD yekuchengetedza dhizaini. Inodaidzwa kuti LightStore uye inokutendera kuti ubatanidze madhiraivha zvakananga kune data center network, nekupfuura ekuchengetedza maseva. By maererano vanyori, hurongwa huchaderedza mari yemagetsi nehafu.

Sei basa iri

LightStore ndeye flash kiyi-kukosha chitoro iyo inomepu zvikumbiro zvevashandisi kudhiraivha sekiyi. Ivo vanobva vatumirwa kune server, iyo inoburitsa iyo data yakabatana nekiyi iyoyo.

maitiro rine yakavakirwa-mukati simba-inoshanda processor, DRAM uye NAND ndangariro. Inodzorwa nemutongi uye yakakosha software. Mutongi ane basa rekushanda neNAND arrays, uye software ine basa rekugadzirisa zvikumbiro zveKV uye kuchengetedza makiyi maviri. Iyo software yekuvaka inovakwa pahwaro LSM miti, iyo inoshandiswa mumaDBMS akawanda emazuva ano.

Iyo dhizaini yekuvaka inogona kumiririrwa seizvi:

Rudzi rutsva rwekuchengetedza SSD runoderedza kushandiswa kwesimba munzvimbo yedata - kuti inoshanda sei

Iyo dhizaini inoratidza zvakakosha zvikamu zveLightStore. A node cluster inoshanda pakiyi-value pairs. Masevha ekushandisa akabatanidzwa kune system achishandisa adapters. Ivo vanoshandura zvikumbiro zvevatengi (senge fread() kubva kuPOSIX API) kuita KV zvikumbiro. Iyo dhizaini zvakare ine yakaparadzana adapta ye YCSB, block (yakavakirwa paBUSE module) uye faira storages.

Pakugovera zvikumbiro, adapta inoshandisa kuenderana hashing. Inoshandiswa mumasisitimu akaita seRedis kana Swift. Uchishandisa kiyi yekukumbira yeKV, adapta inogadzira kiyi yehashi iyo kukosha kwayo kunozivisa iyo inotangwa node.

Kugona kweLightStore cluster zviyero zvine mutsetse - ingobatanidza mamwe manodhi kunetiweki. Mune zvimwe zviitiko, ungangoda kutenga switch nyowani. Nekudaro, ivo vanogadzira vakashongedza imwe neimwe node nekuwedzera slots yekubatanidza NAND chips.

Architecture kugona

MIT mainjiniya vanoti iyo LightStore-yakavakirwa mhinduro ine throughput ye620 Mbps pamusoro pegumi Gigabit Ethernet. Imwe node inoshandisa gumi W panzvimbo peyakajairwa 10 W (muSSD masisitimu anoshandiswa nedata data nhasi). Mukuwedzera, iyo midziyo inotora hafu yenzvimbo.

Iye zvino vagadziri vari kupedzisa zvimwe zvinhu. Semuenzaniso, LightStore haigone kushanda nemhando yemibvunzo uye midiki mibvunzo. Aya maficha achawedzerwa mune ramangwana, sezvo LightStore inoshandisa LSM miti. Zvakare, iyo sisitimu ichine yakaganhurwa seti yeadapta - YCSB uye block adapter zvinotsigirwa. Mune ramangwana, LightStore ichakwanisa kugadzirisa SQL mibvunzo, nezvimwe.

Zvimwe zviitiko

Muzhizha ra2018, Marvell, kambani yekusimudzira yekuchengetedza, yakaunza mutsara mutsva weSDD controllers yakavakirwa paAI masisitimu. Vagadziri vakabatanidza NVIDIA yakadzama yekudzidza accelerators mune yakajairwa controller yedata data uye vatengi maapplication. Nekuda kweizvozvo, vakagadzira dhizaini-yega iyo inoshandisa simba shoma kana ichienzaniswa neyekare SSD controllers. Iyo kambani inotarisira kuti iyo sisitimu ichawana application mumucheto komputa, hombe data analytics uye IoT.

Iyo Western Digital Blue mutsara wemadhiraivha ichangobva kuvandudzwa. Muna Kubvumbi, vanogadzira vakapa mhinduro - iyo WD Blue SSD yakavakirwa paSanDisk tekinoroji, iyo WD yakawana gore rapfuura. Iyo yakagadziridzwa WD Blue SSDs inopa yakagadziridzwa kuita uye kushanda nesimba. Iyo dhizaini yakavakirwa pahwaro hweiyo yakatarwa NVMe, iyo inopa mukana kune SSD dzakabatana kuburikidza nePCI Express.

Iyi tsanangudzo inovandudza kushanda kweSSD dhiraivha nehuwandu hukuru hwezvikumbiro panguva imwe chete uye inomhanyisa kuwana data. Pamusoro pezvo, NVMe inobvumidza iwe kumisikidza iyo SSD interface - yakawanda kune vanogadzira hardware hapana chikonzero chekupambadza zviwanikwa yekuvandudzwa kweakasarudzika madhiraivha, majoini uye fomu zvinhu.

Matarisiro

Iyo data centre SSD musika iri kufamba yakanangana neyakareruka dhizaini, otomatiki yezvinhu zvekuchengetera, uye kuwedzera simba kwesimba. Kuvandudzwa kwemainjiniya kubva kuMIT kunogadzirisa dambudziko rekupedzisira. Vanyori count onkuti LightStore ichave iyo indasitiri chiyero cheSSD yekuchengetedza munzvimbo dzedata. Uye isu tinogona kufungidzira kuti mune ramangwana nyowani, kunyange yakanyatso dhizaini yekuvaka ichaonekwa yakavakirwa pairi.

Zvishandiso zvakati wandei kubva kune Yekutanga blog nezve corporate IaaS:

Source: www.habr.com

Voeg