Ithimba lonjiniyela abavela ku-MIT lenze uhlelo lwenkumbulo egxile entweni ukuze lusebenze nedatha ngempumelelo kakhulu. Esihlokweni sizoqonda ukuthi isebenza kanjani.
/ /PD
Njengoba kwaziwa, ukwanda kokusebenza kwama-CPU anamuhla akuhambisani nokuncipha okuhambisanayo kokubambezeleka lapho ufinyelela inkumbulo. Umehluko ekushintsheni kwezinkomba unyaka nonyaka ungaba izikhathi eziyi-10 (). Ngenxa yalokho, kuvela ibhodlela elivimbela ukusetshenziswa ngokugcwele kwezinsiza ezitholakalayo futhi libambezele ukucutshungulwa kwedatha.
Ukulimala kokusebenza kubangelwa lokho okubizwa ngokuthi ukubambezeleka kokucindezela. Kwezinye izimo, ukumiswa kwedatha okulungiselelwe kungathatha imijikelezo yokucubungula engu-64.
Ukuze uqhathanise: ukuhlanganisa nokuphindaphindeka kwezinombolo zamaphuzu antantayo imijikelezo engekho ngaphezu kweshumi. Inkinga ukuthi inkumbulo isebenza namabhulokhi edatha anosayizi ogxilile, futhi izinhlelo zokusebenza zisebenza ngezinto ezingaqukatha izinhlobo ezahlukene zedatha futhi zihluke ngosayizi ukusuka kwenye. Ukuze kuxazululwe inkinga, onjiniyela kwa-MIT bathuthukise i-memory egxile entweni ethuthukisa ukucutshungulwa kwedatha.
Indlela ubuchwepheshe obusebenza ngayo
Isixazululo sisekelwe kubuchwepheshe obuthathu: Ama-Hotpad, ama-Zippad kanye ne-COCO compression algorithm.
Ama-Hotpad ayisizinda esilawulwa yisoftware sememori ebhalisiwe enesivinini esikhulu (). Lawa marejista abizwa ngama-pads futhi akhona amathathu - ukusuka ku-L1 kuya ku-L3. Bagcina izinto ezinosayizi abahlukene, imethadatha nemigqa yesikhombi.
Empeleni, i-architecture iyisistimu ye-cache, kodwa elungiselelwe ukusebenza nezinto. Izinga lephedi into ekuyo lincike ekutheni isetshenziswa kaningi kangakanani. Uma elinye lamazinga "lichichima," isistimu iqala indlela efana "nabaqoqi bakadoti" ngezilimi ze-Java noma ze-Go. Ihlaziya ukuthi yiziphi izinto ezisetshenziswa kancane kunezinye futhi izihambisa ngokuzenzakalelayo phakathi kwamaleveli.
Ama-Zippad asebenza phezu kwama-Hotpad - izingobo zomlando kanye nedatha egciniwe engena noma eshiya amaleveli amabili okugcina ohlelo - i-L3 pad kanye nenkumbulo eyinhloko. Iphedi yokuqala neyesibili igcina idatha ingashintshiwe.
Ama-Zippad acindezela izinto usayizi wazo ongadluli amabhayithi angu-128. Izinto ezinkulu zihlukaniswa zibe izingxenye, ezibe sezibekwa ezindaweni ezihlukahlukene zenkumbulo. Njengoba abathuthukisi bebhala, le ndlela inyusa i-coefficient yememori esetshenziswe ngempumelelo.
Ukuze ucindezele izinto, i-algorithm ye-COCO (Cross-Object COmpression) isetshenziswa, esizoxoxa ngayo kamuva, nakuba uhlelo lungasebenza nalo. noma . I-algorithm ye-COCO iwuhlobo lokucindezelwa okuhlukile (). Iqhathanisa izinto "nesisekelo" futhi isuse izingcezu eziyimpinda - bona umdwebo ongezansi:
Ngokusho konjiniyela abavela ku-MIT, isigaba sabo senkumbulo egxile entweni sikhiqiza kakhulu ngo-17% kunezindlela zakudala. Isondele kakhulu ekuklanyeni ekwakhiweni kwezinhlelo zokusebenza zesimanje, ngakho-ke indlela entsha inamandla.
Kulindeleke ukuthi izinkampani ezisebenza ngedatha enkulu kanye nama-algorithms wokufunda komshini zizoqala ukusebenzisa ubuchwepheshe kuqala. Esinye isiqondiso esingase sibe khona izinkundla zamafu. Abahlinzeki be-IaaS bazokwazi ukusebenza ngokuphumelelayo nge-virtualization, izinhlelo zokugcina idatha kanye nezinsiza zekhompyutha.
Izinsiza zethu ezengeziwe nemithombo:
Source: www.habr.com