Iqela leenjineli ezivela kwi-MIT liphuhlise i-hierarchy yememori ejoliswe kwinto yokusebenza kunye nedatha ngokufanelekileyo. Kwinqaku siza kuqonda indlela esebenza ngayo.
/ /PD
Njengoko kusaziwa, ukonyuka kokusebenza kwee-CPU zanamhlanje akukhatshwa kukuhla okuhambelanayo kwe-latency xa ufikelela kwimemori. Umahluko kutshintsho lwezalathisi ukusuka kunyaka ukuya kunyaka ungafikelela kumaxesha ali-10 (). Ngenxa yoko, kuvela i-bottleneck evimbela ukusetyenziswa ngokupheleleyo kwezibonelelo ezikhoyo kunye nokunciphisa ukucutshungulwa kwedatha.
Umonakalo wokusebenza ubangelwa yinto ebizwa ngokuba yi-decompression delay. Kwezinye iimeko, ulungiso lwedatha olulungisiweyo lungathatha ukuya kuma-64 imijikelo yeprosesa.
Uthelekiso: ukudibanisa kunye nokuphindaphinda amanani amanqaku adadayo imijikelo engekho ngaphezulu kweshumi. Ingxaki kukuba imemori isebenza kunye neebhloko zedatha yesayizi esisigxina, kwaye izicelo zisebenza kunye nezinto ezinokuquka iintlobo ezahlukeneyo zedatha kwaye zihluke ngobukhulu ukusuka komnye nomnye. Ukusombulula ingxaki, iinjineli e-MIT zaphuhlisa uluhlu lwememori olujolise kwinto ekhulisa ukusetyenzwa kwedatha.
Indlela iteknoloji isebenza ngayo
Isisombululo sisekelwe kwiiteknoloji ezintathu: iiHotpads, iZippads kunye ne-COCO compression algorithm.
IiHotpads luluhlu olulawulwa yisoftware lwenkumbulo ebhalisiweyo enesantya esiphezulu.). Ezi rejista zibizwa ngokuba yi-pads kwaye zintathu kuzo - ukusuka kwi-L1 ukuya kwi-L3. Bagcina izinto ezinobukhulu obahlukeneyo, imethadatha kunye nemigca yesalathisi.
Ngokusisiseko, i-architecture yinkqubo ye-cache, kodwa ilungiselelwe ukusebenza ngezinto. Umgangatho wepadi into ekuyo ixhomekeke kwindlela esetyenziswa ngayo rhoqo. Ukuba elinye lamanqanaba "liphuphuma," inkqubo iqala indlela efana "nabaqokeleli benkunkuma" kwiilwimi zeJava okanye zeGo. Ihlalutya ukuba zeziphi izinto ezisetyenziswa kancinci kancinci kunezinye kwaye izihambisa ngokuzenzekelayo phakathi kwamanqanaba.
I-Zippads isebenza phezu kwee-Hotpads-i-archives kunye nedatha engagcinwanga engena okanye eshiya amanqanaba amabini okugqibela e-hierarchy - i-L3 pad kunye nememori ephambili. Ipads yokuqala neyesibini igcina idatha ingatshintshwanga.
Ii-Zippads zicinezela izinto ezinobukhulu obungagqithiyo kwi-128 bytes. Izinto ezinkulu zohlulwe zibe ziinxalenye, ezithi ke zibekwe kwiindawo ezahlukeneyo zememori. Njengoko abaphuhlisi bebhala, le ndlela yokwandisa i-coefficient yememori esetyenziswa ngokufanelekileyo.
Ukucinezela izinto, i-algorithm ye-COCO (Cross-Object COmpression) isetyenzisiwe, esiza kuxoxa ngayo kamva, nangona inkqubo inokusebenza nayo. okanye . I-algorithm ye-COCO luhlobo loxinzelelo olwahlukileyo (). Ithelekisa izinto "kwisiseko" kwaye isuse amasuntswana aphindwe kabini - jonga umzobo ongezantsi:
Ngokutsho kweenjineli ezivela kwi-MIT, i-hierarchy yememori ejoliswe kwinto eyi-17% inemveliso ngakumbi kuneendlela zakudala. Isondele kakhulu kuyilo kuyilo lwezicelo zanamhlanje, ngoko ke indlela entsha inamandla.
Kulindeleke ukuba iinkampani ezisebenza ngedatha enkulu kunye ne-algorithms yokufunda koomatshini ziya kuqala ukusebenzisa iteknoloji kuqala. Olunye ulwalathiso olunokubakho ngamaqonga elifu. Ababoneleli be-IaaS baya kukwazi ukusebenza ngokufanelekileyo ngokubonakalayo, iinkqubo zokugcina idatha kunye nezixhobo zekhompyutha.
Izibonelelo zethu ezongezelelweyo kunye nemithombo:
umthombo: www.habr.com