I-Micron evulelekileyo kwi-HSE injini yokugcina elungiselelwe i-SSD

I-Micron Technology, i-DRAM kunye nenkampani yememori ye-flash, thaca injini entsha yokugcina HSE (I-Heterogeneous-memory Storage Engine), eyilwe ngokuthathela ingqalelo iinkcukacha zokusetyenziswa kwi-SSD drives esekelwe kwi-NAND flash (X100, TLC, QLC 3D NAND) okanye imemori esisigxina (NVDIMM). I-injini iyilwe njengethala leencwadi lokuzinzisa kwezinye izicelo kwaye ixhasa ukusetyenzwa kwedatha kwifomathi yexabiso elingundoqo. Ikhowudi ye-HSE ibhalwe kwi-C kunye isasazwa ngu ilayisenisi phantsi kweApache 2.0.

Phakathi kwemimandla yesicelo se-injini, ukukhankanywa kwenziwa kwizinga eliphantsi lokugcinwa kwedatha kwi-NoSQL DBMS, i-software storages (SDS, i-Software-Defined Storage) njenge-Ceph kunye ne-Scality RING, iiplatifomu zokucubungula inani elikhulu ledatha (iDatha enkulu) , ii-high-performance computing systems (HPC), izixhobo ze-Intanethi zezinto (IoT) kunye nezisombululo zeenkqubo zokufunda koomatshini.

I-HSE ayilungiselelwanga kuphela ukusebenza okuphezulu, kodwa kwanobomi obude kuzo zonke iindidi zeeklasi ze-SSD. Isantya esiphezulu sokusebenza sifezekiswa ngemodeli yokugcina i-hybrid - eyona datha ifanelekileyo igcinwe kwi-RAM, enciphisa inani lokufikelela kwi-drive. Njengomzekelo wokudibanisa injini entsha kwiiprojekthi zomntu wesithathu zilungisiwe uguqulelo lwe-DBMS MongoDB ejolise kuxwebhu, eguqulelwe ukusebenzisa i-HSE.

Ngokwetekhnoloji, i-HSE ixhomekeke kwimodyuli yekernel eyongezelelweyo mpool, osebenzisa ujongano olukhethekileyo lokugcina into kwi-slid-state drives, kuthathelwa ingqalelo amandla abo kunye neempawu, ezikuvumela ukuba ufumane ngokusisiseko ukusebenza okwahlukileyo kunye neempawu zokuqina. I-Mpool ikwaluphuhliso lwe-Micron Technology, evulwa ngaxeshanye ne-HSE, kodwa yahlulwe yaba yiprojekthi yeziseko ezingundoqo ezizimeleyo. I-Mpool ithatha ukusetyenziswa inkumbulo ezingisayo и indawo yokugcina indawo, kodwa okwangoku ixhasa kuphela ii-SSD zemveli.

Uvavanyo lokusebenza usebenzisa iphakheji YCSB (I-Yahoo Cloud Serving Benchmark) ibonise ukunyuka okuphawulekayo ekusebenzeni xa usebenzisa i-2 TB yokugcina kunye nokucubungula iibhloko zedatha ye-1 KB. Ukwandiswa kwentsebenzo okubalulekileyo ngokukodwa kubonwa kuvavanyo kunye nokuhanjiswa okufanayo kwemisebenzi yokufunda nokubhala (uvavanyo "A" kwigrafu).

Ngokomzekelo, i-MongoDB ene-injini ye-HSE yajika ibe malunga namaxesha e-8 ngokukhawuleza kune-version ene-injini ye-WiredTiger eqhelekileyo, kwaye i-RocksDB DBMS yayikhawuleza kune-injini ye-HSE ngaphezu kwamaxesha e-6. Ukusebenza okugqwesileyo kuyabonakala nakwiimvavanyo ezibandakanya i-95% yemisebenzi yokufunda kunye ne-5% yokuguqula okanye ukudibanisa imisebenzi (uvavanyo "B" kunye no "D" kwiigrafu). Uvavanyo C, olubandakanya imisebenzi yokufunda kuphela, lubonisa inzuzo emalunga nama-40%. Ukunyuka kokusinda kwe-SSD drives ngexesha lokubhala imisebenzi xa kuthelekiswa nesisombululo esisekelwe kwi-RocksDB kuqikelelwa ukuba ngamaxesha e-7.

Iimpawu eziphambili zeHSE:

• Inkxaso yabaqhubi abasemgangathweni kunye nokwandisiweyo ukusetyenzwa kwedatha kwifomathi engundoqo / yexabiso;
• Inkxaso epheleleyo yeentengiselwano kunye nokukwazi ukuhlukanisa izilayi zokugcina ngokudala ii-snapshots (i-snapshots ingasetyenziselwa ukugcina iqoqo elizimeleyo kwindawo yokugcina);
• Ukukwazi ukusebenzisa i-cursors ukunqumla idatha kwiimbono ezisekelwe kwi-snapshot;
• Imodeli yedatha elungiselelwe iindidi zomthwalo oxubeneyo kwindawo yokugcina enye;
• Iindlela eziguquguqukayo zokulawula ukuthembeka kokugcinwa;
• Izicwangciso ze-orchestration yedatha eyenziwe ngokwezifiso (ukusasazwa kwiindidi ezahlukeneyo zememori ezikhoyo kwindawo yokugcina);
• Ithala leencwadi elineC API enokuthi idibanise ngokuguquguqukayo kuso nasiphi na isicelo;
• Ukukwazi ukukala kwii-terabytes zedatha kunye namakhulu eebhiliyoni zezitshixo kwindawo yokugcina;
• Ukusetyenzwa ngokufanelekileyo kwamawaka emisebenzi efanayo;
• Ukunyuka okuphawulekayo kwi-throughput, ukunciphisa i-latency kunye nokunyuka kokubhala / ukufunda ukusebenza kwiindidi ezahlukeneyo zomsebenzi xa kuthelekiswa nezisombululo ezizezinye eziqhelekileyo;
• Ukukwazi ukusebenzisa iidrives ze-SSD kwiiklasi ezahlukeneyo kwindawo yokugcina ukunyusa ukusebenza kunye nokuqina.

umthombo: opennet.ru