I-Micron Open Code HSE Storage Engine Elungiselelwe ama-SSD

I-Micron Technology, inkampani ye-DRAM kanye ne-flash memory, kwethulwe injini entsha yokugcina I-HSE (Heterogeneous-memory Storage Engine), yakhelwe kucatshangelwa imininingwane yokusetshenziswa kumadrayivu e-SSD asekelwe ku-NAND flash (X100, TLC, QLC 3D NAND) noma inkumbulo engapheli (NVDIMM). Injini yakhelwe njengomtapo wolwazi ukuze ishumekwe kwezinye izinhlelo zokusebenza futhi isekela ukucubungula idatha ngefomethi yenani elingukhiye. Ikhodi ye-HSE ibhalwe ngo-C kanye isatshalaliswa ngu ilayisensi ngaphansi kwe-Apache 2.0.

Phakathi kwezindawo zokusetshenziswa kwenjini, kukhulunywa ngokugcinwa kwedatha okusezingeni eliphansi ku-NoSQL DBMS, ama-software storages (SDS, Software-Defined Storage) afana ne-Ceph ne-Scality RING, amapulatifomu okucubungula inani elikhulu ledatha (Big Data) , ama-high-performance computing systems (HPC), Amadivayisi e-Inthanethi yezinto (IoT) nezixazululo zezinhlelo zokufunda zomshini.

I-HSE ayilungiselelwe ukusebenza okuphezulu kuphela, kodwa futhi nokuphila isikhathi eside kuwo wonke amakilasi e-SSD. Ijubane eliphezulu lokusebenza lifinyelelwa ngemodeli yesitoreji esiyingxubevange - idatha ebaluleke kakhulu igcinwe ku-RAM, okunciphisa inani lokufinyelela kudrayivu. Njengesibonelo sokuhlanganisa injini entsha kumaphrojekthi ezinkampani zangaphandle zilungisiwe inguqulo ye-DBMS MongoDB egxile kumadokhumenti, ehunyushwe ukuze kusetshenziswe i-HSE.

Ngokobuchwepheshe, i-HSE incike kumojula ye-kernel eyengeziwe mpool, esebenzisa isixhumi esibonakalayo esikhethekile sokugcinwa kwento kumadrayivu e-solid-state, kucatshangelwa amandla awo nezici, okukuvumela ukuthi uthole izici zokusebenza ezihluke kakhulu nokuhlala isikhathi eside. I-Mpool futhi iwukuthuthukiswa kweMicron Technology, evulwa ngesikhathi esifanayo ne-HSE, kodwa ihlukaniswe yaba iphrojekthi yengqalasizinda ezimele. UMpool uthatha ukusetshenziswa inkumbulo eqhubekayo и izindawo zokugcina izindawo, kodwa okwamanje isekela kuphela ama-SSD endabuko.

Ukuhlolwa kokusebenza kusetshenziswa iphakheji I-YCSB (I-Yahoo Cloud Serving Benchmark) ibonise ukukhuphuka okukhulu ekusebenzeni lapho kusetshenziswa isitoreji esingu-2 TB ngokucubungula amabhulokhi edatha angu-1 KB. Ukwenyuka kokusebenza okuphawulekayo kubonakala esivivinyweni ngokusabalalisa okufanayo kokusebenza kokufunda nokubhala (ukuhlola okuthi “A” kugrafu).

Isibonelo, i-MongoDB enenjini ye-HSE ivele yashesha izikhathi ezingaba ngu-8 kunenguqulo enenjini evamile ye-WiredTiger, futhi i-RocksDB DBMS yayishesha kunenjini ye-HSE izikhathi ezingaphezu kwezingu-6. Ukusebenza okuhle kakhulu kubonakala ezivivinyweni ezibandakanya u-95% wokufundwayo kanye no-5% guqula noma wengeze imisebenzi (ukuhlola okuthi “B” kanye “no-D” kumagrafu). Ukuhlolwa C, okubandakanya imisebenzi yokufunda kuphela, kubonisa inzuzo elinganiselwa ku-40%. Ukwanda kokusinda kwamadrayivu e-SSD ngesikhathi sokusebenza kokubhala uma kuqhathaniswa nesixazululo esisekelwe ku-RocksDB kulinganiselwa ukuthi kube izikhathi ezingu-7.

Izici ezibalulekile ze-HSE:

• Ukusekelwa kwama-opharetha ajwayelekile nanwetshiwe ukuze kucutshungulwe idatha ngefomethi yokhiye/inani;
• Ukusekelwa okugcwele kokwenziwe kanye nekhono lokuhlukanisa izingcezu zesitoreji ngokudala izifinyezo (izifinyezo zingasetshenziswa futhi ukugcina amaqoqo azimele endaweni eyodwa yokugcina);
• Ikhono lokusebenzisa izikhombisi ukuze unqamule idatha ekubukweni okusekelwe esifinyezweni;
• Imodeli yedatha elungiselelwe izinhlobo zomthwalo oxubile endaweni yokubeka eyodwa;
• Izindlela eziguquguqukayo zokuphatha ukuthembeka kwesitoreji;
• Izikimu ze-orchestration zedatha ezenziwe ngendlela oyifisayo (ukusatshalaliswa ezinhlotsheni ezahlukene zememori ezikhona kusitoreji);
• Umtapo wolwazi one-C API engaxhuma ngokuguqukayo kunoma yiluphi uhlelo lokusebenza;
• Ikhono lokukala ukuya kuma-terabytes wedatha kanye namakhulu ezigidigidi zokhiye endaweni yokugcina;
• Ukucutshungulwa okusebenzayo kwezinkulungwane zemisebenzi efanayo;
• Ukwenyuka okuphawulekayo komphumela, ukubambezeleka okuncishisiwe kanye nokusebenza okwandisiwe kokubhala/ukufunda kwezinhlobo ezihlukahlukene zomthwalo womsebenzi uma kuqhathaniswa nezinye izixazululo ezivamile;
• Ikhono lokusebenzisa amadrayivu e-SSD amakilasi ahlukene kusitoreji esisodwa ukuze kuthuthukiswe ukusebenza nokuqina.

Source: opennet.ru