Injini yotsegulira ya Micron yotsegulira ya HSE yokonzedwera SSD

Micron Technology, kampani ya DRAM ndi flash memory, прСдставила injini yatsopano yosungira HSE (Heterogeneous-memory Storage Engine), yopangidwa poganizira momwe amagwiritsidwira ntchito pama drive a SSD kutengera NAND flash (X100, TLC, QLC 3D NAND) kapena kukumbukira kosatha (NVDIMM). Injiniyo idapangidwa ngati laibulale yolowera muzinthu zina ndipo imathandizira kukonza deta mumtundu wamtengo wapatali. Khodi ya HSE imalembedwa mu C ndi wogawidwa ndi zololedwa pansi pa Apache 2.0.

Pakati pa madera omwe amagwiritsira ntchito injiniyo, kutchulidwa kumapangidwira kusungirako deta ku NoSQL DBMS, zosungirako mapulogalamu (SDS, Software-Defined Storage) monga Ceph ndi Scality RING, nsanja zopangira deta yambiri (Big Data) , makina apakompyuta apamwamba kwambiri (HPC), zida zapaintaneti za zinthu (IoT) ndi mayankho pamakina ophunzirira makina.

HSE imakongoletsedwa osati kuti igwire bwino ntchito, komanso kuti ikhale ndi moyo wautali m'makalasi osiyanasiyana a SSD. Kuthamanga kwakukulu kumatheka kudzera mu mtundu wosungirako wosakanizidwa - deta yofunikira kwambiri imasungidwa mu RAM, yomwe imachepetsa kuchuluka kwa magalimoto. Monga chitsanzo chophatikizira injini yatsopano m'ma projekiti a chipani chachitatu okonzeka mtundu wa DBMS MongoDB wopangidwa ndi zolemba, wotanthauziridwa kugwiritsa ntchito HSE.

Mwaukadaulo, HSE imadalira gawo lowonjezera la kernel mpool, yomwe imagwiritsa ntchito mawonekedwe apadera osungira zinthu zamagalimoto olimba, poganizira za kuthekera kwawo ndi mawonekedwe awo, zomwe zimakulolani kuti mupeze magwiridwe antchito komanso kulimba kosiyanasiyana. Mpool ndi chitukuko cha Micron Technology, chotsegulidwa nthawi imodzi ndi HSE, koma chopatulidwa kukhala projekiti yodziyimira payokha. Mpool akuganiza ntchito kukumbukira kosalekeza ΠΈ zonal yosungirako, koma pakadali pano imathandizira ma SSD achikhalidwe.

Kuyesa magwiridwe antchito pogwiritsa ntchito phukusi Mtengo wa YCSB (Yahoo Cloud Serving Benchmark) idawonetsa kuwonjezeka kwakukulu kwa magwiridwe antchito mukamagwiritsa ntchito 2 TB yosungirako ndikukonza midadada 1 KB. Kuwonjezeka kwakukulu kwa magwiridwe antchito kumawonedwa pakuyesa ndikugawa kofanana kwa ntchito zowerengera ndi kulemba (kuyesa "A" pa graph).

Mwachitsanzo, MongoDB yokhala ndi injini ya HSE inakhala yothamanga pafupifupi 8 kuposa mtundu wa WiredTiger wokhazikika, ndipo RocksDB DBMS inali yachangu kuposa injini ya HSE nthawi zopitilira 6. Kuchita bwino kumawonekeranso pamayesero omwe amaphatikizapo 95% kuwerenga ntchito ndi 5% kusintha kapena kuwonjezera ntchito (mayeso "B" ndi "D" m'magrafu). Mayeso C, omwe amangowerenga kokha, akuwonetsa kupindula pafupifupi 40%. Kuwonjezeka kwa kupulumuka kwa ma drive a SSD panthawi yolemba ntchito poyerekeza ndi yankho lochokera pa RocksDB akuyerekezedwa kukhala nthawi 7.

Injini yotsegulira ya Micron yotsegulira ya HSE yokonzedwera SSD

Injini yotsegulira ya Micron yotsegulira ya HSE yokonzedwera SSD

Zinthu zazikulu za HSE:

  • Thandizo kwa ogwira ntchito okhazikika komanso owonjezera pakukonza deta mumtundu wa kiyi / mtengo;
  • Thandizo lathunthu pazogulitsa komanso kuthekera kolekanitsa magawo osungira kudzera pakupanga zithunzithunzi (zithunzithunzi zitha kugwiritsidwanso ntchito kusunga zosonkhanitsira zodziyimira pawokha posungira chimodzi);
  • Kutha kugwiritsa ntchito zolozera kuti mudutse deta muzowonera pazithunzi;
  • Deta chitsanzo wokometsedwa kwa osakaniza katundu mitundu posungira limodzi;
  • Njira zosinthika zoyendetsera kudalirika kosungirako;
  • Makonda opangira ma data (kugawa pamitundu yosiyanasiyana yamakumbukiro yomwe ilipo posungira);
  • Laibulale yokhala ndi C API yomwe imatha kulumikizana ndi pulogalamu iliyonse;
  • Kutha kukula mpaka ma terabytes a data ndi mazana mabiliyoni a makiyi posungira;
  • Kukonzekera koyenera kwa zikwi za ntchito zofanana;
  • Kuwonjezeka kwakukulu kwa kupititsa patsogolo, kuchepetsedwa kwa latency ndi kuwonjezeka kwa kulemba / kuwerenga ntchito zamitundu yosiyanasiyana ya ntchito poyerekeza ndi njira zina zothetsera mavuto;
  • Kutha kugwiritsa ntchito ma drive a SSD amakalasi osiyanasiyana posungira kumodzi kuti mukwaniritse magwiridwe antchito komanso kulimba.

Injini yotsegulira ya Micron yotsegulira ya HSE yokonzedwera SSD

Source: opennet.ru

Kuwonjezera ndemanga