Micron Technology, lub tuam txhab DRAM thiab flash nco, tshiab cia cav (Heterogeneous-memory Storage Engine), tsim los rau hauv tus account qhov tshwj xeeb ntawm kev siv ntawm SSD drives raws li NAND flash (X100, TLC, QLC 3D NAND) lossis lub cim xeeb ruaj khov (NVDIMM). Lub cav yog tsim los ua ib lub tsev qiv ntawv rau embedding rau hauv lwm yam kev siv thiab txhawb kev ua cov ntaub ntawv nyob rau hauv cov ntaub ntawv tseem ceeb. HSE code yog sau rau hauv C thiab muaj ntawv tso cai nyob rau hauv Apache 2.0.
Ntawm thaj chaw ntawm daim ntawv thov ntawm lub cav, hais txog yog ua los ntawm cov ntaub ntawv qis qis hauv NoSQL DBMS, software khaws cia (SDS, Software-Defined Storage) xws li Ceph thiab Scality RING, platforms rau kev ua cov ntaub ntawv loj (Cov Ntaub Ntawv Loj) , kev ua tau zoo hauv kev ua haujlwm siab (HPC), Cov khoom siv hauv Is Taws Nem (IoT) thiab cov kev daws teeb meem rau tshuab kev kawm.
HSE yog optimized tsis tsuas yog rau siab tshaj plaws kev ua tau zoo, tab sis kuj rau lub neej ntev nyob rau hauv ib tug ntau yam ntawm SSD chav kawm. Kev ua haujlwm siab ceev tau ua tiav los ntawm cov qauv khaws cia hybrid - cov ntaub ntawv tseem ceeb tshaj plaws yog cached hauv RAM, uas txo cov naj npawb ntawm kev nkag mus rau lub tsav. Raws li ib qho piv txwv ntawm kev koom ua ke lub cav tshiab rau hauv cov haujlwm thib peb ib tug version ntawm cov ntaub ntawv-oriented DBMS MongoDB, txhais los siv HSE.
Technologically, HSE tso siab rau ib qho ntxiv kernel module , uas siv cov khoom tshwj xeeb cia interface rau cov khoom siv hauv xeev, suav nrog lawv cov peev xwm thiab cov yam ntxwv, uas tso cai rau koj kom tau txais cov txiaj ntsig sib txawv thiab cov yam ntxwv ua haujlwm ntev. Mpool kuj yog ib qho kev txhim kho ntawm Micron Technology, qhib tib lub sijhawm raws li HSE, tab sis tau muab cais ua ib txoj haujlwm ywj pheej. Mpool xav tias siv ΠΈ , tab sis tam sim no tsuas yog txhawb nqa SSDs ib txwm muaj.
Kev ntsuas kev ua tau zoo siv lub pob (Yahoo Cloud Serving Benchmark) tau pom tias muaj kev nce qib hauv kev ua tau zoo thaum siv 2 TB cia nrog ua 1 KB cov ntaub ntawv thaiv. Qhov tshwj xeeb tseem ceeb ntawm kev ua tau zoo yog pom nyob rau hauv qhov kev xeem nrog kev faib ua ke ntawm kev nyeem thiab sau cov haujlwm (kuaj "A" hauv daim duab).
Piv txwv li, MongoDB nrog lub cav HSE tau dhau los ua 8 npaug sai dua li cov qauv nrog tus qauv WiredTiger cav, thiab RocksDB DBMS tau nrawm dua li HSE lub cav ntau dua 6 zaug. Kev ua tau zoo kuj tseem pom nyob rau hauv cov kev ntsuam xyuas uas koom nrog 95% kev ua haujlwm nyeem thiab 5% hloov kho lossis txuas ntxiv ua haujlwm (kuaj "B" thiab "D" hauv daim duab). Test C, uas tsuas yog nyeem cov haujlwm xwb, qhia txog qhov nce ntawm kwv yees li 40%. Qhov nce hauv kev muaj sia nyob ntawm SSD drives thaum sau ntawv ua haujlwm piv rau kev daws teeb meem raws li RocksDB yog kwv yees li 7 zaug.
Cov yam ntxwv tseem ceeb ntawm HSE:
- Kev them nyiaj yug rau cov neeg ua haujlwm dav dav thiab txuas ntxiv rau kev tuav cov ntaub ntawv hauv hom tseem ceeb / tus nqi;
- Kev them nyiaj yug tag nrho rau kev lag luam thiab nrog lub peev xwm los cais cov khoom khaws cia los ntawm kev tsim cov snapshots (snapshots kuj tseem siv tau los tswj cov khoom ntiag tug hauv ib qho chaw cia);
- Muaj peev xwm siv tus cursors los hla cov ntaub ntawv hauv snapshot-based views;
- Cov ntaub ntawv qauv optimized rau cov khoom sib xyaw ua ke hauv ib qho chaw cia;
- Yooj yim cia kev cia siab rau kev tswj mechanisms;
- Customizable data orchestration schemes (kev faib tawm thoob plaws ntau hom kev nco tam sim no hauv kev cia);
- Lub tsev qiv ntawv nrog C API uas tuaj yeem txuas mus rau txhua daim ntawv thov;
- Muaj peev xwm ntsuas txog terabytes ntawm cov ntaub ntawv thiab ntau pua lab tus yuam sij hauv kev cia;
- Kev ua tau zoo ntawm ntau txhiab kev ua haujlwm sib luag;
- Qhov tseem ceeb nce ntxiv, txo latency thiab nce kev sau ntawv / nyeem ntawv rau ntau hom kev ua haujlwm piv rau cov qauv kev daws teeb meem;
- Lub peev xwm siv SSD drives ntawm cov chav kawm sib txawv hauv ib qho chaw cia kom ua tau zoo thiab ua haujlwm ntev.
Tau qhov twg los: opennet.ru