Yandex tau qhib cov cai rau kev faib DBMS YDB uas txhawb SQL

Yandex tau tshaj tawm cov cai ntawm kev faib DBMS YDB, uas siv kev txhawb nqa rau SQL lus thiab ACID kev lag luam. DBMS tau tsim los ntawm kos thiab tau pib tsim nrog lub qhov muag kom ntseeg tau tias muaj kev zam txim, tsis siv neeg rov qab los ntawm kev ua tsis tiav thiab scalability. Nws tau raug sau tseg tias Yandex tau pib ua haujlwm YDB pawg, suav nrog ntau dua 10 cov nodes, khaws cia ntau pua ntawm cov ntaub ntawv petabytes thiab ua haujlwm ntau lab ntawm kev faib khoom ib ob. YDB yog siv nyob rau hauv xws li Yandex tej yaam num xws li Kev Lag Luam, Huab, Ntse Tsev, Alice, Metrica thiab Auto.ru. Cov cai tau sau rau hauv C / C ++ thiab muab faib raws li Apache 2.0 daim ntawv tso cai. Rau kev paub thiab kev tshaj tawm sai, koj tuaj yeem siv lub thawv Docker npaj txhij.

Cov yam ntxwv ntawm qhov project:

  • Siv cov ntaub ntawv sib raug zoo nrog cov ntxhuav. Rau cov lus nug thiab txhais cov ntaub ntawv schema, YQL lus (YDB Query Language) yog siv, uas yog ib hom lus ntawm SQL yoog rau kev ua haujlwm nrog cov ntaub ntawv loj loj. Thaum tsim ib lub tswv yim cia, ib pawg ntoo zoo li cov ntxhuav tau txais kev txhawb nqa, nco txog cov npe hauv cov ntaub ntawv. API yog muab rau kev ua haujlwm nrog cov ntaub ntawv hauv JSON hom.
    Yandex tau qhib cov cai rau kev faib DBMS YDB uas txhawb SQL
  • Kev them nyiaj yug rau cov ntaub ntawv nkag mus siv cov lus nug scan tsim los ua cov lus nug ad-hoc ntawm cov ntaub ntawv, ua tiav hauv hom nyeem nkaus xwb thiab xa rov qab cov kwj ntawm grpc.
  • Kev cuam tshuam nrog DBMS thiab xa cov lus thov yog ua tiav siv cov kab hais kom ua interface, built-in web interface lossis YDB SDK, uas muab cov tsev qiv ntawv rau C ++, C# (.NET), Mus, Java, Node.js, PHP thiab Python.
  • Lub peev xwm los tsim cov teeb meem tsis raug cai uas txuas ntxiv ua haujlwm thaum ib tus neeg disks, nodes, racks thiab txawm tias cov chaw zov me nyuam tsis ua haujlwm. YDB txhawb nqa kev xa tawm thiab synchronous replication hauv peb thaj chaw muaj, tswj kev ua haujlwm ntawm pawg hauv qhov xwm txheej tsis ua haujlwm ntawm ib cheeb tsam.
  • Yuav rov qab los ntawm kev ua tsis tiav nrog tsawg latency rau daim ntawv thov thiab cia li tswj cov ntaub ntawv teev tseg redundancy.
  • Tsis siv neeg tsim cov indexes raws li lub hauv paus tseem ceeb thiab lub peev xwm los txhais cov indexes theem nrab los txhim kho cov kev ua tau zoo ntawm kev nkag mus rau txhua kab.
  • Kab rov tav scalability. Raws li kev thauj khoom thiab qhov loj ntawm cov ntaub ntawv khaws cia loj tuaj, pawg tuaj yeem nthuav dav los ntawm tsuas yog txuas cov nodes tshiab. Lub laij lej thiab cov qib khaws cia tau sib cais, tso cai rau koj nthuav koj lub tshuab xam zauv thiab qhov chaw cia khoom sib cais. DBMS nws tus kheej saib xyuas qhov sib faib ntawm cov ntaub ntawv thiab thauj khoom, suav nrog cov khoom siv kho vajtse muaj. Nws muaj peev xwm xa mus rau thaj chaw faib kev teeb tsa uas suav nrog ntau lub chaw cov ntaub ntawv hauv ntau qhov chaw ntawm lub ntiaj teb.
  • Txhawb nqa tus qauv muaj zog sib xws thiab ACID kev lag luam thaum ua cov lus nug uas nthuav dav ntau lub pob thiab cov ntxhuav. Txhawm rau txhim kho kev ua tau zoo, koj tuaj yeem xaiv lov tes taw kev kuaj xyuas qhov sib xws.
  • Tsis siv neeg cov ntaub ntawv replication, tsis siv neeg muab faib (partitioning, sharding) thaum loj los yog load nce, thiab tsis siv neeg load thiab cov ntaub ntawv ntsuas ntawm nodes.
  • Khaws cov ntaub ntawv ncaj qha rau ntawm cov khoom siv thaiv siv cov khoom siv PDisk thiab VDisk txheej. DSProxy sau rau saum VDisk, uas txheeb xyuas qhov muaj thiab cov yam ntxwv ua haujlwm ntawm cov disks txhawm rau tshem tawm lawv yog tias pom muaj teeb meem.
  • Saj zawg zog architecture uas tso cai rau koj los tsim ntau yam kev pabcuam saum toj kawg nkaus ntawm YDB, suav nrog cov cuab yeej thaiv virtual thiab cov kab txuas ntxiv. Kev tsim nyog rau ntau hom kev ua haujlwm, OLTP thiab OLAP (cov lus nug txheeb xyuas).
  • Kev them nyiaj yug rau multitenant thiab serverless configurations. Muaj peev xwm ntawm tus neeg siv khoom authentication. Cov neeg siv tuaj yeem tsim lawv cov pawg virtual thiab cov ntaub ntawv hauv ib qho kev sib koom ua ke, suav nrog kev siv cov peev txheej ntawm qib ntawm tus lej ntawm kev thov thiab cov ntaub ntawv loj, lossis los ntawm kev xauj / khaws qee cov khoom siv hauv computer thiab chaw cia.
  • Muaj peev xwm los teeb tsa lub neej ntawm cov ntaub ntawv kom tshem tawm cov ntaub ntawv tsis tu ncua.

Tau qhov twg los: opennet.ru

Ntxiv ib saib