Reiser5 yalengeza kuthandizira kwa Burst Buffers (Data Tiering)

Eduard Shishkin adalengeza mwayi watsopano wopangidwa mkati mwa polojekiti ya Reiser5. Reiser5 ndi mtundu wokonzedwanso kwambiri wa fayilo ya ReiserFS, momwe kuthandizira kwa ma voliyumu omveka ofananirako kumayendetsedwa pamlingo wamafayilo, m'malo mwa mulingo wa chipangizo cha block, kukulolani kugawa bwino deta pa voliyumu yomveka.

Pakati pazatsopano zomwe zachitika posachedwa, kuperekedwa kwa
mwayi wogwiritsa ntchito kuwonjezera kachitidwe kakang'ono kapamwamba
chipika chipangizo (mwachitsanzo NVRAM) wotchedwa proxy disk, ku
voliyumu yayikulu yomveka yopangidwa mochedwa
zoyendetsa bajeti. Izi zidzapanga chithunzi kuti onse
voliyumu imapangidwa ndi zokwera mtengo zomwezo
zipangizo, monga "proxy disk".

Njira yomwe idakhazikitsidwa idakhazikitsidwa pakuwona kosavuta kuti muzochita diski sinalembedwe nthawi zonse, ndipo mayendedwe a I / O ali ndi mawonekedwe a nsonga. Pakapita nthawi pakati pa "nsonga" zotere, nthawi zonse zimakhala zotheka kukonzanso deta kuchokera ku proxy disk, kulembanso deta yonse (kapena gawo lokhalo) kumbuyo kumalo osungirako, "ochedwa". Chifukwa chake, diski ya proxy nthawi zonse imakhala yokonzeka kulandira gawo latsopano la data.

Njira iyi (yotchedwa Burst Buffers) idayambira
madera a high performance computing (HPC). Koma zidapezekanso kuti zikufunika kugwiritsa ntchito wamba, makamaka kwa omwe amawonjezera zofunikila pa kukhulupirika kwa data (nthawi zambiri mitundu yosiyanasiyana ya nkhokwe). Ntchito zotere zimapanga kusintha kulikonse mu fayilo iliyonse mwanjira ya atomiki, yomwe ndi:

  • choyamba, fayilo yatsopano idapangidwa yomwe ili ndi data yosinthidwa;
  • Fayilo yatsopanoyi imalembedwa ku disk pogwiritsa ntchito fsync (2);
  • pambuyo pake fayilo yatsopanoyo imasinthidwa kukhala yakale, yomwe imakhala yokha
    Frees midadada wotanganidwa ndi akale deta.

    Masitepe onsewa, kumlingo wina kapena umzake, amachititsa chidwi
    kuwonongeka kwa magwiridwe antchito pamafayilo aliwonse. Mkhalidwe
    zimasintha ngati fayilo yatsopanoyo idalembedwa koyamba kwa yomwe yaperekedwa
    chipangizo chochita bwino kwambiri, zomwe ndizomwe zimachitika
    fayilo yokhala ndi chithandizo cha Burst Buffers.

    Mu Reiser5 ikukonzekera kutumiza osati kokha
    midadada zatsopano zomveka za fayilo, komanso masamba onse akuda. Komanso,
    osati masamba okha omwe ali ndi data, komanso ndi meta data
    amalembedwa m’masitepe (2) ndi (3).

    Thandizo la ma disks a proxy ikuchitika pakugwira ntchito nthawi zonse ndi
    Reiser5 voliyumu zomveka, adalengeza kumayambiriro kwa chaka. Ndiko kuti,
    aggregate system "proxy disk - main storage" ndi yachilendo
    voliyumu yomveka ndi kusiyana kokhako ndikuti proxy disk ndiyofunika kwambiri
    pakati pa zigawo zina za voliyumu mu ndondomeko yogawa adilesi ya disk.

    Kuwonjezera diski ya proxy ku voliyumu yomveka sikutsatizana ndi iliyonse
    deta rebalancing, ndi kuchotsa kwake kumachitika chimodzimodzi monga
    kuchotsa disk wamba. Ntchito zonse za proxy disk ndi atomiki.
    Kuwongolera zolakwika ndi kutumizidwa kwadongosolo (kuphatikiza pambuyo pakuwonongeka kwadongosolo) kumachitika chimodzimodzi monga ngati disk ya proxy inali gawo lanthawi zonse.
    voliyumu yomveka.

    Pambuyo powonjezera disk proxy, mphamvu yonse ya voliyumu yomveka
    kuchuluka ndi kuchuluka kwa diski iyi. Kuwunika kwaulere kwa danga
    proxy disk ikuchitika mofanana ndi zigawo zina za voliyumu, i.e. pogwiritsa ntchito chida cha volume.reiser4(8).

    Proxy disk iyenera kutsukidwa nthawi ndi nthawi, i.e. bwererani deta kuchokera
    izo ku malo osungira. Pambuyo pofika kukhazikika kwa beta Reiser5
    kuyeretsa kumakonzedwa kuti zizingochitika zokha (zidzayendetsedwa ndi
    ulusi wapadera wa kernel). Panthawi imeneyi, udindo kuyeretsa
    imakhala ndi wogwiritsa ntchito. Kukhazikitsanso data kuchokera pa proxy disk kupita ku main
    yosungirako imapangidwa ndikungoyitanitsa chida cha volume.reiser4 ndi mwayi
    "-b". Monga mkangano, muyenera kufotokoza phiri la zomveka
    mabuku Inde, muyenera kukumbukira kuyeretsa nthawi ndi nthawi. Za
    Mutha kulemba chipolopolo chosavuta kuti muchite izi.

    Ngati palibe malo aulere pa proxy disk, deta yonse
    amalembedwa zokha ku kosungirako. Pa nthawi yomweyo, mwa kusakhulupirika
    ntchito yonse ya FS imachepetsedwa (chifukwa cha kuyimba kosalekeza
    ndondomeko zochitira zochitika zonse zomwe zilipo). Mukasankha mutha kukhazikitsa
    mode popanda kutaya ntchito. Komabe, mu nkhani iyi disk
    Malo a chipangizo cha proxy adzagwiritsidwa ntchito bwino.
    Ndikosavuta kugwiritsa ntchito kagawo kakang'ono ka metadata (njerwa) ngati diski ya proxy, malinga ngati idapangidwa pa chipangizo cha block chogwira ntchito kwambiri.

    Source: opennet.ru

  • Kuwonjezera ndemanga