ProHoster > Блог > labaran intanet > Reiser5 ya ba da sanarwar tallafi ga Burst Buffers (Tiering Data)

Reiser5 ya ba da sanarwar tallafi ga Burst Buffers (Tiering Data)

Eduard Shishkin sanar sabbin damar da aka haɓaka a cikin tsarin aikin Reiser5. Reiser5 ne mai wani muhimmin fasalin tsarin fayil na ReiserFS, wanda aka aiwatar da tallafi don daidaitattun ƙididdiga masu ma'ana a matakin tsarin fayil, maimakon matakin toshe na'urar, yana ba ku damar rarraba bayanai da kyau a cikin ƙarar ma'ana.

Daga cikin sababbin abubuwan da aka haɓaka kwanan nan, samar da
damar ga mai amfani don ƙara ƙaramin aiki mai girma
toshe na'urar (misali NVRAM) da ake kira faifan wakili, to
in mun gwada da girman ma'ana mai girma wanda ya hada da jinkirin
kasafin kudin tafiyarwa. Wannan zai haifar da ra'ayi cewa duk
juz'i na kunshe da irin wannan tsada mai tsada
na'urori, kamar "faifan wakili".

Hanyar da aka aiwatar ta dogara ne akan sauƙi mai sauƙi cewa a aikace ba a rubuta faifai zuwa kullun ba, kuma nauyin nauyin I / O yana da siffar kololuwa. A cikin tazara tsakanin irin waɗannan "kololuwa", koyaushe yana yiwuwa a sake saita bayanai daga faifan wakili, sake rubuta duk bayanan (ko ɓangaren kawai) a bango zuwa babban, ajiyar "jinkirin". Don haka, faifan wakili koyaushe yana shirye don karɓar sabon ɓangaren bayanai.

Wannan dabarar (wanda aka sani da Burst Buffers) ta samo asali ne a ciki
yankunan babban aikin kwamfuta (HPC). Amma kuma ya zama ana buƙatar aikace-aikacen yau da kullun, musamman ga waɗanda ke sanya ƙarin buƙatu akan amincin bayanan (yawanci nau'ikan bayanai daban-daban). Irin waɗannan aikace-aikacen suna yin kowane canje-canje a kowane fayil ta hanyar atomic, wato:

  • na farko, an ƙirƙiri sabon fayil wanda ya ƙunshi bayanan da aka canza;
  • Ana rubuta wannan sabon fayil ɗin zuwa diski ta amfani da fsync(2);
  • bayan haka sabon fayil ɗin an sake suna zuwa tsohon, wanda ke atomatik
    Yantar da tubalan da tsofaffin bayanai ke shagaltar da su.

    Duk waɗannan matakan, zuwa mataki ɗaya ko wani, suna haifar da mahimmanci
    lalacewar aiki akan kowane tsarin fayil. Halin da ake ciki
    yana inganta idan an fara rubuta sabon fayil ɗin zuwa wanda aka keɓe
    na'ura mai girma, wanda shine ainihin abin da ke faruwa a ciki
    tsarin fayil tare da tallafin Burst Buffers.

    A cikin Reiser5 an shirya don aikawa da zaɓi ba kawai ba
    sabon tubalan ma'ana na fayil, amma kuma duk dattin shafuka gabaɗaya. Haka kuma,
    ba kawai shafuka masu bayanai ba, har ma tare da bayanan meta waɗanda
    an rubuta a matakai (2) da (3).

    Ana gudanar da goyan bayan faifan wakili a cikin mahallin aiki na yau da kullun tare da
    Reiser5 kundin ma'ana, sanar a farkon shekara. Wato,
    tsarin tsarin "proxy disk - main storage" al'ada ne
    Ƙararren ma'ana tare da kawai bambanci shine cewa faifan wakili yana da fifiko
    a tsakanin sauran abubuwan ƙararrawa a cikin manufofin rarraba adireshin faifai.

    Ƙara faifan wakili zuwa ƙarar ma'ana baya tare da kowa
    sake daidaita bayanai, kuma cire shi yana faruwa a daidai wannan hanyar
    cire faifai na yau da kullun. Duk ayyukan faifan wakili na atomic ne.
    Kuskuren kulawa da tura tsarin (ciki har da bayan faɗuwar tsarin) yana faruwa daidai daidai da faifan wakili na yau da kullun
    ma'ana girma.

    Bayan ƙara faifan wakili, jimillar ƙarfin ƙarar ma'ana
    yana ƙaruwa da ƙarfin wannan faifai. Saka idanu na sarari kyauta
    Proxy disk ana yin su ne kamar yadda ake yi da sauran abubuwan da ake haɗa ƙara, watau. amfani da volume.reiser4(8) mai amfani.

    Dole ne a tsaftace faifan wakili lokaci-lokaci, watau. sake saita bayanai daga
    shi zuwa babban ajiya. Bayan samun kwanciyar hankali na beta Reiser5
    Ana shirya tsaftacewa ta atomatik (za'a sarrafa ta
    zaren kernel na musamman). A wannan mataki, alhakin tsaftacewa
    ya rage tare da mai amfani. Sake saitin bayanai daga faifan wakili zuwa babba
    Ana samar da ajiya ta hanyar kawai kiran mai amfani volume.reiser4 tare da zaɓi
    "-b". A matsayin gardama, kuna buƙatar ƙayyade wurin ɗorawa na ma'ana
    juzu'i Tabbas, dole ne ku tuna don aiwatar da tsaftacewa lokaci-lokaci. Domin
    Kuna iya rubuta rubutun harsashi mai sauƙi don yin wannan.

    Idan babu sarari kyauta akan faifan wakili, duk bayanai
    ana rubuta su ta atomatik zuwa babban ma'ajiyar. A lokaci guda, ta tsohuwa
    An rage yawan aikin FS (saboda akai-akai kira
    hanyoyin aiwatar da duk ma'amaloli da ke akwai). Zabi zaka iya saita
    yanayin ba tare da asarar aiki ba. Duk da haka, a cikin wannan harka da faifai
    Za a yi amfani da sararin na'urar wakili da ƙasa yadda ya kamata.
    Ya dace a yi amfani da ƙaramin sashe na metadata (bulo) azaman faifan wakili, in dai an ƙirƙira shi akan isasshe na'urar toshewa mai girma.

    source: budenet.ru

    • Add a comment