ProHoster > Blog > internet nhau > Reiser5 inozivisa rutsigiro rweBurst Buffers (Data Tiering)

Reiser5 inozivisa rutsigiro rweBurst Buffers (Data Tiering)

Eduard Shishkin yakaziviswa mikana mitsva yakagadzirwa mukati megadziriro yeReiser5 chirongwa. Reiser5 is a yakagadziridzwa zvakanyanya vhezheni yeReiserFS faira system, umo tsigiro yeinoenderana scalable zvine musoro mavhoriyamu inoshandiswa padanho refaira refaira, kwete nhanho yemudziyo we block, ichikubvumidza kuti unyatso kugovera data pane inonzwisisika vhoriyamu.

Pakati pezvinhu zvitsva zvakagadzirwa munguva pfupi yapfuura, kugoverwa kwe
mukana wekuti mushandisi awedzere diki yepamusoro-kuita
block mudziyo (semuenzaniso NVRAM) inonzi proxy disk, to
vhoriyamu yakakura zvine musoro inoumbwa neinononoka
bhajeti inotyaira. Izvi zvinogadzira fungidziro yekuti zvese
vhoriyamu inoumbwa neiyo yakafanana inodhura yepamusoro-kuita
zvishandiso, se "proxy disk".

Iyo yakashandiswa nzira yaive yakavakirwa pakutarisa kuri nyore kuti mukuita dhisiki haina kunyorerwa nguva dzose, uye iyo I / O inotakura curve ine chimiro chepamusoro. Mukati mepakati pakati pe "peaks" dzakadaro, nguva dzose zvinogoneka kugadzirisa zvakare data kubva kune proxy disk, kunyora zvakare data rese (kana chikamu chete) kumashure kune chikuru, "chinononoka" chekuchengetedza. Nokudaro, proxy disk inogara yakagadzirira kugamuchira chikamu chitsva che data.

Iyi nzira (inozivikanwa seBurst Buffers) yakatanga muna
nzvimbo dzepamusoro performance computing (HPC). Asi zvakazoitikawo kuti zviri kudiwa kune zvakajairwa zvikumbiro, kunyanya kune izvo zvinowedzera zvinodikanwa pakuvimbika kwedata (kazhinji marudzi akasiyana emadatabase). Zvishandiso zvakadaro zvinoita chero shanduko mune chero faira nenzira yeatomu, inoti:

  • kutanga, faira idzva rinogadzirwa rine data rakachinjwa;
  • iyi faira itsva inobva yanyorwa ku diski uchishandisa fsync (2);
  • mushure meizvozvo iyo faira itsva inotumidzwa kune yekare, iyo inongoitika
    Mahara mabhuroki akagarwa nedata rekare.

    Matanho ese aya, kune imwe nhanho kana imwe, anokonzera kukosha
    kukanganisa kwekuita pane chero faira system. Mamiriro ezvinhu
    inovandudza kana faira idzva rakatanga kunyorwa kune rakagoverwa
    high-performance device, ndizvo chaizvo zvinoitika mukati
    faira system ine Burst Buffers rutsigiro.

    MuReiser5 yakarongwa kutumira nesarudzo kwete chete
    mabhuroko matsva ane musoro efaira, asiwo ese mapeji akasviba zvakazara. Uyezve,
    kwete chete mapeji ane data, asiwo nemeta data iyo
    zvakanyorwa mumatanho (2) uye (3).

    Kutsigira kweproxy disks kunoitwa mumamiriro ekushanda nguva dzose ne
    Reiser5 inonzwisisika mavhoriyamu, zvakaziviswa pakutanga kwegore. Kureva kuti,
    iyo aggregate system "proxy disk - main storage" yakajairika
    zvine musoro vhoriyamu nemusiyano chete uri wekuti proxy disk ine yekutanga
    pakati pezvimwe zvikamu zvevhoriyamu mudhisiki yekugovera kero mutemo.

    Kuwedzera proxy disk kune inonzwisisika vhoriyamu haina kuperekedzwa nechero
    data rebalancing, uye kubviswa kwayo kunoitika nenzira imwecheteyo
    kubvisa dhisiki yenguva dzose. Yese proxy disk mashandiro ari atomu.
    Kukanganisa kubata uye kutumira sisitimu (kusanganisira mushure mekuparara kwehurongwa) kunoitika nenzira imwecheteyo sekunge proxy disk yaive chikamu chenguva dzose.
    inzwi rine musoro.

    Mushure mekuwedzera proxy disk, huwandu hwese hwehuwandu hunonzwisisika
    inowedzera nekugona kweiyi dhisiki. Yemahara nzvimbo yekutarisa
    proxy disk inoitwa nenzira yakafanana kune zvimwe zvikamu zvevhoriyamu, i.e. uchishandisa volume.reiser4(8) utility.

    Iyo proxy disk inofanira kucheneswa nguva nenguva, i.e. reset data kubva
    iyo kudura guru. Mushure mekusvika beta kugadzikana Reiser5
    kuchenesa kwakarongwa kuve otomatiki (ichatungamirwa ne
    yakakosha kernel thread). Panguva ino, mutoro wekuchenesa
    inozorora nemushandisi. Kugadzirisa zvakare data kubva kune proxy disk kuenda kune iyo huru
    kuchengetedza kunogadzirwa nekungodaidza volume.reiser4 utility nesarudzo
    "-b". Senharo, iwe unofanirwa kutsanangura nzvimbo yekukwira yezvinonzwisisika
    mavhoriyamu Zvechokwadi, unofanira kuyeuka kuita kuchenesa nguva nenguva. For
    Iwe unogona kunyora nyore shell script kuti uite izvi.

    Kana pasina nzvimbo yemahara pane proxy disk, data rese
    zvinonyorerwa otomatiki kudura guru. Panguva imwecheteyo, nekusingaperi
    kushanda kwese kweFS kwakaderedzwa (nekuda kwekufona nguva dzose
    nzira dzekuita zvese zviripo). Optionally unogona kuseta
    mode pasina kurasikirwa kwekuita. Zvisinei, munyaya iyi disk
    Iyo proxy mudziyo nzvimbo ichashandiswa zvishoma zvine hungwaru.
    Zviri nyore kushandisa metadata subsection (zvidhina) seproxy disk, kunze kwekunge yakagadzirwa pane inokwana yepamusoro-inoshanda block mudziyo.

    Source: opennet.ru

    • Voeg