Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Nyika yakaona yekutanga prototype yekuchengetedza chinhu muna 1996. Mumakore gumi, Amazon Web Services ichavhura Amazon S10, uye nyika ichatanga kupenga zvine hungwaru nenzvimbo yekero. Nekuda kwekushanda nemetadata uye kugona kwayo kuyera pasina kusagirira pasi pemutoro, kuchengetedza chinhu kwakakurumidza kuve chiyero cheakawanda makore ekuchengetedza data masevhisi, uye kwete izvozvo chete. Chimwe chinhu chakakosha ndechekuti inonyatso kukodzera kuchengetedza zvinyorwa uye mafaira akafanana asingawanzo shandiswa. Wese aibatanidzwa mukuchengetedza data akafara uye akapfeka tekinoroji nyowani mumaoko avo.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Asi runyerekupe rwevanhu rwakanga rwakazara nerunyerekupe rwekuti kuchengetedza chinhu kunongova makore makuru, uye kana iwe usingade mhinduro kubva kune vakarambwa capitalist, zvino zvichave zvakaoma kuita yako. Zvakawanda zvakatonyorwa nezve kuendesa gore rako pachako, asi hapana ruzivo rwakakwana rwuripo nezvekugadzira izvo zvinonzi S3-inoenderana mhinduro.

Nokudaro, nhasi tichaona kuti ndezvipi zvingasarudzwa zviripo "Kuti zviite sevanhu vakuru, kwete CEPH uye faira yakakura," tichaendesa imwe yacho, uye tichaongorora kuti zvose zvinoshanda here tichishandisa Veeam Backup & Replication. Inoti inotsigira kushanda neS3-inoenderana storages, uye isu tichange tichiyedza ichi chikumbiro.

Zvakadini nevamwe?

Ini ndinokurudzira kutanga nediki tarisiro yemusika uye sarudzo dzekuchengetedza chinhu. Mutungamiriri anozivikanwa uye akajairwa ndeyeAmazon S3. Vateveri vaviri vepedyo ndivo Microsoft Azure Blob Storage uye IBM Cloud Object Storage.

Ndizvo chete here? Chokwadi hapana vamwe vakwikwidzi here? Ehe, kune vakwikwidzi, asi vamwe vanoenda nenzira yavo, seGoogle Cloud kana Oracle Cloud Object Storage, nerutsigiro rusina kukwana rweS3 API. Vamwe vanoshandisa shanduro dzekare dzeAPI, seBaidu Cloud. Uye mamwe, seHitachi Cloud, anoda akakosha mantiki, ayo anozokonzera matambudziko ayo. Chero zvazvingaitika, munhu wese anofananidzwa neAmazon, iyo inogona kutorwa seye indasitiri chiyero.

Asi mu-on-premise mhinduro kune yakawanda sarudzo, saka ngatitaurei maitiro akakosha kwatiri. Muchidimbu, maviri chete akakwana: rutsigiro rweS3 API uye kushandiswa kwev4 kusaina. Ruoko pamwoyo, isu, semutengi weramangwana, tinongofarira mainterfaces ekudyidzana, uye isu hatifarire zvakanyanya mukicheni yemukati yenzvimbo yekuchengetera pachayo.

Mazhinji mhinduro anokodzera aya akareruka mamiriro. Semuenzaniso, classic corporate heavyweights:

  • DellEMC ECS
  • NetApp S3 StorageGrid
  • Nutanix Buckets
  • Yakachena Storage FlashBlade uye StorReduce
  • Huawei FusionStorage

Iko kune niche yezvese software mhinduro dzinoshanda kunze kwebhokisi:

  • Red Hat Ceph
  • SUSE Enterprise Storage
  • Cloudian

Uye kunyangwe avo vanoda kunyatso faira mushure megungano havana kugumbuka:

  • CEPH mune yayo yakachena chimiro
  • Minio (Linux vhezheni, nekuti kune yakawanda mibvunzo nezve Windows vhezheni)

Rondedzero iri kure nekupedzwa; inogona kukurukurwa mumashoko. Ingo usakanganwa kutarisa maitiro ehurongwa mukuwedzera kune API kuenderana isati yaitwa. Chinhu chekupedzisira chaunoda kurasikirwa neterabytes yedata nekuda kwekunamira mibvunzo. Saka usanyara nemiyedzo yemutoro. Kazhinji, software yese yevakuru inoshanda nehuwandu hwakawanda hwe data ine kanenge inoenderana mishumo. In case of Veeam pane purogiramu yose pakuongorora mutual, izvo zvinotibvumira kutaura nechivimbo kuenderana kwakazara kwezvigadzirwa zvedu nemichina chaiyo. Iri ratova basa renzira mbiri, kwete nguva dzose rinokurumidza, asi isu tiri kuramba tichiwedzera Pamazita yakaedzwa mhinduro.

Kuunganidza chimiro chedu

Ndinoda kutaura zvishoma nezvekusarudza chidzidzo chebvunzo.

Chekutanga, ndaida kutsvaga sarudzo yaizoshanda kunze kwebhokisi. Zvakanaka, kana kuti pamwe nemukana wakakura wekuti ichashanda pasina chikonzero chekuita mafambiro asina kufanira. Kutamba netamborini uye kurira nekoni muhusiku kunonakidza kwazvo, asi dzimwe nguva unoda kuti ishande ipapo. Uye kuvimbika kwese kwezvigadziriso zvakadaro kazhinji kwakakwira. Uye hongu, mweya we adventurism wakanyangarika matiri, takarega kukwira mumahwindo evakadzi vedu vanodikanwa, nezvimwewo (c).

Chechipiri, kutaura chokwadi, kudiwa kwekushanda nekuchengetedza chinhu kunomuka mumakambani akakura zvakaringana, saka iyi ndiyo nyaya chaiyo kana uchitarisa kune bhizinesi-nhanho mhinduro hazvinyare chete, asi zvinotokurudzirwa. Chero zvazvingava, ini handisati ndaziva nezvemienzaniso yemunhu wese ari kudzingwa basa nekuda kwekutenga mhinduro dzakadaro.

Kubva pane zvese zviri pamusoro, sarudzo yangu yakawira Dell EMC ECS Nharaunda Edition. Iyi ipurojekiti inonakidza, uye ndinoona zvakakodzera kukuudza nezvayo.

Chinhu chekutanga chinouya mupfungwa kana iwe ukaona iyo yekuwedzera Yenharaunda Edition - kuti iyi ingori kopi yeECS yakazara nezvimwe zvirambidzo zvinobviswa nekutenga rezinesi. Saka kwete!

Yeuka:

!!!Community Edition ipurojekiti yakaparadzana yakagadzirwa kuti iedzwe, uye isina rutsigiro rwehunyanzvi kubva kuna Dell!!
Uye haigone kushandurwa kuita ECS yakazara, kunyangwe iwe uchida chaizvo.

Ngatizvionei

Vanhu vazhinji vanotenda kuti Dell EMC ECS ingangoita mhinduro yakanaka kana iwe uchida kuchengetedza chinhu. Mapurojekiti ese ari pasi peiyo ECS mhando, kusanganisira yekutengeserana uye yemakambani, yakavakirwa pa github. Chimiro chenyasha kubva kuna Dell. Uye pamusoro pesoftware inomhanya pane yavo branded hardware, kune yakavhurika sosi vhezheni iyo inogona kuiswa mugore, pamushini chaiwo, mumudziyo, kana pane chero yako hardware. Tichitarisa kumberi, kune kunyange OVA vhezheni, yatichashandisa.
Iyo DELL ECS Nharaunda Edition pachayo i mini-vhezheni ye-yakazara-yakazara software inomhanya pane yakanzi Dell EMC ECS maseva.

Ndakaona misiyano ina mikuru:

  • Hapana encryption rutsigiro. Zvinonyadzisa, asi kwete kutsoropodza.
  • Fabric Layer isipo. Ichi chinhu chine basa rekuvaka masumbu, manejimendi zviwanikwa, zvigadziriso, kutarisa uye kuchengetedza Docker mifananidzo. Apa ndipo pazvatonyanya kugumbura, asi Dell anogonawo kunzwisiswa.
  • Mhedzisiro inosemesa yenzvimbo yapfuura: saizi yenode haigone kuwedzerwa mushure mekuiswa kwapera.
  • Hapana rubatsiro rwehunyanzvi. Ichi chigadzirwa chekuyedza, icho chisingarambidzwe kushandiswa mune zvidiki zvigadziriso, asi ini pachangu handingaedze kurodha mapetabytes e data rakakosha ipapo. Asi zvehunyanzvi hapana anogona kukumisa kuita izvi.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Chii chiri mushanduro huru?

Ngatifambei muEurope uye tifambe nemhinduro dze ironclad kuitira kuti tive nekunzwisisa kwakazara kweiyo ecosystem.

Ini handisi kuzosimbisa kana kuramba chirevo chekuti DELL ECS ndiyo yakanakisa pane-prem chinhu chekuchengetedza, asi kana uine chero chekutaura pamusoro penyaya iyi, ndichafara kuiverenga mumashoko. Zvirinani maererano neshanduro IDC MarketScape 2018 Dell EMC ane chivimbo pakati pevatungamiriri vashanu vemusika weOBS. Kunyange zvazvo cloud-based solutions isingafungidzirwe ipapo, iyi ihurukuro yakasiyana.

Kubva pane tekinoroji yekuona, ECS chinhu chekuchengetedza chinopa mukana kune data uchishandisa cloud storage protocol. Inotsigira AWS S3 uye OpenStack Swift. Kune mabhakiti anogonesa faira, ECS inotsigira NFSv3 yefaira-ne-faira kutumira.

Maitiro ekurekodha ruzivo haana kujairika, kunyanya mushure me classical block kuchengetedza masisitimu.

  • Kana data idzva rasvika, chinhu chitsva chinogadzirwa chine zita, iyo data pachayo, uye metadata.
  • Zvinhu zvakakamurwa kuita 128 MB chunks, uye chunk yega yega inonyorerwa kune matatu nodes kamwechete.
  • Iyo index file inovandudzwa, uko zviziviso nenzvimbo dzekuchengetera zvinorekodhwa.
  • Iyo faira regi (log yekupinda) inogadziridzwa uye zvakare inonyorerwa kune matatu node.
  • Mharidzo pamusoro pekubudirira kurekodha inotumirwa kune mutengi
    Ese makopi matatu e data akanyorwa zvakafanana. Kunyora kunoonekwa kwakabudirira chete kana makopi ese ari matatu akanyorwa zvinobudirira.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Kuverenga kuri nyore:

  • Mutengi anokumbira data.
  • Iyo index inotarisa panochengeterwa data.
  • Dhata inoverengwa kubva kune imwe node uye inotumirwa kune mutengi.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Kune akati wandei maseva pachawo, saka ngatitarisei kudiki Dell EMC ECS EX300. Inotanga kubva pa60TB, nekukwanisa kukura kusvika ku1,5PB. Uye mukoma wayo mukuru, iyo Dell EMC ECS EX3000, inobvumidza iwe kuchengeta yakawanda se8,6PB paraki.

Deploy

Nehunyanzvi, Dell ECS CE inogona kuiswa yakakura sezvaunoda. Chero zvazvingava, handina kuwana zvirambidzo zvakajeka. Nekudaro, zviri nyore kuita zvese kuyera nekugadzira iyo yekutanga node, yatinoda:

  • 8 vCPUs
  • 64GB RAM
  • 16GB yeOS
  • 1TB yakananga kuchengetedza
  • Kuburitswa kwekupedzisira kweCentOS kushoma

Iyi isarudzo yekuti kana iwe uchida kuisa zvese iwe pachako kubva pakutanga. Iyi sarudzo haina basa kwatiri, nekuti ... Ini ndichashandisa iyo OVA mufananidzo wekutumira.

Asi chero zvipi zvazvo, zvinodiwa zvakanyanya kuipa kunyange kune imwe node, uye kana iwe ukanyatsotevera tsamba yemutemo, iwe unoda node ina dzakadaro.

Nekudaro, vagadziri veECS CE vanogara munyika chaiyo, uye kuisirwa kunobudirira kunyangwe nenode imwe, uye zvidiki zvinodiwa ndezvi:

  • 4 vCPUs
  • 16 GB RAM
  • 16GB yeOS
  • 104 GB yekuchengetedza pachayo

Aya ndiwo zviwanikwa zvinodiwa kuendesa iyo OVA mufananidzo. Atova nehunhu uye hwechokwadi.

Iyo yekuisa node pachayo inogona kuwanikwa kubva kune mukuru github. Kune zvakare magwaro akadzama pane zvese-mu-imwe kutumirwa, asi iwe unogona zvakare kuverenga pane mukuru readthedocs. Naizvozvo, isu hatizogara mune zvakadzama pakuburitswa kweOVA, hapana manomano ipapo. Chinhu chikuru ndechekuti usati watanga, usakanganwa kuwedzera dhisiki kune vhoriyamu inodiwa, kana kubatanidza izvo zvinodiwa.
Isu tinotanga muchina, vhura iyo koni uye shandisa yakanakisa default zvitupa:

  • login: admin
  • password: ChangeMe

Zvadaro tinomhanya sudo nmtui uye gadzirisa network interface - IP / mask, DNS uye gedhi. Tichifunga kuti CentOS shoma haina net-zvishandiso, isu tinotarisa marongero kuburikidza ne ip addr.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Uye sezvo chete vakashinga vanokunda makungwa, tinoita yum update, mushure mezvo isu tinotangazve. Izvo chaizvo zvakachengeteka nekuti ... kutumirwa kwese kunoitwa kuburikidza nemabhuku ekutamba, uye ese akakosha docker mapakeji akavharirwa kune yazvino vhezheni.

Iye zvino yave nguva yekugadzirisa iyo yekuisa script. Hapana fancy windows kana pseudo UI yako - zvese zvinoitwa kuburikidza neyako yaunofarira mavara edhita. Nehunyanzvi, pane nzira mbiri: unogona kumhanyisa kuraira wega wega kana nekukurumidza kuvhura iyo videoploy configurator. Iyo inongovhura iyo config mu vim, uye kana yabuda ichatanga kuitarisa. Asi hazvifadze kurerutsa hupenyu hwako nemaune, saka ngatimhanye mimwe mirairo miviri. Kunyangwe izvi zvisina musoro, ndakakuyambira =)

Saka, ngatiite vim ECS-CommunityEdition/deploy.xml uye tiite shanduko shoma shoma kuitira kuti ECS itange kushanda. Rondedzero yemaparamita inogona kupfupikiswa, asi ndakazviita seizvi:

  • licensed_accepted: true Haufanire kuichinja, ipapo kana uchitumira uchakumbirwa kuti ugamuchire uye ucharatidzwa mutsara wakanaka. Zvichida iri rinotova zai reIsita.
    Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi
  • Uncomment iyo mitsetse autonames: uye tsika: Isa rimwechete raunoda zita reiyo node - hostname inotsiviwa naro panguva yekuisa maitiro.
  • install_node: 192.168.1.1 Taurai chaiyo IP yenode. Muchiitiko chedu, tinoratidza zvakafanana nenmtui
  • dns_domain: isa yako domain.
  • dns_servers: isa dns yako.
  • ntp_servers: unogona kutsanangura chero. Ndakatora yekutanga yandakasangana nayo kubva padziva 0.pool.ntp.org (yakava 91.216.168.42)
  • autonaming: tsika Kana ukasabvisa, mwedzi uchanzi Luna.
  • ecs_block_devices:
    / dev / sdb
    Nechimwe chikonzero chisingazivikanwe, panogona kunge paine chisipo chekuchengetedza block mudziyo /dev/vda
  • storage_pools:
    nhengo:
    192.168.1.1 Pano zvakare tinoratidza IP chaiyo yenodhi
  • ecs_block_devices:
    /dev/sdb Isu tinodzokorora kushanda kwekucheka michina isipo.

Kazhinji, iyo faira yese inotsanangurwa zvakadzama mukati zvinyorwa, asi ndiani achaiverenga munguva yakaoma kudaro. Inotiwo iyo shoma yakakwana ndeyekutsanangura IP uye mask, asi mulabhu yangu seti yakadai yakatanga zvisina kunaka, uye ndaifanira kuiwedzera kune yakataurwa pamusoro.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Mushure mokubuda mupepeti, unoda kumhanya update_deploy /home/admin/ECS-CommunityEdition/deploy.yml, uye kana zvinhu zvose zvikaitwa nemazvo, izvi zvichange zvichitaurwa zvakajeka.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Ipapo iwe uchiri kumhanyisa videoploy, kumirira kuti nharaunda igadzirise, uye iwe unogona kutanga kuisirwa pachako neova-step1 kuraira, uye mushure mekubudirira kwayo kupedzwa, iyo ova-step2 kuraira. Zvakakosha: usamise zvinyorwa nemaoko! Mamwe matanho anogona kutora nguva yakakura, anogona kusapedzwa pakuedza kwekutanga, uye anogona kutaridzika senge zvese zvaputsika. Chero zvazvingava, unofanirwa kumirira kuti script ipedze zvakasununguka. Pakupedzisira iwe unofanirwa kuona meseji yakafanana neiyi.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Iye zvino tinogona pakupedzisira kuvhura iyo WebUI control panel tichishandisa IP yatinoziva. Kana iyo gadziriso isina kuchinjwa padanho, iyo default account ichave mudzi/ChangeMe. Unogona kushandisa yedu S3-inoenderana chengetedzo ipapo ipapo. Inowanikwa pamadoko 9020 eHTTP, uye 9021 yeHTTPS. Zvekare, kana pasina chakachinjwa, ipapo access_key: object_admin1 uye secret_key: ChangeMeChangeMeChangeMeChangeMeChangeMe.

Asi ngatirege kunyanyozvitangira isu totanga muhurongwa.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Paunopinda mukati kekutanga, iwe unozomanikidzwa kushandura password yako kune inokwana, izvo chaizvo chaizvo. Dashboard huru yakanyatsojeka, saka ngatiitei chimwe chinhu chinonakidza pane kutsanangura zviri pachena metrics. Semuenzaniso, ngatigadzire mushandisi watichashandisa kuwana chengetedzo. Munyika yevanopa mabasa, ava vanonzi maroja. Izvi zvinoitwa mukati Manage> Vashandisi> Nyowani Chinhu Mushandisi

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Paunenge uchigadzira mushandisi, tinokumbirwa kuti titaure nzvimbo yezita. Nehunyanzvi, hapana chinotitadzisa kugadzira akawanda acho sekune vashandisi. Uye zvakasiyana. Izvi zvinokutendera kuti utore zviwanikwa wakazvimirira kune wega wega.

Naizvozvo, isu tinosarudza mabasa atinoda uye tinogadzira makiyi emushandisi. S3/Atmos ichandikwanira. Uye usakanganwa kuchengetedza kiyi πŸ˜‰

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Mushandisi akagadzirwa, ikozvino yave nguva yekugovera bhaketi kwaari. Enda kuManeja> Bucket uye zadza minda inodiwa. Zvose zviri nyore pano.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Iye zvino tine zvese zvakagadzirira kurwisa kushandiswa kweS3 yedu yekuchengetedza.

Kugadzira Veeam

Saka, sezvatinorangarira, imwe yekushandiswa kukuru kwekuchengetedza chinhu ndeyekuchengetwa kwenguva refu kwemashoko asingawanzo kuwanikwa. Muenzaniso wakakwana ndiko kudiwa kwekuchengeta backups kune iri kure saiti. MuVeeam Backup & Replication iyi ficha inonzi Capacity Tier.

Ngatitangei kumisa nekuwedzera yedu Dell ECS CE kune Veeam interface. PaBackup Infrastructure tab, tanga iyo Wedzera New Repository Wizard uye sarudza Chinhu Chekuchengetedza.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Ngatisarudze izvo zvese zvakatangira - S3 Inoenderana.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Muhwindo rinoonekwa, nyora zita raunoda uye enda kuAccount nhanho. Pano iwe unofanirwa kutsanangura iyo Service point mufomu https://your_IP:9021, dunhu rinogona kusiiwa sezvariri uye mushandisi akagadzirwa anogona kuwedzerwa. Sevha yegedhi inodiwa kana chengetedzo yako iri panzvimbo iri kure, asi iyi yatove musoro wekugadzirisa zvivakwa uye chinyorwa chakasiyana, saka unogona kuchiruka zvakachengeteka pano.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Kana zvese zvakatsanangurwa uye zvakagadziriswa nemazvo, yambiro nezvechitupa ichaonekwa uyezve hwindo rine bhaketi kwaunogona kugadzira folda yemafaira edu.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Isu tinofamba ne wizard kusvika kumagumo uye tinonakidzwa nemhedzisiro.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Nhanho inotevera ndeyekugadzira Scale-out Backup Repository, kana kuwedzera S3 yedu kune iripo - ichashandiswa seCapacity Tier yekuchengetedza zvinyorwa. Iko hakuna basa rekushandisa S3-inoenderana chengetedzo zvakananga, seyakajairwa repository, mukuburitswa kwazvino. Matambudziko akawanda kwazvo asiri pachena anoda kugadziriswa kuti izvi zviitike, asi zvese zvinogoneka.
Enda kune repository marongero uye gonesa Capacity Tier. Zvese zviri pachena ipapo, asi pane inonakidza nuance: kana iwe uchida kuti data rese ritumirwe kune chinhu chekuchengetedza nekukurumidza sezvinobvira, ingoisa kumazuva 0.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Mushure mekuenda nemuwizard, kana iwe usingade kumirira, unogona kudzvanya ctrl + RMB pane repository, nechisimba tanga basa reTiering uye tarisa magirafu achikambaira.

Chengetedza chinhu mukamuri yekuseri, kana Maitiro ekuve wako wega sevhisi

Ndizvo zvose ikozvino. Ndinofunga kuti ndakabudirira mubasa rekuratidza kuti block storage haisi kutyisa sezvinofungwa nevanhu. Hongu, kune zvigadziriso uye sarudzo dzengoro uye ngoro diki, asi haugone kuvhara zvese mune imwe chinyorwa. Saka ngatigovere ruzivo rwedu mumashoko.

Source: www.habr.com

Voeg