Dziko lapansi lidawona chiwonetsero choyamba chosungira zinthu mu 1996. M'zaka za 10, Amazon Web Services idzayambitsa Amazon S3, ndipo dziko lidzayamba kuchita misala mwadongosolo ndi malo adilesi. Chifukwa chogwira ntchito ndi metadata komanso kuthekera kwake kukwera popanda kutsika pansi, kusungirako zinthu mwachangu kunakhala muyezo wazinthu zambiri zosungira deta yamtambo, osati zokhazo. Chinthu china chofunikira ndi chakuti ndi yoyenera kusunga zolemba zakale ndi mafayilo ofanana omwe sagwiritsidwa ntchito kawirikawiri. Aliyense wokhudzidwa ndi kusungirako deta anasangalala ndi kuvala teknoloji yatsopano m'manja mwawo.
Koma mphekesera za anthu zinali zodzaza ndi mphekesera kuti kusungirako zinthu kumangokhudza mitambo ikuluikulu, ndipo ngati simukusowa mayankho kuchokera kwa ma capitalist otembereredwa, zidzakhala zovuta kwambiri kuti mupange zanu. Zambiri zalembedwa kale za kutumiza mtambo wanu, koma palibe chidziwitso chokwanira chokhudza kupanga zomwe zimatchedwa S3-compatible solutions.
Choncho, lero tiwona zomwe mungasankhe "Kuti zikhale ngati akuluakulu, osati CEPH ndi fayilo yaikulu," tidzatumiza imodzi mwa izo, ndipo tiyang'ana kuti zonse zimagwira ntchito pogwiritsa ntchito Veeam Backup & Replication. Imati imathandizira kugwira ntchito ndi zosungira zomwe zimagwirizana ndi S3, ndipo tikhala tikuyesa izi.
Nanga bwanji ena?
Ndikupangira kuti ndiyambe ndikuwonetsa pang'ono msika ndi zosankha zosungira zinthu. Mtsogoleri wodziwika bwino komanso wodziwika ndi Amazon S3. Otsatira awiri omwe ali pafupi kwambiri ndi Microsoft Azure Blob Storage ndi IBM Cloud Object Storage.
Ndizo zonse? Kodi palibenso mpikisano wina? Inde, pali opikisana nawo, koma ena amapita kwawo, monga Google Cloud kapena Oracle Cloud Object Storage, ndi chithandizo chosakwanira cha S3 API. Ena amagwiritsa ntchito mitundu yakale ya API, monga Baidu Cloud. Ndipo ena, monga Hitachi Cloud, amafunikira malingaliro apadera, omwe angayambitse zovuta zawo. Mulimonsemo, aliyense amafanizidwa ndi Amazon, yomwe imatha kuonedwa ngati muyezo wamakampani.
Koma pamayankho apanyumba pali zosankha zambiri, kotero tiyeni tifotokoze zomwe zili zofunika kwa ife. Kwenikweni, ziwiri zokha ndizokwanira: kuthandizira S3 API ndi kugwiritsa ntchito v4 kusaina. Dzanja pamtima, ife, monga kasitomala wam'tsogolo, timangokonda zolumikizirana, ndipo sitikhala ndi chidwi ndi khitchini yamkati ya malo osungira omwe.
Zambiri zothetsera zimagwirizana ndi zinthu zosavuta izi. Mwachitsanzo, olemera kwambiri amakampani:
- Malingaliro a kampani DellEMC ECS
- NetApp S3 StorageGrid
- Nkhumba za Nutanix
- Pure Storage FlashBlade ndi StorReduce
- Huawei FusionStorage
Pali kagawo kakang'ono ka mayankho a mapulogalamu omwe amagwira ntchito m'bokosi:
- Red Hat Ceph
- SUSE Enterprise Storage
- Cloudian
Ndipo ngakhale iwo omwe amakonda kusungitsa mosamala pambuyo pa msonkhano sanakhumudwitsidwe:
- CEPH mu mawonekedwe ake oyera
- Minio (Linux version, chifukwa pali mafunso ambiri okhudza Windows version)
Mndandandawu sunali wokwanira; ukhoza kukambidwa mu ndemanga. Osayiwala kuyang'ana momwe kachitidwe kachitidwe kakagwiritsidwira ntchito kuphatikiza kuyanjana kwa API musanayambe kukhazikitsa. Chomaliza chomwe mukufuna ndikutaya ma terabytes a data chifukwa cha mafunso osakhazikika. Chifukwa chake musachite manyazi ndi mayeso a katundu. Nthawi zambiri, mapulogalamu onse akuluakulu omwe amagwira ntchito ndi data yambiri amakhala ndi malipoti ofananira. Ngati Veeam pali pa kuyezetsa pamodzi, zomwe zimatithandiza kulengeza molimba mtima kugwirizana kwathunthu kwa zinthu zathu ndi zida zenizeni. Iyi ndi ntchito ya njira ziwiri, osati yofulumira nthawi zonse, koma tikukula nthawi zonse mayankho oyesedwa.
Kusonkhanitsa maimidwe athu
Ndikufuna kulankhula pang'ono posankha phunziro loyesera.
Choyamba, ndimafuna kupeza njira yomwe ingagwire ntchito m'bokosi. Chabwino, kapena osachepera ndi kuthekera pazipita kuti ntchito popanda kufunika mayendedwe osafunika. Kuvina ndi maseche ndi kusewera ndi console usiku kumakhala kosangalatsa kwambiri, koma nthawi zina mumafuna kuti igwire ntchito nthawi yomweyo. Ndipo kudalirika kwathunthu kwa mayankho otere nthawi zambiri kumakhala kokwera. Ndipo inde, mzimu wa adventurism wasowa mwa ife, tinasiya kukwera m'mawindo a amayi athu okondedwa, ndi zina zotero (c).
Kachiwiri, kunena zoona, kufunikira kogwira ntchito ndi kusungirako zinthu kumachitika m'makampani akuluakulu, choncho ndi momwe zimakhalira pamene kuyang'ana njira zamabizinesi sikungochititsa manyazi, komanso kulimbikitsidwa. Mulimonsemo, sindikudziwa za zitsanzo za aliyense amene achotsedwa ntchito pogula mayankho otere.
Kutengera zonse zomwe tafotokozazi, kusankha kwanga kudagwa Dell EMC ECS Community Edition. Iyi ndi ntchito yosangalatsa kwambiri, ndipo ndikuwona kuti ndikofunikira kuti ndikuuzeni za izi.
Chinthu choyamba chimene chimabwera m'maganizo mukawona zowonjezera Edition Magulu - kuti iyi ndi kopi chabe ya ECS yodzaza ndi zoletsa zina zomwe zimachotsedwa pogula laisensi. Ndiye ayi!
Kumbukirani:
!!!Community Edition ndi pulojekiti yapadera yomwe idapangidwa kuti iyesedwe, ndipo popanda thandizo laukadaulo kuchokera kwa Dell!!
Ndipo sichingasinthidwe kukhala ECS yodzaza, ngakhale mukufunadi.
Tiyeni tiwone
Anthu ambiri amakhulupirira kuti Dell EMC ECS ndiyo njira yabwino kwambiri ngati mukufuna kusungirako zinthu. Ma projekiti onse omwe ali pansi pa mtundu wa ECS, kuphatikiza malonda ndi makampani, adakhazikitsidwa . Kukomera mtima kwamtundu wa Dell. Ndipo kuwonjezera pa pulogalamu yomwe imagwira ntchito pazida zawo zodziwika bwino, pali mtundu wotseguka womwe utha kutumizidwa mumtambo, pamakina, mumtsuko, kapena pazida zanu zilizonse. Kuyang'ana m'tsogolo, palinso mtundu wa OVA, womwe tidzagwiritse ntchito.
DELL ECS Community Edition palokha ndi pulogalamu yaying'ono yomwe imagwira ntchito pa seva zodziwika bwino za Dell EMC ECS.
Ndazindikira kusiyana kwakukulu zinayi:
- Palibe chithandizo chachinsinsi. Ndi zamanyazi, koma osati kutsutsa.
- Fabric Layer ikusowa. Ichi ndi ntchito yomanga masango, kasamalidwe kazinthu, zosintha, kuyang'anira ndi kusunga zithunzi za Docker. Apa ndipamene zakhumudwitsa kale, koma Dell amathanso kumveka.
- Chotsatira chonyansa kwambiri cha mfundo yapitayi: kukula kwa node sikungakulitsidwe pambuyo pomaliza kukhazikitsa.
- Palibe chithandizo chaukadaulo. Ichi ndi chinthu choyesera, chomwe sichiletsedwa kugwiritsidwa ntchito m'makhazikitsidwe ang'onoang'ono, koma ine ndekha sindingayerekeze kukweza ma petabytes a data yofunika pamenepo. Koma mwaukadaulo palibe amene angakuletseni kuchita izi.
Kodi mu mtundu waukulu ndi chiyani?
Tiyeni tidutse ku Europe ndikudutsa muzitsulo za ironclad kuti timvetsetse bwino za chilengedwe.
Sindingatsimikizire kapena kutsutsa mawu akuti DELL ECS ndiyo yabwino kwambiri yosungiramo zinthu, koma ngati muli ndi chilichonse choti munene pamutuwu, ndidzakhala wokondwa kuwerenga mu ndemanga. Osachepera malinga ndi Baibulo Dell EMC ali molimba mtima pakati pa atsogoleri asanu apamwamba a msika wa OBS. Ngakhale mayankho amtambo sakuganiziridwa pamenepo, uku ndi kukambirana kosiyana.
Kuchokera pamalingaliro aukadaulo, ECS ndi chinthu chosungira chomwe chimapereka mwayi wopeza deta pogwiritsa ntchito ma protocol osungira mitambo. Imathandizira AWS S3 ndi OpenStack Swift. Pazidebe zothandizidwa ndi mafayilo, ECS imathandizira NFSv3 pakutumiza mafayilo ndi mafayilo.
Njira yojambulira zidziwitso ndizachilendo, makamaka pambuyo posungirako chipika chapamwamba.
- Deta yatsopano ikafika, chinthu chatsopano chimapangidwa chomwe chili ndi dzina, deta yokha, ndi metadata.
- Zinthu zimagawidwa mu 128 MB chunks, ndipo chunk iliyonse imalembedwa ku mfundo zitatu nthawi imodzi.
- Fayilo ya index imasinthidwa, pomwe zozindikiritsa ndi malo osungira zimalembedwa.
- Fayilo ya chipika (lolowera) imasinthidwa ndikulembedwanso ku ma node atatu.
- Uthenga wokhudza kujambula bwino umatumizidwa kwa kasitomala
Makope onse atatu a deta amalembedwa mofanana. Kulembako kumaonedwa kuti ndi kopambana kokha ngati makope onse atatu analembedwa bwino.
Kuwerenga ndikosavuta:
- Wogula amapempha deta.
- Mlozerawu umayang'ana komwe deta imasungidwa.
- Deta imawerengedwa kuchokera ku mfundo imodzi ndikutumizidwa kwa kasitomala.
Pali ma seva ochepa okha, ndiye tiyeni tiwone Dell EMC ECS EX300 yaying'ono kwambiri. Imayamba kuchokera ku 60TB, ndikutha kukula mpaka 1,5PB. Ndipo mchimwene wake wamkulu, Dell EMC ECS EX3000, amakulolani kusunga mpaka 8,6PB pa rack.
Ikani
Mwaukadaulo, Dell ECS CE ikhoza kutumizidwa yayikulu momwe mungafunire. Mulimonsemo, sindinapeze zoletsa zomveka. Komabe, ndikosavuta kuchita makulitsidwe onse popanga node yoyamba, yomwe tikufuna:
- 8 vCPU
- 64GB RAM
- 16GB ya OS
- 1TB yosungirako mwachindunji
- Kutulutsidwa kwaposachedwa kwa CentOS kochepa
Uwu ndi mwayi wosankha pamene mukufuna kukhazikitsa zonse nokha kuyambira pachiyambi. Kusankha uku sikuli koyenera kwa ife, chifukwa ... Ndigwiritsa ntchito chithunzi cha OVA potumiza.
Koma mulimonsemo, zofunikira ndi zoipa kwambiri ngakhale mfundo imodzi, ndipo ngati mutatsatira mosamalitsa kalata ya lamulo, ndiye kuti mukufunikira mfundo zinayi zotere.
Komabe, opanga ECS CE amakhala m'dziko lenileni, ndipo kuyikako kumakhala kopambana ngakhale ndi mfundo imodzi, ndipo zofunika zochepa ndi izi:
- 4 vCPU
- 16 GB RAM
- 16 GB ya OS
- 104 GB yosungirako yokha
Izi ndizomwe zimafunikira kuti titumizire chithunzi cha OVA. Kale kwambiri umunthu ndi zenizeni.
Node yoyika yokha ingapezeke kuchokera kwa wogwira ntchitoyo . Palinso zolembedwa zatsatanetsatane pazotumiza zonse m'modzi, koma mutha kuwerenganso pa mkuluyo . Chifukwa chake, sitikhala mwatsatanetsatane pakuwululidwa kwa OVA, palibe zamatsenga pamenepo. Chachikulu ndichakuti musanayambe, musaiwale kukulitsa diski ku voliyumu yofunikira, kapena kuyika zofunikira.
Timayamba makinawo, tsegulani cholumikizira ndikugwiritsa ntchito zidziwitso zabwino kwambiri:
- kulowa: admin
- password: ChangeMe
Kenako timayendetsa sudo nmtui ndikukonza mawonekedwe a netiweki - IP/mask, DNS ndi chipata. Pokumbukira kuti CentOS yaying'ono ilibe zida za ukonde, timayang'ana makonda kudzera pa ip addr.
Ndipo popeza olimba mtima okha amagonjetsa nyanja, timapanga yum update, pambuyo pake timayambiranso. Ndi zotetezeka chifukwa ... Kutumiza konse kumachitika kudzera m'mabuku osewerera, ndipo ma phukusi onse ofunikira amatsekedwa ku mtundu wapano.
Tsopano ndi nthawi yosintha zolemba. Palibe mawindo apamwamba kapena pseudo UI yanu - zonse zimachitika kudzera m'mawu omwe mumakonda. Mwaukadaulo, pali njira ziwiri: mutha kuyendetsa lamulo lililonse pamanja kapena kuyambitsanso kasinthidwe ka videoploy. Ingotsegula config mu vim, ndipo ikatuluka iyamba kuyang'ana. Koma sizosangalatsa kufewetsa dala moyo wanu, kotero tiyeni tiyendetse malamulo ena awiri. Ngakhale izi sizomveka, ndakuchenjezani =)
Chifukwa chake, tiyeni tipange vim ECS-CommunityEdition/deploy.xml ndikupanga zosintha zochepa kuti ECS iyambe kugwira ntchito. Mndandanda wa magawo atha kufupikitsidwa, koma ndidachita motere:
- licensed_accepted: true Simuyenera kusintha, ndiye mukatumiza mudzafunsidwa kuti muvomereze ndipo mudzawonetsedwa mawu abwino. Mwina ili ndi dzira la Isitala.
- Tsegulani mizere autonames: ndi chizolowezi: Lowetsani dzina limodzi lomwe mukufuna la node - dzina la alendo lidzasinthidwa ndi ilo panthawi yoyika.
- install_node: 192.168.1.1 Tchulani IP yeniyeni ya node. Kwa ife, timasonyeza chimodzimodzi monga mu nmtui
- dns_domain: lowetsani dera lanu.
- dns_servers: lowetsani dns yanu.
- ntp_servers: mutha kufotokoza iliyonse. Ndinatenga yoyamba yomwe ndinakumana nayo padziwe la 0.pool.ntp.org (inakhala 91.216.168.42)
- autonaming: mwambo Ngati simukumasula, mwezi umatchedwa Luna.
- ecs_block_devices:
/ dev / sdb
Pazifukwa zina zosadziwika, pangakhale chipangizo chosungirako chosungirako /dev/vda - dziwe_malo:
mamembala:
192.168.1.1 Apanso tikuwonetsa IP yeniyeni ya node - ecs_block_devices:
/dev/sdb Timabwereza ntchito yodula zida zomwe palibe.
Kawirikawiri, fayilo yonseyo imafotokozedwa mwatsatanetsatane mu , koma ndani amene adzawerenge mu nthawi yovuta ngati imeneyi. Imanenanso kuti chocheperako ndikutchula IP ndi chigoba, koma mu labu yanga izi zidayamba movutikira, ndipo ndidayenera kuzikulitsa mpaka zomwe zatchulidwa pamwambapa.
Pambuyo potuluka mkonzi, muyenera kuyendetsa update_deploy /home/admin/ECS-CommunityEdition/deploy.yml, ndipo ngati zonse zachitika molondola, izi zidzafotokozedwa momveka bwino.
Ndiye mukuyenerabe kuyambitsa videoploy, dikirani kuti chilengedwe chisinthidwe, ndipo mutha kuyambitsa kukhazikitsa nokha ndi lamulo la ova-step1, ndipo mukamaliza bwino, lamulo la ova-step2. Chofunika: osayimitsa zolemba ndi dzanja! Masitepe ena atha kutenga nthawi yochulukirapo, mwina sangamalizidwe pakuyesa koyamba, ndipo zitha kuwoneka ngati zonse zasweka. Mulimonsemo, muyenera kudikirira kuti script imalize mwachilengedwe. Pamapeto pake muyenera kuwona uthenga wofanana ndi uwu.
Tsopano titha kutsegula gulu lowongolera la WebUI pogwiritsa ntchito IP yomwe tikudziwa. Ngati kasinthidwe sikunasinthidwe pagawo, akaunti yokhazikika idzakhala mizu/ChangeMe. Mutha kugwiritsanso ntchito zosungira zathu zomwe zimagwirizana ndi S3 nthawi yomweyo. Imapezeka pamadoko 9020 a HTTP, ndi 9021 a HTTPS. Apanso, ngati palibe chomwe chasinthidwa, ndiye access_key: object_admin1 ndi secret_key: ChangeMeChangeMeChangeMeChangeMeChangeMe.
Koma tisadzitsogolere ndikuyamba mwadongosolo.
Mukalowa kwa nthawi yoyamba, mudzakakamizika kusintha mawu anu achinsinsi kukhala okwanira, zomwe ziri zolondola. Dashboard yayikulu ndi yomveka bwino, ndiye tiyeni tichite zina zochititsa chidwi kuposa kufotokoza zodziwikiratu. Mwachitsanzo, tiyeni tipange wogwiritsa ntchito yemwe tidzamugwiritse ntchito kuti apeze malo osungira. M'dziko la opereka chithandizo, awa amatchedwa obwereka. Izi zimachitika Sinthani > Ogwiritsa > Ogwiritsa Ntchito Chatsopano
Popanga wogwiritsa ntchito, timafunsidwa kuti titchule dzina. Mwaukadaulo, palibe chomwe chimatilepheretsa kupanga ambiri aiwo monga momwe alili ogwiritsa ntchito. Ndipo mosemphanitsa. Izi zimakuthandizani kuti muzitha kuyang'anira zothandizira pawokha kwa wobwereka aliyense.
Chifukwa chake, timasankha ntchito zomwe tikufuna ndikupanga makiyi ogwiritsa ntchito. S3/Atmos idzandikwanira. Ndipo musaiwale kusunga kiyi π
Wogwiritsa wapangidwa, tsopano ndi nthawi yoti mugawire chidebe kwa iye. Pitani ku Sinthani > Chidebe ndikudzaza minda yofunikira. Zonse ndi zophweka apa.
Tsopano tili ndi chilichonse chokonzekera kuti tigwiritse ntchito posungirako S3 yathu.
Kupanga Veeam
Kotero, monga tikukumbukira, imodzi mwa ntchito zazikulu zosungira zinthu ndi kusungidwa kwa nthawi yaitali kwa chidziwitso chomwe sichipezeka kawirikawiri. Chitsanzo chabwino ndichofunika kusunga zosunga zobwezeretsera pamalo akutali. Mu Veeam Backup & Replication izi zimatchedwa Capacity Tier.
Tiyeni tiyambe kukhazikitsa powonjezera Dell ECS CE yathu pa mawonekedwe a Veeam. Pa tabu ya Backup Infrastructure, yambani Add New Repository Wizard ndikusankha Object Storage.
Tiyeni tisankhe zomwe zidayambira - S3 Yogwirizana.
Pazenera lomwe likuwoneka, lembani dzina lomwe mukufuna ndikupita ku sitepe ya Akaunti. Apa muyenera kufotokoza malo Service mu mawonekedwe , dera likhoza kusiyidwa momwe liliri ndipo wogwiritsa ntchitoyo akhoza kuwonjezeredwa. Seva yachipata ndiyofunikira ngati chosungira chanu chili pamalo akutali, koma uwu ndi mutu wa kukhathamiritsa kwa zomangamanga ndi nkhani ina, kotero mutha kulumpha mosamala apa.
Ngati zonse zafotokozedwa ndikukonzedwa moyenera, chenjezo la satifiketi lidzawonekera kenako zenera lomwe lili ndi ndowa momwe mungapangire chikwatu cha mafayilo athu.
Timadutsa mfiti mpaka kumapeto ndikusangalala ndi zotsatira zake.
Chotsatira ndicho kupanga Scale-out Backup Repository yatsopano, kapena kuwonjezera S3 yathu ku yomwe ilipo - idzagwiritsidwa ntchito ngati Capacity Tier posungira zakale. Palibe ntchito yogwiritsira ntchito yosungirako yogwirizana ndi S3 mwachindunji, monga malo osungira nthawi zonse, pakumasulidwa kwatsopano. Mavuto ambiri osadziwika bwino ayenera kuthetsedwa kuti izi zitheke, koma chilichonse ndi kotheka.
Pitani ku zoikamo zosungira ndikuyambitsa Capacity Tier. Chilichonse chikuwonekera pamenepo, koma pali chidwi chochititsa chidwi: ngati mukufuna kuti deta yonse itumizidwe kusungirako zinthu mwamsanga, ingoikani kwa masiku 0.
Mukadutsa mfiti, ngati simukufuna kudikirira, mutha kukanikiza ctrl + RMB pamalo osungira, yambitsani mwamphamvu ntchito ya Tiering ndikuwona ma graph akukwawa.
Ndizo zonse pakadali pano. Ndikuganiza kuti ndidachita bwino ntchito yowonetsa kuti kusungirako block sikowopsa monga momwe anthu amaganizira. Inde, pali zothetsera ndi zosankha za ngolo ndi ngolo yaying'ono, koma simungathe kuphimba chirichonse m'nkhani imodzi. Ndiye tiyeni tigawane zomwe takumana nazo mu ndemanga.
Source: www.habr.com