Idizayini yesikhungo sedatha esibonakalayo

Idizayini yesikhungo sedatha esibonakalayo

Isingeniso

Isistimu yolwazi ngokombono womsebenzisi ichazwe kahle ku-GOST RV 51987 - "uhlelo oluzenzakalelayo, umphumela walo ukwethulwa kolwazi oluphumayo ukuze lusetshenziswe ngokulandelayo." Uma sicabangela isakhiwo sangaphakathi, empeleni noma iyiphi i-IS iwuhlelo lwama-algorithms axhumene asetshenziswa ngekhodi. Ngomqondo obanzi wethisisi ye-Turing-Church, i-algorithm (noma i-IS) iguqula isethi yedatha yokufaka ibe yisethi yedatha yokuphumayo.
Umuntu angaze athi ukuguqulwa kwedatha yokufaka kusho ukuthi kukhona uhlelo lolwazi. Ngokufanelekile, inani le-IS nayo yonke inkimbinkimbi ye-IS inqunywa ngevelu yedatha yokufaka neyokukhiphayo.
Ngokusekelwe kulokhu, ukuklama kufanele kuqale futhi kuhambisane nedatha, ukwakheka kwezakhiwo nezindlela ezihambisana nesakhiwo nokubaluleka kwedatha.

Idatha egciniwe
Isigaba esibalulekile sokulungiselela ukuklama ukuthola izici zawo wonke amasethi edatha ahlelelwe ukucutshungulwa nokugcinwa. Lezi zici zihlanganisa:
- Ivolumu yedatha;
- Ulwazi mayelana nomjikelezo wempilo wedatha (ukukhula kwedatha entsha, ubude bokuphila, ukucutshungulwa kwedatha ephelelwe yisikhathi);
- Ukuhlelwa kwedatha ngokombono umthelela ebhizinisini eliwumgogodla lenkampani (ukugcinwa okuyimfihlo okuthathu, ubuqotho, ukutholakala) kanye nezinkomba zezimali (isibonelo, izindleko zokulahleka kwedatha ehoreni lokugcina);
- IJografi yokucubungula idatha (indawo ebonakalayo yezinhlelo zokucubungula);
- Izidingo zokulawula zekilasi ledatha ngalinye (isibonelo, i-Federal Law-152, PCI DSS).

Ulwazi Systems

Idatha ayigcini nje ngokugcinwa, kodwa futhi icutshungulwe (iguqulwe) ngamasistimu olwazi. Isinyathelo esilandelayo ngemva kokuthola izici zedatha iqoqo eliphelele kakhulu lezinhlelo zolwazi, izici zabo zezakhiwo, ukuthembela komunye nomunye kanye nezimfuneko zengqalasizinda kumayunithi avamile ezinhlotsheni ezine zezinsiza:
- Amandla wekhompyutha weprosesa;
- Inani le-RAM;
- Izidingo zevolumu nokusebenza kohlelo lokugcinwa kwedatha;
— Izidingo zenethiwekhi yokudlulisa idatha (amashaneli angaphandle, amashaneli phakathi kwezingxenye ze-IS).
Kulokhu, kufanele kube nezidingo zesevisi/isevisi encane ngayinye njengengxenye ye-IS.
Ngokwehlukana, kubalulekile ukuqaphela ukuthi, ngokuklama okulungile, ukutholakala kwedatha ngomthelela we-IS ebhizinisini eliyinhloko lenkampani ngendlela yezindleko ze-IS isikhathi sokuphumula (ama-ruble ngehora) kuyimpoqo.

Imodeli yosongo

Kumelwe kube nemodeli esemthethweni yezinsongo lapho kuhlelelwa khona ukuvikela idatha/amasevisi. Ngaphezu kwalokho, imodeli yokusongela ayihlanganisi izici zobumfihlo kuphela, kodwa futhi nobuqotho nokutholakala. Labo. Ngokwesibonelo:
- Ukwehluleka kweseva ebonakalayo;
- Ukuhluleka kwe-top-of-the-rack switch;
- Ukuphazamiseka kwesiteshi sokuxhumana phakathi kwezikhungo zedatha;
- Ukuhluleka kwalo lonke uhlelo lokugcina olusebenzayo.
Kwezinye izimo, amamodeli okusongela abhalwa hhayi kuphela ezingxenyeni zengqalasizinda, kodwa futhi kumasistimu olwazi oluthile noma izingxenye zawo, njengokwehluleka kwe-DBMS ngokubhujiswa okunengqondo kwesakhiwo sedatha.
Zonke izinqumo ezingaphakathi kwephrojekthi zokuvikela usongo olungachaziwe azidingeki.

Izidingo zokulawula

Uma idatha ecutshungulwayo ingaphansi kwemithetho ekhethekile esungulwe abalawuli, ulwazi mayelana namasethi wedatha nemithetho yokucubungula/yokugcina iyadingeka.

Okuhlosiwe kwe-RPO/RTO

Ukudizayina noma yiluphi uhlobo lokuvikela kudinga ukuba nezinkomba zokulahleka kwedatha kanye nesikhathi sokutholwa kwesevisi okuqondiwe kuso ngasinye sezinsongo ezichaziwe.
Ngokufanelekile, i-RPO ne-RTO kufanele zibe nezindleko ezihlotshaniswayo zokulahleka kwedatha nesikhathi sokuphumula ngesikhathi seyunithi ngayinye.

Idizayini yesikhungo sedatha esibonakalayo

Hlukanisa kube amachibi ezinsiza

Ngemva kokuqoqa lonke ulwazi olufakiwe, isinyathelo sokuqala siwukuqoqa amasethi edatha kanye ne-IP ibe amachibi asekelwe kumamodeli asongelayo kanye nezidingo zokulawula. Uhlobo lokuhlukaniswa kwamachibi ahlukahlukene lunqunywa - ngokohlelo ezingeni lesofthiwe yesistimu noma ngokomzimba.
izibonelo:
- Isifunda sokucubungula idatha yomuntu siqu ihlukaniswe ngokuphelele nezinye izinhlelo;
- Izipele zigcinwa ohlelweni oluhlukile lokugcina.

Kulesi simo, amachibi angakwazi ukuzimela ngokuphelele, isibonelo, amachibi amabili ezinsiza zekhompiyutha achazwe (amandla okucubungula + RAM), asebenzisa i-pool yokugcina idatha kanye nedamu elilodwa lensiza yokudlulisa idatha.

Amandla okucubungula

Idizayini yesikhungo sedatha esibonakalayo

Okufingqiwe, izidingo zamandla okucubungula esikhungo sedatha esibonakalayo zikalwa ngokwenani lama-virtual processors (vCPUs) kanye nesilinganiso sawo sokuhlanganisa kumaphrosesa aphathekayo (pCPU). Kulesi simo, i-1 pCPU = i-processor ye-physical processor (ngaphandle kwe-Hyper-Threading). Inombolo yama-vCPU ifinyezwa kuwo wonke amachibi ezinsiza achaziwe (ngalinye elingase libe nesici salo sokuhlanganisa).
I-coefficient yokuhlanganisa yamasistimu alayishiwe itholwa ngokomthetho, ngokusekelwe kungqalasizinda ekhona, noma ngokufaka ukulinga nokuhlola umthwalo. Kumasistimu angalayishiwe, "umkhuba omuhle kakhulu" usetshenziswa. Ngokucacile, i-VMware icaphuna isilinganiso esimaphakathi njengo-8:1.

I-RAM

Isidingo esiphelele se-RAM sitholwa ngokuhlanganisa okulula. Ukusebenzisa ukubhalisa ngokweqile kwe-RAM akunconywa.

Izinsiza zokugcina

Izidingo zesitoreji zitholwa ngokumane ufingqe wonke amachibi ngomthamo nokusebenza.
Izidingo zokusebenza zivezwa ku-IOPS kuhlanganiswe nesilinganiso esimaphakathi sokufunda/sokubhala futhi, uma kunesidingo, ukubambezeleka okukhulu kokuphendula.
Izimfuneko Zekhwalithi Yesevisi (i-QoS) zamachibi athile noma amasistimu kufanele zicaciswe ngokwehlukana.

Izinsiza zenethiwekhi yedatha

Izidingo zenethiwekhi yedatha zitholwa ngokumane kufingqe wonke amachibi omkhawulokudonsa.
Izimfuneko Zekhwalithi Yesevisi (i-QoS) kanye ne-latency (RTT) yamachibi athile noma amasistimu kufanele zicaciswe ngokwehlukana.
Njengengxenye yezidingo zezinsiza zenethiwekhi yedatha, izimfuneko zokuhlukaniswa kanye/noma ukubethelwa kwethrafikhi yenethiwekhi nezindlela ezikhethwayo (802.1q, IPSec, njll.) nazo zibonisiwe.

Ukukhetha kwezakhiwo

Lo mhlahlandlela awuxoxi nganoma iyiphi inketho ngaphandle kwezakhiwo ze-x86 kanye nokwenziwa kweseva okungu-100%. Ngakho-ke, ukukhetha kwezakhiwo ze-subsystem yekhompuyutha kwehla ekukhethweni kweplatifomu ye-virtualization yeseva, isici sefomu leseva, kanye nezidingo zokucushwa kweseva evamile.

Iphuzu eliyinhloko lokuzikhethela liwukuba nesiqiniseko sokusebenzisa indlela ye-classical ngokuhlukaniswa kwemisebenzi yokucubungula, ukugcinwa nokudlulisa idatha noma eyodwa eguqukayo.

izakhiwo zakudala kuhilela ukusetshenziswa kwezinhlelo ezingaphansi ezihlakaniphile zangaphandle zokugcina nokudlulisa idatha, kuyilapho amaseva enikela kuphela amandla okucubungula kanye ne-RAM kuqoqo elivamile lezinsiza ezibonakalayo. Ezimweni ezimbi kakhulu, amaseva aziwa ngokuphelele, angabi namadiski awo kuphela, kodwa angabi naso isihlonzi sesistimu. Kulesi simo, i-OS noma i-hypervisor ilayishwa kusuka ku-flash media eyakhelwe ngaphakathi noma ohlelweni lwangaphandle lokugcina idatha (i-boot kusuka ku-SAN).
Ngaphakathi kohlaka lwezakhiwo zakudala, ukukhetha phakathi kwama-blades nama-rack kwenziwa ngokuyinhloko ngokusekelwe ezimisweni ezilandelayo:
- Okungabizi kakhulu (ngokwesilinganiso, amaseva we-rack-mount ashibhile);
- Ukuminyana kwekhompyutha (okuphakeme kuma-blade);
- Ukusetshenziswa kwamandla kanye nokuchithwa kokushisa (ama-blade aneyunithi ethize ephakeme ngeyunithi ngayinye);
- Ukunwebeka nokulawula (izindwani ngokuvamile zidinga umzamo omncane wokufakwa okukhulu);
- Ukusetshenziswa kwamakhadi okunweba (ukukhetha okulinganiselwe kwama-blade).
I-Convergent Architecture (obeye aziwe njengo i-hyperconverged) kuhlanganisa ukuhlanganisa imisebenzi yokucubungula nokugcinwa kwedatha, okuholela ekusetshenzisweni kwamadiski eseva yendawo futhi, ngenxa yalokho, ukushiywa kwesici sefomu le-blade yakudala. Kuzinhlelo ezihlanganisiwe, kusetshenziswa amaseva e-rack noma amasistimu eqoqo, okuhlanganisa amaseva ama-blade amaningana namadiski endawo endaweni eyodwa.

CPU/Inkumbulo

Ukuze ubale kahle ukucushwa, udinga ukuqonda uhlobo lomthwalo wendawo noma iqoqo ngalinye elizimele.
I-CPU iboshiwe - indawo ekhawulelwe ekusebenzeni ngamandla eprosesa. Ukwengeza i-RAM ngeke kushintshe lutho ngokuya ngokusebenza (inani lama-VM ngeseva ngayinye).
Inkumbulo iboshiwe - imvelo ekhawulelwe yi-RAM. I-RAM eningi kuseva ikuvumela ukuthi usebenzise ama-VM amaningi kuseva.
I-GB / MHz (GB / pCPU) – isilinganiso esimaphakathi sokusetshenziswa kwe-RAM namandla okucubungula ngalo mthwalo othile. Ingasetshenziswa ukubala inani elidingekayo lememori ekusebenzeni okunikeziwe futhi okuphambene nalokho.

Isibalo sokumisa iseva

Idizayini yesikhungo sedatha esibonakalayo

Okokuqala, udinga ukunquma zonke izinhlobo zomthwalo bese unquma ukuhlanganisa noma ukuhlukanisa amachibi ekhompyutha ahlukene abe amaqoqo ahlukene.
Okulandelayo, kuqoqo ngalinye elichaziwe, isilinganiso se-GB / MHz sinqunywa emthwalweni owaziwa kusengaphambili. Uma umthwalo ungaziwa kusengaphambili, kodwa kukhona ukuqonda okungaqondakali kwezinga lokusebenzisa amandla okucubungula, ungasebenzisa izilinganiso ezijwayelekile ze-vCPU:pCPU ukuze uguqule izidingo zephuli zibe ezangempela.

Kuqoqo ngalinye, hlukanisa isamba sezidingo zephuli ye-vCPU nge-coefficient:
vCPUsum / vCPU:pCPU = pCPUsum – inombolo edingekayo yamayunithi aphathekayo. ama-cores
pCPUsum / 1.25 = pCPUht – inombolo yezinhlamvu ezilungiselwe i-Hyper-Threading
Ake sicabange ukuthi kuyadingeka ukubala iqoqo elinama-cores angu-190 / 3.5 TB we-RAM. Ngesikhathi esifanayo, samukela umthwalo ohlosiwe ongu-50% wamandla okucubungula kanye no-75% we-RAM.

pCPU
190
CPU ukusetshenziswa
50%

Mem
3500
Usizo lwe-Mem
75%

Isokhethi
Core
I-Srv/CPU
Srv Mem
Srv/Mem

2
6
25,3
128
36,5

2
8
19,0
192
24,3

2
10
15,2
256
18,2

2
14
10,9
384
12,2

2
18
8,4
512
9,1

Kulesi simo, sisebenzisa njalo ukusondeza kuye kunamba ephelele eseduze (=ROUNDUP(A1;0)).
Kusukela kuthebula kuba sobala ukuthi ukulungiselelwa kweseva okuningana kulinganisa izinkomba eziqondiwe:
— 26 amaseva 2 * 6c / 192 GB
— 19 amaseva 2 * 10c / 256 GB
— 10 amaseva 2 * 18c / 512 GB

Ukukhethwa kwalokhu kulungiselelwa kufanele kwenziwe ngokusekelwe ezintweni ezengeziwe, njengephakheji eshisayo nokupholisa okutholakalayo, amaseva asesetshenzisiwe kakade, noma izindleko.

Izici zokukhetha ukucushwa kweseva

Ama-VM abanzi. Uma kudingekile ukusingatha ama-VM abanzi (aqhathaniswa nenodi engu-1 NUMA noma ngaphezulu), kuyatuswa, uma kungenzeka, ukukhetha iseva enokulungiselelwa okuvumela ama-VM anjalo ukuthi ahlale ngaphakathi kwenodi ye-NUMA. Ngenani elikhulu lama-VM abanzi, kunobungozi bokuhlukaniswa kwezinsiza zeqoqo, futhi kulokhu, amaseva akhethiwe avumela ama-VM abanzi ukuthi abekwe aminyene ngangokunokwenzeka.

Usayizi wesizinda sokuhluleka okukodwa.

Ukukhethwa kosayizi weseva nakho kusekelwe kumgomo wokunciphisa isizinda esisodwa sokuhluleka. Isibonelo, lapho ukhetha phakathi:
— 3 x 4*10c / 512 GB
— 6 x 2*10c / 256 GB
Zonke ezinye izinto zilingana, kufanele ukhethe inketho yesibili, kusukela lapho iseva eyodwa ihluleka (noma igcinwa), hhayi i-33% yezinsiza zeqoqo ezilahlekile, kodwa i-17%. Ngendlela efanayo, isibalo sama-VM nama-IS athintwe ingozi sincipha ngohhafu.

Ukubalwa kwamasistimu okulondoloza akudala ngokusekelwe ekusebenzeni

Idizayini yesikhungo sedatha esibonakalayo

Amasistimu esitoreji sakudala ahlala ebalwa kusetshenziswa isimo esibi kakhulu, ngaphandle komthelela wenqolobane yokusebenza kanye nokwenza kahle kokusebenza.
Njengezinkomba zokusebenza eziyisisekelo, sithatha ukusebenza kwemishini kudiski (IOPSdisk):
– 7.2k – 75 IOPS
– 10k – 125 IOPS
– 15k – 175 IOPS

Okulandelayo, inani lamadiski echibini lediski libalwa kusetshenziswa ifomula elandelayo: = I-TotalIOPS * ( RW + (1 –RW) * RAIDPen) / IOPSdisk. Kuphi:
- IngqikithiIOPS - ukusebenza okuphelele okudingekayo ku-IOPS kusuka ku-disk pool
- RW – iphesenti lemisebenzi yokufunda
- I-RAIDpen - Inhlawulo ye-RAID yezinga elikhethiwe le-RAID

Funda kabanzi mayelana ne-RAID Yedivayisi kanye Nesijeziso se-RAID lapha - Ukusebenza kwesitoreji. Ingxenye yokuqala. и Ukusebenza kwesitoreji. Ingxenye yesibili. и Ukusebenza kwesitoreji. Ingxenye yesithathu

Ngokusekelwe kwinani eliwumphumela lamadiski, izinketho ezingenzeka zibalwa ezihlangabezana nezidingo zamandla okugcina, kufaka phakathi izinketho ezinokugcinwa kwamazinga amaningi.
Ukubalwa kwamasistimu asebenzisa i-SSD njengesendlalelo sesitoreji kubhekwa ngokwehlukana.
Izici zokubala izinhlelo nge-Flash Cache

I-Flash Cache - igama elivamile labo bonke ubuchwepheshe bobunikazi bokusebenzisa imemori ye-flash njengenqolobane yezinga lesibili. Uma usebenzisa i-flash cache, uhlelo lokugcina luvame ukubalwa ukuze lunikeze umthwalo ozinzile ovela kumadiski kazibuthe, kuyilapho ukuphakama kunikezwa inqolobane.
Kulokhu, kuyadingeka ukuqonda iphrofayili yomthwalo kanye nezinga lokwenziwa kwasendaweni kokufinyelela kumabhulokhi wamavolumu okugcina. Inqolobane ye-Flash iwubuchwepheshe bomthwalo wemisebenzi onemibuzo yendawo, futhi ayisebenzi kumavolumu alayishwe ngokufanayo (njengamasistimu okuhlaziya).

Ukubalwa kwezinhlelo ezixubile ezisezingeni eliphansi/maphakathi nebanga

Amasistimu amaHybrid ezigaba eziphansi neziphakathi asebenzisa ukugcinwa kwamazinga amaningi ngedatha ehamba phakathi kwamazinga kushejuli. Ngesikhathi esifanayo, ubukhulu bebhulokhi yesitoreji samazinga amaningi wamamodeli angcono kakhulu ngu-256 MB. Lezi zici azisivumeli ukuthi sicabangele ubuchwepheshe besitoreji esinezigaba njengobuchwepheshe bokukhulisa umkhiqizo, njengoba abantu abaningi bekholelwa ngephutha. Ukugcinwa kwamazinga amaningi kumasistimu asezingeni eliphansi naphakathi kuwubuchwepheshe bokuthuthukisa izindleko zokulondoloza amasistimu anokungalingani okugqamile komthwalo.

Ukuze uthole isitoreji esinezigaba, ukusebenza kwesigaba esiphezulu kubalwa kuqala, kuyilapho isigaba esiphansi sesitoreji sibhekwa njengomnikelo kuphela kumthamo wesitoreji ongekho. Ohlelweni oluxubile lwe-multi-tier, kuyisibopho ukusebenzisa ubuchwepheshe benqolobane ye-flash endaweni yokubhukuda ye-multi-tier ukuze kunxeshezelwe ukwehla kokusebenza kwedatha eshisiwe ngokuzumayo evela ezingeni eliphansi.

Ukusebenzisa i-SSD ku-Tiered Disk Pool

Idizayini yesikhungo sedatha esibonakalayo

Ukusetshenziswa kwama-SSD ku-multilevel disk pool kunokuhlukahluka, kuye ngokusetshenziswa okuqondile kwe-flash cache algorithms ngumkhiqizi othile.
Inkambiso evamile yenqubomgomo yokugcina yedisk pool enezinga le-SSD i-SSD kuqala.
Funda I-Flash Cache Kuphela. Ukuze uthole inqolobane ye-flash efundwayo kuphela, isendlalelo sesitoreji ku-SSD siza nokubhala okubalulekile kwasendaweni, kungakhathaliseki ukuthi inqolobane iyini.
Funda/Bhala i-Flash Cache. Endabeni yenqolobane ye-flash, usayizi wenqolobane yokubhala uqala ngokusethwa kusayizi wenqolobane omkhulu, futhi isigaba sesitoreji se-SSD sivela kuphela lapho usayizi wenqolobane unganele ukusevisa wonke umsebenzi wendawo.
Izibalo zokusebenza kwe-SSD kanye nenqolobane zenziwa isikhathi ngasinye ngokusekelwe ezincomweni zomkhiqizi, kodwa njalo ngenxa yesimo esibi kakhulu.

Source: www.habr.com

Engeza amazwana