Inani elikhulu lezicelo zoShishino kunye neenkqubo ze-virtualization zineendlela zazo zokwakha izisombululo zokunyamezela iimpazamo. Ngokukodwa, i-Oracle RAC (i-Oracle Real Application Cluster) liqela leeseva ezimbini okanye ngaphezulu ze-Oracle ze-database ezisebenzisanayo ukulinganisa umthwalo kunye nokubonelela ukunyamezela impazamo kwinqanaba lomncedisi / wesicelo. Ukuze usebenze kule modi, udinga ukugcinwa okwabelwanayo, okuqhelekileyo kuyinkqubo yokugcina.
Njengoko sele sixoxile kwenye yethu , inkqubo yokugcina ngokwayo, nangona kukho ubukho bamacandelo aphindwe kabini (kubandakanywa nabalawuli), kusekho amanqaku angaphumeleli - ngokukodwa kwifom yedatha enye. Ngoko ke, ukwakha isisombululo se-Oracle ngokunyuka kweemfuno zokuthembeka, i-"N amaseva - inkqubo enye yokugcina" kufuneka ibe nzima.
Okokuqala, kakade, kufuneka sigqibe ukuba yeyiphi imingcipheko esizama ukuyikhusela. Kweli nqaku, asiyi kucinga ngokhuseleko kwizisongelo ezifana “nemeteorite ifikile.” Ngoko ke ukwakha isisombululo sokubuyisela intlekele esasasazekayo kuya kuhlala sisihloko kwelinye lamanqaku alandelayo. Apha siza kujonga into ebizwa ngokuba yi-Cross-Rack yesisombululo sokubuyisela intlekele, xa ukhuseleko lwakhiwe kwinqanaba leekhabhinethi zeseva. Iikhabhinethi ngokwazo zinokufumaneka kwigumbi elinye okanye kwiindawo ezahlukeneyo, kodwa ngokuqhelekileyo ngaphakathi kwesakhiwo esifanayo.
Ezi khabhinethi kufuneka ziqulethe yonke isethi efunekayo yezixhobo kunye nesofthiwe eya kuvumela ukusebenza kwe-Oracle yolwazi kungakhathaliseki ukuba yiyiphi imeko "yommelwane". Ngamanye amazwi, sisebenzisa isisombululo sokubuyisela intlekele ye-Cross-Rack, sisusa imingcipheko yokusilela:
- Iiseva zeSicelo se-Oracle
- Iinkqubo zokugcina
- Ukutshintsha iinkqubo
- Ukungaphumeleli ngokupheleleyo kwazo zonke izixhobo kwikhabhinethi:
- Ukwaliwa kwamandla
- Ukungaphumeleli kwenkqubo yokupholisa
- Izinto zangaphandle (umntu, indalo, njl.)
Ukuphinda-phindwa kweeseva ze-Oracle kuthetha kwawona mgaqo wokusebenza we-Oracle RAC kwaye uphunyezwa ngesicelo. Ukuphindaphinda izixhobo zokutshintsha nako akuyongxaki. Kodwa ngokuphindaphinda kwenkqubo yokugcina, yonke into ayilula kangako.
Olona khetho lulula luphindaphindo lwedatha ukusuka kwinkqubo yogcino engundoqo ukuya kweyogcino. I-synchronous okanye i-asynchronous, kuxhomekeke kubuchule benkqubo yokugcina. Ngokuphindaphinda kwe-asynchronous, umbuzo uvela ngokukhawuleza wokuqinisekisa ukuhambelana kwedatha ngokumalunga ne-Oracle. Kodwa nangona kukho ukuhlanganiswa kwesofthiwe kunye nesicelo, nakweyiphi na imeko, xa kukho ukungaphumeleli kwinkqubo yokugcina yokugcina, ukungenelela ngesandla ngabalawuli kuya kufuneka ukuze utshintshe iqela kwisitoreji sokulondoloza.
Inketho enzima ngakumbi yi-software kunye / okanye ukugcinwa kwe-hardware "i-virtualizers" eya kuphelisa iingxaki zokuhambelana kunye nokungenelela ngesandla. Kodwa ubunzima bokuthunyelwa kunye nolawulo olulandelayo, kunye neendleko ezingafanelekanga kakhulu zezisombululo ezinjalo, zoyikisa abaninzi.
I-AccelStor NeoSapphire™ Sonke isisombululo se-Flash sifanelekile kwiimeko ezifana nokubuyisela intlekele ye-Cross-Rack. usebenzisa ulwakhiwo lweSabelo-Akukho nto. Lo mzekelo yinkqubo yokugcina i-node ezimbini esebenzisa iteknoloji ye-FlexiRemap® yobunini ukuze isebenze ngee-flash drives. Enkosi Ku I-NeoSapphire™ H710 iyakwazi ukuhambisa ukusebenza ukuya kuthi ga kwi-600K IOPS@4K yokubhala okungahleliwe kunye ne-1M+ IOPS@4K yokufunda ngokungacwangciswanga, engafikelelekiyo xa usebenzisa iinkqubo zokugcina ezisekwe kwi-RAID.
Kodwa eyona nto iphambili yeNeoSapphire™ H710 kukwenziwa kweenodi ezimbini ngendlela yamatyala ahlukeneyo, nganye inekopi yayo yedatha. Ungqamaniso lweenodi luqhutywa nge-interface ye-InfiniBand yangaphandle. Ndiyabulela kule zakhiwo, kunokwenzeka ukusabalalisa iindawo ezihlukeneyo kwiindawo ezikude ukuya kwi-100m, ngaloo ndlela unikezela isisombululo sokubuyisela intlekele ye-Cross-Rack. Zombini iinodi zisebenza ngokuhambelana ngokupheleleyo. Ukusuka kwicala lokusingatha, i-H710 ijongeka njengenkqubo eqhelekileyo yokugcina isilawuli-mbini. Ke ngoko, akukho mfuneko yokwenza nayiphi na isoftware eyongezelelweyo okanye iinketho zehardware okanye useto olunzima ngakumbi.
Ukuba sithelekisa zonke izisombululo zokubuyisela iintlekele ze-Cross-Rack ezichazwe ngasentla, ngoko ke ukhetho oluvela kwi-AccelStor luvelele ngokuphawulekayo kwabanye:
I-AccelStor NeoSapphire™ aYabelananga nganto ngoYilo lwezakhiwo
Inkqubo yokugcina isoftware okanye ihardware “virtualizer”
Isisombululo esisekwe ekuphindaphindweni
Ukufumaneka
Ukusilela kweseva
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Ukusilela kokutshintsha
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Ukusilela kwenkqubo yokugcina
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Ukuhlawula
Ukusilela ngokupheleleyo kwikhabhinethi
Akukho xesha lokuphumla
Akukho xesha lokuphumla
Ukuhlawula
Iindleko kunye nobunzima
Iindleko zesisombululo
Phantsi*
Высокая
Высокая
Ukuntsokotha kokusasazwa
Ephantsi
Высокая
Высокая
*I-AccelStor NeoSapphire™ iseyi-All Flash array, ethi ngokwengcaciso ayibizi "3 kopecks," ngakumbi kuba inomthamo ophindwe kabini wogcino. Nangona kunjalo, xa kuthelekiswa neendleko zokugqibela zesisombululo esisekelwe kuyo kunye nezinto ezifanayo ezivela kwabanye abathengisi, iindleko zingathathwa njengephantsi.
I-topology yokuqhagamshela iiseva zesicelo kunye ne-Flash yoluhlu lweenodi ziya kujongeka ngolu hlobo:
Xa ucwangcisa i-topology, kukwacetyiswa kakhulu ukuphindaphinda iiswitshi zolawulo kunye neeseva zonxibelelwano.
Apha nangaphezulu siza kuthetha ngokuqhagamshela ngeFiber Channel. Ukuba usebenzisa i-iSCSI, yonke into iya kufana, ilungelelaniswe kwiintlobo zotshintshiselwano ezisetyenzisiweyo kunye nezicwangciso zoluhlu olwahlukileyo kancinci.
Umsebenzi wokulungiselela kuluhlu
Izixhobo kunye nesoftware esetyenziswayo
IiNkcazo zeseva kunye noTshintsho
Izixhobo
inkcazelo
Oracle Database 11g abancedisi
Два
Inkqubo yokusebenza yeseva
I-Oracle Linux
Uguqulelo lwedatha ye-Oracle
11g (RAC)
Iiprosesa ngeseva nganye
I-16 cores ezimbini ze-Intel® Xeon® CPU E5-2667 v2 @ 3.30GHz
Inkumbulo yomzimba ngeseva nganye
128GB
Inethiwekhi yeFC
I-16Gb/s FC ene-multipathing
FC HBA
I-Emulex Lpe-16002B
Izibuko zoluntu ezinikezelweyo ze-1GbE zolawulo lwamaqela
I-adaptha ye-ethernet ye-Intel RJ45
16Gb / s FC ukutshintsha
Brocade 6505
Izibuko ezinikezelweyo zabucala ze-10GbE zokuvumelanisa idatha
I-Intel X520
I-AccelStor NeoSapphire™ Yonke iMibalo yeFlash Array
Izixhobo
inkcazelo
Inkqubo yokugcina
NeoSapphire™ imodeli yokufumaneka okuphezulu: H710
Uguqulelo lomfanekiso
4.0.1
Lilonke inani lokuqhuba
48
Ubungakanani bokuqhuba
1.92TB
Uhlobo lweDrayivu
SSD
Amazibuko ekujoliswe kuwo yiFC
16x 16Gb izibuko (8 kwindawo nganye)
Amazibuko olawulo
Intambo ye-ethernet ye-1GbE eqhagamshela kwiinginginya ngokutshintsha kwe-ethernet
Ukubetha kwentliziyo port
Intambo ye-ethernet ye-1GbE edibanisa phakathi kweendawo ezimbini zokugcina
Indawo yongqamaniso lwedatha
I-56Gb/s intambo ye-InfiniBand
Ngaphambi kokuba usebenzise uluhlu, kufuneka uluqalise. Ngokungagqibekanga, idilesi yolawulo lweenodi zombini iyafana (192.168.1.1). Udinga ukudibanisa kubo nganye nganye kwaye usete iidilesi ezintsha (sele zihluke) kwaye usethe ulungelelwaniso lwexesha, emva koko ii-ports zoLawulo zinokudibaniswa kwinethiwekhi enye. Emva koko, ii-nodes zidibaniswe kwi-HA pair ngokunikezela ii-subnets zoqhagamshelwano lwe-Interlink.
Emva kokuba ukuqaliswa kugqityiwe, ungalawula uluhlu lwazo nakweyiphi na indawo.
Emva koko, senza imiqulu efunekayo kwaye siyipapashe kwiiseva zesicelo.
Kucetyiswa kakhulu ukwenza imiqulu emininzi ye-Oracle ASM njengoko oku kuya kwandisa inani leethagethi zeeseva, eziya kuthi ekugqibeleni ziphucule ukusebenza ngokubanzi (ngaphezulu kwimigca kwenye ).
Uqwalaselo loqwalaselo
Igama Lomthamo Wokugcina
Ubungakanani bevolumu
Idatha01
200GB
Idatha02
200GB
Idatha03
200GB
Idatha04
200GB
Idatha05
200GB
Idatha06
200GB
Idatha07
200GB
Idatha08
200GB
Idatha09
200GB
Idatha10
200GB
Igridi01
1GB
Igridi02
1GB
Igridi03
1GB
Igridi04
1GB
Igridi05
1GB
Igridi06
1GB
Phinda wenze kwakhona01
100GB
Phinda wenze kwakhona02
100GB
Phinda wenze kwakhona03
100GB
Phinda wenze kwakhona04
100GB
Phinda wenze kwakhona05
100GB
Phinda wenze kwakhona06
100GB
Phinda wenze kwakhona07
100GB
Phinda wenze kwakhona08
100GB
Phinda wenze kwakhona09
100GB
Phinda wenze kwakhona10
100GB
Ezinye iinkcazo malunga neendlela zokusebenza zoluhlu kunye neenkqubo ezenzeka kwiimeko eziphuthumayo
Iseti yedatha yenode nganye ine parameter "yenombolo yoguqulelo". Emva kokuqaliswa kokuqala, kuyafana kwaye kuyalingana no-1. Ukuba ngenxa yesizathu esithile inombolo yenguqu ihluke, ngoko idatha isoloko ivumelanisa ukusuka kwinguqulo endala ukuya kumncinci, emva koko inani lenguqu encinci ihambelana, oko kukuthi. oku kuthetha ukuba iikopi ziyafana. Izizathu zokuba kutheni iinguqulelo zinokwahluka:
- Ukuqalisa kwakhona okucwangcisiweyo kwenye yeenodi
- Ingozi kwenye yeenodi ngenxa yokuvalwa ngokukhawuleza (ukunikezelwa kwamandla, ukufudumala, njl.).
- Uqhagamshelo lwe-InfiniBand olulahlekileyo ngokungakwazi ukungqamanisa
- Ukuwa kwenye yeendawo ngenxa yorhwaphilizo lwedatha. Apha kuya kufuneka wenze iqela elitsha le-HA kwaye ugqibezele ungqamaniso lweseti yedatha.
Kwimeko nayiphi na into, i-node ehlala kwi-intanethi yandisa inombolo yayo yenguqulo enye ukwenzela ukuba ivumelanise isethi yayo yedatha emva kokuba uxhulumaniso kunye nesibini lubuyiselwe.
Ukuba uqhagamshelo phezu kwekhonkco Ethernet ilahleka, Heartbeat okwethutyana itshintshela InfiniBand kwaye ubuyela emva ngaphakathi 10 imizuzwana xa ibuyiselwe.
Ukumisela ababuki zindwendwe
Ukuqinisekisa ukunyamezela iimpazamo kunye nokuphucula ukusebenza, kufuneka uvumele inkxaso ye-MPIO kuluhlu. Ukwenza oku, kufuneka udibanise imigca kwifayile /etc/multipath.conf, kwaye uqalise kwakhona inkonzo yendlela yobuninzi.
Isicatshulwa esifihliweyoizixhobo {
isixhobo {
umthengisi "Astor"
indlela_yeqela_lomgaqo-nkqubo "iqela_nge_prio"
indlela_umkhethi "ubude bomgca 0"
indlela_umkhangeli "tur"
Iimpawu "0"
isixhobo_sosibambi "0"
ngaphambili "const"
ukungaphumeleli kwangoko
fast_io_fail_tmo 5
dev_loss_tmo 60
umsebenzisi_amagama_ewe ewe
detect_prio ewe
rr_min_io_rq 1
hayi_indlela_phinda uzame 0
}
}
Okulandelayo, ukuze i-ASM isebenze neMPIO nge-ASMLib, kufuneka utshintshe ifayile /etc/sysconfig/oracleasm emva koko uqhube /etc/init.d/oracleasm scandisks
Isicatshulwa esifihliweyo
# ORACLEASM_SCANORDER: Iipateni zokudibanisa ukucwangcisa ukuskena kwediski
ORACLEASM_SCANORDER="dm"
# ORACLEASM_SCANEXCLUDE: Ukutshatisa iipatheni ukukhuphela ngaphandle iidiski kwiskeni
ORACLEASM_SCANEXCLUDE="sd"
Qaphela:
Ukuba awufuni ukusebenzisa i-ASMLib, ungasebenzisa imigaqo ye-UDEV, esisiseko se-ASMLib.
Ukuqala ngenguqulo ye-12.1.0.2 ye-Oracle Database, ukhetho luyafumaneka ukuze kufakwe njengenxalenye ye-software ye-ASMFD.
Kunyanzelekile ukuba kuqinisekiswe ukuba iidiski ezenzelwe i-Oracle ASM zihambelana nobungakanani bebhloko apho uluhlu lusebenza ngokwasemzimbeni (4K). Ngaphandle koko, iingxaki zokusebenza zinokuthi zenzeke. Ke ngoko, kuyimfuneko ukwenza imiqulu ngeeparamitha ezifanelekileyo:
yahluliwe /dev/mapper/device-name mklabel gpt mkpart primary 2048s 100% lungelelanisa-jonga eyona 1
Ukusasazwa kogcino-lwazi kuyo yonke imiqulu eyenziweyo ukulungiselela uqwalaselo lwethu lovavanyo
Igama Lomthamo Wokugcina
Ubungakanani bevolumu
Umthamo we-LUNs wokwenza imephu
I-ASM Volume Device Detail
Ubungakanani beyunithi yolwabiwo
Idatha01
200GB
Imephu yonke imiqulu yokugcina kwisistim yogcino onke amazibuko edatha
UkuNgafuneki: Kuqhelekile
Igama:DGDATA
Injongo:Iifayile zedatha
4MB
Idatha02
200GB
Idatha03
200GB
Idatha04
200GB
Idatha05
200GB
Idatha06
200GB
Idatha07
200GB
Idatha08
200GB
Idatha09
200GB
Idatha10
200GB
Igridi01
1GB
UkuNgafuneki: Kuqhelekile
Igama: DGGRID1
Injongo:Igridi: CRS kunye noVoto
4MB
Igridi02
1GB
Igridi03
1GB
Igridi04
1GB
UkuNgafuneki: Kuqhelekile
Igama: DGGRID2
Injongo:Igridi: CRS kunye noVoto
4MB
Igridi05
1GB
Igridi06
1GB
Phinda wenze kwakhona01
100GB
UkuNgafuneki: Kuqhelekile
Igama: DGREDO1
Injongo: Phinda wenze ilog yomsonto 1
4MB
Phinda wenze kwakhona02
100GB
Phinda wenze kwakhona03
100GB
Phinda wenze kwakhona04
100GB
Phinda wenze kwakhona05
100GB
Phinda wenze kwakhona06
100GB
UkuNgafuneki: Kuqhelekile
Igama: DGREDO2
Injongo: Phinda wenze ilog yomsonto 2
4MB
Phinda wenze kwakhona07
100GB
Phinda wenze kwakhona08
100GB
Phinda wenze kwakhona09
100GB
Phinda wenze kwakhona10
100GB
Izicwangciso zeDatabase
- Ubungakanani bebhloko = 8K
- Indawo yokutshintsha = 16GB
- Khubaza i-AMM (uLawulo lweMemori oluzenzekelayo)
- Khubaza amaPhepha amakhulu aNgaphandle
Ezinye iisetingi
# vi /etc/sysctl.conf
✓ fs.aio-max-nr = 1048576
✓ fs.ifayile-ubuninzi = 6815744
✓ kernel.shmmax 103079215104
✓ kernel.shmall 31457280
✓ kernel.shmmn 4096
✓ kernel.sem = 250 32000 100 128
✓ net.ipv4.ip_local_port_range = 9000 65500
✓ net.core.rmem_default = 262144
✓ net.core.rmem_max = 4194304
✓ net.core.wmem_default = 262144
✓ net.core.wmem_max = 1048586
✓vm.swappiness=10
✓ vm.min_free_kbytes=524288 # sukucwangcisa oku ukuba usebenzisa i Linux x86
✓ vm.vfs_cache_pressure=200
✓ vm.nr_hugepages = 57000
# vi /etc/security/limits.conf
✓ igridi ethambileyo ye-nproc 2047
✓ igridi elukhuni nproc 16384
✓ igridi ethambileyo inofile 1024
✓ igridi elukhuni nofileyo 65536
✓ isitakhi esithambileyo segridi 10240
✓ isitakhi esiqinileyo segridi 32768
✓ i-oracle ethambileyo ye-nproc 2047
✓ oracle nzima nproc 16384
✓ i-oracle soft nofile 1024
✓ i-oracle hard nofile 65536
✓ isitaki esithambileyo se-oracle 10240
✓ isitaki esiqinileyo se-oracle 32768
✓ i-memlock ethambileyo 120795954
✓ i-memlock enzima 120795954
sqlplus "/ as sysdba"
guqula inkqubo yokuseta inkqubo=2000 scope=spfile;
isixokelelwano sokutshintsha open_cursors=2000 scope=spfile;
tshintsha inkqubo iseti session_cached_cursors=300 scope=spfile;
guqula inkqubo yokuseta db_files=8192 scope=spfile;
Uvavanyo lokusilela
Ngeenjongo zokubonisa, i-HammerDB isetyenziselwe ukulinganisa umthwalo we-OLTP. Ubumbeko lwe-HammerDB:
Inani leZitora
256
IiNtengiselwano zizonke ngoMsebenzisi ngamnye
1000000000000
Abasebenzisi be-Virtual
256
Isiphumo saba yi-2.1M TPM, ekude kumda wokusebenza koluhlu , kodwa "yisilingi" yoqwalaselo lwehardware yangoku yeeseva (isikakhulu ngenxa yabaqhubekekisi) kunye nenani labo. Injongo yolu vavanyo isabonisa ukunyamezela kwesiphoso kwisisombululo ngokubanzi, kwaye kungekhona ukuphumeza ukusebenza okuphezulu. Ke ngoko, siya kwakha nje kulo mzobo.
Uvavanyo lokungaphumeleli kwenye yeenodi
Imikhosi yalahlekelwa inxalenye yeendlela zokugcina, iqhubeka nokusebenza ngokuseleyo kunye ne-node yesibini. Ukusebenza kwehle imizuzwana embalwa ngenxa yeendlela eziphinda zakhiwe, kwaye emva koko zibuyele kwesiqhelo. Khange kubekho ziphazamiso kwinkonzo.
Uvavanyo lokungaphumeleli kweKhabhinethi ngazo zonke izixhobo
Kule meko, ukusebenza kwakhona kwehla imizuzwana embalwa ngenxa yohlengahlengiso lweendlela, kwaye emva koko kubuyiselwe kwisiqingatha sexabiso lokuqala. Isiphumo sasiyisiqingatha ukusuka kwesokuqala ngenxa yokungabandakanywa kweseva yesicelo enye ekusebenzeni. Kwakungekho kuphazamiseka enkonzweni.
Ukuba kukho imfuneko yokuphumeza isisombululo sokubuyisela intlekele ye-Cross-Rack kwi-Oracle ngexabiso elifanelekileyo kunye nomzamo omncinci wokuhambisa / wokulawula, ngoko i-Oracle RAC kunye ne-architecture isebenza kunye. iya kuba yenye yezona ndlela zingcono. Esikhundleni se-Oracle RAC, kunokubakho nayiphi na enye isofthiwe ebonelela ngokudibanisa, i-DBMS efanayo okanye iinkqubo ze-virtualization, umzekelo. Umgaqo wokwakha isisombululo uya kuhlala ufana. Kwaye umgca osezantsi ngu-zero we-RTO kunye ne-RPO.
umthombo: www.habr.com