Tiro aad u badan oo ka mid ah codsiyada ganacsiga iyo nidaamyada ikhtiraacida ayaa leh habab iyaga u gaar ah oo lagu dhisayo xalalka u dulqaadan kara cilladaha. Gaar ahaan, Oracle RAC (Oracle Real Application Cluster) waa koox ka kooban laba ama in ka badan oo ka mid ah xayndaabyada xogta Oracle oo ka wada shaqaynaya sidii ay isugu dheellitiri lahaayeen culayska iyo bixinta dulqaadka khaladka ah ee heerka adeegaha/arjiga. Si aad ugu shaqeyso qaabkan, waxaad u baahan tahay kayd la wadaago, taas oo inta badan ah nidaamka kaydinta.
Sida aynu hore uga soo hadalnay mid ka mid ah our , nidaamka kaydinta laftiisa, in kasta oo ay jiraan qaybo nuqul ka mid ah (oo ay ku jiraan kontaroolayaasha), weli waxa uu leeyahay dhibco guuldarro - inta badan qaab xogta set oo keliya. Sidaa darteed, si loo dhiso xalka Oracle oo leh shuruudo la isku halleyn karo oo kordhay, nidaamka "N servers - one system system" wuxuu u baahan yahay inuu adkaado.
Marka hore, dabcan, waxaan u baahanahay inaan go'aan ka gaarno khataraha aan isku dayeyno inaan ka caymino. Maqaalkan, kama tixgelin doono ilaalinta hanjabaadaha sida "meteorite ayaa yimid." Markaa dhisidda xal ka-soo-kabashada musiibada oo kala firidhsan ayaa ahaan doonta mawduuc ka mid ah maqaallada soo socda. Halkan waxaan ku eegi doonaa waxa loogu yeero xalka soo kabashada musiibada Cross-Rack, marka ilaalinta lagu dhiso heerka armaajooyinka server-ka. Armaajooyinka laftoodu waxay ku yaalaan hal qol ama kuwo kala duwan, laakiin badanaa waxay ku yaalaan dhismo isku mid ah.
Armaajooyinkani waa inay ka kooban yihiin dhammaan qalabka lagama maarmaanka u ah qalabka iyo software-ka kaas oo u oggolaanaya hawlgalka xogta Oracle iyada oo aan loo eegin xaaladda "deriska". Si kale haddii loo dhigo, iyadoo la adeegsanayo xalka soo kabashada musiibada Cross-Rack, waxaan meesha ka saaraynaa khataraha fashilka:
- Adeegayaasha Codsiga Oracle
- Nidaamka kaydinta
- Nidaamyada beddelka
- Qalabkii golaha wasiirada oo dhan oo si buuxda u fashilmay:
- Awood diid
- Nadaamka qaboojinta fashilka
- Arrimaha dibadda (aadmiga, dabeecadda, iwm.)
Isku-duubnida server-yada Oracle waxa ay tusinaysaa mabda'a hawlgalka ee Oracle RAC waxaana lagu hirgeliyaa codsi. Ku celcelinta tas-hiilaadka beddelka sidoo kale dhib maaha. Laakiin marka la isku celceliyo nidaamka kaydinta, wax walba ma fududa.
Xulashada ugu fudud waa ku-celinta xogta laga soo bilaabo nidaamka kaydinta ugu weyn oo loo beddelo kaydka. Isku-duubni ama asynchronous, iyadoo ku xidhan awoodaha nidaamka kaydinta. Ku celcelinta asynchronous, su'aashu isla markiiba waxay soo baxaysaa hubinta joogtaynta xogta ee la xiriirta Oracle. Laakiin xitaa haddii ay jirto isdhexgalka software ee codsiga, xaalad kasta, haddii ay dhacdo fashil ku yimaada nidaamka kaydinta ugu weyn, faragelinta gacanta ee maamulayaasha ayaa loo baahan doonaa si loogu beddelo kutlada kaydinta kaydinta.
Ikhtiyaar aad u adag waa software iyo/ama kaydinta qalabka "virtualizers" kaas oo meesha ka saari doona dhibaatooyinka joogtada ah iyo faragelinta gacanta. Laakiin kakanaanta hawlgelinta iyo maamulka ku xiga, iyo sidoo kale qiimaha aan habboonayn ee xalalka noocaas ah, ayaa cabsi geliya kuwo badan.
AccelStor NeoSapphire ™ Dhammaan xallinta array Flash waxay ku habboon tahay xaaladaha sida soo kabashada musiibada Cross-Rack iyadoo la isticmaalayo qaab-dhismeedka la wadaago-waxba. Habkani waa kayd laba-node ah oo isticmaala tignoolajiyada iska leh ee FlexiRemap® si ay ugu shaqeeyaan flash drives. Mahadsanid NeoSapphire™ H710 waxa uu awood u leeyahay in uu keeno waxqabad ilaa 600K IOPS@4K qoraal random ah iyo 1M+ IOPS@4K akhriska random, kaas oo aan la heli karin marka la isticmaalayo hababka kaydinta caadiga ah ee RAID.
Laakiin muuqaalka ugu weyn ee NeoSapphire ™ H710 waa fulinta laba nood oo ah qaab kiisas gaar ah, mid kastaa wuxuu leeyahay nuqul u gaar ah oo xogta ah. Isku xidhka qanjidhada waxaa lagu fuliyaa iyada oo loo marayo interface InfiniBand dibadda. Thanks to dhismahan, waxaa suurtagal ah in loo qaybiyo noodhka meelo kala duwan oo fogaan ah ilaa 100m, taas oo bixisa xal kabashada musiibada Cross-Rack. Labada noodu waxay si buuxda u shaqeeyaan si isku mid ah. Laga soo bilaabo dhinaca martida loo yahay, H710 waxay u egtahay nidaamka kaydinta laba-kontorool ee caadiga ah. Sidaa darteed, ma jirto baahi loo qabo in la sameeyo wax software dheeraad ah ama fursadaha hardware ama goobaha gaar ahaan kakan.
Haddii aan is barbar dhigno dhammaan xalalka soo kabashada musiibada Cross-Rack ee kor lagu sifeeyay, markaa doorashada AcelStor ayaa si muuqata uga muuqata inta kale:
AccelStor NeoSapphire ™ Wax La Wadaajiyay Ma Jirto Dhisme
Nidaamka kaydinta "virtualizer" software ama hardware
Xalka ku-saleysan-celinta
Helitaanka
Guuldarrooyinka adeegaha
Waqti La'aan
Waqti La'aan
Waqti La'aan
Beddelka fashilka
Waqti La'aan
Waqti La'aan
Waqti La'aan
Nidaamkii kaydinta oo xumaaday
Waqti La'aan
Waqti La'aan
Waqtiga dhaca
Guuldarradii golaha wasiirada oo dhan
Waqti La'aan
Waqti La'aan
Waqtiga dhaca
Qiimaha iyo kakanaanta
Qiimaha xalka
Hoose*
Vysокая
Vysокая
Kakanaanta hawlgelinta
Nizkaya
Vysокая
Vysокая
*AccelStor NeoSapphire™ wali waa All Flash array, kaas oo qeexitaan ahaan aan qiimahoodu "3 kopecks," gaar ahaan maadaama ay leedahay kayd awood labanlaab ah. Si kastaba ha noqotee, marka la barbardhigo qiimaha ugu dambeeya ee xalka oo ku salaysan kuwa la mid ah iibiyeyaasha kale, kharashka waxaa loo tixgelin karaa mid hooseeya.
Topology-ga isku xirka server-yada codsiyada iyo Dhammaan qanjidhada array Flash waxay u ekaan doontaa sidan:
Marka la qorsheynayo topology-ga, waxaa sidoo kale aad loogu talinayaa in la nuqulo furayaasha maamulka iyo server-yada isku xira.
Halkan iyo in ka badan waxaan ka hadli doonaa ku xidhka via Fiber Channel. Haddii aad isticmaasho iSCSI, wax walbaa waxay noqonayaan isku mid, oo lagu hagaajinayo noocyada furayaasha la isticmaalo iyo habayn kala duwan oo kala duwan.
Shaqada diyaarinta ee soo diyaarinta
Qalabka iyo software la isticmaalo
Tilmaamaha Server-ka iyo Bedelka
Qeybaha
Description
Oracle Database 11g server
Laba
Nidaamka hawlgalka Server
Oracle Linux
Nooca database Oracle
11g (RAC)
Processors halkii server
Laba 16 koor Intel® Xeon® CPU E5-2667 v2 @ 3.30GHz
Xusuusta jirka ee server kasta
128GB
Shabakadda FC
16Gb/s FC oo leh waddooyin badan
FC HBA
Emulex Lpe-16002B
Dekedo dadweyne 1GbE ah oo u heellan maamulka kooxda
Qalabka Ethernet ee Intel RJ45
16Gb/s FC
Qaybta 6505
Dekedo gaar ah oo 10GbE ah oo loo qoondeeyay isku xidhka xogta
Intel X520
AcelStor NeoSapphire™ Dhammaan Tilmaamaha Array Flash
Qeybaha
Description
Nidaamka kaydinta
Qaabka la heli karo ee NeoSapphire™: H710
Nooca sawirka
4.0.1
Wadarta tirada wadayaasha
48
Cabirka wadista
1.92TB
Nooca wadista
SSD
FC bartilmaameedka dekedaha
16x 16Gb dekedo (8 qandiba)
Dekadaha maamulka
Xadhkaha 1GbE ethernet ee ku xidha martigaliyayaasha iyada oo loo marayo furaha ethernetka
Dekedda garaaca wadnaha
Xadhkaha 1GbE ethernet ee isku xidha labada noodood ee kaydinta
Dekadda isku xidhka xogta
56Gb/s InfiniBand fiilada
Kahor intaadan isticmaalin array, waa inaad bilowdaa. Sida caadiga ah, ciwaanka kantaroolka ee labada nood waa isku mid (192.168.1.1). Waxaad u baahan tahay inaad mid mid ugu xirto iyaga oo aad dejiso cinwaanno cusub (oo horeba uga duwanaa) oo aad dejisay isku-xirnaanta waqtiga, ka dib dekedaha Maareynta waxaa lagu xiri karaa hal shabakad. Ka dib, qanjidhada ayaa la isku daraa labo HA iyada oo loo xilsaarayo isku xidhka isku xirka Interlink.
Ka dib bilawga bilawga ah, waxaad ka maareyn kartaa shaxanka nood kasta.
Marka xigta, waxaan abuurnaa mugga lagama maarmaanka ah waxaanan ku daabacnaa adeegayaasha codsiyada.
Waxaa aad loogu talinayaa in loo abuuro tirooyin badan Oracle ASM maxaa yeelay tani waxay kordhin doontaa tirada bartilmaameedyada server-yada, taas oo ugu dambeyntii hagaajin doonta waxqabadka guud (inbadan oo ku saabsan safafka kale). ).
Qaabeynta tijaabada
Magaca Mugga Kaydinta
Cabbirka mugga
Xogta01
200GB
Xogta02
200GB
Xogta03
200GB
Xogta04
200GB
Xogta05
200GB
Xogta06
200GB
Xogta07
200GB
Xogta08
200GB
Xogta09
200GB
Xogta10
200GB
Grid01
1GB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Grid05
1GB
Grid06
1GB
Dib u habeyn01
100GB
Dib u habeyn02
100GB
Dib u habeyn03
100GB
Dib u habeyn04
100GB
Dib u habeyn05
100GB
Dib u habeyn06
100GB
Dib u habeyn07
100GB
Dib u habeyn08
100GB
Dib u habeyn09
100GB
Dib u habeyn10
100GB
Qaar ka mid ah sharraxaadaha ku saabsan hababka hawlgalka ee array iyo hababka dhacaya xaaladaha degdegga ah
Qaabka xogta ee nood kastaa wuxuu leeyahay cabbirka "lambarka nooca". Ka dib bilawga bilawga ah, waxay la mid tahay oo la mid tahay 1. Haddii sababo qaar ka mid ah nambarka nuqulku ka duwan yahay, markaa xogta had iyo jeer waa isku mid laga bilaabo nuqulkii hore ilaa kan ka yar, ka dib nambarka nooca yar ayaa la siman yahay, i.e. Tani waxay ka dhigan tahay in koobiyada ay isku mid yihiin. Sababaha sababta noocyadu u kala duwanaan karaan:
- Dib-u-kicinta la qorsheeyay ee mid ka mid ah noodyada
- Shil ka dhacay mid ka mid ah qanjidhada oo ay sababtay xidhid kedis ah (korontada, kulaylka xad dhaafka ah, iwm.).
- Xidhiidhka InfiniBand ee lumay oo leh awood la'aanta in la wada shaqeeyo
- Shil ku dhacay mid ka mid ah noodyada sababtuna waa musuqmaasuqa xogta. Halkan waxaad u baahan doontaa inaad abuurto koox cusub oo HA oo dhammaystirto isku-dubbaridka xogta.
Si kastaba ha ahaatee, noodhka ku sii hadha intarneedka ayaa hal mid ku kordhiya nambarkiisa nooca si uu u habeeyo xogtiisa ka dib marka la soo celiyo xidhiidhka lammaanaha.
Haddii xidhiidhka ka sarreeya xidhiidhka Ethernet uu lumo, garaaca wadnaha si ku meel gaar ah ayuu u beddelaa InfiniBand oo uu ku soo noqdaa 10 ilbiriqsi gudahood marka la soo celiyo.
Dejinta martigaliyayaasha
Si loo xaqiijiyo dulqaadka qaladka iyo hagaajinta waxqabadka, waa inaad awood u yeelatid taageerada MPIO ee diyaarinta. Si tan loo sameeyo, waxaad u baahan tahay inaad ku darto khadadka faylka /etc/multipath.conf, ka dibna dib u bilaw adeegga multipath.
Qoraal qarsoonaaladaha {
qalab {
iibiyaha "AStor"
siyaasada_kooxeed_kooxeed_koox_prio
jidka_doorta "kuyuu-dhererka 0"
jeegaga jidka "tur"
sifooyinka "0"
hardware_handler "0"
prio "const"
fashilaad degdeg ah
fast_io_fail_tmo 5
dev_loss_tmo 60
user_friendly_names haa
ogaan_prio haa
rr_min_io_rq 1
dariiq_la'aan_dib u tijaabi 0
}
}
Marka xigta, si ay ASM ula shaqeyso MPIO iyada oo loo marayo ASMLib, waxaad u baahan tahay inaad bedesho faylka /etc/sysconfig/oracleasm ka dibna socodsii /etc/init.d/oracleasm scandisks
Qoraal qarsoon
# ORACLEASM_SCANORDER: Qaababka isbarbardhigga si loo dalbado iskaanka diskka
ORACLEASM_SCANORDER="dm"
# ORACLEASM_SCANEXCLUDE: Qaababka isbarbardhigga si looga saaro saxanka sawirka
ORACLEASM_SCANEXCLUDE="sd"
tacliiq
Haddii aadan rabin inaad isticmaasho ASMLib, waxaad isticmaali kartaa xeerarka UDEV, kuwaas oo saldhig u ah ASMLib.
Laga bilaabo nooca 12.1.0.2 ee Oracle Database, ikhtiyaarka ayaa diyaar u ah rakibida iyada oo qayb ka ah software-ka ASMFD.
Waa lama huraan in la hubiyo in saxannada loo sameeyay Oracle ASM ay la jaanqaadaan cabbirka xannibaadda ee ay hannaanku jir ahaan ugu shaqeeyo (4K). Haddii kale, dhibaatooyinka waxqabadka ayaa dhici kara. Sidaa darteed, waxaa lagama maarmaan ah in la abuuro mugga leh cabbirada ku habboon:
kala qaybsantay /dev/mapper/magaca-qalabka mklabel gpt mkpart hoose 2048s 100% toosin-hubinta ugu fiican 1
Qaybinta xog-ururinta ee dhammaan mugga la sameeyay ee qaabaynta imtixaankeena
Magaca Mugga Kaydinta
Cabbirka mugga
Khariidaynta mugga LUNs
ASM Mugga Aaladda Faahfaahinta
Cabbirka Unugga Qoondaynta
Xogta01
200GB
Khariidad dhammaan mugga kaydinta nidaamka kaydinta dhammaan dekedaha xogta
Ku-noqosho: Caadi
Magaca:DGDATA
Ujeedo:Faylasha xogta
4MB
Xogta02
200GB
Xogta03
200GB
Xogta04
200GB
Xogta05
200GB
Xogta06
200GB
Xogta07
200GB
Xogta08
200GB
Xogta09
200GB
Xogta10
200GB
Grid01
1GB
Ku-noqosho: Caadi
Magaca: DGGRID1
Ujeedo:Grid: CRS iyo Codaynta
4MB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Ku-noqosho: Caadi
Magaca: DGGRID2
Ujeedo:Grid: CRS iyo Codaynta
4MB
Grid05
1GB
Grid06
1GB
Dib u habeyn01
100GB
Ku-noqosho: Caadi
Magaca: DGREDO1
Ujeedo: Dib-u-habaynta log of thread 1
4MB
Dib u habeyn02
100GB
Dib u habeyn03
100GB
Dib u habeyn04
100GB
Dib u habeyn05
100GB
Dib u habeyn06
100GB
Ku-noqosho: Caadi
Magaca: DGREDO2
Ujeedo: Dib-u-habaynta log of thread 2
4MB
Dib u habeyn07
100GB
Dib u habeyn08
100GB
Dib u habeyn09
100GB
Dib u habeyn10
100GB
Dejinta Database
- Cabbirka xannibaadda = 8K
- Beddelka booska = 16GB
- Dami AMM (Maaraynta xusuusta tooska ah)
- Dami boggaga waaweyn ee hufan
Dejinta kale
# vi /etc/sysctl.conf
✓ fs.aio-max-nr = 1048576
✓ fs.file-max = 6815744
✓ kernel.shmmax 103079215104
✓ kernel.shmall 31457280
✓ kernel.shmmn 4096
✓ kernel.sem = 250 32000 100 128
✓ net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
✓ net.core.rmem_max = 4194304
✓ net.core.wmem_default = 262144
✓ net.core.wmem_max = 1048586
✓vm.swappiness=10
✓ vm.min_free_kbytes=524288 # ha dhigin tan haddii aad isticmaalayso Linux x86
✓ vm.vfs_cache_pressure=200
✓ vm.nr_hugepages = 57000
# vi /etc/security/limits.conf
✓ grid soft nproc 2047
✓ grid adag nproc 16384
✓ grid soft nofile 1024
✓ grid adag nofile 65536
✓ xirmo jilicsan 10240
✓ xirmada adag ee 32768
✓ Oracle soft nproc 2047
✓ Oracle hard nproc 16384
✓ Oracle soft nofile 1024
Oracle hard nofile 65536
Xidhmada jilicsan ee Oracle 10240
✓ Oracle hard stack 32768
Memlock jilicsan 120795954
Memlock adag 120795954
sqlplus "/ as sysdba"
hababka habaynta beddelka=2000 scope=spfile;
habka beddelka loo dhigay open_cursors=2000 scope=spfile;
beddelka habka loo dhigay session_cached_cursors=300 scope=spfile;
nidaamka beddelka db_files=8192 scope=spfile;
Tijaabada guuldarada
Ujeedooyinka bandhiga, HammerDB waxa loo isticmaalay in lagu daydo culayska OLTP. Habaynta HammerDB:
Tirada Bakhaarada
256
Wadarta macaamilka isticmaale kasta
1000000000000
Isticmaalayaasha Virtual
256
Natiijadu waxay ahayd 2.1M TPM, taasoo ka fog xadka wax qabad ee shaxanka , laakiin waa "saqaf" loogu talagalay habaynta qalabka hadda ee server-yada (ugu horreyntii sababtoo ah processor-yada) iyo lambarkooda. Ujeedada imtixaankani wali waa in la muujiyo dulqaadka khaladka ah ee xalka guud ahaan, oo aan la gaarin waxqabadka ugu sarreeya. Sidaa darteed, waxaan si fudud u dhisi doonaa jaantuskan.
Tijaabi fashilka mid ka mid ah qanjidhada
Martigaliyayaasha waxay lumiyeen qayb ka mid ah waddooyinka kaydinta, iyagoo sii wada inay ka shaqeeyaan kuwa soo hadhay ee leh qanjidhada labaad. Waxqabadka ayaa hoos u dhacay dhowr ilbiriqsi sababtoo ah waddooyinka dib loo dhisay, ka dibna caadi ayay ku soo noqotay. Ma jirin wax kala joogsi ah oo ku saabsan adeegga
Tijaabada fashilka golaha oo wata dhamaan qalabka
Xaaladdan oo kale, waxqabadka ayaa sidoo kale hoos u dhacay dhowr ilbiriqsi sababtoo ah dib u habeynta waddooyinka, ka dibna ku soo laabtay kala bar qiimaha asalka ah. Natiijada kala bar ayaa laga dhigay tii hore iyadoo ay ugu wacan tahay ka saarida hal server oo codsi ah oo shaqada laga saaray. Sidoo kale ma jirin wax kala joogsi ah oo ku saabsan adeegga.
Haddii ay jirto baahi loo qabo in la hirgeliyo xallinta cillad-u-dulqaadka Cross-Rack ee ka soo kabashada musiibada ee Oracle kharash macquul ah oo leh dadaal yar oo maamul / hawlgelin, ka dib Oracle RAC iyo naqshadeynta ayaa wada shaqeeya waxay noqon doontaa mid ka mid ah fursadaha ugu fiican. Halkii laga heli lahaa Oracle RAC, waxaa jiri kara software kasta oo bixiya isku-dubarid, DBMS isku mid ah ama hababka wax-ku-oolka ah, tusaale ahaan. Mabda'a dhismaha xalka wuxuu ahaan doonaa sidiisa. Xariiqda hoosena waa eber RTO iyo RPO.
Source: www.habr.com