Huwandu hwakati wandei hweBusiness application uye virtualization masisitimu vane yavo nzira yekuvaka yekutadza-kushivirira mhinduro. Kunyanya, Oracle RAC (Oracle Real Application Cluster) isumbu revaviri kana anopfuura Oracle dhatabhesi maseva anoshanda pamwechete kuenzanisa mutoro uye kupa kukanganisa kushivirira pane server / application level. Kuti ushande mune iyi modhi, iwe unoda yakagovaniswa chengetedzo, iyo inowanzova yekuchengetedza system.
Sezvatakambokurukura mune imwe yedu , iyo yekuchengetedza sisitimu pachayo, kunyangwe kuvepo kwezvakadzokororwa zvikamu (kusanganisira controller), ichine mapoinzi ekutadza - kunyanya muchimiro cheseti imwe chete yedata. Naizvozvo, kuvaka mhinduro yeOracle nekuwedzera kuvimbika zvinodiwa, iyo "N maseva - imwe yekuchengetedza sisitimu" chirongwa chinoda kuve chakaoma.
Kutanga, chokwadika, tinofanira kusarudza kuti injodzi dzipi dzatiri kuedza kuisa inishuwarenzi padziri. Muchinyorwa chino, isu hatizofunga nezve dziviriro pakutyisidzira senge "meteorite yasvika." Saka kuvaka nharaunda yakapararira yekudzoreredza njodzi mhinduro icharamba iri musoro wechimwe chezvinyorwa zvinotevera. Pano tichatarisa iyo inonzi Cross-Rack njodzi yekugadzirisa mhinduro, apo kuchengetedzwa kunovakwa pamwero wevhavha makabati. Iwo makabati pachawo anogona kuwanikwa mukamuri imwechete kana mune akasiyana, asi kazhinji mukati meimba imwechete.
Aya makabati anofanirwa kuve neseti inodiwa yese yemidziyo uye software inobvumira kushanda kweOracle dhatabhesi zvisinei nemamiriro e "muvakidzani". Mune mamwe mazwi, tichishandisa Cross-Rack njodzi yekudzoreredza mhinduro, tinobvisa njodzi dzekutadza:
- Oracle Application Servers
- Zvirongwa zvekuchengetedza
- Kuchinja masisitimu
- Kukundikana zvachose kwemidziyo yese mukhabhineti:
- Kuramba simba
- Kutonhora kwehurongwa kutadza
- Zvinhu zvekunze (munhu, hunhu, nezvimwewo)
Kudzokororwa kwemaseva eOracle kunoreva iyo chaiyo inoshanda musimboti weOracle RAC uye unoitwa kuburikidza nekushandisa. Kudzokororwa kwezvivakwa zvekuchinja zvakare harisi dambudziko. Asi nekudzokorora kwegadziriro yekuchengetedza, zvese hazvisi nyore.
Sarudzo yakareruka ndeyekudzokorodza data kubva kune huru yekuchengetedza sisitimu kune iyo backup imwe. Synchronous kana asynchronous, zvichienderana nekugona kwegadziriro yekuchengetedza. Neasynchronous replication, mubvunzo unobva wamuka wekuona kuenderana kwedata zvine chekuita neOracle. Asi kunyangwe paine kubatanidzwa kwesoftware nechishandiso, mune chero mamiriro ezvinhu, kana paine kutadza pane huru yekuchengetedza sisitimu, kupindira kwemanyorero nevatungamiriri kunozodiwa kuitira kuti uchinje sumbu kukuchengetedza kuchengetedza.
Imwe nzira yakaoma ndeye software uye / kana hardware kuchengetedza "virtualizers" iyo inobvisa kusawirirana kwezvinetso uye kupindira kwemanyore. Asi kuomarara kwekuendesa uye kunotevera manejimendi, pamwe nemutengo wakashata wemhinduro dzakadaro, zvinovhundutsa vazhinji.
Iyo AccelStor NeoSapphire ™ Yese Flash array mhinduro yakanakira mamiriro akadai seCross-Rack kupora njodzi. uchishandisa Shared-Nothing architecture. Iyi modhi imbiri-node yekuchengetedza sisitimu inoshandisa tekinoroji yeFlexiRemap® kushanda nemadhiraivha. Thanks to NeoSapphire™ H710 inokwanisa kuendesa kuita kunosvika 600K IOPS@4K zvisina tsarukano kunyora uye 1M+ IOPS@4K kuverenga zvisina tsarukano, izvo zvisingawanikwe kana uchishandisa ekare RAID-yakavakirwa masisitimu ekuchengetera.
Asi chinhu chikuru cheNeoSapphire ™ H710 ndechekuitwa kwemanodhi maviri muchimiro chekesi dzakasiyana, imwe neimwe ine kopi yayo yedata. Kuwiriranisa kwemanodhi kunoitwa kuburikidza neyekunze InfiniBand interface. Kutenda kune iyi dhizaini, zvinokwanisika kugovera node kunzvimbo dzakasiyana kure kure kusvika ku100m, nekudaro ichipa Cross-Rack njodzi yekudzoreredza mhinduro. Manode ese ari maviri anoshanda zvachose synchronously. Kubva kudivi rekugamuchira, iyo H710 inotaridzika seyakajairwa mbiri-yedhizaini yekuchengetedza system. Naizvozvo, hapana chikonzero chekuita chero yekuwedzera software kana hardware sarudzo kana kunyanya kuomesesa marongero.
Kana tikaenzanisa ese Cross-Rack njodzi yekudzoreredza mhinduro inotsanangurwa pamusoro, saka sarudzo kubva kuAccelStor inomira pachena kubva kune vamwe:
AccelStor NeoSapphire™ Yakagovera Hapana Chimiro
Software kana hardware "virtualizer" yekuchengetedza system
Replication-based solution
Kuwanika
Server kukundikana
Hapana Downtime
Hapana Downtime
Hapana Downtime
Kuchinja kukundikana
Hapana Downtime
Hapana Downtime
Hapana Downtime
Kukundikana kwegadziriro yekuchengeta
Hapana Downtime
Hapana Downtime
Downtime
Kutadza kwekabati kwese
Hapana Downtime
Hapana Downtime
Downtime
Mutengo uye kuoma
Solution mutengo
Pazasi*
Высокая
Высокая
Deployment yakaoma
Low
Высокая
Высокая
*AccelStor NeoSapphire™ ichiri Yese Flash array, iyo netsanangudzo haitore "3 kopecks," kunyanya sezvo iine kaviri chengetedzo. Zvisinei, pakuenzanisa mutengo wekupedzisira wekugadzirisa unobva pairi nemamwe akafanana kubva kune vamwe vatengesi, mari yacho inogona kuonekwa yakaderera.
Iyo topology yekubatanidza maseva ekushandisa uye Yese Flash array node inotaridzika seizvi:
Kana uchironga iyo topology, zvakare inokurudzirwa zvakanyanya kutevedzera manejimendi switch uye yekubatanidza maseva.
Pano uye mberi isu tichataura nezve yekubatanidza kuburikidza neFiber Channel. Kana iwe ukashandisa iSCSI, zvese zvichave zvakafanana, zvakagadziridzwa kune marudzi ekuchinja anoshandiswa uye zvishoma akasiyana marongero.
Basa rekugadzirira pane array
Zvishandiso uye software inoshandiswa
Server uye Switch Specifications
Components
tsananguro
Oracle Database 11g maseva
Two
Server inoshanda system
oracle linux
Oracle database version
11g (RAC)
processors per server
Mbiri gumi nematanhatu Intel® Xeon® CPU E16-5 v2667 @ 2GHz
Physical memory per server
128GB
FC network
16Gb/s FC ine multipathing
FC HBA
Emulex Lpe-16002B
Yakatsaurirwa yeruzhinji 1GbE ports ye cluster management
Intel ethernet adapta RJ45
16Gb/s FC chinja
Brocade 6505
Yakatsaurirwa yakavanzika 10GbE ports yekubatanidza data
Intel X520
AccelStor NeoSapphire™ Yese Flash Array Yakatsanangurwa
Components
tsananguro
Kuchengetedza system
NeoSapphire™ yepamusoro inowanikwa modhi: H710
Mufananidzo vhezheni
4.0.1
Huwandu hwemadhiraivha
48
Dhiraivha saizi
1.92TB
Dhiyabhorosi rudzi
SSD
FC chinangwa chezviteshi
16x 16Gb ports (8 pa node)
Management ports
Iyo 1GbE ethernet tambo inobatanidza kune vanogamuchira kuburikidza ne ethernet switch
Heartbeat port
Iyo 1GbE ethernet tambo inobatanidza pakati penzvimbo mbiri dzekuchengetera
Data synchronization port
56Gb/s InfiniBand tambo
Usati washandisa array, unofanira kutanga. Nekutadza, kero yekudzora yenode mbiri yakafanana (192.168.1.1). Iwe unofanirwa kubatanidza kwavari imwe neimwe uye kuseta nyowani (yakatosiyana) manejimendi kero uye kuseta nguva yekuwiriranisa, mushure meiyo Management ports inogona kubatanidzwa kune imwechete network. Mushure mezvo, node dzinosanganiswa kuita HA pair nekupa subnets yeInterlink yekubatanidza.
Mushure mekutanga kwapera, unogona kubata dhizaini kubva kune chero node.
Tevere, isu tinogadzira mavhoriyamu anodiwa uye tinoashambadzira kumaseva ekushandisa.
Zvinokurudzirwa kugadzira akawanda mavhoriyamu eOracle ASM sezvo izvi zvichizowedzera huwandu hwezvinangwa zvemaseva, izvo zvinozopedzisira zvanatsiridza kuita kwese (zvimwe pamitsetse mune imwe. ).
Test configuration
Zita Rokuchengetera Vhoriyamu
Kukura kwehoriyamu
Dhata01
200GB
Dhata02
200GB
Dhata03
200GB
Dhata04
200GB
Dhata05
200GB
Dhata06
200GB
Dhata07
200GB
Dhata08
200GB
Dhata09
200GB
Dhata10
200GB
Grid01
1GB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Grid05
1GB
Grid06
1GB
Redo01
100GB
Redo02
100GB
Redo03
100GB
Redo04
100GB
Redo05
100GB
Redo06
100GB
Redo07
100GB
Redo08
100GB
Redo09
100GB
Redo10
100GB
Dzimwe tsananguro nezve mashandisirwo maitiro eiyo array uye maitiro anoitika mumamiriro ekukurumidzira
Iyo data set yeimwe node ine "version nhamba" parameter. Mushure mekutanga kwekutanga, iyo yakafanana uye yakaenzana ne 1. Kana nokuda kwechimwe chikonzero nhamba yevhesi yakasiyana, ipapo data inogara ichifananidzwa kubva kune yekare shanduro kusvika kune diki, mushure mokunge nhamba yeshanduro yechidiki inopindirana, i.e. izvi zvinoreva kuti makopi akafanana. Zvikonzero nei shanduro dzingave dzakasiyana:
- Yakarongwa reboot yeimwe yemanodhi
- Tsaona pane imwe node nekuda kwekuvhara kamwe kamwe (simba rekupa, kupisa, nezvimwewo).
- Yakarasika InfiniBand yekubatanidza nekusakwanisa kuwiriranisa
- Kuputsika pane imwe yemanodhi nekuda kwehuori hwe data. Pano iwe unozofanirwa kugadzira iyo itsva HA boka uye yakakwana kuwiriranisa kweiyo data set.
Chero zvazvingaitika, iyo node inoramba iri online inowedzera nhamba yayo yevhezheni neimwe kuitira kuwiriranisa data yayo yakatarwa mushure mekubatana nevaviri kwadzorerwa.
Kana kubatanidza pamusoro peEthernet link kukarasika, Heartbeat inochinja kwekanguva kuInfiniBand uye inodzoka shure mukati memasekonzi gumi kana yadzorerwa.
Kugadzira vaenzi
Kuti uve nechokwadi chekushivirira kukanganisa uye nekuvandudza mashandiro, iwe unofanirwa kugonesa MPIO rutsigiro rweiyo array. Kuti uite izvi, unofanirwa kuwedzera mitsetse ku /etc/multipath.conf faira, uye wotangazve sevhisi yenzira dzakawanda.
Zvinyorwa zvakavanzwazvishandiso {
mudziyo {
mutengesi "Astor"
path_grouping_policy "group_by_prio"
nzira_selector "mutsara-urefu 0"
nzira_checker "tur"
zvinhu "0"
hardware_handler "0"
prio "const"
failback pakarepo
fast_io_fail_tmo 5
dev_loss_tmo 60
user_friendly_names hongu
detect_prio hongu
rr_min_io_rq 1
no_path_try 0
}
}
Tevere, kuitira kuti ASM ishande neMPIO kuburikidza ne ASMLib, unofanirwa kushandura iyo /etc/sysconfig/oracleasm faira wobva wamhanya /etc/init.d/oracleasm scandisks
Zvinyorwa zvakavanzwa
# ORACLEASM_SCANORDER: Kufananidza mapatani ekuraira disk scanning
ORACLEASM_SCANORDER="dm"
# ORACLEASM_SCANEXCLUDE: Kufananidza mapatani ekubvisa madhisiki kubva ku scan
ORACLEASM_SCANEXCLUDE="sd"
taura pfungwa
Kana iwe usingade kushandisa ASMLib, unogona kushandisa iyo UDEV mitemo, inova hwaro hwe ASMLib.
Kutanga neshanduro 12.1.0.2 yeOracle Database, sarudzo iripo yekuiswa sechikamu cheASMFD software.
Izvo zvakakosha kuve nechokwadi kuti madhisiki akagadzirwa eOracle ASM anoenderana nehukuru hwebhuroka iyo array inoshanda nayo mumuviri (4K). Zvikasadaro, matambudziko ekuita anogona kuitika. Naizvozvo, zvinodikanwa kugadzira mavhoriyamu neakakodzera paramita:
zvakakamurwa /dev/mapper/device-zita mklabel gpt mkpart primary 2048s 100% align-cheki yakakwana 1
Kugoverwa kwemadatabase pamavhoriyamu akagadzirwa ekugadzirisa kwedu bvunzo
Zita Rokuchengetera Vhoriyamu
Kukura kwehoriyamu
Vhoriyamu LUNs mepu
ASM Volume Device Detail
Allocation Unit Saizi
Dhata01
200GB
Mepu mavhoriyamu ese ekuchengetera kune ekuchengetedza system ese data ports
Redundancy: Zvakajairika
Zita:DGDATA
Chinangwa: Data mafaira
4MB
Dhata02
200GB
Dhata03
200GB
Dhata04
200GB
Dhata05
200GB
Dhata06
200GB
Dhata07
200GB
Dhata08
200GB
Dhata09
200GB
Dhata10
200GB
Grid01
1GB
Redundancy: Zvakajairika
Zita: DGGRID1
Chinangwa:Gridhi: CRS uye Kuvhota
4MB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Redundancy: Zvakajairika
Zita: DGGRID2
Chinangwa:Gridhi: CRS uye Kuvhota
4MB
Grid05
1GB
Grid06
1GB
Redo01
100GB
Redundancy: Zvakajairika
Zita: DGREDO1
Chinangwa: Dzokorora danda re thread 1
4MB
Redo02
100GB
Redo03
100GB
Redo04
100GB
Redo05
100GB
Redo06
100GB
Redundancy: Zvakajairika
Zita: DGREDO2
Chinangwa: Dzokorora danda re thread 2
4MB
Redo07
100GB
Redo08
100GB
Redo09
100GB
Redo10
100GB
Database Settings
- Saizi yekuvhara = 8K
- Chinjana nzvimbo = 16GB
- Dzima AMM (Otomatiki Memory Management)
- Dzima Transparent Huge Mapeji
Zvimwe zvirongwa
# vi /etc/sysctl.conf
✓ fs.aio-max-nr = 1048576
✓ fs.file-max = 6815744
✓ kernel.shmmax 103079215104
✓ kernel.shmall 31457280
✓ kernel.shmmn 4096
✓ kernel.sem = 250 32000 100 128
✓ net.ipv4.ip_local_port_range = 9000 65500
✓ net.core.rmem_default = 262144
✓ net.core.rmem_max = 4194304
✓ net.core.wmem_default = 262144
✓ net.core.wmem_max = 1048586
✓vm.swappiness=10
✓ vm.min_free_kbytes=524288 # usaise izvi kana uri kushandisa Linux x86
✓ vm.vfs_cache_pressure=200
✓ vm.nr_hugepages = 57000
# vi /etc/security/limits.conf
✓ grid yakapfava nproc 2047
✓ grid yakaoma nproc 16384
✓ grid nyoro nofile 1024
✓ grid hard nofile 65536
✓ grid yakapfava stack 10240
✓ grid hard stack 32768
✓ oracle nyoro nproc 2047
✓ oracle yakaoma nproc 16384
✓ oracle nyoro nofile 1024
✓ oracle hard nofile 65536
✓ oracle yakapfava stack 10240
✓ oracle yakaoma stack 32768
✓ nyoro memlock 120795954
✓ hard memlock 120795954
sqlplus "/ as sysdba"
shandura masisitimu eseti maitiro=2000 scope=spfile;
alter system set open_cursors=2000 scope=spfile;
shandura system set session_cached_cursors=300 scope=spfile;
alter system set db_files=8192 scope=spfile;
Kutadza bvunzo
Nezvinangwa zvekuratidzira, HammerDB yakashandiswa kutevedzera mutoro weOLTP. HammerDB kugadzirisa:
Nhamba Yematura
256
Total Transactions per User
1000000000000
Virtual Users
256
Mhedzisiro yacho yaive 2.1M TPM, iri kure neiyo array's performance limit , asi i "ceiling" yeazvino hardware kumisikidzwa yemaseva (kunyanya nekuda kwema processors) uye nhamba yavo. Chinangwa chebvunzo iyi ichiri kuratidza kukanganisa kushivirira kwemhinduro seyakazara, uye kwete kuwana yakanyanya kuita. Naizvozvo, isu tichangovaka pane iyi nhamba.
Muedzo wekukundikana kweimwe node
Iwo mauto akarasikirwa nechikamu chenzira dzekuchengetera, achienderera mberi nekushanda kuburikidza neakasara ane node yechipiri. Kuita kwakadzikira kwemasekonzi mashoma nekuda kwenzira dziri kuvakwazve, ndokuzodzokera kune zvakajairika. Pakanga pasina kudzongonyedzwa mubasa.
Cabinet kutadza bvunzo nemidziyo yese
Muchiitiko ichi, kushanda kwakadonhawo kwemasekondi mashomanana nekuda kwekugadzirisazve nzira, uye ndokudzokera kuhafu yehuwandu hwepakutanga. Mhedzisiro yacho yakave nehafu kubva kune yekutanga nekuda kwekusabatanidzwa kweimwe application server kubva mukushanda. Pakanga pasina kudzongonyedzwa mubasa zvakare.
Kana paine kudikanwa kwekushandisa kukanganisa-kushivirira kweCross-Rack njodzi yekudzoreredza mhinduro yeOracle nemutengo unonzwisisika uye nekushomeka kudiki / kutonga kushanda, ipapo Oracle RAC uye zvivakwa zvinoshanda pamwechete. ichava imwe yezvakanakisa sarudzo. Panzvimbo yeOracle RAC, panogona kuve nechero imwe software inopa kubatanidza, iyo yakafanana DBMS kana virtualization masisitimu, semuenzaniso. Nheyo yekugadzira mhinduro icharamba yakafanana. Uye iyo yepasi ndeye zero yeRTO neRPO.
Source: www.habr.com