O se numera tele o talosaga a Enterprise ma faiga fa'atekonolosi o lo'o i ai a latou lava faiga mo le fausiaina o fofo fa'aletonu. Aemaise lava, Oracle RAC (Oracle Real Application Cluster) o se fuifui o lua pe sili atu Oracle database servers o loʻo galulue faʻatasi e faapaleni le uta ma tuʻuina atu le faʻapalepale sese i le tulaga o le server / talosaga. Ina ia galue i lenei faiga, e te manaʻomia se faʻasoa faʻasoa, lea e masani lava o se mea e teu ai.
E pei ona uma ona tatou talanoaina i se tasi o tatou , o le faʻapipiʻiina lava ia, e ui lava i le i ai o vaega faʻalua (e aofia ai le faʻatonutonuina), o loʻo i ai pea tulaga o le toilalo - aemaise lava i le tulaga o se seti o faʻamaumauga. O le mea lea, ina ia fausia se vaifofo Oracle ma le faʻalauteleina o manaʻoga faʻalagolago, o le "N servers - one storage system" e manaʻomia ona faʻalavelave.
Muamua, ioe, e tatau ona tatou filifili po o le a le lamatiaga o loʻo tatou taumafai e faʻamautinoa. I te mataupu tenei, ka se mafau‵fau tatou ki te puipuiga mai mea fakama‵taku e pelā mo “se meteorite ko oko mai.” O lea la o le fausiaina o se fa'afanua fa'asalalau fa'alavelave toe fa'aleleia fofo o le a tumau pea o se autu mo se tasi o tala o lo'o mulimuli mai. O iinei o le a tatou vaʻavaʻai ai i le mea e taʻua o Cross-Rack faʻalavelave toe faʻaleleia fofo, pe a fausia le puipuiga i le tulaga o kapoti server. O kapoti lava ia e mafai ona tu i totonu o le potu e tasi pe i totonu o potu eseese, ae masani lava i totonu o le fale e tasi.
O nei kapeneta e tatau ona i ai le seti atoa o meafaigaluega ma polokalama e mafai ai ona faʻaogaina faʻamaumauga a Oracle e tusa lava po o le a le tulaga o le "tuaoi". I se isi faaupuga, faʻaaogaina le Cross-Rack faʻalavelave toe faʻaleleia fofo, matou te faʻaumatia tulaga lamatia o le toilalo:
- Oracle Application Servers
- Faiga teu oloa
- Suiga faiga
- Le manuia atoatoa o meafaigaluega uma i totonu o le kapeneta:
- Fa'afitiga malosi
- Fa'aletonu faiga fa'amafanafana
- O mea mai fafo (tagata, natura, ma isi)
O le toe fa'aluaina o 'au'aunaga a Oracle o lo'o fa'atusalia ai le ta'iala o le Oracle RAC ma fa'atinoina e ala i se talosaga. E le ose fa'afitauli fo'i le toe fa'aluaina o mea e sui ai. Ae faʻatasi ai ma le toe faʻaluaina o le teuina o mea, e le faigofie mea uma.
O le filifiliga pito sili ona faigofie o le toe fa'aliliuina o fa'amaumauga mai le faiga fa'amautu autu i le fa'amaumauga. Synchronous poʻo le asynchronous, faʻalagolago i le gafatia o le faʻaogaina o mea. Fa'atasi ai ma le fa'asologa fa'atasi, o le fesili e tula'i vave mai i le fa'amautinoaina o fa'amaumauga e fa'atatau i Oracle. Ae tusa lava pe i ai le tuʻufaʻatasia o polokalama faʻapipiʻi ma le talosaga, i soʻo se tulaga, i le tulaga o le toilalo i luga o le faʻapipiʻi autu, o le a manaʻomia le faʻaogaina o le tusi a le pule ina ia mafai ai ona fesuiaʻi le fuifui i le teuina faʻamaumauga.
O se filifiliga sili atu ona lavelave o le polokalama ma / poʻo le teuina o meafaigaluega "virtualizers" o le a faʻaumatia faʻafitauli tumau ma faʻaoga tusilima. Ae o le lavelave o le faʻapipiʻiina ma le pulega mulimuli ane, faʻapea foʻi ma le tau mataga o ia fofo, e faʻafefe ai le toʻatele.
Ole AccelStor NeoSapphire™ All Flash array solution e lelei atoatoa mo fa'aaliga e pei ole Cross-Rack fa'aleagaina fa'alavelave. fa'aogaina le fa'asoa-leai se fausaga fausaga. O lenei fa'ata'ita'iga ose faiga e teu ai pona e lua lea e fa'aogaina ai le tekonolosi FlexiRemap® e fa'aoga ai le ta'avale uila. Faafetai i NeoSapphire ™ H710 e mafai ona tuʻuina atu le faʻatinoga e oʻo atu i le 600K IOPS@4K tusitusi faʻafuaseʻi ma le 1M + IOPS@4K faitau faʻafuaseʻi, lea e le mafai ona maua pe a faʻaogaina faiga faʻapipiʻi masani RAID.
Ae o le vaega autu o NeoSapphire ™ H710 o le faʻatinoina o ni nodes se lua i le tulaga o mataupu eseese, e tofu ma lana lava kopi o faʻamaumauga. O le fa'amaopoopoina o nodes e fa'atinoina e ala ile fa'aoga ole InfiniBand fafo. Faʻafetai i lenei faʻataʻitaʻiga, e mafai ona tufatufaina atu nodes i nofoaga eseese i se mamao e oʻo atu i le 100m, ma tuʻuina atu ai se faʻalavelave faʻalavelave faʻaleagaina Cross-Rack. O pona uma e lua e galulue fa'atasi. Mai le itu talimalo, o le H710 e foliga mai o se faiga masani e teu ai le lua-pule. O le mea lea, e leai se mana'oga e fa'atino so'o se polokalame fa'aopoopo po'o meafaigaluega fa'apitoa po'o fa'alavelave fa'apitoa.
Afai tatou te faʻatusatusa uma faʻafitauli o le toe faʻaleleia o faʻalavelave faʻafuaseʻi o loʻo faʻamatalaina i luga, o le filifiliga mai le AccelStor e matua iloga lava mai isi:
AccelStor NeoSapphire™ Leai se Mea Fa'asoa Fa'ata'ita'iga
Polokalama po'o meafaigaluega fa'apipi'i "virtualizer".
Fofo fa'avae toe faia
Faʻamatalaga
Fa'aletonu le server
Leai se Downtime
Leai se Downtime
Leai se Downtime
Suiga toilalo
Leai se Downtime
Leai se Downtime
Leai se Downtime
Fa'aletonu faiga teu
Leai se Downtime
Leai se Downtime
Talosaga
Le manuia uma o le kapeneta
Leai se Downtime
Leai se Downtime
Talosaga
Tau ma lavelave
Tau fofo
Maulalo*
Faʻatonu
Faʻatonu
Lavelave le fa'atinoina
Tatalo
Faʻatonu
Faʻatonu
*AccelStor NeoSapphire™ ose All Flash array, lea i lona faauigaga e le tau “3 kopecks,” aemaise lava ona e faaluaina le gafatia. Ae ui i lea, pe a faʻatusatusa le tau mulimuli o se fofo e faʻavae i luga ma tutusa mai isi faʻatau, o le tau e mafai ona manatu maualalo.
O le topology mo le faʻafesoʻotaʻi sapalai talosaga ma All Flash array nodes o le a pei o lenei:
Pe a fuafuaina le topology, e matua fautuaina foi le faaluaina o suiga o le pulega ma fesoʻotaʻiga fesoʻotaʻiga.
O iinei ma isi o le a tatou talanoa e uiga i le fesoʻotaʻi e ala i le Fiber Channel. Afai e te faʻaogaina le iSCSI, o mea uma o le a tutusa, fetuutuunai mo ituaiga o ki faʻaaogaina ma faʻaoga eseese laʻititi.
Galuega sauniuni ile fa'asologa
Meafaigaluega ma polokalama faʻaaogaina
Server ma Suiga Fa'amatalaga
Vaega
faʻamatalaga
Oracle Database 11g servers
Lua
Faiga fa'aogaina o le server
oracle linux
Oracle fa'amaumauga fa'amaumauga
11g (RAC)
Fa'atonuga ile server
Lua 16 cores Intel® Xeon® CPU E5-2667 v2 @ 3.30GHz
Manatu fa'aletino ile server
128GB
FC feso'ota'iga
16Gb/s FC ma multipathing
FC HBA
Emulex Lpe-16002B
Ua tu'ufa'atasia uafu fa'alaua'itele 1GbE mo le fa'atonutonuina o fuifui
Intel ethernet adapter RJ45
16Gb/s FC ki
Peretania 6505
Fa'apitoa 10GbE ports mo fa'amaumauga fa'atasi
Intel X520
AccelStor NeoSapphire™ All Flash Array Fa'amatalaga
Vaega
faʻamatalaga
Teuina o Mea
NeoSapphire™ fa'ata'ita'iga avanoa maualuga: H710
Faiga ata
4.0.1
Aofa'i numera o ta'avale
48
Tele taavale
1.92TB
Taʻaloga taʻavale
SSD
FC taula'iga uafu
16x 16Gb ports (8 i le node)
Taulaga tau pulega
O le 1GbE ethernet cable e feso'ota'i atu i 'au e ala i le ethernet switch
Uafu tātā fatu
Le 1GbE ethernet cable e feso'ota'i i le va o nodes e lua e teu ai
Fa'amatalaga tu'u fa'atasi
56Gb/s InfiniBand uaea
Ae e te le'i fa'aogaina se laiga, e tatau ona e fa'amataina. E le mafai, o le tuatusi fa'atonutonu o nodes e lua e tutusa (192.168.1.1). E tatau ona e faʻafesoʻotaʻi ia i latou taʻitoʻatasi ma faʻapipiʻi tuatusi fou (ua eseese) pulega ma faʻapipiʻi taimi faʻatasi, pe a maeʻa ona mafai ona faʻafesoʻotaʻi ports o le Pulega i se fesoʻotaiga e tasi. A maeʻa, e tuʻufaʻatasia nodes i se HA paipa e ala i le tuʻuina atu o subnets mo fesoʻotaʻiga Interlink.
A mae'a le amataga, e mafai ona e pulea le laina mai so'o se node.
Le isi, matou te fatuina voluma talafeagai ma faʻasalalau i latou i luga o faʻaumau talosaga.
E matua fautuaina le fatuina o le tele o voluma mo Oracle ASM aua o lenei mea o le a faʻateleina ai le numera o sini mo 'auʻaunaga, lea o le a iu ai ina faʻaleleia le faʻatinoga atoa (sili atu i laina i se isi. ).
Fa'atonuga o su'ega
Igoa Volume Teuteu
Tele tele
Faʻamatalaga01
200GB
Faʻamatalaga02
200GB
Faʻamatalaga03
200GB
Faʻamatalaga04
200GB
Faʻamatalaga05
200GB
Faʻamatalaga06
200GB
Faʻamatalaga07
200GB
Faʻamatalaga08
200GB
Faʻamatalaga09
200GB
Faʻamatalaga10
200GB
Grid01
1GB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Grid05
1GB
Grid06
1GB
Toe fai01
100GB
Toe fai02
100GB
Toe fai03
100GB
Toe fai04
100GB
Toe fai05
100GB
Toe fai06
100GB
Toe fai07
100GB
Toe fai08
100GB
Toe fai09
100GB
Toe fai10
100GB
O nisi fa'amatalaga e uiga i faiga fa'aogaina o le laina ma fa'agasologa o lo'o tutupu i fa'alavelave fa'afuase'i
O faʻamaumauga o faʻamaumauga o node taʻitasi o loʻo i ai se "numera numera" parakalafa. A maeʻa le amataga muamua, e tutusa ma tutusa ma le 1. Afai mo nisi mafuaaga e ese ai le numera o le numera, ona faʻapipiʻiina lea o faʻamaumauga mai le tuai i le laʻititi, a maeʻa ona faʻaogaina le numera o le laʻititi laʻititi, i.e. o lona uiga e tutusa kopi. Mafuaaga e ono eseese ai fa'aliliuga:
- Toe fa'atulagaina se tasi o nodes
- O se faʻalavelave i se tasi o pona ona o se tapuni faʻafuaseʻi (sapalai eletise, vevela, ma isi).
- Leiloa InfiniBand feso'ota'iga ma le le mafai ona fa'atasi
- Se fa'alavelave i se tasi o pona ona o fa'amatalaga pi'opi'o. O iinei e te manaʻomia ai le fatuina o se vaega HA fou ma faʻamaeʻaina le faʻatulagaina o faʻamaumauga.
I soo se tulaga, o le node o loʻo tumau i luga ole laiga e faʻateleina lona numera numera i le tasi ina ia faʻafetaui ana seti faʻamaumauga pe a uma ona toe faʻaleleia le fesoʻotaʻiga ma le paga.
Afai ua leiloa le feso'ota'iga i luga o le feso'ota'iga Ethernet, e sui le Heartbeat mo sina taimi i le InfiniBand ma toe fo'i mai i totonu ole 10 sekone pe a toe fa'afo'isia.
Fa'atonu 'au
Ina ia mautinoa le faapalepale o sese ma faʻaleleia le faʻatinoga, e tatau ona e faʻatagaina le lagolago a le MPIO mo le laina. Ina ia faia lenei mea, e tatau ona e faaopoopo laina i le /etc/multipath.conf faila, ona toe amata lea o le multipath service
Tusi natiamasini {
masini {
fa'atau "AStor"
path_grouping_policy "group_by_prio"
ala_filifilia "queue-umi 0"
path_checker "tur"
foliga "0"
meafaigaluega_handler "0"
muamua "const"
failback vave
vave_io_fail_tmo 5
dev_loss_tmo 60
user_friendly_name ioe
detect_prio ioe
rr_min_io_rq 1
leai_ala_toe taumafai 0
}
}
Ma le isi, ina ia mafai e le ASM ona galulue ma MPIO e ala i le ASMLib, e tatau ona e sui le /etc/sysconfig/oracleasm file ona taʻavale lea /etc/init.d/oracleasm scandisks
Tusi natia
# ORACLEASM_SCANORDER: Fa'afetaui mamanu e fa'atonu le su'ega tisiki
ORACLEASM_SCANORDER="dm"
# ORACLEASM_SCANEXCLUDE: Fa'atusa fa'atusa e le aofia ai tisiki mai su'esu'ega
ORACLEASM_SCANEXCLUDE="sd"
mataʻi
Afai e te le manaʻo e faʻaoga ASMLib, e mafai ona e faʻaogaina tulafono UDEV, o le faʻavae lea mo ASMLib.
Amata i le version 12.1.0.2 o Oracle Database, o loʻo avanoa le filifiliga mo le faʻapipiʻiina o se vaega o le polokalama ASMFD.
E taua tele le fa'amautinoaina o tisiki na faia mo Oracle ASM o lo'o ogatusa ma le lapo'a poloka o lo'o fa'agaioi fa'aletino le laina (4K). A leai, e ono tupu fa'afitauli fa'atinoga. O le mea lea, e manaʻomia le fatuina o voluma ma faʻamaufaʻailoga talafeagai:
vaeluaina /dev/mapper/name-name mklabel gpt mkpart primary 2048s 100% align-check sili ona lelei 1
Fa'asoaina o fa'amaumauga i luga o voluma na faia mo la matou fa'atulagaina o su'ega
Igoa Volume Teuteu
Tele tele
Volume LUNs fa'afanua
ASM Volume Device Fa'amatalaga
Va'aiga Vaega Tele
Faʻamatalaga01
200GB
Fa'afanua voluma uma e teu i le faiga e teu ai fa'amaumauga uma
Fa'atosina: masani
Igoa:DGDATA
Fa'amoemoega: Fa'amaumauga faila
4MB
Faʻamatalaga02
200GB
Faʻamatalaga03
200GB
Faʻamatalaga04
200GB
Faʻamatalaga05
200GB
Faʻamatalaga06
200GB
Faʻamatalaga07
200GB
Faʻamatalaga08
200GB
Faʻamatalaga09
200GB
Faʻamatalaga10
200GB
Grid01
1GB
Fa'atosina: masani
Igoa: DGGRID1
Fa'amoemoega: Fa'amau: CRS ma Palota
4MB
Grid02
1GB
Grid03
1GB
Grid04
1GB
Fa'atosina: masani
Igoa: DGGRID2
Fa'amoemoega: Fa'amau: CRS ma Palota
4MB
Grid05
1GB
Grid06
1GB
Toe fai01
100GB
Fa'atosina: masani
Igoa: DGREDO1
Fa'amoemoega: Toe fai ogalaau o filo 1
4MB
Toe fai02
100GB
Toe fai03
100GB
Toe fai04
100GB
Toe fai05
100GB
Toe fai06
100GB
Fa'atosina: masani
Igoa: DGREDO2
Fa'amoemoega: Toe fai ogalaau o filo 2
4MB
Toe fai07
100GB
Toe fai08
100GB
Toe fai09
100GB
Toe fai10
100GB
Fa'amaumauga Fa'amaumauga
- Tele poloka = 8K
- Fetufa'i avanoa = 16GB
- Fa'agata le AMM (Otometi le Puleaina o le Fa'amanatuga)
- Fa'agata le Transparent Teles Pages
Isi faatulagaga
# vi /etc/sysctl.conf
✓ fs.aio-max-nr = 1048576
✓ fs.file-max = 6815744
✓ kernel.shmmax 103079215104
✓ kernel.shmall 31457280
✓ kernel.shmmn 4096
✓ kernel.sem = 250 32000 100 128
✓ net.ipv4.ip_local_port_range = 9000 65500
✓ net.core.rmem_default = 262144
✓ net.core.rmem_max = 4194304
✓ net.core.wmem_default = 262144
✓ net.core.wmem_max = 1048586
✓vm.swappiness=10
✓ vm.min_free_kbytes=524288 # aua le setiina pe afai o loʻo e faʻaogaina Linux x86
✓ vm.vfs_cache_pressure=200
✓ vm.nr_hugepages = 57000
# vi /etc/security/limits.conf
✓ laina vaivai nproc 2047
✓ laina malo nproc 16384
✓ grid soft nofile 1024
✓ grid hard nofile 65536
✓ fa'aputu vaivai 10240
✓ fa'aputu malo 32768
✓ Oracle soft nproc 2047
✓ oracle hard nproc 16384
✓ Oracle soft nofile 1024
✓ oracle hard nofile 65536
✓ fa'aputu mālū lemu 10240
✓ fa'aputu malo fa'aola 32768
✓ memlock malu 120795954
✓ memlock malo 120795954
sqlplus "/ as sysdba"
sui faiga seti faiga=2000 lautele=spfile;
suia seti seti open_cursors = 2000 lautele = spfile;
sui seti seti session_cached_cursors = 300 lautele = spfile;
suia seti seti db_files = 8192 lautele = spfile;
Su'ega le manuia
Mo faʻamoemoega faʻataʻitaʻiga, na faʻaaogaina HammerDB e faʻataʻitaʻi ai se uta OLTP. Fa'atonuga a HammerDB:
Numera o Faleteuoloa
256
Aofa'i Fefa'atauaiga a le Tagata Fa'aaoga
1000000000000
Tagata fa'aoga fa'apitoa
256
O le i'uga o le 2.1M TPM, lea e mamao mai le fa'atapula'a o fa'atinoga , ae o se "faʻaalo" mo le faʻatulagaina o meafaigaluega o loʻo i ai nei o 'auʻaunaga (faʻapitoa ona o le gaosiga) ma a latou numera. O le faʻamoemoega o lenei suʻega o loʻo faʻaalia pea le faʻapalepale sese o le fofo atoa, ae le o le ausia o le maualuga o le faatinoga. O le mea lea, o le a tatou faʻavaeina i luga o lenei fuainumera.
Su'ega mo le toilalo o se tasi o pona
Na leiloa e le au talimalo se vaega o auala i le teuina, faʻaauau pea ona galue i le isi vaega o loʻo totoe ma le node lona lua. Na pa'u le faatinoga mo ni nai sekone ona o auala ua toe fausia, ona toe foi lea i le tulaga masani. Sa leai se faalavelave i le auaunaga.
Su'ega le manuia o le Kapeneta ma meafaigaluega uma
I lenei tulaga, o le faʻatinoga na paʻu mo ni nai sekone ona o le toe faʻatulagaina o auala, ona toe foʻi lea i le afa o le tau muamua. O le fa'ai'uga na fa'afafa mai le mea muamua ona o le le aofia ai o le tasi le server talosaga mai le fa'agaioiga. Sa leai foi se faalavelave i le auaunaga.
Afai e i ai se manaʻoga e faʻatino se faʻafitauli faʻaleagaina Cross-Rack faʻalavelave toe faʻaleleia mo Oracle i se tau talafeagai ma faʻatasi ai ma le itiiti o le faʻatinoina / pulega taumafaiga, ona galulue faatasi lea o Oracle RAC ma le tusiata fale. o le a avea ma se tasi o filifiliga sili ona lelei. Nai lo le Oracle RAC, e mafai ona i ai soʻo se isi polokalama e tuʻuina atu faʻapipiʻi, tutusa DBMS poʻo faiga faʻapitoa, mo se faʻataʻitaʻiga. O le mataupu faavae o le fausiaina o le fofo o le a tumau pea. Ma o le pito i lalo e leai se mea mo RTO ma RPO.
puna: www.habr.com