Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Chiwerengero chochuluka cha ma Enterprise applications ndi machitidwe a virtualization ali ndi njira zawo zopangira njira zothetsera zolakwika. Mwachindunji, Oracle RAC (Oracle Real Application Cluster) ndi gulu la ma seva awiri kapena angapo a Oracle database omwe amagwira ntchito limodzi kuti azitha kuwongolera komanso kupereka kulekerera zolakwika pa seva/mapulogalamu. Kuti mugwiritse ntchito njirayi, mukufunikira kusungirako komweko, komwe nthawi zambiri kumakhala kosungirako.

Monga takambirana kale mu umodzi wathu zolemba, dongosolo losungirako lokha, ngakhale kukhalapo kwa zigawo zobwerezabwereza (kuphatikizapo olamulira), akadali ndi mfundo zolephera - makamaka mwa mawonekedwe a deta imodzi. Chifukwa chake, kuti mupange njira ya Oracle yokhala ndi zofunikira zodalirika, chiwembu cha "N seva - imodzi yosungirako" chikuyenera kukhala chovuta.

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Choyamba, tiyenera kusankha zoopsa zomwe tikuyesera kuziteteza. M'nkhaniyi, sitiganizira za chitetezo ku ziwopsezo monga "meteorite yafika." Chifukwa chake kupanga njira yothanirana ndi masoka achilengedwe ikhalabe mutu wankhani zotsatirazi. Apa tiwona zomwe zimatchedwa Cross-Rack disaster recovery solution, pamene chitetezo chimamangidwa pamlingo wa makabati a seva. Makabatiwo amatha kukhala m'chipinda chimodzi kapena mosiyanasiyana, koma nthawi zambiri mkati mwa nyumba yomweyo.

Makabatiwa ayenera kukhala ndi zida zonse zofunika ndi mapulogalamu omwe angalole kugwira ntchito kwa ma database a Oracle mosasamala kanthu za dziko la "mnansi". Mwa kuyankhula kwina, pogwiritsa ntchito njira yothetsera tsoka la Cross-Rack, timachotsa zoopsa za kulephera:

  • Oracle Application Server
  • Machitidwe osungira
  • Kusintha machitidwe
  • Kulephera kwathunthu kwa zida zonse mu kabati:
    • Kukana mphamvu
    • Kulephera kwa dongosolo lozizirira
    • Zinthu zakunja (anthu, chilengedwe, etc.)

Kubwereza kwa ma seva a Oracle kumatanthauzanso mfundo yogwiritsira ntchito Oracle RAC ndipo imayendetsedwa kudzera mu pulogalamu. Kubwereza kwa malo osinthira si vuto. Koma ndi kubwereza kwa makina osungira, zonse sizophweka.

Njira yosavuta ndiyo kubwereza deta kuchokera ku dongosolo lalikulu losungirako kusungirako. Synchronous kapena asynchronous, kutengera mphamvu ya yosungirako. Ndi kubwereza kwa asynchronous, funso limabwera nthawi yomweyo ndikuwonetsetsa kusasinthika kwa data pokhudzana ndi Oracle. Koma ngakhale pali kuphatikiza kwa mapulogalamu ndi ntchito, mulimonse, ngati pali kulephera pa dongosolo lalikulu losungirako, kulowetsedwa kwamanja ndi olamulira kudzafunika kuti asinthe masango kuti asungidwe zosunga zobwezeretsera.

Njira yovuta kwambiri ndi mapulogalamu ndi / kapena kusungirako kwa hardware "virtualizers" zomwe zidzathetse mavuto osasinthasintha ndi kulowererapo pamanja. Koma zovuta za kutumiza ndi kuyang'anira kotsatira, komanso mtengo wosayenerera wa mayankho otere, amawopseza ambiri.

AccelStor NeoSapphire™ All Flash array solution ndi yabwino pazochitika monga Cross-Rack kuchira tsoka. H710 pogwiritsa ntchito Shared-Nothing zomangamanga. Mtundu uwu ndi makina awiri osungira omwe amagwiritsa ntchito ukadaulo wa FlexiRemap® kuti agwire ntchito ndi ma drive drive. Zikomo kwa FlexiRemap® NeoSapphire™ H710 imatha kutumiza magwiridwe antchito mpaka 600K IOPS@4K yolembedwa mwachisawawa ndi 1M+ IOPS@4K yowerengeka mwachisawawa, zomwe sizingatheke mukamagwiritsa ntchito makina osungira otengera RAID.

Koma mbali yayikulu ya NeoSapphire ™ H710 ndikuchita ma node awiri mwanjira yamilandu yosiyana, iliyonse ili ndi zolemba zake. Kulunzanitsa kwa node kumachitika kudzera mu mawonekedwe akunja a InfiniBand. Chifukwa cha zomangamangazi, ndizotheka kugawa ma node kumalo osiyanasiyana pamtunda wa 100m, potero kupereka njira yothetsera tsoka la Cross-Rack. Ma node onsewa amagwira ntchito mogwirizana. Kuchokera kumbali yolandila, H710 imawoneka ngati njira wamba yosungiramo olamulira awiri. Chifukwa chake, palibe chifukwa chopangira mapulogalamu ena owonjezera kapena zosankha za Hardware kapena zosintha zovuta kwambiri.

Tikayerekeza mayankho onse a Cross-Rack obwezeretsa tsoka omwe afotokozedwa pamwambapa, ndiye kuti njira yochokera ku AccelStor imadziwika bwino ndi ena onse:

AccelStor NeoSapphire™ Sanagawane Chilichonse Zomangamanga
Mapulogalamu kapena hardware "virtualizer" yosungirako
Replication based solution

Kupezeka

Kulephera kwa seva
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula

Kusinthana kulephera
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula

Kulephera kwa dongosolo losungira
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula
Nthawi yotsika

Kulephera konse kwa nduna
Palibe Nthawi Yopumula
Palibe Nthawi Yopumula
Nthawi yotsika

Mtengo ndi zovuta

Mtengo wothetsera
Pansi*
Высокая
Высокая

Kutumiza zovuta
Low
Высокая
Высокая

*AccelStor NeoSapphire™ ikadali gulu lonse la Flash, lomwe mwatanthauzo silimawononga "3 kopecks," makamaka popeza lili ndi malo osungira kawiri. Komabe, poyerekeza mtengo womaliza wa yankho lochokera pa izo ndi zofanana ndi ogulitsa ena, mtengowo ukhoza kuonedwa kuti ndi wotsika.

Ma topology olumikizira ma seva ogwiritsira ntchito ndi All Flash array node adzawoneka motere:

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Pokonzekera topology, tikulimbikitsidwanso kubwereza ma switch owongolera ndi ma seva olumikizana.

Apa ndi kupitilira apo tikambirana za kulumikizana kudzera pa Fiber Channel. Ngati mugwiritsa ntchito iSCSI, chilichonse chidzakhala chofanana, chosinthidwa kumitundu yosinthira yomwe imagwiritsidwa ntchito komanso makonda osiyanasiyana osiyanasiyana.

Kukonzekera ntchito pagulu

Zida ndi mapulogalamu ogwiritsidwa ntchito

Zosintha za Seva ndi Kusintha

Zida
mafotokozedwe

Oracle Database 11g maseva
Awiri

Makina ogwiritsira ntchito seva
Linux Oracle

Mtundu wa database wa Oracle
11g (RAC)

Mapurosesa pa seva
Ma cores awiri a 16 Intel® Xeon® CPU E5-2667 v2 @ 3.30GHz

Kukumbukira kwakuthupi pa seva
128GB

FC network
16Gb/s FC yokhala ndi multipathing

FC HBA
Emulex Lpe-16002B

Madoko odzipatulira a 1GbE akuwongolera magulu
Adapta ya Intel Ethernet RJ45

16Gb/s FC kusintha
Mtsinje 6505

Madoko odzipatulira achinsinsi a 10GbE kuti agwirizane ndi data
Intel X520

Mafotokozedwe a AccelStor NeoSapphire™ Onse Flash Array

Zida
mafotokozedwe

Yosungirako dongosolo
NeoSapphire™ mtundu wopezeka kwambiri: H710

Mtundu wazithunzi
4.0.1

Chiwerengero cha ma drive
48

Kukula kwagalimoto
1.92TB

Mtundu wa galimoto
SSD

FC chandamale madoko
16x 16Gb madoko (8 pa node)

Madoko oyang'anira
Chingwe cha ethernet cha 1GbE cholumikizira ku makamu kudzera pa switch ya ethernet

Kugunda kwa mtima port
Chingwe cha ethernet cha 1GbE cholumikiza pakati pa ma node awiri osungira

Doko lolumikizira data
56Gb/s InfiniBand chingwe

Musanagwiritse ntchito gulu, muyenera kuyambitsa. Mwachikhazikitso, adiresi yolamulira ya node zonsezo ndi yofanana (192.168.1.1). Muyenera kulumikiza kwa iwo mmodzimmodzi ndikukhazikitsa maadiresi atsopano (osiyana kale) ndikukhazikitsa nthawi yolumikizirana, pambuyo pake madoko a Management akhoza kulumikizidwa ku netiweki imodzi. Pambuyo pake, ma node amaphatikizidwa kukhala awiri HA popereka ma subnets olumikizirana ndi Interlink.

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Mukamaliza kumaliza, mutha kuyang'anira mndandanda kuchokera ku node iliyonse.

Kenako, timapanga ma voliyumu ofunikira ndikusindikiza ku ma seva ogwiritsira ntchito.

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Ndikofunikira kwambiri kuti mupange ma voliyumu angapo a Oracle ASM chifukwa izi zidzakulitsa kuchuluka kwa zomwe ma seva, zomwe pamapeto pake zidzasintha magwiridwe antchito (zambiri pamizere ina. nkhani).

Mayesero kasinthidwe

Dzina la Voliyumu Yosungirako
Kukula Kwa Voliyumu

Chidziwitso01
200GB

Chidziwitso02
200GB

Chidziwitso03
200GB

Chidziwitso04
200GB

Chidziwitso05
200GB

Chidziwitso06
200GB

Chidziwitso07
200GB

Chidziwitso08
200GB

Chidziwitso09
200GB

Chidziwitso10
200GB

Grid01
1GB

Grid02
1GB

Grid03
1GB

Grid04
1GB

Grid05
1GB

Grid06
1GB

Redo01
100GB

Redo02
100GB

Redo03
100GB

Redo04
100GB

Redo05
100GB

Redo06
100GB

Redo07
100GB

Redo08
100GB

Redo09
100GB

Redo10
100GB

Kufotokozera zina za njira zogwirira ntchito za gululi ndi njira zomwe zimachitika pakagwa mwadzidzidzi

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Seti ya data ya node iliyonse ili ndi gawo la "version number". Pambuyo poyambitsa koyambirira, ndizofanana ndi zofanana ndi 1. Ngati pazifukwa zina chiwerengero cha chiwerengerocho ndi chosiyana, ndiye kuti deta nthawi zonse imagwirizanitsidwa kuchokera ku mtundu wakale kupita ku wamng'ono, pambuyo pake chiwerengero chaching'ono chikugwirizana, i.e. izi zikutanthauza kuti makope ndi ofanana. Zifukwa zomwe matembenuzidwe angakhale osiyana:

  • Kuyambiranso kokonzekera kwa imodzi mwa node
  • Ngozi pa imodzi mwa mfundo chifukwa cha kuzimitsa mwadzidzidzi (magetsi, kutenthedwa, etc.).
  • Kutayika kwa InfiniBand ndikulephera kulunzanitsa
  • Kuwonongeka pa imodzi mwa node chifukwa cha kuwonongeka kwa deta. Apa mudzafunika kupanga gulu latsopano la HA ndi kulunzanitsa kwathunthu kwa seti ya data.

Mulimonse momwe zingakhalire, mfundo yomwe imakhalabe pa intaneti imawonjezera nambala yake yamtundu umodzi kuti igwirizanitse deta yake pambuyo poti kulumikizidwa ndi awiriwo kubwezeretsedwa.

Ngati kugwirizana pa ulalo wa Efaneti kutayika, Heartbeat imasinthira kwakanthawi ku InfiniBand ndikubwerera mkati mwa masekondi a 10 ikabwezeretsedwa.

Kupanga makamu

Kuti muwonetsetse kulekerera zolakwika ndikuwongolera magwiridwe antchito, muyenera kuthandizira kuthandizira kwa MPIO pamndandanda. Kuti muchite izi, muyenera kuwonjezera mizere ku fayilo ya /etc/multipath.conf, ndikuyambitsanso ntchito yochulukitsa.

Mawu obisikazida {
chipangizo {
wogulitsa "Astor"
path_grouping_policy "group_by_prio"
path_selector "mzere-utali 0"
path_checker "tur"
mawonekedwe "0"
hardware_handler "0"
poyamba "const"
failback yomweyo
fast_io_fail_tmo 5
dev_loss_tmo 60
user_friendly_names inde
detect_prio inde
rr_min_io_rq 1
no_path_retry 0
}
}

Kenako, kuti ASM igwire ntchito ndi MPIO kudzera pa ASMLib, muyenera kusintha fayilo /etc/sysconfig/oracleasm ndiyeno kuthamanga /etc/init.d/oracleasm scandisks

Mawu obisika

# ORACLEASM_SCANORDER: Kufananiza mayendedwe kuti muyitanitsa kusanthula kwa disk
ORACLEASM_SCANORDER="dm"

# ORACLEASM_SCANEXCLUDE: Kufananiza mayendedwe kuti muchotse ma disks pa sikani
ORACLEASM_SCANEXCLUDE="sd"

ndemanga

Ngati simukufuna kugwiritsa ntchito ASMLib, mutha kugwiritsa ntchito malamulo a UDEV, omwe ndi maziko a ASMLib.

Kuyambira ndi mtundu 12.1.0.2 wa Oracle Database, njirayo ilipo kuti muyike ngati gawo la pulogalamu ya ASMFD.

Ndikofunikira kuwonetsetsa kuti ma disks omwe amapangidwira Oracle ASM akugwirizana ndi kukula kwa chipika chomwe gulu limagwira nawo ntchito (4K). Kupanda kutero, mavuto amachitidwe amatha kuchitika. Chifukwa chake, ndikofunikira kupanga ma voliyumu okhala ndi magawo oyenera:

ogawidwa /dev/mapper/chipangizo-dzina mklabel gpt mkpart primary 2048s 100% align-cheke mulingo woyenera 1

Kugawa kwamadatabase pama voliyumu omwe adapangidwa kuti asinthire mayeso athu

Dzina la Voliyumu Yosungirako
Kukula Kwa Voliyumu
Kupanga mapu a LUNs
Tsatanetsatane wa Chipangizo cha ASM Volume
Kugawika kwa Unit size

Chidziwitso01
200GB
Lembani ma voliyumu onse osungira kumalo osungira ma data onse
Zosowa: Zachilendo
Dzina: DGDATA
Cholinga: Mafayilo a data

4MB

Chidziwitso02
200GB

Chidziwitso03
200GB

Chidziwitso04
200GB

Chidziwitso05
200GB

Chidziwitso06
200GB

Chidziwitso07
200GB

Chidziwitso08
200GB

Chidziwitso09
200GB

Chidziwitso10
200GB

Grid01
1GB
Zosowa: Zachilendo
Dzina: DGGRID1
Cholinga:Gridi: CRS ndi Kuvota

4MB

Grid02
1GB

Grid03
1GB

Grid04
1GB
Zosowa: Zachilendo
Dzina: DGGRID2
Cholinga:Gridi: CRS ndi Kuvota

4MB

Grid05
1GB

Grid06
1GB

Redo01
100GB
Zosowa: Zachilendo
Dzina: DGREDO1
Cholinga: Bwezeraninso chipika cha ulusi 1

4MB

Redo02
100GB

Redo03
100GB

Redo04
100GB

Redo05
100GB

Redo06
100GB
Zosowa: Zachilendo
Dzina: DGREDO2
Cholinga: Bwezeraninso chipika cha ulusi 2

4MB

Redo07
100GB

Redo08
100GB

Redo09
100GB

Redo10
100GB

Zokonda pa Database

  • Kukula kwa block = 8K
  • Sinthani malo = 16GB
  • Letsani AMM (Automatic Memory Management)
  • Letsani Masamba Akuluakulu Owonekera

Zokonda zina

# vi /etc/sysctl.conf
✓ fs.aio-max-nr = 1048576
✓ fs.file-max = 6815744
✓ kernel.shmmax 103079215104
✓ kernel.shmall 31457280
✓ kernel.shmmn 4096
✓ kernel.sem = 250 32000 100 128
✓ net.ipv4.ip_local_port_range = 9000 65500
✓ net.core.rmem_default = 262144
✓ net.core.rmem_max = 4194304
✓ net.core.wmem_default = 262144
✓ net.core.wmem_max = 1048586
✓vm.swappiness=10
✓ vm.min_free_kbytes=524288 # osayika izi ngati mukugwiritsa ntchito Linux x86
✓ vm.vfs_cache_pressure=200
✓ vm.nr_hugepages = 57000

# vi /etc/security/limits.conf
✓ grid yofewa nproc 2047
✓ gululi molimba nproc 16384
✓ grid soft nofile 1024
✓ grid hard nofile 65536
✓ zofewa za grid 10240
✓ gulu lolimba la grid 32768
✓ oracle soft nproc 2047
✓ oracle molimba nproc 16384
✓ oracle soft nofile 1024
✓ oracle hard nofile 65536
✓ oracle soft stack 10240
✓ oracle hard stack 32768
✓ Memlock yofewa 120795954
✓ memlock yolimba 120795954

sqlplus "/ as sysdba"
alter system set process=2000 scope=spfile;
alter system set open_cursors=2000 scope=spfile;
alter system set session_cached_cursors=300 scope=spfile;
alter system set db_files=8192 scope=spfile;

Kulephera kuyesa

Pazifukwa zowonetsera, HammerDB idagwiritsidwa ntchito kutsanzira katundu wa OLTP. Kusintha kwa HammerDB:

Nambala ya Malo Osungiramo katundu
256

Total Transactions pa User
1000000000000

Ogwiritsa Ntchito
256

Zotsatira zake zinali 2.1M TPM, yomwe ili kutali ndi malire a magwiridwe antchito H710, koma ndi "denga" pamasinthidwe amakono a ma seva (makamaka chifukwa cha mapurosesa) ndi chiwerengero chawo. Cholinga cha mayesowa ndikuwonetsabe kulekerera kolakwa kwa yankho lonse, osati kukwaniritsa ntchito yaikulu. Chifukwa chake, tingomanga pachithunzichi.

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Yesani kulephera kwa imodzi mwa mfundo

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Makamuwo adataya gawo la njira zosungirako, akupitiriza kugwira ntchito mwa otsalawo ndi node yachiwiri. Kuchita kwatsika kwa masekondi angapo chifukwa cha njira zomwe zimamangidwanso, ndikubwerera mwakale. Panalibe kusokonezedwa muutumiki.

Kulephera kwa nduna ndi zida zonse

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Kupanga yankho lololera zolakwika kutengera Oracle RAC ndi AccelStor Shared-Nothing zomangamanga

Pankhaniyi, magwiridwe antchito adatsikanso kwa masekondi pang'ono chifukwa cha kukonzanso kwa njira, ndikubwerera ku theka la mtengo woyambirira. Chotsatiracho chinachepetsedwa ndi theka kuchokera pachiyambi chifukwa cha kuchotsedwa kwa seva imodzi yogwiritsira ntchito ntchito. Panalibenso kusokoneza muutumiki.

Ngati pakufunika kukhazikitsa njira yothanirana ndi vuto la Cross-Rack yobwezeretsa tsoka la Oracle pamtengo wokwanira komanso osagwiritsa ntchito / kuyang'anira, ndiye Oracle RAC ndi zomangamanga zimagwirira ntchito limodzi. AccelStor Yogawana-Palibe idzakhala imodzi mwa njira zabwino kwambiri. M'malo mwa Oracle RAC, pangakhale mapulogalamu ena aliwonse omwe amapereka magulu, DBMS yomweyo kapena machitidwe owonetseratu, mwachitsanzo. Mfundo yopangira njira yothetsera vutoli idzakhala yofanana. Ndipo chofunikira ndi ziro kwa RTO ndi RPO.

Source: www.habr.com

Kuwonjezera ndemanga