E-Skyeng sisebenzisa i-Amazon Redshift, kubandakanywa ukulinganisa okufanayo, ngoko ke sifumene eli nqaku nguStefan Gromoll, umseki we-dotgo.com, kwi-intermix.io enomdla. Emva kokuguqulelwa, incinci yamava ethu avela kwinjineli yedatha uDaniyar Belkhodzhaev.
ivumela ukukala ngokongeza iindawo ezintsha kwiqela. Isidingo sokumelana nenani eliphezulu lezicelo kunokukhokelela ekuboneleleni ngokugqithisileyo kweendawo zokuhlala. I-Concurrency Scaling, ngokuchaseneyo nokongeza iindawo ezintsha, kwandisa amandla ekhompyuter njengoko kufuneka.
Ukulinganisa okuhambelanayo kweAmazon Redshift kunika amaqela e-Redshift amandla ongezelelweyo okusingatha imiqulu yesicelo esiphezulu. Isebenza ngokuhambisa izicelo kumaqela amatsha "afanayo" ngasemva. Izicelo zihanjiswa ngokusekwe kuqwalaselo nemigaqo yeWLM.
Amaxabiso okulinganisa ahambelanayo asekwe kwimodeli yekhredithi enenqanaba lasimahla. Ngaphezulu kweekhredithi zasimahla, intlawulo isekelwe kwixesha i-Parallel Scaling Cluster iqhuba izicelo.
Umbhali uvavanye ukukala okuhambelanayo kwelinye lamaqela angaphakathi. Kule post, uya kuthetha ngeziphumo zovavanyo kwaye anike iingcebiso malunga nendlela yokuqalisa.
Iimfuno zeqela
Ukusebenzisa ukulinganisa okufanayo, iqela lakho le-Amazon Redshift kufuneka lihlangabezane nezi mfuno zilandelayo:
-iqonga: EC2-VPC;
-udidi lweenodi: dc2.8xlarge, ds2.8xlarge, dc2.inkulu okanye ds2.xlarge;
-inani leendawo: ukusuka kwi-2 ukuya kwi-32 (amaqela e-node enye ayixhaswanga).
Iintlobo zesicelo ezamkelekileyo
I-Parallel scaling ayifanelekanga kuzo zonke iintlobo zemibuzo. Kuguqulelo lokuqala, iqhuba kuphela izicelo ezifundwayo ezanelisa iimeko ezintathu:
β KHETHA imibuzo efundwayo kuphela (nangona ezinye iintlobo zicwangcisiwe);
β umbuzo awubhekiseli kwitafile enesitayile sokhetho INTERLEAVED;
-Umbuzo awusebenzisi i-Amazon Redshift Spectrum ukubhekisela kwiitafile zangaphandle.
Ukuze sisiwe kwi-Parallel Scalling Cluster, isicelo kufuneka sibekwe emgceni. Ukongeza, imibuzo ifanelekile kumgca , aziyi kuqhuba kumaqela esikali ahambelanayo.
Imigca kunye ne-SQA zifuna ulungelelwaniso olululo . Sicebisa ukuba wenze ngcono i-WLM yakho kuqala - oku kuya kunciphisa imfuno yokulinganisa okuhambelanayo. Kwaye oku kubalulekile kuba ukukala okuhambelanayo kusimahla kuphela ngenani elithile leeyure. I-AWS ibango lokuba ukukala okuhambelanayo kuya kukhululeka kwi-97% yabathengi, oku kusizisa kumbandela wamaxabiso.
Iindleko zokukalwa ngokunxuseneyo
I-AWS ibonelela ngemodeli yetyala lokulinganisa okufanayo. Iqela ngalinye elisebenzayo Iqokelela iikhredithi ngeyure, ukuya kuthi ga kwiyure enye yasimahla yokukala iikhredithi ezihambelanayo ngosuku.
Uhlawula kuphela xa ukusetyenziswa kwakho kweParallel Scaling Clusters kugqithise kwisixa seekhredithi ozifumeneyo.
Ixabiso libalwa ngesantya semfuno yomzuzwana ngamnye kwi-parallel cluster esetyenziswa ngaphezulu kwereyithi yasimahla. Uhlawuliswa kuphela ngexesha lezicelo zakho, ubuncinane bentlawulo yomzuzu omnye ngexesha iParallel Scaling Cluster ivuliwe. Ireyithi yomzuzwana ngamnye ekufunwayo ibalwa ngokusekelwe kwimigaqo yexabiso jikelele , oko kukuthi, kuxhomekeke kuhlobo lwe-node kunye nenani lee-nodes kwiqela lakho.
Ukuphehlelela ukuKhawulwa ngokuFanayo
Ukukala okunxuseneyo kuyaqaliswa kumgca ngamnye we-WLM. Yiya kwi-console ye-AWS Redshift kwaye ukhethe uLawulo loMsebenzi ukusuka kwimenyu yokukhangela ekhohlo. Khetha iqela lakho leqela lepharamitha yeWLM kwimenyu eyehlayo ilandelayo.
Uya kubona ikholamu entsha ebizwa ngokuba yi "Concurrency Scaling Mode" ecaleni komgca ngamnye. Ukungagqibeki ngu "Disabled". Cofa "Hlela" kwaye ungatshintsha useto lomgca ngamnye.
Isimo
Ukulinganisa okunxuseneyo kusebenza ngokuthumela izicelo ezifanelekileyo kumaqela amatsha azinikeleyo. Amaqela amatsha anobukhulu obufanayo (uhlobo kunye nenani leendibano) njengeqela eliphambili.
Inani elimiselweyo lamaqela asetyenziselwa ukukala ngokunxuseneyo linye (1), elinamandla okuqwalasela ukuya kuthi ga kwishumi (10) lilonke lamaqela.
Itotali yenani lamaqela okulinganisa ngokunxuseneyo lingamiselwa yiparameter enkulu ye-max_concurrency_scaling_clusters. Ukwandisa ixabiso lale parameter kubonelela ngamaqela angasebenziyo.
Ukubeka iliso
Kukho iigrafu ezininzi ezongezelelweyo ezikhoyo kwi-AWS Redshift console. Itshathi yamaqela aMaqela oBugcino obuQinisekisiweyo obuninzi okubonisa ixabiso le-max_concurrency_scaling_clusters ngokuhamba kwexesha.
Inani leqela elisebenzayo lokukala liboniswa kujongano lomsebenzisi kwicandelo "loMsebenzi wokuKwiliswa kweeMali zemali":
Kwi Imibuzo thebhu, kukho ikholamu ebonisa ukuba umbuzo uye waqhutywa kwiqela eliphambili okanye kwiqela elihambelanayo lokala:
Nokuba umbuzo othile uye wasetyenziswa kwiqela eliyintloko okanye ngeqela elilinganayo lokukala, ligcinwa ku-stl_query.concurrency_scaling_status.
Ixabiso le-1 libonisa ukuba umbuzo wenziwa kwi-parallel scale cluster, ngelixa amanye amaxabiso ebonisa ukuba yenziwe kwiqela lokuqala.
Umzekelo:
Ulwazi lokulinganisa ngokwemali lukwagcinwe kwezinye iitheyibhile kunye neemboniselo, ezifana ne-SVCS_CONCURRENCY_SCALING_USAGE. Ukongezelela, kukho inani leetafile zekhathalogu ezigcina ulwazi malunga nokulinganisa okufanayo.
Iziphumo
Ababhali baqalise ukukala ngokunxuseneyo kumgca omnye kwiqela langaphakathi malunga no-18:30:00 GMT nge-29.03.2019/3/20. Utshintshe iparamitha ye-max_concurrency_scaling_clusters ukuya ku-30 malunga no-00:29.03.2019:XNUMX ngo-XNUMX/XNUMX/XNUMX.
Ukulinganisa umgca wesicelo, sinciphise inani leendawo zokubeka kulo mgca ukusuka kwi-15 ukuya kwisi-5.
Apha ngezantsi kukho itshathi yedeshibhodi ye-intermix.io ebonisa inani lezicelo eziqhubayo kunye nokufola emva kokunciphisa inani leendawo zokubeka.
Siyabona ukuba ixesha lokulinda izicelo emgceni liye landa, ixesha elide lingaphezu kwemizuzu emi-5.
Nalu ulwazi olufanelekileyo oluvela kwi-console ye-AWS malunga nokwenzeka ngeli xesha:
I-Redshift isungule amaqela amathathu (3) ahambelanayo wokukalisa njengoko eqwalaselwe. Kubonakala ngathi la maqela aye asetyenziswa kancinane, nangona izicelo ezininzi kwiqela lethu zazifoliswe.
Igrafu yosetyenziso inxulumana negrafu yomsebenzi wokukala:
Emva kweeyure ezimbalwa, ababhali bahlolisise umgca kwaye kwakubonakala ngathi izicelo ezi-6 zisebenza ngokulinganayo. Siye savavanya ngokungenamkhethe izicelo ezibini ngojongano lomsebenzisi. Asikhange sijonge indlela yokusebenzisa la maxabiso xa amaqela amaninzi ahambelanayo esebenza kanye.
ezifunyanisiweyo
Ukulinganisa okunxuseneyo kunokunciphisa ixesha elichithwa kwizicelo emgceni ngexesha lomthwalo omkhulu.
Ngokusekelwe kwiziphumo zovavanyo olusisiseko, kwavela ukuba imeko enezicelo zokulayisha iphuculwe ngokuyinxenye. Nangona kunjalo, ukulinganisa okuhambelanayo kukodwa akuzange kuzicombulule zonke iingxaki zeconcurrency.
Oku kungenxa yezithintelo kwiindidi zemibuzo ezinokusebenzisa ukukala okuhambelanayo. Umzekelo, ababhali banetafile ezininzi ezinezitshixo zohlobo oludibeneyo, kwaye uninzi lomsebenzi wethu ubhala.
Nangona i-parallel scaling ayisosisombululo sendalo yonke sokuseta i-WLM, ukusebenzisa olu phawu kulula kwaye kuthe ngqo.
Ke ngoko, umbhali ucebisa ukuba uyisebenzise kwimigca ye-WLM yakho. Qala ngeqela elinye elihambelanayo kwaye ubeke iliso kwincopho yomthwalo ngokusebenzisa ikhonsoli ukujonga ukuba amaqela amatsha asetyenziswa ngokupheleleyo na.
Njengoko i-AWS yongeza inkxaso kwiintlobo zemibuzo eyongezelelweyo kunye neetheyibhile, ukukala okuhambelanayo kufuneka ngokuthe ngcembe kusebenze ngakumbi nangakumbi.
Izimvo ezivela kuDaniyar Belkhodzhaev, iNjineli yeDatha yaseSkyeng
Thina kwaSkyeng sikwaqaphele kwangoko ukubakho amathuba okunyuka okufanayo.
Ukusebenza kunomtsalane kakhulu, ngakumbi xa ucinga ukuba i-AWS iqikelela ukuba uninzi lwabasebenzisi abayi kuphinda bahlawule ngaphezulu.Kwenzekile ukuba phakathi ku-Epreli saba nokungxama okungaqhelekanga kwezicelo kwiqela le-Redshift. Ngeli xesha, sasidla ngokubhenela kwiConcurrency Scaling; ngamanye amaxesha iqela elongezelelweyo lalisebenza iiyure ezingama-24 ngosuku ngaphandle kokuyeka.
Oku kwenza ukuba kwenzeke, ukuba akuyi kusombulula ngokupheleleyo ingxaki ngemigca, ngoko ubuncinane ukwenza imeko yamkeleke.
Uqwalaselo lwethu ubukhulu becala lungqamana neempembelelo zabafana abavela kwi-intermix.io.
Siphinde saqaphela ukuba nangona kukho izicelo ezilindileyo emgceni, ayizizo zonke izicelo eziye zathunyelwa ngokukhawuleza kwi-parallel cluster. Ngokucacileyo oku kwenzeka ngenxa yokuba i-parallel cluster isafuna ixesha lokuqalisa. Ngenxa yoko, ngexesha lomthwalo ophakamileyo wexesha elifutshane sisenemigca emincinci, kwaye ii-alamu ezihambelanayo zinexesha lokuqalisa.
Emva kokulahla imithwalo engaqhelekanga ngo-Epreli, thina, njengoko i-AWS ilindelekile, sangena kwindlela yokusetyenziswa ngamaxesha athile - ngaphakathi kwesiqhelo samahhala.
Unokulandelela iindleko zakho zokulinganisa ezihambelanayo kwi-AWS Cost Explorer. Kufuneka ukhethe iNkonzo - i-Redshift, Uhlobo losetyenziso - CS, umzekelo USW2-CS:dc2.large.Unokufunda ngakumbi malunga namaxabiso ngesiRashiya
umthombo: www.habr.com