I-HighLoad++, uMikhail Makurov, uMaxim Chernetsov (Intersvyaz): Zabbix, 100kNVPS kuseva eyodwa

Ingqungquthela elandelayo ye-HighLoad++ izoba ngo-Ephreli 6 no-7, 2020 e-St. Petersburg Imininingwane namathikithi. isixhumanisi. I-HighLoad ++ eMoscow 2018. Ihholo "eMoscow". Novemba 9, 15:00. Lezi kanye isethulo.

* Ukuqapha - ku-inthanethi kanye nezibalo.
* Imikhawulo eyisisekelo yesikhulumi se-ZABBIX.
* Isixazululo sokukala isitoreji sokuhlaziya.
* Ukwenziwa ngcono kweseva ye-ZABBIX.
* Ukwenza ngcono kwe-UI.
* Zizwa ukusebenzisa uhlelo ngaphansi kwemithwalo engaphezu kwe-40k NVPS.
* Iziphetho ezimfushane.

Mikhail Makurov (ngemuva kwalokhu – MM): - Sanibonani nonke!

UMaxim Cherntsov (ngemuva kwalokhu - MCH): - Sawubona!

MM: – Ake ngethule uMaxim. UMax ungunjiniyela onekhono, inethiwekhi engcono kakhulu engiyaziyo. UMaxim ubandakanyeka kumanethiwekhi nezinsizakalo, ukuthuthukiswa nokusebenza kwawo.

I-MCH: - Futhi ngingathanda ukukutshela ngoMikhail. UMikhail ungunjiniyela we-C. Ubhalele inkampani yethu izixazululo eziningi zokucubungula ithrafikhi ephezulu. Sihlala futhi sisebenza e-Urals, edolobheni lamadoda aqinile e-Chelyabinsk, enkampanini ye-Intersvyaz. Inkampani yethu ihlinzeka ngezinsizakalo zikamabonakude ze-inthanethi nezekhebula kubantu abayisigidi emadolobheni angu-16.

MM: - Futhi kufanelekile ukusho ukuthi i-Intersvyaz ingaphezu nje komhlinzeki, iyinkampani ye-IT. Iningi lezixazululo zethu zenziwa umnyango wethu we-IT.

A: kusuka kumaseva acubungula ithrafikhi kuya esikhungweni sezingcingo kanye nohlelo lokusebenza lweselula. Umnyango we-IT manje usunabantu ababalelwa ku-80 abanamakhono ahluke kakhulu.

Mayelana ne-Zabbix nezakhiwo zayo

I-MCH: - Futhi manje ngizozama ukusetha irekhodi lomuntu siqu futhi ngisho ngomzuzu owodwa ukuthi i-Zabbix iyini (ngemuva kwalokhu ebizwa ngokuthi "Zabbix").

I-Zabbix izibeka njengesistimu yokuqapha engaphandle kwebhokisi yezinga lebhizinisi. Inezici eziningi ezenza ukuphila kube lula: imithetho ethuthukisiwe yokwenyuka, i-API yokuhlanganisa, ukwenza amaqembu kanye nokutholwa okuzenzakalelayo kwabasingathi namamethrikhi. I-Zabbix inamathuluzi okukala - ama-proxies. I-Zabbix iyisistimu yomthombo ovulekile.

Kafushane mayelana nezakhiwo. Singasho ukuthi iqukethe izingxenye ezintathu:

• Iseva. Ibhalwe ngo-C. Ngokucutshungulwa okuyinkimbinkimbi nokudluliswa kolwazi phakathi kwemicu. Konke ukucubungula kwenzeka kuyo: kusukela ekutholeni kuya ekulondolozeni kusizindalwazi.
• Yonke idatha igcinwa kusizindalwazi. I-Zabbix isekela i-MySQL, i-PostreSQL ne-Oracle.
• I-interface yewebhu ibhalwe nge-PHP. Ezinhlelweni eziningi iza neseva ye-Apache, kodwa isebenza ngokuphumelelayo ngokuhlanganiswa ne-nginx + php.

Namuhla sithanda ukuxoxa indaba eyodwa ngempilo yenkampani yethu ehlobene neZabbix...

Indaba evela empilweni yenkampani ye-Intersvyaz. Yini esinayo futhi yini esiyidingayo?

5 noma 6 izinyanga ezedlule. Ngolunye usuku ngemva komsebenzi...

I-MCH: - Misha, sawubona! Ngiyajabula ukuthi ngikwazile ukukubamba - kukhona ingxoxo. Siphinde saba nezinkinga ngokuqapha. Ngesikhathi sengozi enkulu, yonke into yayihamba kancane futhi kwakungekho ulwazi mayelana nesimo senethiwekhi. Ngeshwa, akukhona okokuqala lokhu kwenzeka. Ngidinga usizo lwakho. Masenze ukuqapha kwethu kusebenze ngaphansi kwanoma yiziphi izimo!

MM: - Kodwa ake sivumelanise kuqala. Sekuphele iminyaka embalwa ngingabhekanga lapho. Ngokukhumbula kwami, sayishiya i-Nagios futhi sashintshela ku-Zabbix cishe eminyakeni engu-8 edlule. Futhi manje sibonakala sinamaseva anamandla ayi-6 kanye nama-proxies angaba yishumi nambili. Kukhona engididayo?

I-MCH: - Cishe. Amaseva ayi-15, amanye awo imishini ebonakalayo. Okubaluleke kakhulu ukuthi akusisindisi ngesikhathi esikudinga ngaso kakhulu. Njengengozi - amaseva anciphisa ijubane futhi awukwazi ukubona lutho. Sizamile ukuthuthukisa ukucushwa, kodwa lokhu akuzange kunikeze ukwanda kokusebenza okuphelele.

MM: - Kuyabonakala. Uke wabheka okuthile, ingabe usuvele umba okuthile ekuxilongweni?

I-MCH: - Into yokuqala okufanele ubhekane nayo yi-database. I-MySQL ihlale ilayishwa, igcina amamethrikhi amasha, futhi lapho i-Zabbix iqala ukukhiqiza inqwaba yemicimbi, i-database ingena ekushayeleni ngokweqile amahora ambalwa. Sengikutshelile kakade mayelana nokuthuthukisa ukucushwa, kodwa ngokoqobo kulo nyaka babuyekeze i-hardware: amaseva anememori engaphezu kwekhulu ye-gigabytes kanye ne-disk arrays kuma-SSD RAIDs - akukho phuzu lokuyikhulisa ngokulandelana esikhathini eside. Senzenjani?

MM: - Kuyabonakala. Ngokuvamile, i-MySQL iyisizindalwazi se-LTP. Ngokusobala, ayisafanele ukugcina ingobo yomlando yamamethrikhi osayizi wethu. Ake sikuthole.

I-MCH: - Ake!

Ukuhlanganiswa kwe-Zabbix ne-Clickhouse njengomphumela we-hackathon

Ngemva kwesikhathi esithile sithole idatha ethakazelisayo:

Iningi lesikhala kusizindalwazi sethu belisetshenziswa ingobo yomlando yamamethrikhi futhi ngaphansi kuka-1% sasetshenziselwa ukulungisa, izifanekiso nezilungiselelo. Ngaleso sikhathi, sase sisebenza isixazululo sedatha enkulu esekelwe ku-Clickhouse isikhathi esingaphezu konyaka. Isiqondiso sokunyakaza sasisobala kithi. Entwasahlobo yethu i-Hackathon, ngibhale ukuhlanganiswa kwe-Zabbix ne-Clickhouse yeseva kanye ne-frontend. Ngaleso sikhathi, i-Zabbix yayivele inokusekelwa kwe-ElasticSearch, futhi sanquma ukuyiqhathanisa.

Ukuqhathaniswa kweClickhouse ne-Elasticsearch

MM: - Uma siqhathanisa, sikhiqize umthwalo ofanayo njengoba iseva ye-Zabbix ihlinzeka futhi sabheka ukuthi amasistimu azoziphatha kanjani. Sibhale idatha ngamaqoqo emigqa eyi-1000, sisebenzisa i-CURL. Sicabange kusengaphambili ukuthi i-Clickhouse izosebenza kahle kakhulu kuphrofayela yokulayisha eyenziwa yi-Zabbix. Imiphumela yaze yedlula lokho ebesikulindele:

Ngaphansi kwezimo ezifanayo zokuhlola, u-Clickhouse wabhala idatha ephindwe kathathu. Ngesikhathi esifanayo, zombili izinhlelo zidle kahle kakhulu (inani elincane lezinsiza) lapho kufundwa idatha. Kodwa i-Elastics yayidinga inani elikhulu leprosesa lapho uqopha:

Sekukonke, i-Clickhouse yayiphakeme kakhulu kune-Elastix mayelana nokusetshenziswa kweprosesa nesivinini. Ngesikhathi esifanayo, ngenxa yokucindezelwa kwedatha, i-Clickhouse isebenzisa izikhathi ezingu-11 ngaphansi kwe-hard drive futhi yenza cishe izikhathi ezingu-30 imisebenzi yediski embalwa:

I-MCH: - Yebo, umsebenzi weClickhouse nge-subsystem yediski usetshenziswa kahle kakhulu. Ungasebenzisa amadiski amakhulu e-SATA kusizindalwazi futhi uthole isivinini sokubhala samakhulu ezinkulungwane zemigqa ngomzuzwana. Uhlelo olungaphandle kwebhokisi lusekela ukwahlukanisa, ukuphindaphinda, futhi kulula kakhulu ukululungiselela. Seneliseke kakhulu ngokusetshenziswa kwayo unyaka wonke.

Ukwandisa izinsiza, ungafaka i-Clickhouse eduze kwesizindalwazi sakho esikhulu esikhona futhi ngaleyo ndlela wonge isikhathi esiningi se-CPU nokusebenza kwediski. Sihambise ingobo yomlando yamamethrikhi kumaqoqo akhona e-Clickhouse:

Sikhulule i-database eyinhloko ye-MySQL kangangokuthi sakwazi ukuyihlanganisa emshinini owodwa neseva ye-Zabbix futhi silahle iseva ezinikele ye-MySQL.

Ukuvota kusebenza kanjani e-Zabbix?

Izinyanga ze-4 ezedlule

MM: - Hhayi-ke, singakhohlwa ngezinkinga ngesisekelo?

I-MCH: - Lokho kuyiqiniso! Enye inkinga okudingeka siyixazulule ukuqoqwa kwedatha kancane. Manje wonke amaseva ethu ommeleli ayi-15 agcwele i-SNMP nezinqubo zokuvota. Futhi ayikho indlela ngaphandle kokufaka amaseva amasha namasha.

MM: - Kukhulu. Kodwa okokuqala, sitshele ukuthi ukuvota kusebenza kanjani e-Zabbix?

I-MCH: - Ngamafuphi, kunezinhlobo ezingama-20 zamamethrikhi nezindlela eziyishumi nambili zokuwathola. I-Zabbix ingaqoqa idatha ngemodi "yesicelo-impendulo", noma ilinde idatha entsha nge-"Trapper Interface".

Kuyaphawuleka ukuthi ku-Zabbix yasekuqaleni le ndlela (Trapper) ishesha kakhulu.

Kunamaseva elibamba wokusabalalisa umthwalo:

Amaphrokzi angenza imisebenzi yeqoqo efanayo neyeseva ye-Zabbix, athole imisebenzi evela kuyo futhi athumele amamethrikhi aqoqiwe ngohlelo olubonakalayo lwe-Trapper. Lena indlela enconywa ngokusemthethweni yokusabalalisa umthwalo. Ama-proxies nawo ayasiza ekuqapheni ingqalasizinda ekude esebenza nge-NAT noma ngesiteshi esinensayo:

MM: - Konke kucacile nge-architecture. Kumele sibheke imithombo...

Ngemva kwezinsuku ezimbalwa

Indaba yokuthi i-nmap fping iwine kanjani

MM: "Ngicabanga ukuthi kukhona engikumbile."

I-MCH: - Ngitshele!

MM: - Ngithole ukuthi lapho ihlola ukutholakala, i-Zabbix ihlola inani eliphakeme labasingathi be-128 ngesikhathi. Ngizamile ukukhulisa le nombolo iye ku-500 futhi ngisuse isikhawu se-inter-packet ku-ping yabo (ping) - lokhu kuphinde kabili ukusebenza. Kodwa ngingathanda izinombolo ezinkulu.

I-MCH: - Ekusebenzeni kwami, ngezinye izikhathi kufanele ngihlole ukutholakala kwezinkulungwane zabasingathi, futhi angikaze ngibone lutho ngokushesha kune-nmap yalokhu. Ngiyaqiniseka ukuthi lena indlela eshesha kakhulu. Ake sizame! Sidinga ukwandisa kakhulu inani labasingathi ngokuphindaphinda ngakunye.

MM: – Hlola ezingaphezu kwamakhulu amahlanu? 600?

I-MCH: - Okungenani izinkulungwane ezimbalwa.

MM: - KULUNGILE. Into ebaluleke kakhulu ebengifuna ukuyisho ukuthi ngithole ukuthi ukuvota okuningi e-Zabbix kwenziwa ngokuhambisana. Impela sidinga ukuyishintsha ibe yimodi ye-asynchronous. Bese singakhuphula ngokumangalisayo inani lamamethrikhi aqoqwe abapholi, ikakhulukazi uma sinyusa inani lamamethrikhi ngokuphindaphinda ngakunye.

I-MCH: - Kuhle! Futhi nini?

MM: – Njengenjwayelo, izolo.

I-MCH: - Siqhathanise zombili izinhlobo ze-fping ne-nmap:

Ngenani elikhulu labasingathi, i-nmap bekulindeleke ukuthi isebenze ngokuphindwe kahlanu. Njengoba i-nmap ihlola kuphela ukutholakala nesikhathi sokuphendula, sihambise ukubalwa kokulahlekelwa kuzingcipho futhi sehlise kakhulu izikhawu zokuhlola ukutholakala. Sithole inani eliphelele labasingathi be-nmap abangaba ngu-4 120 ngokuphindaphinda. I-Nmap isivumele ukuthi sehlise izindleko ze-CPU zokuhlola ukutholakala izikhathi ezintathu futhi sehlise isikhawu sisuka kumasekhondi ayi-10 siye kwayi-XNUMX.

Ukuthuthukisa ukuvota

MM: “Sibe sesiqala ukwenza ama-pollers. Sasithanda kakhulu ukutholwa kwe-SNMP nama-ejenti. E-Zabbix, ukuvota kwenziwa ngendlela efanayo futhi izinyathelo ezikhethekile zithathwe ukuze kwandiswe ukusebenza kahle kwesistimu. Kumodi yokuvumelanisa, ukungatholakali komsingathi kubangela ukuwohloka okukhulu kokuvota. Kukhona uhlelo lonke lwezifundazwe, kunezinqubo ezikhethekile - okuthiwa ama-pollers angenakufinyeleleka, asebenza kuphela nababungazi abangafinyeleleki:

Lokhu ukuphawula okubonisa i-matrix yezwe, yonke inkimbinkimbi yesistimu yezinguquko edingekayo ukuze uhlelo luhlale lusebenza. Ngaphezu kwalokho, ukuvota okuvumelanayo ngokwako kuhamba kancane:

Kungakho izinkulungwane zama-poller stream kuma-proxies amaningi azikwazanga ukuqoqa inani elidingekayo ledatha yethu. Ukuqaliswa okuhambisanayo akuxazululanga izinkinga ngenani lezintambo kuphela, kodwa futhi kwenze kwaba lula kakhulu isistimu yezwe yabasingathi abangatholakali, ngoba kunoma iyiphi inombolo ehloliwe ekuphindaphindweni okukodwa kokuvota, isikhathi esiphezulu sokulinda sasiwukuphela kwesikhathi esingu-1:

Ukwengeza, silungise futhi sathuthukisa isistimu yokuvota yezicelo ze-SNMP. Iqiniso liwukuthi abantu abaningi abakwazi ukuphendula izicelo eziningi ze-SNMP ngesikhathi esisodwa. Ngakho-ke, senze imodi ye-hybrid, lapho ukuvota kwe-SNMP komsingathi ofanayo kwenziwa ngendlela efanayo:

Lokhu kwenziwa kulo lonke iphakethe labasingathi. Le modi ekugcineni ayihamba kancane kune-asynchronous ngokuphelele, njengoba ukuvota kwamanani e-SNMP ayikhulu nengxenye kusashesha kakhulu kunesikhathi esi-1 sokuvala.

Ukuhlola kwethu kubonise ukuthi inani eliphelele lezicelo ekuphindaphindweni okukodwa cishe liyizinkulungwane eziyi-8 ngokuvota kwe-SNMP. Sekukonke, ukushintshela kumodi ye-asynchronous kusivumele ukuthi sisheshise ukusebenza kokuvota izikhathi ezingama-200, izikhathi ezingamakhulu ambalwa.

I-MCH: - Ukuthuthukiswa kokuvota okuwumphumela kubonise ukuthi asikwazi nje ukususa wonke ama-proxies, kodwa futhi sinciphise izikhawu zokuhlola okuningi, futhi ama-proxies ngeke esadingeka njengendlela yokwabelana ngomthwalo.

Cishe ezinyangeni ezintathu ezedlule

Shintsha izakhiwo - ukwandisa umthwalo!

MM: - Hhayi-ke, Max, ingabe yisikhathi sokukhiqiza? Ngidinga iseva enamandla kanye nonjiniyela omuhle.

I-MCH: - Kulungile, ake sikuhlele. Isikhathi esiphezulu sokusuka endaweni efile yamamethrikhi ayizinkulungwane ezingu-5 ngomzuzwana.

Ekuseni ngemva kokuthuthukiswa

I-MCH: - Misha, sizibuyekeze, kodwa ekuseni sahlehla... Qagela ukuthi isiphi isivinini esikwazile ukusifinyelela?

MM: - 20 izinkulungwane esiphezulu.

I-MCH: - Yebo, 25! Ngeshwa, sikhona lapho siqale khona.

MM: - Kungani? Ingabe uye wenza noma yikuphi ukuxilonga?

I-MCH: - Yebo, ngokuqinisekile! Nakhu, isibonelo, phezulu okuthakazelisayo:

MM: - Ake sibuke. Ngiyabona ukuthi sizame inombolo enkulu yochungechunge lokuvota:

Kodwa ngesikhathi esifanayo abakwazanga ukuvuselela uhlelo ngisho nangesigamu:

Futhi ukusebenza kukonke kuncane kakhulu, cishe amamethrikhi ayizinkulungwane ezi-4 ngomzuzwana:

Ingabe kukhona okunye?

I-MCH: - Yebo, umucu womunye wabavoti:

MM: - Lapha ungabona ngokucacile ukuthi inqubo yokuvota ilinde "ama-semaphores". Lawa amalokhi:

I-MCH: - Akucacile.

MM: - Bheka, lokhu kufana nesimo lapho inqwaba yezintambo izama ukusebenza ngezinsiza ezingasebenza eyodwa kuphela ngesikhathi. Bese abangakwenza ukwabelana ngalesi sisetshenziswa ngokuhamba kwesikhathi:

Futhi ukusebenza okuphelele kokusebenza nesisetshenziswa esinjalo kunqunyelwe isivinini somongo owodwa:

Kunezindlela ezimbili zokuxazulula le nkinga.

Thuthukisa i-Hardware yomshini, shintshela kuma-cores asheshayo:

Noma shintsha ukwakheka futhi ngesikhathi esifanayo ushintshe umthwalo:

I-MCH: Kodwa-ke, emshinini wokuhlola sizosebenzisa ama-cores ambalwa kunakuwodwa wokulwa, kodwa ashesha izikhathi ezingu-1,5 kumvamisa ngomongo ngamunye!

MM: - Sula? Udinga ukubheka ikhodi yeseva.

Indlela yedatha kuseva ye-Zabbix

I-MCH: - Ukuze sikuthole, siqale ukuhlaziya ukuthi idatha idluliselwa kanjani ngaphakathi kweseva ye-Zabbix:

Isithombe esihle, akunjalo? Masidlule kukho isinyathelo ngesinyathelo ukuze sikwenze kucace kakhulu. Kukhona uchungechunge namasevisi anesibopho sokuqoqa idatha:

Badlulisela amamethrikhi aqoqiwe ngesokhethi kumphathi we-Preprocessor, lapho alondolozwa khona kumugqa:

"Imenenja ye-preprocessor" idlulisela idatha kubasebenzi bayo, esebenzisa imiyalelo yokucubungula kusengaphambili futhi iyibuyisele ngesokhethi efanayo:

Ngemuva kwalokhu, umphathi we-preprocessor uzigcina kunqolobane yomlando:

Ukusuka lapho athathwa abacwili bomlando, abenza imisebenzi eminingi impela: isibonelo, ukubala izibangeli, ukugcwalisa inqolobane yenani futhi, okubaluleke kakhulu, ukulondoloza amamethrikhi kusitoreji somlando. Ngokuvamile, inqubo iyinkimbinkimbi futhi iyadida kakhulu.

MM: - Into yokuqala esiyibonile ukuthi izintambo eziningi zincintisana nalokho okubizwa ngokuthi "i-cache yokumisa" (indawo yememori lapho kugcinwa khona konke ukulungiselelwa kweseva). Imicu enesibopho sokuqoqa idatha yenza ikakhulukazi ukuvinjwa okuningi:

...njengoba ukulungiselelwa akugcini nje ngokugcina amamethrikhi namapharamitha awo, kodwa futhi nolayini lapho abavoti bathatha khona ulwazi mayelana nokuthi yini okufanele bayenze ngokulandelayo. Uma kunabavoti abaningi futhi oyedwa evimba ukucushwa, abanye balinda izicelo:

Abavoti akufanele bangqubuzane

Ngakho-ke, into yokuqala esiyenzile ukuhlukanisa ulayini ube izingxenye ezi-4 futhi sivumele abavoti ukuthi bavimbe le migqa, lezi zingxenye ngesikhathi esifanayo, ngaphansi kwezimo eziphephile:

Lokhu kususe ukuncintisana kwenqolobane yokucushwa, futhi isivinini sabavoti sanda kakhulu. Kepha sabe sesihlangana neqiniso lokuthi umphathi we-preprocessor waqala ukuqongelela ulayini wemisebenzi:

Umphathi we-Preprocessor kumele akwazi ukubeka phambili

Lokhu kwenzeka ezimeni lapho engasebenzi khona. Khona-ke konke abengakwenza kwakuwukuqongelela izicelo ezivela ezinqubweni zokuqoqwa kwedatha futhi ahlanganise isigcinalwazi sazo size siqede yonke inkumbulo futhi iphahlazeke:

Ukuze sixazulule le nkinga, sengeze isokhethi yesibili eyayinikezelwe ngokukhethekile kubasebenzi:

Ngakho-ke, umphathi we-preprocessor ube nethuba lokubeka phambili umsebenzi wakhe futhi, uma isilondolozi sikhula, umsebenzi uwukunciphisa ukususwa, kunikeze abasebenzi ithuba lokuthatha lesi sici:

Sibe sesithola ukuthi esinye sezizathu ezenze ukuthi kunciphe kube yizisebenzi uqobo lwayo, kwazise bebeqhudelana nensiza engabalulekile nhlobo emsebenzini wabo. Sibhale le nkinga njenge-bug-fix, futhi isivele ixazululiwe ezinguqulweni ezintsha ze-Zabbix:

Sandisa inani lamasokhethi - sithola umphumela

Ngaphezu kwalokho, umphathi we-preprocessor uqobo waba yibhodlela, ngoba intambo eyodwa. Incike kwijubane eliwumgogodla, inika isivinini esikhulu esingaba amamethrikhi ayizinkulungwane ezingama-70 ngomzuzwana:

Ngakho-ke, senze ezine, ngamasethi amane ezisekelo, izisebenzi:

Futhi lokhu kusivumele ukuthi sinyuse isivinini siye cishe kumamethrikhi ayizinkulungwane eziyi-130:

Ukungahambelani kokukhula kuchazwa ukuthi ukuncintisana kwenqolobane yomlando sekuvele. Abaphathi aba-preprocessor abangu-4 nabacwili bomlando baqhudelana ngakho. Kuleli qophelo, besithola cishe ama-metric ayizinkulungwane eziyi-130 ngomzuzwana emshinini wokuhlola, siwusebenzisa cishe ngo-95% wephrosesa:

Около 2,5 месяцев назад

Ukwenqaba okuvela kumphakathi we-snmp kwenyusa ama-NVP ngesikhathi esisodwa nohhafu

MM: – Max, ngidinga imoto yokuhlola entsha! Asisangeni kulena yamanje.

I-MCH: - Yini onayo manje?

MM: - Manje - ama-NVP angu-130k kanye neprosesa elungele ishalofu.

I-MCH: - Hewu! Kuhle! Ima, nginemibuzo emibili. Ngokwezibalo zami, isidingo sethu siseduze kwamamethrikhi ayizinkulungwane eziyi-15-20 ngomzuzwana. Kungani sidinga okwengeziwe?

MM: "Ngifuna ukuqeda umsebenzi." Ngingathanda ukubona ukuthi kungakanani esingakukhama ngaphandle kwalolu hlelo.

I-MCH: - Kodwa...

MM: "Kodwa akusizi ebhizinisini."

I-MCH: - Kuyabonakala. Futhi umbuzo wesibili: ingabe singasekela lokho esinakho manje ngokwethu, ngaphandle kosizo lonjiniyela?

MM: - Angicabangi. Ukushintsha indlela inqolobane yokumisa esebenza ngayo kuyinkinga. Ithinta izinguquko emicu eminingi futhi kunzima ukuyinakekela. Cishe, kuyoba nzima kakhulu ukuyigcina.

I-MCH: "Bese sidinga enye indlela."

MM: - Kukhona inketho enjalo. Singashintshela kuma-core cores asheshayo, kuyilapho sishiya isistimu yokukhiya entsha. Sisazothola ukusebenza kwamamethrikhi ayizinkulungwane ezingama-60-80. Ngesikhathi esifanayo, singashiya yonke enye ikhodi. I-Clickhouse kanye ne-asynchronous polling izosebenza. Futhi kuyoba lula ukuyigcina.

I-MCH: - Amazing! Ngiphakamisa ukuthi sime lapha.

После оптимизации серверной части мы наконец-то смогли запустить новый код в продуктив. Мы отказались от части изменений в пользу перехода на машину с быстрыми ядрами и минимизации количества изменений в коде. Мы также упростили конфигурацию и по возможности отказались от макросов в элементах данных, поскольку они являются источником дополнительных блокировок.

Isibonelo, ukushiya i-snmp-community macro, evame ukutholakala emibhalweni nasezibonelweni, esimweni sethu kwenza kwaba nokwenzeka ukuqhubekisela phambili ukusheshisa ama-NVP cishe izikhathi ezingu-1,5.

Ngemva kwezinsuku ezimbili ekukhiqizeni

Isusa izigelekeqe zomlando wesigameko

I-MCH: - Misha, sesisebenzise uhlelo izinsuku ezimbili, futhi konke kuyasebenza. Kodwa kuphela lapho konke kusebenza! Sasihlele umsebenzi ngokudluliswa kwengxenye enkulu yenethiwekhi, futhi saphinde sahlola ngezandla zethu ukuthi yini ekhuphuke futhi yini engekho.

MM: - Ngeke kube! Sihlole yonke into izikhathi ezingu-10. Iseva iphatha nokungatholakali kwenethiwekhi okuphelele ngaso leso sikhathi.

I-MCH: - Yebo, ngiyaqonda yonke into: iseva, isizindalwazi, phezulu, i-austat, izingodo - yonke into iyashesha... Kodwa sibheka isixhumi esibonakalayo sewebhu, futhi kukhona iphrosesa "eshalofini" kuseva futhi lokhu:

MM: - Kuyabonakala. Masibukele iwebhu. Sithole ukuthi esimweni lapho bekunenani elikhulu lezehlakalo ezisebenzayo, amawijethi amaningi abukhoma aqale ukusebenza kancane kakhulu:

Isizathu salokhu kwaba ukukhiqizwa kwezigelekeqe zomlando wezehlakalo ezikhiqizwa into ngayinye ohlwini. Ngakho-ke, sishiye isizukulwane salawa mawindi (ubeke amazwana emigqeni emi-5 kukhodi), futhi lokhu kwaxazulula izinkinga zethu.

Isikhathi sokulayisha amawijethi, noma singatholakali nhlobo, sincishisiwe ukusuka emaminithini ambalwa ukuya kumasekhondi amukelekayo ayi-10-15 kithi, futhi umlando usengabonwa ngokuchofoza isikhathi:

Ngemva komsebenzi. 2 izinyanga ezedlule

I-MCH: - Misha, uyahamba? Kufanele sikhulume.

MM: - Bengingahlosile. Ingabe kukhona ngo-Zabbix futhi?

I-MCH: - Cha, phumula! Bengifuna nje ukuthi: konke kuyasebenza, ngiyabonga! Ngiphethe ubhiya.

I-Zabbix iyasebenza

I-Zabbix iyisistimu nomsebenzi osebenza endaweni yonke futhi ocebile. Ingasetshenziselwa ukufakwa okuncane ngaphandle kwebhokisi, kodwa njengoba izidingo zikhula, kufanele ithuthukiswe. Ukuze ugcine ingobo yomlando enkulu yamamethrikhi, sebenzisa isitoreji esifanele:

• ungasebenzisa amathuluzi akhelwe ngaphakathi ngendlela yokuhlanganisa ne-Elasticsearch noma ukulayisha umlando kumafayela ombhalo (atholakala kunguqulo XNUMX);
• Ungathatha ithuba lokuhlangenwe nakho kwethu nokuhlanganiswa ne-Clickhouse.

Ukuze ukhuphule ngokumangazayo isivinini sokuqoqa amamethrikhi, waqoqe usebenzisa izindlela ezingavumelanisi futhi uwadlulisele ngesixhumi esibonakalayo se-trapper kuseva ye-Zabbix; noma ungasebenzisa isichibi ukwenza ama-poller e-Zabbix angavumelani.

I-Zabbix ibhalwe ngo-C futhi isebenza kahle kakhulu. Ukuxazulula izingqinamba ezimbalwa zezakhiwo kukuvumela ukuthi uthuthukise ukusebenza kwayo futhi, ngokwazi kwethu, uthole amamethrikhi angaphezu kwezinkulungwane eziyi-100 emshinini wokucubungula okukodwa.

Isiqephu esifanayo se-Zabbix

MM: – Ngifuna ukwengeza amaphuzu ambalwa. Wonke umbiko wamanje, zonke izivivinyo, izinombolo zinikezwe ukucushwa esikusebenzisayo. Manje sithatha cishe ama-metric ayizinkulungwane ezingama-20 ngesekhondi kuyo. Uma uzama ukuqonda ukuthi lokhu kuzokusebenzela yini, ungaqhathanisa. Okuxoxwe ngakho namuhla kufakwe ku-GitHub ngendlela yesichibi: github.com/miklert/zabbix

Isiqephu sihlanganisa:

• ukuhlanganiswa okugcwele ne-Clickhouse (kokubili iseva ye-Zabbix kanye ne-frontend);
• ukuxazulula izinkinga nomphathi we-preprocessor;
• ama-asynchronous polling.

Isiqephu sihambisana nayo yonke inguqulo 4, kufaka phakathi ama-lts. Ngokunokwenzeka, ngezinguquko ezincane izosebenza kunguqulo 3.4.

Ngiyabonga ngokunaka kwakho.

Imibuzo yakho

Umbuzo ovela ezithamelini (ngemuva kwalokhu – A): – Sawubona! Ngicela ungitshele, ingabe unazo izinhlelo zokusebenzisana okujulile neqembu le-Zabbix noma nabo kanye nawe, ukuze lokhu akuyona isiqephu, kodwa ukuziphatha okuvamile kwe-Zabbix?

MM: - Yebo, sizozibophezela nakanjani ezinye zezinguquko. Kukhona okuzokwenzeka, okuthile kuzohlala esiqeshini.

A: – Siyabonga kakhulu ngombiko omuhle kakhulu! Ngicela ungitshele, ngemuva kokufaka isichibi, ukusekelwa okuvela ku-Zabbix kuzohlala nokuthi ungaqhubeka kanjani uthuthukela ezinguqulweni eziphezulu? Ingabe uzokwazi ukubuyekeza i-Zabbix ngemuva kwesichibi sakho ku-4.2, 5.0?

MM: - Angikwazi ukusho lutho mayelana nokusekelwa. Ukube bengiwusekelo lwezobuchwepheshe lwe-Zabbix, mhlawumbe bengizothi cha, ngoba lena ikhodi yomunye umuntu. Ngokuqondene ne-codebase engu-4.2, isikhundla sethu sithi: “Sizohamba nesikhathi, futhi sizozibuyekeza ngenguqulo elandelayo.” Ngakho-ke, isikhathi esithile sizobe sithumela isiqeshana sezinguqulo ezibuyekeziwe. Sengike ngasho embikweni: inani lezinguquko ezinezinguqulo lisencane kakhulu. Ngicabanga ukuthi ukuguquka kusuka ku-3.4 kuya ku-4 kusithathe cishe imizuzu engu-15. Kukhona okushintshile lapho, kodwa okungabalulekile kakhulu.

A: - Ngakho-ke uhlela ukusekela ipheshi lakho futhi ungalifaka ngokuphepha ekukhiqizeni futhi uthole izibuyekezo ngandlela thile esikhathini esizayo?

MM: – Sincoma kakhulu. Lokhu kusixazululela izinkinga eziningi.

I-MCH: - Ngiyaphinda futhi, ngithanda ukunaka iqiniso lokuthi izinguquko ezingakhathaleli ukwakhiwa kwezakhiwo futhi ezingakhathaleli ukuvimba noma imigqa ziyi-modular, ikumamojula ahlukene. Ngisho nezinguquko ezincane ungazigcina kalula.

MM: - Uma unentshisekelo emininingwaneni, i-"Clickhouse" isebenzisa lokho okubizwa ngokuthi umtapo wolwazi womlando. Ikhululiwe - iyikhophi yokusekelwa kwe-Elastics, okungukuthi, iyalungiseka. Ukuvota kushintsha kuphela abavoti. Sikholwa ukuthi lokhu kuzosebenza isikhathi eside.

A: - Ngibonga kakhulu. Ngitshele, ingabe akhona amadokhumenti ezinguquko ezenziwe?

MM: - Imibhalo iyisiqephu. Ngokusobala, ngokwethulwa kweClickhouse, ngokwethulwa kwezinhlobo ezintsha zabavoti, izinketho ezintsha zokumisa ziyavela. Isixhumanisi esivela kusilayidi sokugcina sinencazelo emfushane yokuthi sisetshenziswa kanjani.

Mayelana nokushintsha i-fping nge-nmap

A: – Ukwenze kanjani lokhu ekugcineni? Ungakwazi ukunikeza izibonelo ezithile: ingabe unazo amabhande kanye neskripthi sangaphandle? Yini egcina ihlola inani elikhulu kangaka lababungazi ngokushesha okungaka? Ubathola kanjani laba bakhaya? Ngabe sidinga ukuzondla ukuze zi-nmap ngandlela thize, sizithole kwenye indawo, sizifake, siqhube okuthile?..

MM: - Kuhle. Umbuzo olungile kakhulu! Iphuzu leli. Silungise umtapo wolwazi (ICMP ping, ingxenye ye-Zabbix) ukuze uthole amasheke e-ICMP, abonisa inani lamaphakethe - elilodwa (1), futhi ikhodi izama ukusebenzisa i-nmap. Okungukuthi, lokhu kungumsebenzi wangaphakathi we-Zabbix, oye waba umsebenzi wangaphakathi we-pinger. Ngokufanelekile, akukho ukuvumelanisa noma ukusetshenziswa kwe-trapper edingekayo. Lokhu kwenziwa ngamabomu ukuze kushiye uhlelo luqinile futhi kungadingeki ubhekane nokuvumelanisa kwezinhlelo ezimbili zedathabheyisi: yini okufanele uyihlole, ulayishe nge-poller, futhi ingabe ukulayisha kwethu kuphukile?.. Lokhu kulula kakhulu.

A: - Ingabe iyasebenza futhi kuma-proxies?

MM: - Yebo, kodwa asizange sihlole. Ikhodi yokuvota iyafana kukho kokubili i-Zabbix neseva. Kufanele isebenze. Ake ngigcizelele futhi: ukusebenza kwesistimu kufana nokuthi asimdingi ummeleli.

I-MCH: - Impendulo efanele yombuzo ithi: "Kungani udinga ummeleli onesistimu enjalo?" Kuphela ngenxa ye-NAT noma ukuqapha ngokusebenzisa uhlobo oluthile lwesiteshi esinensayo...

A: - Futhi usebenzisa i-Zabbix njenge-allertor, uma ngiqonda kahle. Noma ingabe imidwebo yakho (lapho ungqimba lwengobo yomlando ikhona) ihanjiswe kwenye isistimu, efana ne-Grafana? Noma awusebenzisi lokhu kusebenza?

MM: – Ngizophinde ngigcizelele: sizuze ukuhlanganiswa okuphelele. Sithela umlando ku-Clickhouse, kodwa ngasikhathi sinye siguqule i-php frontend. I-Php frontend iya ku-Clickhouse futhi yenza yonke ihluzo ukusuka lapho. Ngesikhathi esifanayo, ukwethembeka, sinengxenye eyakha idatha kwezinye izinhlelo zokubonisa izithombe ezivela ku-Clickhouse efanayo, kusukela kudatha efanayo ye-Zabbix.

I-MCH: - Ku-"Grafan" futhi.

Zathathwa kanjani izinqumo mayelana nokwabiwa kwezinsiza?

A: – Yabelana kancane ngekhishi lakho elingaphakathi. Senziwe kanjani isinqumo sokuthi kudingeke ukuthi kwabiwe izinsiza zokucutshungulwa okubucayi komkhiqizo? Lezi, ngokuvamile, izingozi ezithile. Futhi ngicela ungitshele, kumongo weqiniso lokuthi uzosekela izinguqulo ezintsha: lesi sinqumo sithethelela kanjani ngokombono wokuphatha?

MM: - Ngokusobala, asizange siyitshele kahle idrama yomlando. Sizithole sisesimweni lapho kufanele kwenziwe okuthile, futhi empeleni sahamba namaqembu amabili afanayo:

• Esinye kwakuwukwethula uhlelo lokuqapha kusetshenziswa izindlela ezintsha: ukuqapha njengesevisi, isethi evamile yezixazululo zomthombo ovulekile esizihlanganisayo bese sizama ukuguqula inqubo yebhizinisi ukuze sisebenze nohlelo olusha lokuqapha.
• Ngesikhathi esifanayo, sasinomhleli oshisekayo owayekwenza lokhu (ngaye). Kwenzekile wawina.

A: - Futhi ungakanani usayizi weqembu?

I-MCH: - Uphambi kwakho.

A: - Ngakho-ke, njengenjwayelo, udinga umuntu oshisekayo?

MM: - Angazi ukuthi yini inkanuko.

A: - Kulokhu, ngokusobala, wena. Ngiyabonga kakhulu, umuhle.

MM: - Ngiyabonga.

Mayelana neziqephu ze-Zabbix

A: - Ohlelweni olusebenzisa ama-proxies (isibonelo, kwezinye izinhlelo ezisabalalisiwe), kungenzeka yini ukujwayela nokunamathisela, sithi, abavoti, abameleli kanye nengxenye ye-preprocessor ye-Zabbix ngokwayo; nokusebenzelana kwabo? Ingabe kungenzeka ukuthuthukisa ukuthuthukiswa okukhona kwesistimu enama-proxies amaningi?

MM: - Ngiyazi ukuthi iseva ye-Zabbix ihlanganiswe kusetshenziswa ummeleli (ikhodi ihlanganiswe futhi itholwe). Asizange sikuhlole lokhu ekukhiqizeni. Angiqiniseki ngalokhu, kodwa ngicabanga ukuthi umphathi we-preprocessor akasetshenziswa kummeleli. Umsebenzi wommeleli ukuthatha isethi yamamethrikhi ku-Zabbix, iwahlanganise (iphinde irekhode ukucushwa, isizindalwazi sendawo) bese iyibuyisela kuseva ye-Zabbix. Iseva ngokwayo iyobe seyenza ukucubungula ngaphambili lapho isiyithola.

Intshisekelo kuma-proxy iyaqondakala. Sizoyihlola. Lesi isihloko esithokozisayo.

A: – Umbono wawuyilokhu: uma ukwazi ukuchibiyela abavoti, ungakwazi ukuchibiyela kummeleli futhi unamathisele ukuxhumana neseva, futhi uvumelanise i-preprocessor yalezi zinhloso kuphela kuseva.

MM: - Ngicabanga ukuthi kulula nakakhulu. Uthatha ikhodi, usebenzise isiqeshana, bese usilungiselela ngendlela oyidingayo - qoqa amaseva elibamba (isibonelo, nge-ODBC) bese usabalalisa ikhodi enamachibi kuwo wonke amasistimu. Lapho kunesidingo - qoqa ummeleli, lapho kunesidingo - iseva.

A: - Ngokunokwenzeka, ngeke kudingeke ukuthi unamathisele ukuthunyelwa kommeleli kuseva ngaphezu kwalokho?

I-MCH: - Cha, kujwayelekile.

MM: - Eqinisweni, omunye wemibono awuzange uzwakale. Sihlale sigcina ibhalansi phakathi kokuqhuma kwemibono kanye nenani lezinguquko kanye nokulula kokusekelwa.

Ezinye izikhangiso 🙂

Siyabonga ngokuhlala nathi. Uyazithanda izindatshana zethu? Ufuna ukubona okuqukethwe okuthakaselayo okwengeziwe? Sisekele ngokufaka i-oda noma ngokuncoma kubangani, I-VPS yefu yonjiniyela kusuka ku-$4.99, i-analogue ehlukile yamaseva ezinga lokungena, esungulwe yithi ngenxa yakho: Lonke iqiniso nge-VPS (KVM) E5-2697 v3 (6 Cores) 10GB DDR4 480GB SSD 1Gbps kusuka ku-$19 noma ukwabelana ngeseva? (itholakala nge-RAID1 kanye ne-RAID10, kufika kuma-cores angu-24 kuze kufike ku-40GB DDR4).

I-Dell R730xd 2x ishibhile esikhungweni sedatha se-Equinix Tier IV e-Amsterdam? Lapha kuphela 2 x Intel TetraDeca-Core Xeon 2x E5-2697v3 2.6GHz 14C 64GB DDR4 4x960GB SSD 1Gbps 100 TV kusukela ku-$199 eNetherlands! I-Dell R420 - 2x E5-2430 2.2Ghz 6C 128GB DDR3 2x960GB SSD 1Gbps 100TB - isuka ku-$99! Funda mayelana Indlela yokwakha ingqalasizinda corp. ikilasi ngokusetshenziswa kwe-Dell R730xd E5-2650 v4 amaseva abiza u-9000 euros ngepeni?

Source: www.habr.com