{"id":39133,"date":"2019-10-31T22:28:01","date_gmt":"2019-10-31T19:28:01","guid":{"rendered":"https:\/\/prohoster.info\/blog\/monitoring-nagruzochnoe-testirovanie-prognozirovanie-i-otsutstvie-sboev\/"},"modified":"2019-10-31T22:28:01","modified_gmt":"2019-10-31T19:28:01","slug":"monitoring-nagruzochnoe-testirovanie-prognozirovanie-i-otsutstvie-sboev","status":"publish","type":"post","link":"https:\/\/prohoster.info\/ro\/blog\/administrirovanie\/monitoring-nagruzochnoe-testirovanie-prognozirovanie-i-otsutstvie-sboev","title":{"rendered":"Monitorizare + testare de \u00eenc\u0103rcare = prognoz\u0103 \u0219i absen\u021ba defec\u021biunilor","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Departamentul IT de la VTB s-a confruntat de mai multe ori cu situa\u021bii neprev\u0103zute \u00een activitatea sistemelor, atunci c\u00e2nd \u00eenc\u0103rcarea lor cre\u0219tea de multiple ori. Astfel, a ap\u0103rut nevoia de a dezvolta \u0219i testa un model care s\u0103 prezic\u0103 \u00eenc\u0103rcarea maxim\u0103 pe sistemele critice. \u00cen acest scop, speciali\u0219tii IT ai b\u0103ncii au configurat monitorizarea, au analizat datele \u0219i au \u00eenv\u0103\u021bat s\u0103 automatizeze prognozele. Ce instrumente au ajutat la prognozarea \u00eenc\u0103rc\u0103rii \u0219i dac\u0103 au reu\u0219it s\u0103 optimizeze func\u021bionarea, vom povesti \u00eentr-un articol scurt.<\/p>\n

\"Monitorizare
\n<\/a><\/noindex>
\nProblemele cu serviciile cu \u00eenc\u0103rcare mare apar practic \u00een toate industriile, dar pentru domeniul financiar acestea sunt critice. \u00cen momentele X, toate unit\u0103\u021bile opera\u021bionale trebuie s\u0103 fie preg\u0103tite, ceea ce impune necesitatea de a \u0219ti dinainte ce se poate \u00eent\u00e2mpla \u0219i chiar de a determina ziua \u00een care va cre\u0219te \u00eenc\u0103rcarea \u0219i ce sisteme vor fi afectate. Este nevoie s\u0103 se lupte cu defec\u021biunile \u0219i s\u0103 le previn\u0103, a\u0219a c\u0103 necesitatea implement\u0103rii unui sistem de analiz\u0103 predictiv\u0103 nu a fost discutat\u0103. Era necesar\u0103 modernizarea sistemelor pe baza datelor de monitorizare.<\/p>\n

Analiza de zbor<\/h2>\n

\nProiectul de salarii este unul dintre cele mai sensibile \u00een caz de defec\u021biune. Este, de asemenea, cel mai u\u0219or de prezis, a\u0219a c\u0103 s-a decis s\u0103 se \u00eenceap\u0103 cu el. Datorit\u0103 leg\u0103turii str\u00e2nse, \u00een momentele de v\u00e2rf, alte subsisteme, inclusiv serviciile bancare la distan\u021b\u0103 (DBO), puteau experimenta probleme. De exemplu, clien\u021bii, \u00eenc\u00e2nta\u021bi de SMS-urile privind intrarea banilor, \u00eencepeau s\u0103 \u00eei utilizeze activ. \u00cen acest caz, \u00eenc\u0103rcarea putea cre\u0219te cu mai mult de un ordin de m\u0103rime.\u00a0<\/p>\n

Primul model pentru prognoz\u0103 a fost creat manual. Am luat extragerea pentru ultimul an \u0219i am calculat \u00een ce zile se a\u0219teapt\u0103 v\u00e2rfuri maxime: de exemplu, \u00een zilele de 1, 15 \u0219i 25, precum \u0219i \u00een ultimele zile ale lunii. Acest model a necesitat un efort serios \u0219i nu oferea o prognoz\u0103 exact\u0103. Cu toate acestea, a identificat zonele \u00eenguste unde era necesar s\u0103 ad\u0103ug\u0103m \u201ehardware\u201d \u0219i a permis optimizarea procesului de transfer al banilor, negociind cu clien\u021bii ancore: pentru a nu pl\u0103ti salariile \u201e\u00eentr-o singur\u0103 tran\u0219\u0103\u201d, tranzac\u021biile din diferite regiuni au fost desf\u0103\u0219urate pe timp. Acum le proces\u0103m \u00een p\u0103r\u021bi, pe care infrastructura IT a b\u0103ncii le poate \u201eprelucra\u201d f\u0103r\u0103 erori.<\/p>\n

Dup\u0103 ce am ob\u021binut primul rezultat pozitiv, am trecut la automatizarea prognoz\u0103rii. A\u0219tepta r\u00e2ndul iar unsprezece zone critice.<\/p>\n

Abordare complex\u0103<\/h2>\n

\n\u00cen VTB a fost implementat un sistem de monitorizare de la MicroFocus. De acolo am preluat colectarea datelor pentru prognozare, sistemul de stocare \u0219i sistemul de generare a rapoartelor. Practic, monitorizarea exista deja, r\u0103m\u00e2nea doar s\u0103 ad\u0103ug\u0103m metrici, un modul de predic\u021bie \u0219i s\u0103 cre\u0103m rapoarte noi. Aceast\u0103 solu\u021bie este sus\u021binut\u0103 de un contractor extern \u201eTechnoserv\u201d, astfel c\u0103 lucr\u0103rile principale de implementare a proiectului au fost preluate de speciali\u0219tii lor, \u00eens\u0103 modelul l-am construit noi \u00een\u0219ine. Sistemul de prognoz\u0103 a fost realizat pe baza Prophet \u2014 acest produs open-source a fost dezvoltat de Facebook. Este u\u0219or de utilizat \u0219i se integreaz\u0103 cu u\u0219urin\u021b\u0103 cu instrumentele noastre existente de monitorizare complex\u0103 \u0219i Vertica. \u00cen termeni generali, sistemul analizeaz\u0103 graficul de \u00eenc\u0103rcare \u0219i, pe baza seriilor Fourier, face extrapolarea acestuia. Exist\u0103, de asemenea, posibilitatea de a ad\u0103uga anumite coeficiente pentru zile, extrase din modelul nostru. Metricile sunt preluate f\u0103r\u0103 interven\u021bia uman\u0103, o dat\u0103 pe s\u0103pt\u0103m\u00e2n\u0103 prognoza se recalcul\u0103 automat, iar noile rapoarte sunt trimise destinatarilor.\u00a0<\/p>\n

Aceast\u0103 abordare identific\u0103 principalele cicluri, cum ar fi cele anuale, lunare, trimestriale \u0219i s\u0103pt\u0103m\u00e2nale. Pl\u0103\u021bile salariilor \u0219i avansurilor, perioadele de concediu, s\u0103rb\u0103torile \u0219i reducerile - toate acestea influen\u021beaz\u0103 num\u0103rul de solicit\u0103ri c\u0103tre sisteme. S-a constatat, de exemplu, c\u0103 anumite cicluri se suprapun, iar cea mai mare \u00eenc\u0103rcare (75%) pe sisteme provine din Districtul Federal Central. Persoanele juridice \u0219i fizice se comport\u0103 diferit. \u00cen timp ce \u00eenc\u0103rcarea venit\u0103 de la \u201epersoanele fizice\u201d este relativ uniform distribuit\u0103 pe zilele s\u0103pt\u0103m\u00e2nii (av\u00e2nd multe tranzac\u021bii mici), \u00een cazul companiilor, 99,9% din tranzac\u021bii se concentreaz\u0103 \u00een timpul orelor de lucru, iar tranzac\u021biile pot fi scurte, dar pot dura \u0219i c\u00e2teva minute sau chiar ore.<\/p>\n

\"Monitorizare
\n
\nPe baza datelor ob\u021binute sunt definite tendin\u021bele pe termen lung. Noua sistem\u0103 a scos la iveal\u0103 c\u0103 oamenii p\u0103r\u0103sesc masiv birourile fizice. Acest lucru este bine cunoscut, dar nu ne a\u0219teptam la o astfel de amploare \u0219i la \u00eenceput nu am crezut: num\u0103rul solicit\u0103rilor \u00een birourile b\u0103ncii scade extrem de rapid, iar \u00een acela\u0219i timp, num\u0103rul tranzac\u021biilor la distan\u021b\u0103 cre\u0219te exponen\u021bial. Astfel, \u00eenc\u0103rcarea sistemelor cre\u0219te \u0219i va continua s\u0103 creasc\u0103. Acum prognoz\u0103m \u00eenc\u0103rcarea p\u00e2n\u0103 \u00een februarie 2020. Zilele normale se pot prezice cu o marj\u0103 de eroare de 3%, iar cele de v\u00e2rf cu o marj\u0103 de eroare de 10%. Acesta este un rezultat bun.<\/p>\n

Capcane<\/h2>\n

\nF\u0103r\u0103 dificult\u0103\u021bi, ca de obicei, nu s-a putut. Mecanismul de extrapolare folosind seriile Fourier nu trece u\u0219or prin zero - \u0219tim c\u0103 \u00een weekend persoanele juridice genereaz\u0103 pu\u021bine tranzac\u021bii, dar modul de predic\u021bie ofer\u0103 valori departe de zero. Ar fi putut fi ajustate for\u021bat, dar solu\u021biile de compromis nu sunt metoda noastr\u0103. \u00cen plus, a trebuit s\u0103 rezolv\u0103m problema extragerii f\u0103r\u0103 durere a datelor din sistemele surs\u0103. Colectarea regulat\u0103 a informa\u021biilor necesit\u0103 resurse computa\u021bionale serioase, a\u0219a c\u0103 am construit cache-uri rapide folosind replicarea, ob\u021bin\u00e2nd datele de afaceri deja din replici. Lipsa unei \u00eenc\u0103rc\u0103ri suplimentare pe sistemele principale \u00een aceste cazuri este o cerin\u021b\u0103 blocant\u0103.<\/p>\n

Provoc\u0103ri noi<\/h2>\n

\nSarcina pus\u0103 \u00een fa\u021b\u0103 de a prezice v\u00e2rfurile a fost rezolvat\u0103: nu au existat defec\u021biuni legate de suprasarcin\u0103 \u00een banc\u0103 din mai anul acesta, iar noul sistem de prognoz\u0103 a avut un rol semnificativ \u00een acest sens. Da, s-a dovedit insuficient, iar acum banca vrea s\u0103 \u00een\u021beleag\u0103 c\u00e2t de periculoase sunt v\u00e2rfurile pentru ea. Avem nevoie de prognoze folosind metrici din testarea de \u00eenc\u0103rcare, iar pentru aproximativ 30% dintre sistemele critice, acest lucru func\u021bioneaz\u0103 deja, restul fiind \u00een proces de ob\u021binere a prognozelor. \u00cen urm\u0103toarea etap\u0103, ne vom concentra pe prognozarea \u00eenc\u0103rc\u0103rilor sistemelor nu \u00een tranzac\u021bii de afaceri, ci \u00een termeni de infrastructur\u0103 IT, adic\u0103 ne vom scufunda la un nivel inferior. \u00cen plus, trebuie s\u0103 automatiz\u0103m complet colectarea metricilor \u0219i construirea prognozelor pe baza acestora, pentru a nu mai face exporturi manuale. Nu este nimic deosebit \u00een aceasta \u2014 pur \u0219i simplu combin\u0103m monitorizarea \u0219i testarea de \u00eenc\u0103rcare conform celor mai bune practici din lume.
\n
Sursa: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

IT-\u0434\u0435\u043f\u0430\u0440\u0442\u0430\u043c\u0435\u043d\u0442\u0443 \u0412\u0422\u0411 \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u043b\u043e\u0441\u044c \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0442\u044c\u0441\u044f \u0441 \u043d\u0435\u0448\u0442\u0430\u0442\u043d\u044b\u043c\u0438 \u0441\u0438\u0442\u0443\u0430\u0446\u0438\u044f\u043c\u0438 \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441\u0438\u0441\u0442\u0435\u043c, \u043a\u043e\u0433\u0434\u0430 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0430 \u043d\u0430 \u043d\u0438\u0445 \u043c\u043d\u043e\u0433\u043e\u043a\u0440\u0430\u0442\u043d\u043e \u0432\u043e\u0437\u0440\u0430\u0441\u0442\u0430\u043b\u0430. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u043f\u043e\u044f\u0432\u0438\u043b\u0430\u0441\u044c \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u043e\u0441\u0442\u044c \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0430\u0442\u044c \u0438 \u043e\u043f\u0440\u043e\u0431\u043e\u0432\u0430\u0442\u044c \u043c\u043e\u0434\u0435\u043b\u044c, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043f\u0440\u0435\u0434\u0441\u043a\u0430\u0437\u044b\u0432\u0430\u043b\u0430 \u0431\u044b \u043f\u0438\u043a\u043e\u0432\u0443\u044e \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u043d\u0430 \u043a\u0440\u0438\u0442\u0438\u0447\u043d\u044b\u0435 \u0441\u0438\u0441\u0442\u0435\u043c\u044b. \u0414\u043b\u044f \u044d\u0442\u043e\u0433\u043e IT-\u0441\u043f\u0435\u0446\u0438\u0430\u043b\u0438\u0441\u0442\u044b \u0431\u0430\u043d\u043a\u0430 \u043d\u0430\u0441\u0442\u0440\u043e\u0438\u043b\u0438 \u043c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433, \u043f\u0440\u043e\u0430\u043d\u0430\u043b\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u043b\u0438 \u0434\u0430\u043d\u043d\u044b\u0435 \u0438 \u043d\u0430\u0443\u0447\u0438\u043b\u0438\u0441\u044c \u0430\u0432\u0442\u043e\u043c\u0430\u0442\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043f\u0440\u043e\u0433\u043d\u043e\u0437\u044b. \u041a\u0430\u043a\u0438\u0435 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u044b \u043f\u043e\u043c\u043e\u0433\u043b\u0438 \u0441\u043f\u0440\u043e\u0433\u043d\u043e\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0443 \u0438 \u043f\u043e\u043b\u0443\u0447\u0438\u043b\u043e\u0441\u044c \u043b\u0438 \u0441 \u0438\u0445 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":29368,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-39133","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Monitorizare + testare de \u00eenc\u0103rcare = prognoz\u0103 \u0219i absen\u021ba defec\u021biunilor | ProHoster","description":"Departamentul IT al VTB a fost nevoit de mai multe ori s\u0103 se confrunte cu situa\u021bii neprev\u0103zute \u00een func\u021bionarea sistemelor, atunci c\u00e2nd \u00eenc\u0103rcarea asupra acestora a crescut brusc.","canonical_url":"https:\/\/prohoster.info\/ro\/blog\/administrirovanie\/monitoring-nagruzochnoe-testirovanie-prognozirovanie-i-otsutstvie-sboev","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"ro_RO","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433 + \u043d\u0430\u0433\u0440\u0443\u0437\u043e\u0447\u043d\u043e\u0435 \u0442\u0435\u0441\u0442\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435 = \u043f\u0440\u043e\u0433\u043d\u043e\u0437\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u043e\u0442\u0441\u0443\u0442\u0441\u0442\u0432\u0438\u0435 \u0441\u0431\u043e\u0435\u0432 | ProHoster","og:description":"IT-\u0434\u0435\u043f\u0430\u0440\u0442\u0430\u043c\u0435\u043d\u0442\u0443 \u0412\u0422\u0411 \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u043b\u043e\u0441\u044c \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0442\u044c\u0441\u044f \u0441 \u043d\u0435\u0448\u0442\u0430\u0442\u043d\u044b\u043c\u0438 \u0441\u0438\u0442\u0443\u0430\u0446\u0438\u044f\u043c\u0438 \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441\u0438\u0441\u0442\u0435\u043c, \u043a\u043e\u0433\u0434\u0430 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0430 \u043d\u0430 \u043d\u0438\u0445 \u043c\u043d\u043e\u0433\u043e\u043a\u0440\u0430\u0442\u043d\u043e \u0432\u043e\u0437\u0440\u0430\u0441\u0442\u0430\u043b\u0430.","og:url":"https:\/\/prohoster.info\/ro\/blog\/administrirovanie\/monitoring-nagruzochnoe-testirovanie-prognozirovanie-i-otsutstvie-sboev","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:28:01+00:00","article:modified_time":"2019-10-31T19:28:01+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"39133","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 00:53:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 00:55:36","updated":"2026-01-24 00:53:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/39133","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/comments?post=39133"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/posts\/39133\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/media\/29368"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/media?parent=39133"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/categories?post=39133"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/ro\/wp-json\/wp\/v2\/tags?post=39133"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}