{"id":31139,"date":"2019-10-31T21:39:40","date_gmt":"2019-10-31T18:39:40","guid":{"rendered":"https:\/\/prohoster.info\/blog\/monitorim-resursy-klasterov-kubernetes\/"},"modified":"2019-10-31T21:39:40","modified_gmt":"2019-10-31T18:39:40","slug":"monitorim-resursy-klasterov-kubernetes","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitorim-resursy-klasterov-kubernetes","title":{"rendered":"J\u00e4lgime Kubernetes klastri ressursse","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

\"J\u00e4lgime<\/a><\/noindex><\/p>\n

<\/p>\n

Loomisin Kube Eagle'i \u2013 Prometheuse eksportija. Selgus, et see on lahe t\u00f6\u00f6riist, mis aitab paremini m\u00f5ista v\u00e4ikeste ja keskmise suurusega klastrite ressursse. L\u00f5ppkokkuv\u00f5ttes s\u00e4\u00e4sin mitusada dollarit, sest valisin \u00f5iged masinat\u00fc\u00fcbid ja kohandasin rakenduste ressursipiirangud vastavalt t\u00f6\u00f6koormusele.<\/p>\n

<\/p>\n

R\u00e4\u00e4gin eeliste kohta Kube Eagle<\/a><\/noindex>, aga enne seletan, mis probleemid tekkisid ja miks oli vajalik kvaliteetne vaatlus.<\/p>\n

<\/a><\/noindex><\/p>\n

Haldasin mitut klastri 4\u201350 s\u00f5lmega. Igas klastris oli kuni 200 mikroteenust ja rakendust. Et kasutada olemasolevat riistvara t\u00f5husamalt, olid enamik juurutusi seadistatud burstable-m\u00e4luga ja CPU ressurssidega. Nii saavad podid v\u00f5tta vajadusel saadaval olevaid ressursse, segamata samas teisi rakendusi sellel s\u00f5lmel. Kas pole tore?<\/p>\n

<\/p>\n

Ja kuigi klaster tarbis suhteliselt v\u00e4he CPU-d (8%) ja m\u00e4lukuunde (40%), tekkis meil pidevalt probleeme podide v\u00e4ljasaatmisega, kui nad \u00fcritasid eraldada rohkem m\u00e4lu, kui s\u00f5lmelt saadaval oli. Siis oli meil ainult \u00fcks paneel Kubernetes ressursside j\u00e4lgimiseks. Selline:<\/p>\n

<\/p>\n

\"J\u00e4lgime<\/a><\/noindex>
\nGrafana paneel ainult cAdvisori m\u00f5\u00f5dikute jaoks<\/em><\/p>\n

<\/p>\n

Sellise paneeliga ei ole probleem n\u00e4ha node'e, mis s\u00f6\u00f6vad palju m\u00e4lu ja CPU-d. Probleem on m\u00f5ista, mis on p\u00f5hjus. Et podid paigal p\u00fcsiksid, oleks muidugi v\u00f5imalik seadistada garanteeritud ressursid k\u00f5igile podidele (taotletud ressursid v\u00f5rduvad limiidiga). Kuid see ei ole k\u00f5ige arukam raua kasutamine. Klusteril oli mitu sada gigabaiti m\u00e4lu, samas kui m\u00f5ned node'id n\u00e4lgisid ja teistel j\u00e4i alles 4\u201310 GB.<\/p>\n

<\/p>\n

L\u00f5ppkokkuv\u00f5ttes jaotab Kubernetes'e planeerija t\u00f6\u00f6koormusi saadaval olevate ressursside vahel ebav\u00f5rdselt. Kubernetes'e planeerija arvestab erinevaid konfiguratsioone: affinity reeglid, taints ja tolerations, node'i selektorid, mis v\u00f5ivad piirata saadaval olevate node'ide hulka. Kuid minu juhul ei olnud midagi sellist, ning podid planeeriti s\u00f5ltuvalt taotletud ressurssidest igas node'is.<\/p>\n

<\/p>\n

Podile valiti node, millel oli k\u00f5ige rohkem vabu ressursse ja mis rahuldas taotluse tingimusi. Meil oli olukord, kus taotletud ressursid node'ides ei vastanud tegelikule kasutusele, ja siia tuli appi Kube Eagle ja selle ressursimonitorimise v\u00f5imalused.<\/p>\n

<\/p>\n

Mul on peaaegu k\u00f5ik Kubernetes klastrid j\u00e4lgitud ainult Node exporteri<\/a><\/noindex> ja Kube State Metrics<\/a><\/noindex>. Node Exporter annab statistikat sisendi, v\u00e4ljundi ja diskikasutuse, CPU ja m\u00e4luga, samas Kube State Metrics n\u00e4itab Kubernetes objektide metrikat, nagu CPU ja m\u00e4lu ressursside p\u00e4ringud ja limiidid.<\/p>\n

<\/p>\n

Peame \u00fchendama kasutusm\u00f5\u00f5dikud p\u00e4ringute ja limiitide m\u00f5\u00f5dikute j\u00e4rgi Grafanas ning siis saame kogu teabe probleemist. See k\u00f5lab lihtsalt, kuid tegelikult nimetatakse nende kahe t\u00f6\u00f6riista sildid erinevalt ja m\u00f5nedel m\u00f5\u00f5dikutel pole \u00fcldse metaandmete silte. Kube Eagle teeb k\u00f5ik ise ja paneel n\u00e4eb v\u00e4lja selline:<\/p>\n

<\/p>\n

\"J\u00e4lgime<\/a><\/noindex><\/p>\n

<\/p>\n

\"J\u00e4lgime<\/a><\/noindex>
\nKube Eagle'i seirepaneel<\/a><\/noindex><\/em><\/p>\n

<\/p>\n

Me oleme suutnud lahendada palju ressursiprobleeme ja s\u00e4\u00e4sta seadmeid:<\/p>\n

<\/p>\n

    \n
  1. M\u00f5ned arendajad ei teadnud, kui palju ressursse mikroteenused vajavad (v\u00f5i lihtsalt ei viitsinud). Meil polnud midagi, millega leida vale ressursip\u00e4ringud - selleks on vaja teadlikkust tarbimisest pluss p\u00e4ringud ja limiidid. N\u00fc\u00fcd nad n\u00e4evad Prometheuse m\u00f5\u00f5diku, j\u00e4lgivad tegelikku kasutust ja kohandavad p\u00e4ringud ning limiidid.<\/li>\n
  2. JVM-rakendused kasutavad nii palju m\u00e4lu, kui suudavad. Pr\u00fcgikorjaja vabastab m\u00e4lu ainult siis, kui \u00fcle 75% on kasutusel. Kuna enamik teenuseid kasutab burstable m\u00e4lu, oli JVM alati selle h\u00f5ivanud. Seet\u00f5ttu kasutasid k\u00f5ik need Java-teenused palju rohkem m\u00e4lu, kui oli oodata.<\/li>\n
  3. M\u00f5ned rakendused k\u00fcsisid liiga palju m\u00e4lu, ning Kubernetes'i ajakava ei andnud neid s\u00f5lmi teistele rakendustele, kuigi tegelikult olid need vabamad kui teised s\u00f5lmed. \u00dcks arendaja lisas kogemata taotlusse liigse numbri ja h\u00f5ivas suure hulga m\u00e4lu: 20 GB asemel 2. Keegi ei m\u00e4rganud. Rakendusel oli 3 repliiki, nii et kannatasid lausa 3 s\u00f5lme.<\/li>\n
  4. Seadsime ressurssidepiirangud, \u00fcmberplaneerisime podid \u00f5ige taotlusega ja saavutatud ideaalne tasakaal raua kasutamisel k\u00f5igis s\u00f5lmedes. M\u00f5ne s\u00f5lme oleks isegi saanud sulgeda. Siis n\u00e4gime, et meil on vale masin (suunitletud CPU, mitte m\u00e4lu suunas). Vahetasime t\u00fc\u00fcpi ja kustutasime veel m\u00f5ned s\u00f5lmed.<\/li>\n<\/ol>\n

    <\/p>\n

    Kokkuv\u00f5te<\/h3>\n

    <\/p>\n

    Burstable ressurssidega klastris kasutate olemasolevat riistvara t\u00f5husamalt, kuid Kubernetes'i planeerija planeerib podid ressursi n\u00f5udmiste alusel, mis v\u00f5ib p\u00f5hjustada probleeme. Kuidas \u00fchte saamata j\u00e4tta: v\u00e4ltida probleeme ja kasutada ressursse maksimaalselt \u2014 vajalik on kvaliteetne j\u00e4lgimine. Selleks sobib Kube Eagle<\/a><\/noindex> (Prometheuse eksportija ja Grafana juhtpaneel).<\/p>\n

    Allikas: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

    \u042f \u0441\u043e\u0437\u0434\u0430\u043b Kube Eagle\u00a0\u2014 \u044d\u043a\u0441\u043f\u043e\u0440\u0442\u0435\u0440 Prometheus. \u041e\u043a\u0430\u0437\u0430\u043b\u043e\u0441\u044c, \u043a\u0440\u0443\u0442\u0430\u044f \u0448\u0442\u0443\u043a\u0430, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043f\u043e\u043c\u043e\u0433\u0430\u0435\u0442 \u043b\u0443\u0447\u0448\u0435 \u0440\u0430\u0437\u0431\u0438\u0440\u0430\u0442\u044c\u0441\u044f \u0432 \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u0445 \u043c\u0430\u043b\u0435\u043d\u044c\u043a\u0438\u0445 \u0438 \u0441\u0440\u0435\u0434\u043d\u0438\u0445 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u043e\u0432. \u0412 \u0438\u0442\u043e\u0433\u0435 \u044f \u0441\u044d\u043a\u043e\u043d\u043e\u043c\u0438\u043b \u043d\u0435 \u043e\u0434\u043d\u0443 \u0441\u043e\u0442\u043d\u044e \u0434\u043e\u043b\u043b\u0430\u0440\u043e\u0432, \u043f\u043e\u0442\u043e\u043c\u0443 \u0447\u0442\u043e \u043f\u043e\u0434\u0431\u0438\u0440\u0430\u043b \u043f\u0440\u0430\u0432\u0438\u043b\u044c\u043d\u044b\u0435 \u0442\u0438\u043f\u044b \u043c\u0430\u0448\u0438\u043d \u0438 \u043d\u0430\u0441\u0442\u0440\u0430\u0438\u0432\u0430\u043b \u043e\u0433\u0440\u0430\u043d\u0438\u0447\u0435\u043d\u0438\u044f \u0440\u0435\u0441\u0443\u0440\u0441\u043e\u0432 \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439 \u043f\u043e\u0434 \u0440\u0430\u0431\u043e\u0447\u0438\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0438. \u042f \u0440\u0430\u0441\u0441\u043a\u0430\u0436\u0443 \u043e \u043f\u0440\u0435\u0438\u043c\u0443\u0449\u0435\u0441\u0442\u0432\u0430\u0445 Kube Eagle, \u043d\u043e \u0441\u043d\u0430\u0447\u0430\u043b\u0430 \u043e\u0431\u044a\u044f\u0441\u043d\u044e, \u0438\u0437-\u0437\u0430 \u0447\u0435\u0433\u043e \u0432\u044b\u0448\u0435\u043b \u0441\u044b\u0440-\u0431\u043e\u0440 \u0438 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":23107,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-31139","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47J\u00e4lgime Kubernetes'i klastrite ressursse | ProHoster","description":"Loomisin Kube Eagle \u2014 Prometheuse eksportija. Selgus, et see on suurep\u00e4rane t\u00f6\u00f6riist, mis aitab paremini m\u00f5ista v\u00e4ikeste ja keskmiste klastrite ressursse. Tulemusena s\u00e4\u00e4stsin mitusada dollarit, kuna valisin \u00f5iged masinat\u00fc\u00fcbid ja seadistasin rakenduste ressursipiirangud vastavalt t\u00f6\u00f6koormusele. R\u00e4\u00e4gin Kube Eagle eelistest, kuid k\u00f5igepealt selgitan, miks see k\u00f5ik alguse sai ja","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitorim-resursy-klasterov-kubernetes","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043c \u0440\u0435\u0441\u0443\u0440\u0441\u044b \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u043e\u0432 Kubernetes | ProHoster","og:description":"\u042f \u0441\u043e\u0437\u0434\u0430\u043b Kube Eagle \u2014 \u044d\u043a\u0441\u043f\u043e\u0440\u0442\u0435\u0440 Prometheus. \u041e\u043a\u0430\u0437\u0430\u043b\u043e\u0441\u044c, \u043a\u0440\u0443\u0442\u0430\u044f \u0448\u0442\u0443\u043a\u0430, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043f\u043e\u043c\u043e\u0433\u0430\u0435\u0442 \u043b\u0443\u0447\u0448\u0435 \u0440\u0430\u0437\u0431\u0438\u0440\u0430\u0442\u044c\u0441\u044f \u0432 \u0440\u0435\u0441\u0443\u0440\u0441\u0430\u0445 \u043c\u0430\u043b\u0435\u043d\u044c\u043a\u0438\u0445 \u0438 \u0441\u0440\u0435\u0434\u043d\u0438\u0445 \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u043e\u0432. \u0412 \u0438\u0442\u043e\u0433\u0435 \u044f \u0441\u044d\u043a\u043e\u043d\u043e\u043c\u0438\u043b \u043d\u0435 \u043e\u0434\u043d\u0443 \u0441\u043e\u0442\u043d\u044e \u0434\u043e\u043b\u043b\u0430\u0440\u043e\u0432, \u043f\u043e\u0442\u043e\u043c\u0443 \u0447\u0442\u043e \u043f\u043e\u0434\u0431\u0438\u0440\u0430\u043b \u043f\u0440\u0430\u0432\u0438\u043b\u044c\u043d\u044b\u0435 \u0442\u0438\u043f\u044b \u043c\u0430\u0448\u0438\u043d \u0438 \u043d\u0430\u0441\u0442\u0440\u0430\u0438\u0432\u0430\u043b \u043e\u0433\u0440\u0430\u043d\u0438\u0447\u0435\u043d\u0438\u044f \u0440\u0435\u0441\u0443\u0440\u0441\u043e\u0432 \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439 \u043f\u043e\u0434 \u0440\u0430\u0431\u043e\u0447\u0438\u0435 \u043d\u0430\u0433\u0440\u0443\u0437\u043a\u0438. \u042f \u0440\u0430\u0441\u0441\u043a\u0430\u0436\u0443 \u043e \u043f\u0440\u0435\u0438\u043c\u0443\u0449\u0435\u0441\u0442\u0432\u0430\u0445 Kube Eagle, \u043d\u043e \u0441\u043d\u0430\u0447\u0430\u043b\u0430 \u043e\u0431\u044a\u044f\u0441\u043d\u044e, \u0438\u0437-\u0437\u0430 \u0447\u0435\u0433\u043e \u0432\u044b\u0448\u0435\u043b \u0441\u044b\u0440-\u0431\u043e\u0440 \u0438","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitorim-resursy-klasterov-kubernetes","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:39:40+00:00","article:modified_time":"2019-10-31T18:39:40+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"31139","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-21 04:42:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 03:22:34","updated":"2026-01-21 04:42:20"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/31139","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=31139"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/31139\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media\/23107"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=31139"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=31139"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=31139"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}