{"id":86200,"date":"2020-06-22T13:42:20","date_gmt":"2020-06-22T11:42:20","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/monitoring-i-logirovanie-vneshnih-servisov-v-klaster-kubernetes"},"modified":"2020-06-22T13:42:20","modified_gmt":"2020-06-22T11:42:20","slug":"monitoring-i-logirovanie-vneshnih-servisov-v-klaster-kubernetes","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitoring-i-logirovanie-vneshnih-servisov-v-klaster-kubernetes","title":{"rendered":"V\u00e4liste teenuste j\u00e4lgimine ja logimine Kubernetes'i klastris","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

\"V\u00e4liste
\n
\nTere k\u00f5igile.<\/p>\n

Ma ei leidnud Internetist \u00fcldist juhendit logimise ja m\u00f5\u00f5tmete kogumise kohta kolmandate osapoolte teenustelt s\u00fcsteemidesse, mis on paigaldatud Kubernetes<\/a><\/noindex>. Avaldan oma lahenduse. K\u00e4esolev artikkel eeldab, et teil on juba t\u00f6\u00f6tav Prometheus<\/a><\/noindex> ja teised teenused. Andmeallikana kasutatakse v\u00e4liseid stateful-teenuseid, milleks on andmebaas PostgreSQL<\/a><\/noindex> konteineris Docker<\/a><\/noindex>. Ettev\u00f5ttes kasutatakse pakihaldurit Helm<\/a><\/noindex>, allpool on antud n\u00e4ited sellel. Kogu lahenduse jaoks koostame oma charti, mis sisaldab sissekasvatatud chart'e k\u00f5igile kasutatavatele teenustele.
\n <\/a><\/noindex><\/p>\n

Logimine<\/h4>\n

\nPaljud ettev\u00f5tted kasutavad logide kogumiseks, vaatamiseks ja nende tsentraliseerimiseks tehnoloogiate virna Elasticsearch<\/a><\/noindex> + Logstash<\/a><\/noindex> + kibana<\/a><\/noindex>, l\u00fchendatud ELK. Meie puhul pole sisu indekseerimine vajalik ja ma kasutasin kergemat Loki<\/a><\/noindex>. See on saadaval Helm'i paketina, me lisasime selle subchart'ina ja muutsime ingressi ja pv v\u00e4\u00e4rtusi meie s\u00fcsteemi kohandamiseks.<\/p>\n

values.yaml<\/b><\/p>\n

ingress:\n  enabled: true\n  annotations:\n     kubernetes.io\/ingress.class: nginx\n  hosts:\n    - host: kube-loki.example.domain\n      paths: \n        - \/\n  tls: []\n\n...\n\npersistence:\n  type: pvc\n  enabled: true\n  accessModes:\n    - ReadWriteOnce\n  size: 100Gi\n  finalizers:\n    - kubernetes.io\/pvc-protection\n  existingClaim: \"pv-loki\"\n<\/code><\/pre>\n
Logide saatmiseks kohale Loki<\/a><\/noindex> kasutame Loki Docker Logging Driver<\/a><\/noindex>.<\/p>\n
On vajalik see lisand installida k\u00f5ikidele Docker<\/a><\/noindex> serverid, millest soovite logisid saada. Demonile on mitu v\u00f5imalust, kuidas lisandit kasutada. Valin draiveri YAML-is. Docker Compose<\/a><\/noindex>, mis on osa Ansible<\/a><\/noindex> playbook'ist.<\/p>\n
                        postgres.yaml<\/b><\/p>\n
    - name: K\u00e4ivita konteinerid\n      docker_compose:\n        project_name: main-postgres\n        definition:\n          version: '3.7'\n          services:\n            p:\n              image: \"{{ postgres_version }}\"\n              container_name: postgresql\n              restart: always\n              volumes:\n                - \"{{ postgres_dir }}\/data:\/var\/lib\/postgresql\/data\"\n                - \"{{ postgres_dir }}\/postgres_init_scripts:\/docker-entrypoint-initdb.d\"\n              environment:\n                POSTGRES_PASSWORD: {{ postgres_pass }}\n                POSTGRES_USER: {{ postgres_user }}\n              ports:\n                - \"{{ postgres_ip }}:{{ postgres_port }}:5432\"\n              logging:\n                driver: \"loki\"\n                options:\n                  loki-url: \"{{ loki_url }}\"\n                  loki-batch-size: \"{{ loki_batch_size }}\"\n                  loki-retries: \"{{ loki_retries }}\"\n...\n<\/code><\/pre>\n
\nkus loki_url: kube-loki.example.domain\/loki\/api\/v1\/push<\/a><\/noindex> <\/p>\n
M\u00f5\u00f5dikud<\/h4>\n
\n PostgreSQL-ist kogutakse metrikaid postgres_exporter<\/a><\/noindex> kuna Prometheus<\/a><\/noindex>. \u00dclaltoodud faili j\u00e4tk Ansible<\/a><\/noindex> playbook'ist.<\/p>\n
                        postgres.yaml<\/b><\/p>\n
...\n            pexp:\n              image: \"wrouesnel\/postgres_exporter\"\n              container_name: pexporter\n              restart: unless-stopped\n              environment:\n                DATA_SOURCE_NAME: \"postgresql:\/\/{{ postgres_user }}:{{ postgres_pass }}@p:5432\/postgres?sslmode=disable\"\n              ports:\n                - \"{{ postgres_ip }}:{{ postgres_exporter_port }}:9187\"\n              logging:\n                driver: \"json-file\"\n                options:\n                  max-size: \"5m\"\n...\n<\/code><\/pre>\n
V\u00e4limike stateful-teenuste nimede paremaks visualiseerimiseks m\u00e4\u00e4rame need kaudu Endpoints.<\/p>\n
                        postgres-service.yaml<\/b><\/p>\n
apiVersion: v1\nkind: Endpoints\nmetadata:\n  name: postgres-exporter\nsubsets:\n  - addresses:\n      - ip: {{ .Values.service.postgres.ip }}\n    ports:\n      - port: {{ .Values.service.postgres.port }}\n        protocol: TCP\n---\napiVersion: v1\nkind: Service\nmetadata:\n  name: postgres-exporter\n  labels:\n    chart:  "{{ .Chart.Name }}-{{ .Chart.Version | replace "+" "_" }}"\nspec:\n  ports:\n    - protocol: TCP\n      port: {{ .Values.service.postgres.port }}\n      targetPort: {{ .Values.service.postgres.port }}\n<\/code><\/pre>\n
Prometheuse seadist postgres_exporter'i andmete kogumiseks toimub subchart'i v\u00e4\u00e4rtuste redigeerimise kaudu.<\/p>\n
                        values.yaml<\/b><\/p>\n
scrape_configs:\n...\n  - job_name: postgres-exporter\n    static_configs:\n      - targets: \n         - postgres-exporter.applicationnamespace.svc.cluster.local:9187\n        labels:\n          alias: postgres\n...\n<\/code><\/pre>\n
Kogutud andmete visualiseerimiseks installige vastav Dashboard
\nGrafana<\/a><\/noindex> ja seadistage andmeallikad. Seda saab samuti teha l\u00e4bi subchart Grafana v\u00e4\u00e4rtuste.<\/p>\n
                        Kuidas see v\u00e4lja n\u00e4eb<\/b>
\n                        \"V\u00e4liste<\/p>\n
\nLoodan, et see l\u00fchike artikkel aitas teil m\u00f5ista selle lahenduse p\u00f5hikontseptsioone ja s\u00e4\u00e4stab aega v\u00e4limiste teenuste j\u00e4lgimise ja logimise seadistamisel Loki\/Prometheuse jaoks Kubernetes'i klastris.
\n
Allikas: habr.com<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u0414\u043e\u0431\u0440\u043e\u0433\u043e \u0432\u0441\u0435\u043c. \u042f \u043d\u0435 \u043d\u0430\u0448\u0435\u043b \u0432 \u0441\u0435\u0442\u0438 \u043e\u0431\u043e\u0431\u0449\u0435\u043d\u043d\u043e\u0433\u043e \u0440\u0443\u043a\u043e\u0432\u043e\u0434\u0441\u0442\u0432\u0430 \u043f\u043e \u043b\u043e\u0433\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044e \u0438 \u0441\u0431\u043e\u0440\u0443 \u043c\u0435\u0442\u0440\u0438\u043a \u0441\u043e \u0441\u0442\u043e\u0440\u043e\u043d\u043d\u0438\u0445 \u0441\u0435\u0440\u0432\u0438\u0441\u043e\u0432 \u0432 \u0441\u0438\u0441\u0442\u0435\u043c\u044b \u0440\u0430\u0437\u0432\u0435\u0440\u043d\u0443\u0442\u044b\u0435 \u0432 Kubernetes. \u041f\u0443\u0431\u043b\u0438\u043a\u0443\u044e \u0441\u0432\u043e\u0435 \u0440\u0435\u0448\u0435\u043d\u0438\u0435. \u0414\u0430\u043d\u043d\u0430\u044f \u0441\u0442\u0430\u0442\u044c\u044f \u043f\u043e\u0434\u0440\u0430\u0437\u0443\u043c\u0435\u0432\u0430\u0435\u0442, \u0447\u0442\u043e \u0443 \u0432\u0430\u0441 \u0443\u0436\u0435 \u0438\u043c\u0435\u0435\u0442\u0441\u044f \u0440\u0430\u0431\u043e\u0447\u0438\u0439 Prometheus \u0438 \u0434\u0440\u0443\u0433\u0438\u0435 \u0441\u043b\u0443\u0436\u0431\u044b. \u0412 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 \u043f\u0440\u0438\u043c\u0435\u0440\u0430 \u0438\u0441\u0442\u043e\u0447\u043d\u0438\u043a\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u0432\u043d\u0435\u0448\u043d\u0435\u0433\u043e stateful-\u0441\u0435\u0440\u0432\u0438\u0441\u0430 \u0431\u0443\u0434\u0435\u0442 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c\u0441\u044f \u0421\u0423\u0411\u0414 PostgreSQL \u0432 \u043a\u043e\u043d\u0442\u0435\u0439\u043d\u0435\u0440\u0435 Docker. \u0412 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u0442\u0441\u044f […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":86201,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-86200","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47V\u00e4listest teenustest Kubernetes klastris j\u00e4lgimine ja logimine | ProHoster","description":"Tere k\u00f5igile. Mina ei ole.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitoring-i-logirovanie-vneshnih-servisov-v-klaster-kubernetes","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041c\u043e\u043d\u0438\u0442\u043e\u0440\u0438\u043d\u0433 \u0438 \u043b\u043e\u0433\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435 \u0432\u043d\u0435\u0448\u043d\u0438\u0445 \u0441\u0435\u0440\u0432\u0438\u0441\u043e\u0432 \u0432 \u043a\u043b\u0430\u0441\u0442\u0435\u0440 Kubernetes | ProHoster","og:description":"\u0414\u043e\u0431\u0440\u043e\u0433\u043e \u0432\u0441\u0435\u043c. \u042f \u043d\u0435.","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/monitoring-i-logirovanie-vneshnih-servisov-v-klaster-kubernetes","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-06-22T11:42:20+00:00","article:modified_time":"2020-06-22T11:42:20+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"86200","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 14:21:08","updated":"2022-09-28 06:57:45","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/86200","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=86200"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/86200\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media\/86201"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=86200"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=86200"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=86200"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}