{"id":104459,"date":"2022-06-21T15:36:41","date_gmt":"2022-06-21T13:36:42","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/facebook-predstavil-mehanizm-tmo-pozvolyayushhij-ekonomit-20-32-pamyati-na-serverah"},"modified":"2022-06-21T15:36:41","modified_gmt":"2022-06-21T13:36:42","slug":"facebook-predstavil-mehanizm-tmo-pozvolyayushhij-ekonomit-20-32-pamyati-na-serverah","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hr\/blog\/news\/facebook-predstavil-mehanizm-tmo-pozvolyayushhij-ekonomit-20-32-pamyati-na-serverah","title":{"rendered":"Facebook je predstavio mehanizam TMO, koji omogu\u0107ava u\u0161tedu od 20-32% memorije na serverima","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

In\u017eenjeri iz kompanije Facebook (zabranjena u RF) objavili su izve\u0161taj o implementaciji tehnologije TMO (Transparent Memory Offloading) pro\u0161le godine, koja zna\u010dajno \u0161tedi radnu memoriju na serverima tako \u0161to premesta neophodne sekundarne podatke na jeftinije ure\u0111aje za skladi\u0161tenje, kao \u0161to su NVMe SSD diskovi. Prema proceni Facebook-a, primena TMO omogu\u0107ava u\u0161tedu izme\u0111u 20 i 32% RAM-a na svakom serveru. Re\u0161enje je namenjeno za infrastrukture u kojima se aplikacije pokre\u0107u u izolovanim kontejnerima. Komponente TMO koje rade na strani jezgra ve\u0107 su uklju\u010dene u jezgro Linux-a. <\/p>\n

Na strani jezgra Linux-a rad tehnologije omogu\u0107ava podsistem PSI (Pressure Stall Information), koji je dostupan od izdanja 4.20. PSI se ve\u0107 koristi u razli\u010ditim obradnicima nedostatka memorije i omogu\u0107ava analizu informacija o vremenu \u010dekanja na razli\u010dite resurse (CPU, memorija, ulaz\/izlaz). Pomo\u0107u PSI obradnici u korisni\u010dkom prostoru mogu preciznije proceniti nivo optere\u0107enja sistema i prirodu usporavanja rada, \u0161to omogu\u0107ava identifikaciju odstupanja u samom po\u010detku, kada ona jo\u0161 uvek ne uti\u010du znatno na performanse. <\/p>\n

U korisni\u010dkom prostoru rad TMO-a omogu\u0107ava komponenta Senpai, koja putem cgroup2 dinami\u010dki prilago\u0111ava ograni\u010denje memorije za aplikacijske kontejnere na osnovu podataka dobijenih iz PSI. Senpai analizira znakove zapo\u010dinjanja nedostatka resursa putem PSI, procenjuje osetljivost aplikacija na usporen pristup memoriji i poku\u0161ava da odredi minimalnu potrebnu veli\u010dinu memorije za kontejner, pri \u010demu tra\u017eeni radni podaci ostaju u RAM-u, dok se prate\u0107i podaci, koji su se nalazili u fajl ke\u0161u ili trenutno nisu u upotrebi, premeste u swap particiju.

\"Facebook<\/center> <\/p>\n

Dakle, su\u0161tina TMO-a je odr\u017eavanje procesa na strogoj dijeti u smislu potro\u0161nje memorije, prisilno prebacivanje neiskori\u0161tenih stranica memorije u swap prostor, \u010dije izbacivanje zna\u010dajno ne utje\u010de na performanse (na primjer, stranice s kodovima koji se koriste samo pri inicijalizaciji i podaci koji se koriste samo jednom u diskovnom ke\u0161u). Za razliku od izbacivanja informacija u swap prostor kao reakcije na nedostatak memorije, u TMO-u se podaci izbacuju na osnovu proaktivne prognoze. <\/p>\n

Jedan od kriterija za izbacivanje je odsustvo pristupa stranici memorije tijekom 5 minuta. Takve stranice nazivamo hladnim (cold memory pages) i u prosjeku \u010dine oko 35% memorije aplikacija (ovisno o tipu aplikacija, varira od 19% do 65%). Pri izbacivanju se uzima u obzir aktivnost povezana s anonimnim stranicama memorije (memorija koju aplikacija dodjeljuje) i memorijom kori\u0161tenom za ke\u0161iranje datoteka (dodjeljuje jezgro). U nekim aplikacijama primarna potro\u0161nja je povezana s anonimnom memorijom, dok u drugima i ke\u0161iranje datoteka ima zna\u010dajnu ulogu. Kako bi se izbjegla neravnote\u017ea pri izbacivanju memorije u ke\u0161, u TMO-u se primjenjuje novi algoritam zamjene koji proporcionalno izbacuje anonimne stranice i stranice povezane s ke\u0161iranjem datoteka. <\/p>\n

Izbacivanje rijetko kori\u0161tenih stranica u sporiju memoriju ne utje\u010de zna\u010dajno na performanse, ali zna\u010dajno smanjuje tro\u0161kove opreme. Podaci se izbacuju na NVMe SSD-ove ili u komprimirani swap prostor u radnoj memoriji. Po tro\u0161ku pohrane bajta podataka, kori\u0161tenje NVMe SSD-a je do 10 puta jeftinije od primjene kompresije u radnoj memoriji.

\"Facebook<\/center>
\n
Izvor: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u043d\u0436\u0435\u043d\u0435\u0440\u044b \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Facebook (\u0437\u0430\u043f\u0440\u0435\u0449\u0435\u043d\u0430 \u0432 \u0420\u0424) \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0438 \u043e\u0442\u0447\u0451\u0442 \u043e \u0432\u043d\u0435\u0434\u0440\u0435\u043d\u0438\u0438 \u0432 \u043f\u0440\u043e\u0448\u043b\u043e\u043c \u0433\u043e\u0434\u0443 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0438 TMO (Transparent Memory Offloading), \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u044e\u0449\u0435\u0439 \u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u044d\u043a\u043e\u043d\u043e\u043c\u0438\u0442\u044c \u043e\u043f\u0435\u0440\u0430\u0442\u0438\u0432\u043d\u0443\u044e \u043f\u0430\u043c\u044f\u0442\u044c \u043d\u0430 \u0441\u0435\u0440\u0432\u0435\u0440\u0430\u0445 \u0437\u0430 \u0441\u0447\u0451\u0442 \u0432\u044b\u0442\u0435\u0441\u043d\u0435\u043d\u0438\u044f \u043d\u0435 \u0442\u0440\u0435\u0431\u0443\u0435\u043c\u044b\u0445 \u0434\u043b\u044f \u0432\u044b\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0440\u0430\u0431\u043e\u0442\u044b \u0432\u0442\u043e\u0440\u0438\u0447\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445 \u043d\u0430 \u0431\u043e\u043b\u0435\u0435 \u0434\u0435\u0448\u0451\u0432\u044b\u0435 \u043d\u0430\u043a\u043e\u043f\u0438\u0442\u0435\u043b\u0438, \u0442\u0430\u043a\u0438\u0435 \u043a\u0430\u043a NVMe SSD-\u0434\u0438\u0441\u043a\u0438. \u041f\u043e \u043e\u0446\u0435\u043d\u043a\u0435 Facebook, \u043f\u0440\u0438\u043c\u0435\u043d\u0435\u043d\u0438\u0435 TMO \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u0435\u0442 \u044d\u043a\u043e\u043d\u043e\u043c\u0438\u0442\u044c \u043e\u0442 20 \u0434\u043e 32% […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":104460,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-104459","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Facebook je predstavio mehanizam TMO koji omogu\u0107ava u\u0161tedu od 20-32% memorije na serverima | ProHoster","description":"In\u017eenjeri iz Facebooka (blokiranog u RF) objavili su izvje\u0161taj o implementaciji tehnologije TMO (Transparent Memory Offloading) pro\u0161le godine, koja omogu\u0107ava zna\u010dajno u\u0161tedu radne memorije na serverima.","canonical_url":"https:\/\/prohoster.info\/hr\/blog\/news\/facebook-predstavil-mehanizm-tmo-pozvolyayushhij-ekonomit-20-32-pamyati-na-serverah","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hr_HR","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Facebook \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043c\u0435\u0445\u0430\u043d\u0438\u0437\u043c TMO, \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u044e\u0449\u0438\u0439 \u044d\u043a\u043e\u043d\u043e\u043c\u0438\u0442\u044c 20-32% \u043f\u0430\u043c\u044f\u0442\u0438 \u043d\u0430 \u0441\u0435\u0440\u0432\u0435\u0440\u0430\u0445 | ProHoster","og:description":"\u0418\u043d\u0436\u0435\u043d\u0435\u0440\u044b \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Facebook (\u0437\u0430\u043f\u0440\u0435\u0449\u0435\u043d\u0430 \u0432 \u0420\u0424) \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b\u0438 \u043e\u0442\u0447\u0451\u0442 \u043e \u0432\u043d\u0435\u0434\u0440\u0435\u043d\u0438\u0438 \u0432 \u043f\u0440\u043e\u0448\u043b\u043e\u043c \u0433\u043e\u0434\u0443 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0438 TMO (Transparent Memory Offloading), \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u044e\u0449\u0435\u0439 \u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u044d\u043a\u043e\u043d\u043e\u043c\u0438\u0442\u044c \u043e\u043f\u0435\u0440\u0430\u0442\u0438\u0432\u043d\u0443\u044e \u043f\u0430\u043c\u044f\u0442\u044c \u043d\u0430 \u0441\u0435\u0440\u0432\u0435\u0440\u0430\u0445 \u0437\u0430 \u0441\u0447\u0451\u0442.","og:url":"https:\/\/prohoster.info\/hr\/blog\/news\/facebook-predstavil-mehanizm-tmo-pozvolyayushhij-ekonomit-20-32-pamyati-na-serverah","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2022-06-21T13:36:42+00:00","article:modified_time":"2022-06-21T13:36:42+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"104459","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2022-06-21 13:37:49","updated":"2022-10-01 20:35:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/104459","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/comments?post=104459"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/104459\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media\/104460"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media?parent=104459"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/categories?post=104459"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/tags?post=104459"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}