Facebook webatara usoro TMO, nke na-enye gị ohere ịchekwa 20-32% nke ebe nchekwa na sava

Ndị injinia sitere na Facebook (amachibidoro iwu na Russian Federation) bipụtara akụkọ banyere mmejuputa afọ gara aga nke teknụzụ TMO (Transparent Memory Offloading), nke na-enye ohere nchekwa dị ukwuu na RAM na sava site na iwepu data nke abụọ achọghị maka ọrụ na draịva dị ọnụ ala, dị ka NVMe. SSD - diski. Facebook na-eme atụmatụ na iji TMO nwere ike ịchekwa 20 ruo 32% nke RAM na nkesa ọ bụla. Emebere ihe ngwọta maka iji na akụrụngwa ebe ngwa na-agba ọsọ n'ime akpa dịpụrụ adịpụ. Akụkụ kernel nke TMO etinyelarị na kernel Linux.

N'akụkụ kernel Linux, teknụzụ PSI (Pressure Stall Information) na-akwado teknụzụ, dị na-amalite na ntọhapụ 4.20. A na-eji PSI mee ihe na ndị na-ahụ maka nchekwa dị ala ma na-enye gị ohere nyochaa ozi gbasara oge nchere maka inweta ihe dị iche iche (CPU, ebe nchekwa, I / O). Site na PSI, ndị na-arụ ọrụ-oghere oghere nwere ike nyochaa nke ọma ọkwa ibu sistemu yana usoro mbelata, na-enye ohere ka amata ihe ọjọọ n'oge, tupu ha enwee mmetụta pụtara ìhè na arụmọrụ.

N'ime oghere onye ọrụ, TMO na-enye site na mpaghara Senpai, nke, site na cgroup2, na-emezi oke ebe nchekwa maka ngwa ngwa dabere na data enwetara site na PSI. Senpai na-enyocha ihe ịrịba ama nke mmalite nke ụkọ akụrụngwa site na PSI, na-enyocha uche nke ngwa iji belata ohere nchekwa ma gbalịa chọpụta nha ebe nchekwa kacha nta chọrọ site na akpa ahụ, nke data achọrọ maka ịrụ ọrụ na-anọgide na RAM, yana ihe ndị na-eso ya. data edozi na cache faịlụ ma ọ bụ na-ejighị ya ozugbo, a na-amanye ya na nkebi swap.

Facebook webatara usoro TMO, nke na-enye gị ohere ịchekwa 20-32% nke ebe nchekwa na sava

Ya mere, ihe kachasị mkpa nke TMO bụ idobe usoro na nri siri ike n'ihe gbasara oriri ebe nchekwa, na-amanye swapping nke ibe ebe nchekwa na-ejighị ya, onye nchụpụ ya adịghị emetụta arụmọrụ (dịka ọmụmaatụ, ibe nwere koodu ejiri naanị n'oge mmalite, na otu-eji). data dị na cache diski). N'adịghị ka ịchụpụ ozi na nkebi swap na nzaghachi nrụgide ebe nchekwa, na TMO data a na-achụpụ dabere na amụma amụma.

Otu n'ime njirisi maka ịchụpụ bụ enweghị ohere ịnweta ibe ebe nchekwa maka nkeji ise. A na-akpọ ibe ndị dị otú ahụ ibe ebe nchekwa oyi na nkezi mejupụtara ihe dịka 5% nke ebe nchekwa ngwa (dabere n'ụdị ngwa, enwere ike site na 35% ruo 19%). Preemption na-eburu n'uche ọrụ metụtara ibe ebe nchekwa na-amaghị aha (ncheta nke ngwa ahụ kenyere) yana ebe nchekwa ejiri maka caching faịlụ (nke kernel kenyere). N'ime ngwa ụfọdụ isi oriri bụ ebe nchekwa amaghị aha, mana na ndị ọzọ cache faịlụ dịkwa mkpa. Iji zere ndabara nchụpụ cache, TMO na-eji paging algọridim ọhụrụ na-achụpụ ibe na ibe ndị na-amaghị aha jikọtara ya na cache faịlụ ahụ nke ọma.

Ịkwanye ibe ndị a na-ejikarị eme ihe n'ime ebe nchekwa dị nwayọọ anaghị enwe mmetụta dị ukwuu na arụmọrụ, mana ọ nwere ike ibelata ọnụ ahịa ngwaike nke ukwuu. A na-atụba data na draịva SSD ma ọ bụ na mpaghara mgbanwe abịakọrọ na RAM. N'ihe gbasara ọnụ ahịa ịchekwa byte nke data, iji NVMe SSD dị ihe ruru ugboro iri dị ọnụ ala karịa iji mkpakọ na RAM.

Facebook webatara usoro TMO, nke na-enye gị ohere ịchekwa 20-32% nke ebe nchekwa na sava


isi: opennet.ru

Tinye a comment