{"id":90281,"date":"2020-07-30T13:42:14","date_gmt":"2020-07-30T11:42:14","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/kak-uma-tech-infrastrukturu-razvivala"},"modified":"2020-07-30T13:42:14","modified_gmt":"2020-07-30T11:42:14","slug":"kak-uma-tech-infrastrukturu-razvivala","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-uma-tech-infrastrukturu-razvivala","title":{"rendered":"How Uma.Tech has developed its infrastructure","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

We launched new services, traffic increased, replaced servers, connected new sites, and restructured data centers \u2013 now we will share this story, which we first introduced to you five years ago.<\/i>.<\/a><\/noindex><\/p>\n

Five years is a significant time for summarizing interim results. Therefore, we decided to talk about the development of our infrastructure, which over the past five years has taken an incredibly interesting path that we are proud of. The quantitative changes we implemented have transformed into qualitative ones, allowing the infrastructure to operate in modes that seemed like fantasy in the middle of the last decade. <\/p>\n

We support the operation of complex projects with stringent reliability and load requirements, including PREMIER and Match TV. For sports broadcasts and the premier of popular series, we require traffic delivery in terabits per second, and we easily achieve this, so often that working at such speeds has long become routine for us. Five years ago, the most demanding project running on our systems was Rutube, which has since evolved, increasing its volumes and traffic, which had to be taken into account when planning loads.<\/p>\n

We talked about how we developed the 'hardware' of our infrastructure (\u2018Rutube 2009-2015: The Story of Our Hardware\u2019<\/a><\/noindex>) and improved the system responsible for video delivery (\u2018From Zero to 700 Gigabits Per Second \u2014 How One of Russia's Largest Video Hosting Services Delivers Video\u2019<\/a><\/noindex>), but since the writing of these texts, a lot of time has passed, and many other solutions have been created and implemented, the results of which allow us to meet modern requirements and be flexible enough to adapt to new challenges.<\/p>\n

\"How
\n
\nThe core network<\/b> is constantly evolving. We switched to Cisco equipment in 2015, which we mentioned in the previous article. At that time, it was still 10\/40G, but for obvious reasons, just a few years later we upgraded the existing chassis, and now we actively use 25\/100G as well. <\/p>\n

\"How
\n
\n100G links are no longer a luxury (rather, they are an urgent requirement of the time in our segment), nor are they a rarity (more and more operators are providing connections at such speeds). However, 10\/40G remains relevant: through these links, we continue to connect operators with low traffic volumes, for whom it is currently impractical to use a more capacious port.<\/p>\n

The network core we created deserves a separate examination and will later become the subject of a separate article. There, we will delve into the technical details and examine the logic of our actions in its creation. But for now, let\u2019s continue to sketch the infrastructure more schematically, as your attention, dear readers, is not infinite.<\/p>\n

Video delivery servers <\/b>evolve rapidly, and we are making considerable efforts for this. Previously, we primarily used 2U servers with 4-5 network cards, each with two 10G ports, but now most of the traffic is delivered by 1U servers, which have 2-3 cards, each with two 25G ports. The costs of 10G and 25G cards have almost equalized, and higher-speed solutions allow for delivery at both 10G and 25G. The result has been a clear savings: fewer server components and connection cables mean lower costs (and higher reliability), and components take up less space in the rack\u2014making it possible to place more servers per unit area, and consequently, decreasing rental costs.<\/p>\n

But more important is the gain in speed! Now we can deliver over 100G with 1U! And this is against the backdrop of the situation where some major Russian projects consider 40G delivery with 2U an 'achievement.' We would like to have their problems!<\/p>\n

\"How
\n
\nIt is worth noting that we still use a generation of network cards that only operate at 10G. This equipment functions reliably and is well-known to us, which is why we didn\u2019t discard it but instead found new applications for it. We installed these components in video storage servers, which, for effective operation, clearly require more than one or two 1G interfaces; thus, 10G cards have proven to be relevant.<\/p>\n

Data Storage Systems<\/b> They are also increasing. Over the past five years, they have transformed from twelve-disk (12x HDD 2U) to thirty-six-disk (36x HDD 4U) enclosures. Some fear using such large configurations because if one of these enclosures fails, it could threaten the performance\u2014or even the functionality\u2014of the entire system. But that won't happen with us: we have ensured redundancy through geographically distributed data backups. We have spread the enclosures across different data centers\u2014utilizing three in total\u2014which eliminates problems during both enclosure failures and site outages.<\/p>\n

\"How
\n
\nOf course, this approach has rendered hardware RAID redundant, which we have discarded. By eliminating redundancy, we simultaneously enhanced system reliability, simplifying solutions and removing one potential point of failure. We should note that our storage systems are 'homemade.' This was a conscious decision, and the results have fully satisfied us.<\/p>\n

Data Centers<\/b> over the past five years, we have changed several times. Since the writing of the previous article, we have only retained one data center\u2014DataLine\u2014while the others required replacement as our infrastructure developed. All relocations between sites were planned.<\/p>\n

Two years ago, we migrated within MMTS-9, moving to a site with quality renovations, a good cooling system, stable power supply, and free of dust that previously settled in thick layers on all surfaces, clogging the internals of our equipment. The decision to prioritize service quality\u2014and dust-free environments!\u2014was the reason for our move.<\/p>\n

\"How
\n
\nAlmost always, 'one move equals two fires,' but the problems during migration vary each time. This time, the primary difficulty of relocating within one data center was the optical cross-connects\u2014their excessive presence between floors without consolidation into a single cross-connection from the telecommunications operators. The process of updating and re-laying the cross-connections (where engineers from MMTS-9 assisted us) was probably the most challenging stage of the migration.<\/p>\n

The second migration took place a year ago, in 2019, when we moved from a rather subpar data center to O2xygen. The reasons for the move were similar to those discussed above, but added to them was the issue of the unattractiveness of the initial data center for communication operators \u2014 many providers had to be 'caught up' to this point by our own efforts.<\/p>\n

\"How
\n
\nMigrating 13 racks to a quality site in MMTS-9 allowed us to develop this location not only as an operator site (a couple of racks and the 'cross-connects' of operators), but also to utilize it as one of the main sites. This made the migration from a less than ideal data center somewhat simpler \u2014 we transferred most of the equipment to another site, while O2xygen took on the role of a developing site, sending 5 racks of equipment there as well.<\/p>\n

Today, O2xygen is already a fully-fledged venue, where necessary operators have 'arrived' and continue to connect new ones. For operators, O2xygen has also proved appealing in terms of strategic development.<\/p>\n

We always conduct the main phase of the move overnight, and during the migrations within MMTS-9 and to O2xygen, we adhered to this rule. It is important to note that we strictly follow the 'overnight move' rule, regardless of the number of racks! There was even a precedent when we moved 20 racks and completed it in just one night. Migration is a relatively straightforward process that requires carefulness and sequence, but there are still some tricks involved in both the preparation and the moving itself, as well as in the deployment at the new location. We are ready to discuss the details of migration in depth if you are interested.<\/p>\n

Results<\/b> We appreciate five-year development plans. We have completed the construction of a new fault-tolerant infrastructure distributed across three data centers. We have sharply increased traffic output density \u2014 while we were recently pleased with 40-80G from 2U, we now consider it normal to deliver 100G from 1U. Now even terabit traffic is perceived as common by us. We are ready to further develop our infrastructure, which has become flexible and scalable.<\/p>\n

Question: <\/b>What shall we discuss in the upcoming texts, dear readers? Why we started creating custom data storage systems? About the network core and its features? On the tricks and nuances of migration between data centers? On optimizing solutions for output through component selection and fine-tuning parameters? About creating resilient solutions through multiple redundancy and horizontal scaling capabilities within the data center, realized in a structure of three data centers?<\/p>\n

Author: Peter Vinogradov \u2014 Technical Director of Uma.Tech Hamsters<\/a><\/noindex> <\/i>
\n
Source: habr.com<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041c\u044b \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u043b\u0438 \u043d\u043e\u0432\u044b\u0435 \u0441\u0435\u0440\u0432\u0438\u0441\u044b, \u0442\u0440\u0430\u0444\u0438\u043a \u0440\u043e\u0441, \u0437\u0430\u043c\u0435\u043d\u044f\u043b\u0438 \u0441\u0435\u0440\u0432\u0435\u0440\u0430, \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0430\u043b\u0438 \u043d\u043e\u0432\u044b\u0435 \u043f\u043b\u043e\u0449\u0430\u0434\u043a\u0438 \u0438 \u043f\u0435\u0440\u0435\u0434\u0435\u043b\u044b\u0432\u0430\u043b\u0438 \u0426\u041e\u0414\u044b \u2013 \u0430 \u0441\u0435\u0439\u0447\u0430\u0441 \u0440\u0430\u0441\u0441\u043a\u0430\u0436\u0435\u043c \u044d\u0442\u0443 \u0438\u0441\u0442\u043e\u0440\u0438\u044e, \u0441 \u043d\u0430\u0447\u0430\u043b\u043e\u043c \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u043d\u0430\u043a\u043e\u043c\u0438\u043b\u0438 \u0432\u0430\u0441 \u043f\u044f\u0442\u044c \u043b\u0435\u0442 \u043d\u0430\u0437\u0430\u0434. \u041f\u044f\u0442\u044c \u043b\u0435\u0442 \u2013 \u0445\u0430\u0440\u0430\u043a\u0442\u0435\u0440\u043d\u043e\u0435 \u0432\u0440\u0435\u043c\u044f \u0434\u043b\u044f \u043f\u043e\u0434\u0432\u0435\u0434\u0435\u043d\u0438\u044f \u043f\u0440\u043e\u043c\u0435\u0436\u0443\u0442\u043e\u0447\u043d\u044b\u0445 \u0438\u0442\u043e\u0433\u043e\u0432. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u043c\u044b \u0440\u0435\u0448\u0438\u043b\u0438 \u0440\u0430\u0441\u0441\u043a\u0430\u0437\u0430\u0442\u044c \u043e \u0440\u0430\u0437\u0432\u0438\u0442\u0438\u0438 \u043d\u0430\u0448\u0435\u0439 \u0438\u043d\u0444\u0440\u0430\u0441\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u044b, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u0437\u0430 \u043f\u044f\u0442\u0438\u043b\u0435\u0442\u043a\u0443 \u043f\u0440\u043e\u0448\u043b\u0430 \u0443\u0434\u0438\u0432\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0438\u043d\u0442\u0435\u0440\u0435\u0441\u043d\u044b\u0439 \u043f\u0443\u0442\u044c \u0440\u0430\u0437\u0432\u0438\u0442\u0438\u044f, \u043a\u043e\u0442\u043e\u0440\u044b\u043c \u043c\u044b […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":90282,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-90281","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47How Uma.Tech Developed Infrastructure | ProHoster","description":"We launched new services, traffic increased, we replaced servers, connected new sites, and revamped our data centers \u2013 and now we\u2019ll tell you this story, which we first introduced to you five years ago.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-uma-tech-infrastrukturu-razvivala","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a Uma.Tech \u0438\u043d\u0444\u0440\u0430\u0441\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0443 \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u043b\u0430 | ProHoster","og:description":"\u041c\u044b \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u043b\u0438 \u043d\u043e\u0432\u044b\u0435 \u0441\u0435\u0440\u0432\u0438\u0441\u044b, \u0442\u0440\u0430\u0444\u0438\u043a \u0440\u043e\u0441, \u0437\u0430\u043c\u0435\u043d\u044f\u043b\u0438 \u0441\u0435\u0440\u0432\u0435\u0440\u0430, \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0430\u043b\u0438 \u043d\u043e\u0432\u044b\u0435 \u043f\u043b\u043e\u0449\u0430\u0434\u043a\u0438 \u0438 \u043f\u0435\u0440\u0435\u0434\u0435\u043b\u044b\u0432\u0430\u043b\u0438 \u0426\u041e\u0414\u044b \u2013 \u0430 \u0441\u0435\u0439\u0447\u0430\u0441 \u0440\u0430\u0441\u0441\u043a\u0430\u0436\u0435\u043c \u044d\u0442\u0443 \u0438\u0441\u0442\u043e\u0440\u0438\u044e, \u0441 \u043d\u0430\u0447\u0430\u043b\u043e\u043c \u043a\u043e\u0442\u043e\u0440\u043e\u0439 \u0437\u043d\u0430\u043a\u043e\u043c\u0438\u043b\u0438 \u0432\u0430\u0441 \u043f\u044f\u0442\u044c \u043b\u0435\u0442 \u043d\u0430\u0437\u0430\u0434.","og:url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-uma-tech-infrastrukturu-razvivala","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-07-30T11:42:14+00:00","article:modified_time":"2020-07-30T11:42:14+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"90281","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:54:27","updated":"2022-09-30 02:23:08","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/90281","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=90281"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/90281\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media\/90282"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=90281"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=90281"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=90281"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}