Administration Section
Developing a data warehouse is a long and serious task. Much in the life of a project depends on how well thought out the object model and database structure are from the start. The common approach has been and remains a combination of the 'star' schema with the third normal form. Generally, the principle is: source data — 3NF, data marts — star. This approach, tried and tested over time, is backed by […]
Hello everyone. This spring, I came across a project where the guys learned to run a 2014 version Dota 2 server and, accordingly, play on it. I am a big fan of this game and couldn't pass up the unique opportunity to dive into my childhood. I dove in very deeply, and it turns out that I wrote a Discord bot that responds to almost […]
Hi! My name is Sergey, and I am a DevOps at Surf. The DevOps department at Surf aims not only to establish interaction between specialists and integrate workflows but also to actively research and implement current technologies in both our infrastructure and that of our clients. Below, I will share a bit about the changes in the technology stack for containers that we […]
Sometimes, you need to obtain a full copy of a volume within a single storage system (SAN), not a snapshot, but a complete volume. However, not all SANs allow this to be done using their own tools. It seems that the only option is to copy through the server, but in this case, the entire volume of data will be routed through the server itself, the network to the SAN, and the SAN ports, […]
LOST by sophiagworld This article compiles some general templates that help engineers work with large-scale services that are queried by millions of users. Based on the author's experience, this is not an exhaustive list, but truly effective advice. So, let's get started. Translated with the support of Mail.ru Cloud Solutions. Beginner Level The measures listed below are relatively easy to implement, but provide high returns. If […]
Daria Vilkova's report for Zabbix Meetup Online I want to introduce you to the monitoring tool for PostgreSQL and the operating system that our company is developing using Zabbix. We chose Zabbix as our monitoring tool a long time ago because it's an open-source platform supported by an active community and is quite popular in Russia. We created an active agent […]
TL;DR: I'm setting up Wireguard on a VPS, connecting to it from my home router on OpenWRT, and gaining access to my home subnet from my phone. If you have a personal infrastructure on your home server or multiple IP-managed devices at home, you certainly want to access them from work, on the bus, train, or metro. More often […]
In brief, MTA-STS is a way to further secure emails against interception (i.e., man-in-the-middle attacks aka MitM) during transmission between mail servers. It partially addresses inherited architectural issues of email protocols and is described in a relatively recent standard RFC 8461. Mail.ru is the first major mail service in RuNet to implement this standard. A more detailed discussion can be found […]
On August 10, a video course on Docker started at Slurm, where we cover it in full — from basic abstractions to network parameters. In this article, we will discuss the history of Docker's emergence and its main abstractions: Image, CLI, Dockerfile. This lecture is aimed at beginners, so it is unlikely to be of interest to experienced users. There will be no blood, appendix, or deep dives. […]
Hello, Habr! Right now, OTUS is accepting applications for a new batch of the 'Data Engineer' course. In anticipation of the course launch, we continue to share useful material with you. Read the first part on Data Management Strong Data Governance – the core principle of Twitter Engineering. As we implement BigQuery into our platform, we focus on data discovery, access control, and security […]
It's not embarrassing to shorten links at 13, right? A beginner, and not just beginners, should try writing their own Link Shortener while learning some new framework along the way. That's what I've been doing. What can I say — the fifth bootstrap, a lean framework, and a piece of my soul. Here's a demo, and here's the code. For readers like me 😉 A framework, right? Of course […]
When entering a product that has been evolving for more than a decade, it is not surprising to encounter outdated technologies. But what if in six months you need to handle a load ten times higher, and the cost of failures increases by hundreds? In this case, you need a skilled Highload Engineer. However, in the absence of one, the problem was entrusted to me. In the first […]