Category: Administration

File formats in big data: a brief overview

Weather Deity by Remarin The Mail.ru Cloud Solutions team presents a translation of an article by engineer Rahul Bhatia from Clairvoyant discussing the various file formats in big data, the most common features of Hadoop formats, and which format is best to use. Why different file formats are needed A significant bottleneck in the performance of applications supporting HDFS, such as MapReduce and […]

Deep dive into PostgreSQL internal statistics. Alexey Lesovskiy

Transcript of Alexey Lesovsky's 2015 report 'Deep dive into PostgreSQL internal statistics' Disclaimer from the author of the report: I would like to note that this report is dated November 2015 — more than 4 years have passed, and a lot has changed. The version discussed in the report, 9.4, is no longer supported. Over the past 4 years, 5 new releases have come out, introducing many innovations and improvements […]

We understand PostgreSQL query plans even better

Six months ago, we launched explain.tensor.ru — a public service for analyzing and visualizing SQL query plans for PostgreSQL. In the months that followed, we presented about it at PGConf.Russia 2020, prepared a summary article on speeding up SQL queries based on the recommendations it provides… but most importantly, we collected your feedback and observed real use cases. And now we are ready […]

Similarities and Differences Between Wi-Fi 6 and 5G

I often hear debates in both professional and casual circles about Wi-Fi 6 and 5G. Which is better? What’s the difference? By the time 5G arrives, Wi-Fi 6 may no longer be necessary. It reminds me of childhood arguments over pressing topics: Who is stronger, a whale or an elephant? Who is a stronger actor, Van Damme or Schwarzenegger? My kung-fu is stronger than your karate! I decided to share some brief theses […]

MikroTik in repeater mode — as simple as One-Two-Three

First, reset the router without creating a default configuration, for example, through the console. /system reset-configuration no-defaults=yes skip-backup=yes Second, use the auto-configuration command, which will set up the wireless interface to connect to the access point and create a virtual interface, a bridge interface, and add both (main and virtual) interfaces to the bridge ports. In the parameters, specify the wireless interface, Wi-Fi network name, and […]

Installing Debian on Netgear Stora

Recently, I came across this marvel: netgear ms 2000 — stora. I decided to immediately ditch the built-in OS and install Debian on the hard drive. The information available online is somewhat scattered, links have long since died, so I decided to update the installation process of Debian on stora. Those interested are welcome under the cut. The main source was […]

Synchronization of time in Linux: NTP, Chrony, and systemd-timesyncd

Most people keep track of time. We wake up on time to carry out our morning rituals and head to work, take lunch breaks, meet project deadlines, celebrate birthdays and holidays, catch flights, and so on. Moreover, some of us are obsessed with time. My watch is powered by solar energy and receives accurate time from the National […]

How to use fio to check disks for adequate performance for etcd

Note: this article summarizes a mini-research conducted by IBM Cloud engineers in search of a solution to a real problem related to the operation of the etcd database. We faced a similar challenge, but the authors' thought process and actions may be interesting in a broader context. A brief summary of the entire article: fio and etcd The performance of the etcd cluster greatly depends on […]

Data Vault

In previous articles, we explored the fundamentals of DATA VAULT, extending DATA VAULT for better analytical applicability, and creating BUSINESS DATA VAULT. It's time to conclude the series with the third article. As I announced in the previous publication, this article will focus on the topic of BI, specifically preparing DATA VAULT as a data source for BI. Let's consider how to create […]

The evolution of DATA VAULT and the transition to BUSINESS DATA VAULT.

In the previous article, I discussed the basics of DATA VAULT, describing its key elements and their purposes. However, this topic is not exhausted; we need to address the next stages of the evolution of DATA VAULT. In this article, I will focus on the development of DATA VAULT and the transition to BUSINESS DATA VAULT or simply BUSINESS VAULT. The reasons for its emergence […]

The deadly sins of website security: what we learned from a year of vulnerability scanner statistics.

About a year ago, we at DataLine launched a service for detecting and analyzing vulnerabilities in IT applications. The service is based on the cloud solution Qualys, which we have already reported on. Over the course of a year with this solution, we conducted 291 scans for different websites and accumulated statistics on common vulnerabilities in web applications. In the article below, I will show exactly which […]

One-cloud — data center-level operating system in Odnoklassniki

Aloha, people! My name is Oleg Anastasyev, and I work at Odnoklassniki on the Platform team. Besides me, a lot of hardware works at Odnoklassniki. We have four data centers, housing around 500 racks with over 8,000 servers. At one point, we realized that implementing a new management system would allow us to utilize our equipment more effectively and streamline management […]

Buy reliable website hosting with DDoS protection, VPS VDS servers 🔥 Buy reliable website hosting with DDoS protection, VPS VDS servers | ProHoster