Administration Section
Hello, Habr! Today we will build a system that processes streams of messages from Apache Kafka using Spark Streaming and writes the processing results to the AWS RDS cloud database. Let's assume a credit organization presents us with the task of processing incoming transactions 'on the fly' across all its branches. This can be done for the purpose of instant currency calculations […]
MAX Data will merge with Optane DC for efficient operation with AI and ML systems. Photo — Hitesh Choudhary — Unsplash According to a study by MIT Sloan Management Review and The Boston Consulting Group, 85% of the three thousand surveyed managers believe that AI systems will help their companies gain a competitive advantage in the market. However, something like this has been attempted before […]
Containers represent a lightweight version of the user space of the Linux operating system — in fact, they are a 'bare' minimum. Nonetheless, it is still a full-fledged operating system, and therefore the quality of this container is just as important as that of a complete operating system. This is why we have long offered Red Hat Enterprise Linux (RHEL) images, so users can have certified, modern […]
Hello, friends. Before the second part of the May holidays, we're sharing material that we translated in anticipation of the launch of the new stream for the "Relational DBMS" course. Application developers spend a lot of time comparing several operational databases to choose the one that best fits their expected workload. Needs may include simplified data modeling, […]
Released in 2015, Agar.io became the progenitor of the new genre of .io games, whose popularity has since surged. I have personally experienced the rise in popularity of .io games: in the last three years, I have created and sold two games in this genre. In case you have never heard of such games before: they are free multiplayer web games in which […]
Throughout the year, Russians regularly go on holidays – New Year breaks, May Day, and other shorter weekends. This is a traditional time for binge-watching series, spontaneous purchases, and sales on Steam. During the pre-holiday period, retail and logistics companies experience heightened demand: people order gifts from online stores, pay for their delivery, buy tickets for trips, and communicate. Calendar peaks […]
Welcome to the anniversary — 10th lesson. Today we will discuss another Check Point blade — Identity Awareness. At the very beginning, when we described NGFW, we established that it is essential to have the ability to regulate access based on accounts rather than IP addresses. This is primarily due to the increased mobility of users and the widespread adoption of […]
Today we will examine the BGP protocol. We won’t spend too long discussing why it is used as the sole protocol. There is quite a bit of information available on this topic, for example here. So, what is BGP? BGP is a dynamic routing protocol and the only EGP (External Gateway Protocol). This protocol is used for building routing on the internet. Let's explore how […]
A short story about fio and etcd The performance of the etcd cluster largely depends on the performance of its storage. etcd exports some metrics to Prometheus to provide the necessary information about storage performance. For example, the metric wal_fsync_duration_seconds. The etcd documentation states that for the storage to be considered fast enough, the 99th percentile of this metric should be less than 10 ms. If you plan to run […]
A brief note: this lab is synthetic. Some tasks described here can be performed much more simply, but since the purpose of the lab is to familiarize oneself with the functionalities of RAID and LVM, certain operations are intentionally complicated. Tool requirements for completing the lab: Virtualization tools, for example, VirtualBox Installation image of Linux, such as Debian 9 Internet access to download several packages SSH connection to […]
At its annual developer conference, Microsoft made several important announcements. We selected two of them. The first: in the summer update 19H2, Windows 10 will be shipped with a complete Linux kernel based on version 4.19 from October 22, 2018, for its own 'Windows Subsystem for Linux' (WSL). The second: future enterprise builds will feature a Chromium reincarnation […]
Today, we would like to share some of the latest updates from the Sherlock system [this is a high-performance cluster from Stanford University – Ed.], which significantly speeds up file listings in directories with large numbers of entries. Unlike regular articles, this is more of an insider report on the ongoing regular work on Sherlock to keep it in the best shape for our users. We hope […]