Hi all! We continue to launch new streams for the courses you have already fallen in love with and now we are in a hurry to announce that we are starting a new set of courses which will launch at the end of April. A new publication will be dated for this event. With the original material, you can .
Virtual file systems act as a kind of magical abstraction that allows philosophy Linux to say that "everything is a file."
What is a file system? According to one of the first contributors and authors Linux , "A file system is a hierarchical storage of data assembled according to a specific structure." Be that as it may, this definition is equally well suited to VFAT (Virtual File Allocation Table), Git and (). So what exactly defines such a thing as a "file system"?
Filesystem Basics
Core Linux has certain requirements for an entity to be considered a file system. It must implement methods open(), read() и write() for persistent objects that have names. From an object-oriented point of view , the kernel defines a generic filesystem as an abstract interface, and these three large functions are considered "virtual" and have no concrete definition. Accordingly, the default file system implementation is called a virtual file system (VFS).
If we can open, read, and write to an entity, then that entity is considered a file, as we can see from the example in the console above.
The VFS phenomenon only underscores the Unix-like observation that "everything is a file". Think how weird that that little /dev/console example above shows how the console actually works. The picture shows an interactive Bash session. Sending a string to the console (virtual console device) displays it on a virtual screen. VFS has other, even stranger properties. For example, it allows you to search by .
Familiar systems such as ext4, NFS, and /proc have three important functions in a C data structure called Additionally, certain file systems extend and reimplement VFS functionality in a familiar object-oriented manner. As Robert Love notes, the VFS abstraction allows users Linux Carelessly copy files to and from third-party operating systems or abstract entities such as pipes, without worrying about their internal data format. From the user side (userspace), a process can copy from a file into kernel data structures using a system call. read() one file system and then use the method write () another file system for data output.
The function definitions that belong to the base VFS types are in the files kernel source code, while subdirectories fs/ contain certain file systems. The core also contains entities such as cgroups, /dev и tmpfs, which are required during the boot process and are therefore defined in the kernel subdirectory init/. Notice that cgroups, /dev и tmpfs do not call the "big three" functions file_operations, but directly read and write to memory.
The diagram below shows how userspace accesses the different types of file systems commonly mounted on systems. Linux. Such constructions as are not shown pipes, dmesg и POSIX clocks, which also implement the structure file_operations, accessed through the VFS layer.
VFS is a "wrapper layer" between system calls and implementations of certain file_operationsSuch as ext4 и procfs. Functions file_operations can interact with either device drivers or memory access devices. tmpfs, devtmpfs и cgroups do not use file_operations, but directly access the memory.
The existence of VFS provides an opportunity to reuse code, since the basic methods associated with file systems do not have to be re-implemented by each type of file system. Code reuse is a common practice among software engineers! However, if the reusable code contains , all implementations that inherit common methods suffer from them.
/tmp: Simple hint
An easy way to detect that VFS are present on a system is to type mount | grep -v sd | grep -v :/, which will show all mounted (mounted) filesystems that are not disk-resident and non-NFS, which is true on most computers. One of the listed mounts (mounts) VFS will undoubtedly /tmp, right?
Everyone knows that storage / tmp on a physical medium - madness! .
Why is it undesirable to store /tmp on physical media? Because the files in /tmp are temporary and storage devices are slower than the memory where tmpfs is created. Moreover, physical media is more prone to overwriting wear than memory. Finally, files in /tmp can contain sensitive information, so making them disappear on every reboot is an essential feature.
Unfortunately, some installation scripts Linux Distributions create /tmp on the storage device by default. Don't despair if this happens to your system. Follow a few simple instructions with to fix this, and be aware that the memory allocated for tmpfs becomes unavailable for other purposes. In other words, a system with a giant tmpfs and large files on it can run out of memory and crash. Another hint: while editing a file /etc/fstab, remember that it must end with a newline, otherwise your system will not boot.
/proc and /sys
Besides /tmp, VFS (virtual file systems), which are most familiar to users Linux - is /proc и /syssystem. (/dev resides in shared memory and does not have file_operations). Why these two components? Let's look into this issue.
procfs creates a snapshot of the kernel and the processes it monitors for userspace. As for the /proc the kernel prints information about what it has available, such as interrupts, virtual memory, and the scheduler. Besides, /proc/sys is the place where the parameters configured with the command sysctl, available for userspace. The status and statistics of individual processes are displayed in directories /proc/.
Here /proc/meminfo is an empty file that nevertheless contains valuable information.
Behavior /proc files shows how different VFS disk file systems can be. On the one side, /proc/meminfo contain information that can be viewed with the command free. On the other hand, it's empty! How does it work? The situation is reminiscent of the famous article titled written by Cornell University physics professor David Mermin in 1985. The fact is that the kernel collects memory statistics when a request is made to /proc, and actually in files /proc there is nothing when no one is looking. As said , "Fundamental quantum doctrine says that measurement generally does not reveal a pre-existing value of the property being measured." (And consider the question about the moon as homework!)
Seeming emptiness procfs makes sense because the information there is dynamic. A slightly different situation with sysfs. Let's compare how many files that are at least one byte in size are in /proc and /sys.
Procfs has one file, namely the exported kernel configuration, which is an exception because it only needs to be generated once per boot. On the other hand, in /sys there are many larger files, many of which take up an entire page of memory. Usually files sysfs contain exactly one number or line, unlike tables of information obtained from reading files such as /proc/meminfo.
Goal sysfs - provide read/write properties of what the kernel calls «kobjects» in userspace. The only goal kobjects is link counting: when the last link to a kobject is removed, the system will restore the resources associated with it. Nevertheless, /sys makes up most of the famous core, which no one can ever, under any circumstances . This does not mean that files in sysfs are static, which would be inconsistent with reference counting of unstable objects.
The kernel's stable ABI limits what can appear in /sys, not what is actually present at that particular moment. Listing file permissions in sysfs provides insight into how configurable settings for devices, modules, filesystems, etc. can be configured or read. The logical conclusion is that procfs is also part of the kernel's stable ABI, although this is not explicitly stated in .
Files in sysfs describe one particular property for each entity and can be readable, writable, or both. "0" in the file means that the SSD cannot be removed.
Let's start the second part of the translation with how to monitor VFS using the eBPF and bcc tools, and now we are waiting for your comments and traditionally invite you to , which will be held by our teacher on April 9 - .
Source: habr.com
