Recent, a new version of Kaitai Struct 0.9 has been released — a description language and toolkit for parsing various binary formats (for example, network packets, image/audio/video files, databases, archives, containers, etc.). Despite the seemingly trivial version number 0.9, this is a major release that includes developments from the last 2.5 years. During this time, the language has grown into a whole family of projects:
- a compiler that allows generating a ready-made parser source code from a format specification file (.ksy) in numerous programming languages (C++, C#, Construct, Go, Java, JavaScript, Lua, Nim, Perl, PHP, Python, Ruby), as well as diagrams in GraphViz format and human-readable format specifications in HTML;
- tools for convenient specification development with simultaneous visual control: Web IDE, console visualizer, plugin for Visual Studio Code, Hobbits, Veles, plugin for Hiew, plugin for Binary Ninja;
- modules for integrating Kaitai Struct into the build process for Maven, for Gradle, for Python, for JavaScript/WebPack
- library of formats, which in this release already includes 156 descriptions (and another 78 formats are currently in pull request review).
- library of compression algorithms Kaitai Compress
- module for FUSE — Kaitai FS, which allows mounting a file as a file system using a ksy description of its format
Language recognized by GitHub and is currently used in over 400 free/open-source projects for parsing various exotic data formats, ranging from reverse engineering data files from proprietary games, to analyzing communication protocols of satellites..
Key new features of language 0.9 include:
- support for new target languages (Python through the Construct library, Nim, HTML documentation generation)
- full support for modern C++ (smart pointers, no need for manual memory management, fixing all known memory leak variants)
- support for addressing nested types through syntax like foo::bar::baz
- support for validation of read data according to specified conditions (valid)
- computing the sizes of static data structures in bytes and bits (sizeof and bitsizeof operators)
- formal description of the language in the form of JSON schema, from which documentation is now generated.
Sursa: linux.org.ru
