This week, version 0.3.0 of the open-source utility Vector was released, designed for collecting, transforming, and saving log, metric, and event data.
Written in Rust, it features high performance and low memory consumption compared to its counterparts. Additionally, significant attention is given to correctness features, specifically the ability to buffer unsent events to disk and file rotation.
Architecturally, Vector is an event router that receives messages from one or more sources, optionally applying transformations to these messages , and sending them to one or moresinks. The following.
Sources
file β continuous reading of events from one or more local files;
- statsd β continuous reception of events via the StatsD protocol over UDP;
- stdin β continuous reading of events from the standard input stream;
- syslog β continuous reception of events via the Syslog 5424 protocol;
- tcp β continuous reading of events from a TCP socket;
- vector β receiving events from another instance of Vector.
- Transformations
add_fields β adding additional fields to events;
- field_filter β filtering events by field value;
- grok_parser β parsing field values in Grok format;
- json_parser β parsing field values in JSON format;
- lua β transforming events using Lua scripts;
- regex_parser β transforming field values using regular expressions;
- remove_fields β removing fields from events;
- tokenizer β splitting field values into tokens.
- Sinks
aws_cloudwatch_logs β sending logs to AWS CloudWatch;
- aws_kinesis_streams β sending events to AWS Kinesis;
- aws_s3 β sending events in batches to AWS S3;
- blackhole β discarding events, intended for testing;
- console β sending events to the standard output or standard error stream;
- elasticsearch β sending events to ElasticSearch;
- http β sending events to an arbitrary HTTP URL;
- kafka β sending events to Kafka;
- splunk_hec β sending events to Splunk HTTP Collector;
- tcp β sending events to a TCP socket;
- vector β sending events to another instance of Vector.
- Version 0.3.0 added support for Lua, Grok, regular expressions, and the tokenizer.
Public Speaking. Briefly about the main points
Source: linux.org.ru
