ProHoster > Blog > internet news > Vector 0.3.0

Vector 0.3.0

This week, version 0.3.0 of Vector, a free utility for collecting, transforming and saving log data, metrics and events, was released.

Being written in the Rust language, it is characterized by high performance and low RAM consumption compared to its counterparts. In addition, much attention is paid to functions related to correctness, in particular, the ability to save unsent events to a buffer on disk and file rotation.

Architecturally, Vector is an event router that accepts messages from one or more sources of, optionally applying over these messages transformations, and sending them to one or more drains.

Implemented the following

Sources of

  • file - continuous reading of events from one or more local files;
  • statsd - continuous receipt of events via the StatsD protocol via UDP;
  • stdin - continuous reading of events from the standard input stream;
  • syslog - continuous receipt of events via the Syslog 5424 protocol;
  • tcp - continuous reading of events from a TCP socket;
  • vector - receiving events from another Vector instance.

Transformations

  • add_fields - adding additional fields to events;
  • field_filter - event filtering by field value;
  • grok_parser - parsing field values ​​in Grok format;
  • json_parser - parsing field values ​​in JSON format;
  • lua - event conversion using Lua scripts;
  • regex_parser - transformation of field values ​​using regular expressions;
  • remove_fields - remove fields from events;
  • tokenizer - splitting field values ​​into tokens.

Sewage

  • aws_cloudwatch_logs - send logs to AWS CloudWatch;
  • aws_kinesis_streams - Sending events to AWS Kinesis
  • aws_s3 - sending events in batches to AWS S3;
  • blackhole - destruction of events, intended for testing;
  • console - send events to the standard output stream or to the standard error stream;
  • elasticsearch - sending events to ElasticSearch;
  • http - sending events to an arbitrary HTTP URL;
  • kafka - sending events to Kafka;
  • splunk_hec - sending events to the Splunk HTTP Collector;
  • tcp - sending events to a TCP socket;
  • vector - dispatching events to another Vector instance.

Version 0.3.0 added support for Lua, Grok, regular expressions, and a tokenizer.

Source: linux.org.ru

Add a comment