2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ืื™ืŸ ื“ืขืจ ืคืึทืจื’ืึทื ื’ืขื ื”ื™ื™ื˜ ืึทืจื˜ื™ืงืœ ืžื™ืจ ื‘ืื’ืขื’ื ื˜ ELK ืึธื ืœื™ื™ื’ืŸ, ื•ื•ืึธืก ื•ื•ื™ื™ื›ื•ื•ืืจื’ ืคึผืจืึธื“ื•ืงื˜ืŸ ืขืก ื‘ืืฉื˜ื™ื™ื˜ ืคื•ืŸ. ืื•ืŸ ื“ืขืจ ืขืจืฉื˜ืขืจ ืึทืจื‘ืขื˜ ื•ื•ืึธืก ืึท ื™ื ื–ืฉืขื ื™ืจ ืคื™ื™ืกื™ื– ื•ื•ืขืŸ ืืจื‘ืขื˜ืŸ ืžื™ื˜ ื“ื™ ELK ืึธื ืœื™ื™ื’ืŸ ืื™ื– ืฉื™ืงื˜ ืœืึธื’ืก ืคึฟืึทืจ ืกื˜ืึธืจื™ื“ื–ืฉ ืื™ืŸ ืœืึทืกื˜ื™ืง ื–ื•ื›ืŸ ืคึฟืึทืจ ืกืึทื‘ืกืึทืงื•ื•ืึทื ื˜ ืึทื ืึทืœื™ืกื™ืก. ืึธื‘ืขืจ, ื“ืึธืก ืื™ื– ื ืึธืจ ืœื™ืคึผ ืกืขืจื•ื•ื™ืก, elasticsearch ืกื˜ืึธืจื– ืœืึธื’ืก ืื™ืŸ ื“ื™ ืคืึธืจืขื ืคื•ืŸ ื“ืึธืงื•ืžืขื ื˜ืŸ ืžื™ื˜ ื–ื™ื›ืขืจ ืคืขืœื“ืขืจ ืื•ืŸ ื•ื•ืึทืœื•ืขืก, ื•ื•ืึธืก ืžื™ื˜ืœ ืึทื– ื“ืขืจ ื™ื ื–ืฉืขื ื™ืจ ืžื•ื–ืŸ ื ื•ืฆืŸ ืคืึทืจืฉื™ื“ืŸ ืžื›ืฉื™ืจื™ื ืฆื• ืคึผืึทืจืกื™ืจืŸ ื“ื™ ืึธื ื–ืึธื’ ื•ื•ืึธืก ืื™ื– ื’ืขืฉื™ืงื˜ ืคึฟื•ืŸ ื“ื™ ืกื•ืฃ ืกื™ืกื˜ืขืžืขืŸ. ื“ืึธืก ืงืขืŸ ื–ื™ื™ืŸ ื’ืขื˜ืืŸ ืื™ืŸ ืขื˜ืœืขื›ืข ื•ื•ืขื’ืŸ - ืฉืจื™ื™ึทื‘ืŸ ืึท ืคึผืจืึธื’ืจืึทื ื–ื™ืš ื•ื•ืึธืก ื•ื•ืขื˜ ืœื™ื™ื’ืŸ ื“ืึธืงื•ืžืขื ื˜ืŸ ืฆื• ื“ื™ ื“ืึทื˜ืึทื‘ื™ื™ืก ื ื™ืฆืŸ ื“ื™ ืึทืคึผื™, ืึธื“ืขืจ ื ื•ืฆืŸ ืคืึทืจื˜ื™ืง ืกืึทืœื•ืฉืึทื ื–. ืื™ืŸ ื“ืขื ืงื•ืจืก ืžื™ืจ ื•ื•ืขืœืŸ ื‘ืึทื˜ืจืึทื›ื˜ืŸ ื“ื™ ืœื™ื™ื–ื•ื ื’ ืœืึธื’ืกื˜ืึทืฉ, ื•ื•ืึธืก ืื™ื– ื˜ื™ื™ืœ ืคื•ืŸ ื“ื™ ELK ืึธื ืœื™ื™ื’ืŸ. ืžื™ืจ ื•ื•ืขืœืŸ ืงื•ืงืŸ ื•ื•ื™ ืžื™ืจ ืงืขื ืขืŸ ืฉื™ืงืŸ ืœืึธื’ืก ืคื•ืŸ ืขื ื“ืคึผื•ื™ื ื˜ ืกื™ืกื˜ืขืžืขืŸ ืฆื• Logstash, ืื•ืŸ ื“ืขืจื ืึธืš ืžื™ืจ ืฉื˜ืขืœืŸ ืึท ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืฆื• ืคึผืึทืจืก ืื•ืŸ ืจื™ื“ืขืจืขืงื˜ ืฆื• ื“ื™ Elasticsearch ื“ืึทื˜ืึทื‘ื™ื™ืก. ืฆื• ื˜ืึธืŸ ื“ืึธืก, ืžื™ืจ ื ืขืžืขืŸ ืœืึธื’ืก ืคื•ืŸ ื“ื™ ื˜ืฉืขืง ืคึผื•ื™ื ื˜ ืคื™ื™ืจื•ื•ืึทืœ ื•ื•ื™ ื“ื™ ื™ื ืงืึทืžื™ื ื’ ืกื™ืกื˜ืขื.

ื“ืขืจ ืงื•ืจืก ื˜ื•ื˜ ื ื™ืฉื˜ ื“ืขืงืŸ ื“ื™ ื™ื ืกื˜ืึทืœื™ืจื•ื ื’ ืคื•ืŸ ELK ืกื˜ืึทืง, ื•ื•ื™ื™ึทืœ ืขืก ื–ืขื ืขืŸ ืึท ืจื™ื–ื™ืง ื ื•ืžืขืจ ืคื•ืŸ ืึทืจื˜ื™ืงืœืขืŸ ืื•ื™ืฃ ื“ืขื ื˜ืขืžืข; ืžื™ืจ ื•ื•ืขืœืŸ ื‘ืึทื˜ืจืึทื›ื˜ืŸ ื“ื™ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ืงืึธืžืคึผืึธื ืขื ื˜.

ืœืึธืžื™ืจ ืžืึทื›ืŸ ืึทืŸ ืึทืงืฆื™ืข ืคึผืœืึทืŸ ืคึฟืึทืจ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ:

  1. ืงืึธื ื˜ืจืึธืœื™ืจืŸ ืึทื– Elasticsearch ื•ื•ืขื˜ ืึธื ื ืขืžืขืŸ ืœืึธื’ืก (ืงืึธื ื˜ืจืึธืœื™ืจืŸ ื“ื™ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™ ืื•ืŸ ืึธื•ืคึผืึทื ื ืึทืก ืคื•ืŸ ื“ื™ ืคึผืึธืจื˜).
  2. ืžื™ืจ ื‘ืึทื˜ืจืึทื›ื˜ืŸ ื•ื•ื™ ืžื™ืจ ืงืขื ืขืŸ ืฉื™ืงืŸ events ืฆื• Logstash, ืงืœื™ื™ึทื‘ืŸ ืึท ืื•ืคึฟืŸ ืื•ืŸ ื™ื ืกื˜ืจื•ืžืขื ื˜ ืขืก.
  3. ืžื™ืจ ืงืึทื ืคื™ื’ื™ืขืจ ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘ ืื™ืŸ ื“ื™ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข.
  4. ืžื™ืจ ืงืึทื ืคื™ื’ื™ืขืจ ืจืขื–ื•ืœื˜ืึทื˜ ืื™ืŸ ื“ื™ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืื™ืŸ ื“ื™ื‘ืึทื’ ืžืึธื“ืข ืฆื• ืคึฟืึทืจืฉื˜ื™ื™ืŸ ื•ื•ื™ ื“ื™ ืงืœืึธืฅ ืึธื ื–ืึธื’ ืงื•ืงื˜ ื•ื•ื™.
  5. ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ืคื™ืœื˜ืขืจ.
  6. ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ื“ื™ ืจื™ื›ื˜ื™ืง ืจืขื–ื•ืœื˜ืึทื˜ ืื™ืŸ ElasticSearch.
  7. Logstash ืœืึธื ื˜ืฉื™ื–.
  8. ืงืึธื ื˜ืจืึธืœื™ืจืŸ ื“ื™ ืœืึธื’ืก ืื™ืŸ ืงื™ื‘ืึทื ืึท.

ื–ืืœ ืก ืงื•ืง ืื™ืŸ ื™ืขื“ืขืจ ืคื•ื ื˜ ืื™ืŸ ืžืขืจ ื“ืขื˜ืึทืœ:

ืงืึธื ื˜ืจืึธืœื™ืจืŸ ืึทื– Elasticsearch ื•ื•ืขื˜ ืึธื ื ืขืžืขืŸ ืœืึธื’ืก

ืฆื• ื˜ืึธืŸ ื“ืึธืก, ืื™ืจ ืงืขื ืขืŸ ื ื•ืฆืŸ ื“ื™ ืงืขืจืœ ื‘ืึทืคึฟืขืœ ืฆื• ืงืึธื ื˜ืจืึธืœื™ืจืŸ ืึทืงืกืขืก Elasticsearch ืคึฟื•ืŸ ื“ื™ ืกื™ืกื˜ืขื ืื•ื™ืฃ ื•ื•ืึธืก Logstash ืื™ื– ื“ื™ืคึผืœื•ื™ื“. ืื•ื™ื‘ ืื™ืจ ื”ืึธื‘ืŸ ืึธื˜ืขื ื˜ืึทืงื™ื™ืฉืึทืŸ ืงืึทื ืคื™ื’ื™ืขืจื“, ืžื™ืจ ืื•ื™ืš ืึทืจื™ื‘ืขืจืคื™ืจืŸ ื“ื™ ื‘ืึทื ื™ืฆืขืจ / ืคึผืึทืจืึธืœ ื“ื•ืจืš ืงืขืจืœ, ืกืคึผืขืฆื™ืคื™ืฆื™ืจืŸ ืคึผืึธืจื˜ 9200 ืื•ื™ื‘ ืื™ืจ ื”ืึธื˜ ื ื™ืฉื˜ ื˜ืฉื™ื™ื ื“ื–ืฉื“ ืขืก. ืื•ื™ื‘ ืื™ืจ ื‘ืึทืงื•ืžืขืŸ ืึทืŸ ืขื ื˜ืคืขืจ ืขื ืœืขืš ืฆื• ื“ืขืจ ืื•ื ื˜ืŸ, ืึทืœืฅ ืื™ื– ืื™ืŸ ืกื“ืจ.

[elastic@elasticsearch ~]$ curl -u <<user_name>> : <<password>> -sS -XGET "<<ip_address_elasticsearch>>:9200"
{
  "name" : "elastic-1",
  "cluster_name" : "project",
  "cluster_uuid" : "sQzjTTuCR8q4ZO6DrEis0A",
  "version" : {
    "number" : "7.4.1",
    "build_flavor" : "default",
    "build_type" : "rpm",
    "build_hash" : "fc0eeb6e2c25915d63d871d344e3d0b45ea0ea1e",
    "build_date" : "2019-10-22T17:16:35.176724Z",
    "build_snapshot" : false,
    "lucene_version" : "8.2.0",
    "minimum_wire_compatibility_version" : "6.8.0",
    "minimum_index_compatibility_version" : "6.0.0-beta1"
  },
  "tagline" : "You Know, for Search"
}
[elastic@elasticsearch ~]$

ืื•ื™ื‘ ื“ืขืจ ืขื ื˜ืคืขืจ ืื™ื– ื ื™ืฉื˜ ื‘ืืงื•ืžืขืŸ, ืขืก ืงืขืŸ ื–ื™ื™ืŸ ืขื˜ืœืขื›ืข ื˜ื™ื™ืคึผืก ืคื•ืŸ ืขืจืจืึธืจืก: ื“ื™ Elasticsearch ืคึผืจืึธืฆืขืก ืื™ื– ื ื™ืฉื˜ ืคืœื™ืกื ื“ื™ืง, ื“ื™ ืคืึทืœืฉ ืคึผืึธืจื˜ ืื™ื– ืกืคึผืขืกื™ืคื™ืขื“, ืึธื“ืขืจ ื“ื™ ืคึผืึธืจื˜ ืื™ื– ืืคื’ืขืฉื˜ืขืœื˜ ื“ื•ืจืš ืึท ืคื™ื™ืจื•ื•ืึทืœ ืื•ื™ืฃ ื“ื™ ืกืขืจื•ื•ืขืจ ื•ื•ื• Elasticsearch ืื™ื– ืื™ื ืกื˜ืึทืœื™ืจืŸ.

ื–ืืœ ืก ืงื•ืง ื•ื•ื™ ืื™ืจ ืงืขื ืขืŸ ืฉื™ืงืŸ ืœืึธื’ืก ืฆื• Logstash ืคึฟื•ืŸ ืึท ื˜ืฉืขืง ืคื•ื ื˜ ืคื™ื™ืจื•ื•ืึทืœ

ืคึฟื•ืŸ ื˜ืฉืขืง ืคึผื•ื™ื ื˜ ืคืึทืจื•ื•ืึทืœื˜ื•ื ื’ ืกืขืจื•ื•ืขืจ ืื™ืจ ืงืขื ืขืŸ ืฉื™ืงืŸ ืœืึธื’ืก ืฆื• Logstash ื“ื•ืจืš ืกื™ืกืœืึธื’ ื ื™ืฆืŸ ื“ื™ log_exporter ื ื•ืฆืŸ, ืื™ืจ ืงืขื ืขืŸ ืœื™ื™ืขื ืขืŸ ืžืขืจ ื•ื•ืขื’ืŸ ืื™ื ื“ืึธ ืึทืจื˜ื™ืงืœ, ื“ืึธ ืžื™ืจ ืœืึธื–ืŸ ื‘ืœื•ื™ื– ื“ื™ ื‘ืึทืคึฟืขืœ ื•ื•ืึธืก ืงืจื™ื™ื™ืฅ ื“ืขื ื˜ื™ื™ึทืš:

cp_log_export ืœื™ื™ื’ืŸ ื ืึธืžืขืŸ ื˜ืฉืขืง_ืคึผืึธื™ื ื˜_ืกื™ืกืœืึธื’ ืฆื™ืœ-ืกืขืจื•ื•ืขืจ < > ืฆื™ืœ-ืคึผืึธืจื˜ 5555 ืคึผืจืึธื˜ืึธืงืึธืœ ื˜ืงืคึผ ืคึฟืึธืจืžืึทื˜ ื“ื–ืฉืึทื ืขืจื™ืง ืœื™ื™ืขื ืขืŸ-ืžืึธื“ืข ื”ืึทืœื‘-ื•ื ืึทืคื™ื™ื“

< > - ืึทื“ืจืขืก ืคื•ืŸ ื“ื™ ืกืขืจื•ื•ืขืจ ืื•ื™ืฃ ื•ื•ืึธืก Logstash ืœื•ื™ืคื˜, ืฆื™ืœ-ืคึผืึธืจื˜ 5555 - ืคึผืึธืจื˜ ืฆื• ื•ื•ืึธืก ืžื™ืจ ื•ื•ืขืœืŸ ืฉื™ืงืŸ ืœืึธื’ืก, ืฉื™ืงืŸ ืœืึธื’ืก ื“ื•ืจืš tcp ืงืขื ืขืŸ ืœืึธื“ืŸ ื“ื™ ืกืขืจื•ื•ืขืจ, ืึทื–ื•ื™ ืื™ืŸ ืขื˜ืœืขื›ืข ืงืึทืกืขืก ืขืก ืื™ื– ืžืขืจ ืจื™ื›ื˜ื™ืง ืฆื• ื ื•ืฆืŸ ื•ื“ืคึผ.

ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ื™ื ืคึผื•ื˜ ืื™ืŸ ื“ื™ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ื“ื•ืจืš ืคืขืœื™ืงื™ื™ึทื˜, ื“ื™ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืื™ื– ืœื™ื’ืŸ ืื™ืŸ ื“ื™ /etc/logstash/conf.d/ ื•ื•ืขื’ื•ื•ื™ื™ึทื–ืขืจ. ื“ื™ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ื‘ืืฉื˜ื™ื™ื˜ ืคื•ืŸ 3 ืžื™ื ื™ื ื’ืคืึทืœ ืคึผืึทืจืฅ: ื™ื ืคึผื•ื˜, ืคื™ืœื˜ืขืจ, ืจืขื–ื•ืœื˜ืึทื˜. ืื™ืŸ ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘ ืžื™ืจ ืึธื ื•ื•ื™ื™ึทื–ืŸ ื•ื•ื• ื“ื™ ืกื™ืกื˜ืขื ื•ื•ืขื˜ ื ืขืžืขืŸ ืœืึธื’ืก ืคื•ืŸ, ืื™ืŸ ืคื™ืœื˜ืขืจ ืคึผืึทืจืก ื“ื™ ืงืœืึธืฅ - ืฉื˜ืขืœืŸ ืึทืจื•ื™ืฃ ื•ื•ื™ ืฆื• ื˜ื™ื™ืœืŸ ื“ืขื ืึธื ื–ืึธื’ ืื™ืŸ ืคืขืœื“ืขืจ ืื•ืŸ ื•ื•ืึทืœื•ืขืก, ืื™ืŸ ืจืขื–ื•ืœื˜ืึทื˜ ืžื™ืจ ืงืึทื ืคื™ื’ื™ืขืจ ื“ื™ ืจืขื–ื•ืœื˜ืึทื˜ ื˜ื™ื™ึทืš - ื•ื•ื• ื“ื™ ืคึผืึทืจืกืขื“ ืœืึธื’ืก ื•ื•ืขื˜ ื–ื™ื™ืŸ ื’ืขืฉื™ืงื˜.

ืขืจืฉื˜ืขืจ, ืœืึธื–ืŸ ืื•ื ื“ื– ืงืึทื ืคื™ื’ื™ืขืจ INPUT, ื‘ืึทื˜ืจืึทื›ื˜ืŸ ืขื˜ืœืขื›ืข ื˜ื™ื™ืคึผืก ื•ื•ืึธืก ืงืขื ืขืŸ ื–ื™ื™ืŸ - ื˜ืขืงืข, tcp ืื•ืŸ exe.

ื˜ืงืคึผ:

input {
tcp {
    port => 5555
    host => โ€œ10.10.1.205โ€
    type => "checkpoint"
    mode => "server"
}
}

ืžืึธื“ืข => "ืกืขืจื•ื•ื™ืจืขืจ"
ื™ื ื“ื™ืงื™ื™ืฅ ืึทื– Logstash ืื™ื– ืึทืงืกืขืคึผื˜ื™ื ื’ ืงืึทื ืขืงืฉืึทื ื–.

ืคึผืึธืจื˜ => 5555
ื‘ืึทืœืขื‘ืึธืก => "10.10.1.205"
ืžื™ืจ ืึธื ื ืขืžืขืŸ ืงืึทื ืขืงืฉืึทื ื– ื“ื•ืจืš IP ืึทื“ืจืขืก 10.10.1.205 (ืœืึธื’ืกื˜ืืฉ), ืคึผืึธืจื˜ 5555 - ื“ื™ ืคึผืึธืจื˜ ืžื•ื–ืŸ ื–ื™ื™ืŸ ืขืจืœื•ื™ื‘ื˜ ื“ื•ืจืš ื“ื™ ืคื™ื™ืจื•ื•ืึทืœ ืคึผืึธืœื™ื˜ื™ืง.

ื˜ื™ืคึผ => "ื˜ืฉืขืงืคึผื•ื™ื ื˜"
ืžื™ืจ ืฆื™ื™ื›ืŸ ื“ืขื ื“ืึธืงื•ืžืขื ื˜, ื–ื™ื™ืขืจ ื‘ืึทืงื•ื•ืขื ืื•ื™ื‘ ืื™ืจ ื”ืึธื‘ืŸ ืขื˜ืœืขื›ืข ื™ื ืงืึทืžื™ื ื’ ืงืึทื ืขืงืฉืึทื ื–. ื“ืขืจื ืึธืš, ืคึฟืึทืจ ื™ืขื“ืขืจ ืงืฉืจ ืื™ืจ ืงืขื ืขืŸ ืฉืจื™ื™ึทื‘ืŸ ื“ื™ื™ืŸ ืื™ื™ื’ืขื ืข ืคื™ืœื˜ืขืจ ืžื™ื˜ ื“ื™ ืœืึทื“ื–ืฉื™ืงืึทืœ ืื•ื™ื‘ ื‘ื•ื™ืขืŸ.

ื˜ืขืงืข:

input {
  file {
    path => "/var/log/openvas_report/*"
    type => "openvas"
    start_position => "beginning"
    }
}

ื‘ืึทืฉืจื™ื™ึทื‘ื•ื ื’ ืคื•ืŸ ืกืขื˜ื˜ื™ื ื’ืก:
ื“ืจืš => "/ื•ื•ืึทืจ/ืœืึธื’/ืึธืคึผืขื ืขื•ื•ืึทืก_ืจืขืคึผืึธืจื˜/*"
ืžื™ืจ ืึธื ื•ื•ื™ื™ึทื–ืŸ ื“ื™ ื•ื•ืขื’ื•ื•ื™ื™ึทื–ืขืจ ืื™ืŸ ื•ื•ืึธืก ื“ื™ ื˜ืขืงืขืก ื“ืึทืจืคึฟืŸ ืฆื• ื–ื™ื™ืŸ ืœื™ื™ืขื ืขืŸ.

ื˜ื™ืคึผ => "ืึธืคึผืขื ืขื•ื•ืึทืก"
ื’ืขืฉืขืขื ื™ืฉ ื˜ื™ืคึผ.

start_position => "ืึธื ื”ื™ื™ื‘"
ื•ื•ืขืŸ ื˜ืฉืึทื ื’ื™ื ื’ ืึท ื˜ืขืงืข, ืขืก ืœื™ื™ืขื ื˜ ื“ื™ ื’ืื ืฆืข ื˜ืขืงืข; ืื•ื™ื‘ ืื™ืจ ืฉื˜ืขืœืŸ "ืกื•ืฃ", ื“ื™ ืกื™ืกื˜ืขื ื•ื•ื™ื™ืฅ ืคึฟืึทืจ ื ื™ื™ึทืข ืจืขืงืึธืจื“ืก ืฆื• ื“ืขืจืฉื™ื™ึทื ืขืŸ ืื™ืŸ ื“ื™ ืกื•ืฃ ืคื•ืŸ ื“ืขืจ ื˜ืขืงืข.

ืขืงืกืขืง:

input {
  exec {
    command => "ls -alh"
    interval => 30
  }
}

ื ื™ืฆืŸ ื“ืขื ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘, ืึท (ื‘ืœื•ื™ื–!) ืฉืึธืœ ื‘ืึทืคึฟืขืœ ืื™ื– ืœืึธื ื˜ืฉื˜ ืื•ืŸ ื–ื™ื™ึทืŸ ืจืขื–ื•ืœื˜ืึทื˜ ืื™ื– ืคืืจืงืขืจื˜ ืื™ืŸ ืึท ืงืœืึธืฅ ืึธื ื–ืึธื’.

ื‘ืึทืคึฟืขืœ => "ืœืก -ืึทืœื”"
ื“ืขืจ ื‘ืึทืคึฟืขืœ ื•ื•ืขืžืขื ืก ืจืขื–ื•ืœื˜ืึทื˜ ืžื™ืจ ื–ืขื ืขืŸ ืื™ื ื˜ืขืจืขืกื™ืจื˜ ืื™ืŸ.

ืžืขื”ืึทืœืขืš => 30
ื‘ืึทืคึฟืขืœืŸ ื™ื ื•ื•ืึธืงืึทื˜ื™ืึธืŸ ืžืขื”ืึทืœืขืš ืื™ืŸ ืกืขืงื•ื ื“ืขืก.

ืื™ืŸ ืกื“ืจ ืฆื• ื‘ืึทืงื•ืžืขืŸ ืœืึธื’ืก ืคื•ืŸ ื“ื™ ืคื™ื™ืจื•ื•ืึทืœ, ืžื™ืจ ืจืขื’ื™ืกื˜ืจื™ืจืŸ ืึท ืคื™ืœื˜ืขืจ tcp ืึธื“ืขืจ ืคึผื•ื“, ื“ื™ืคึผืขื ื“ื™ื ื’ ืื•ื™ืฃ ื•ื•ื™ ื“ื™ ืœืึธื’ืก ื–ืขื ืขืŸ ื’ืขืฉื™ืงื˜ ืฆื• Logstash.

ืžื™ืจ ืงืึทื ืคื™ื’ื™ืขืจ ืจืขื–ื•ืœื˜ืึทื˜ ืื™ืŸ ื“ื™ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืื™ืŸ ื“ื™ื‘ืึทื’ ืžืึธื“ืข ืฆื• ืคึฟืึทืจืฉื˜ื™ื™ืŸ ื•ื•ื™ ื“ื™ ืงืœืึธืฅ ืึธื ื–ืึธื’ ืงื•ืงื˜ ื•ื•ื™

ื ืึธืš ืžื™ืจ ื”ืึธื‘ืŸ ืงืึทื ืคื™ื’ื™ืขืจื“ INPUT, ืžื™ืจ ื“ืึทืจืคึฟืŸ ืฆื• ืคึฟืึทืจืฉื˜ื™ื™ืŸ ื•ื•ื™ ื“ื™ ืงืœืึธืฅ ืึธื ื–ืึธื’ ื•ื•ืขื˜ ืงื•ืงืŸ ื•ื•ื™ ืื•ืŸ ื•ื•ืึธืก ืžืขื˜ื”ืึธื“ืก ื“ืึทืจืคึฟืŸ ืฆื• ื–ื™ื™ืŸ ื’ืขื•ื•ื™ื™ื ื˜ ืฆื• ืงืึทื ืคื™ื’ื™ืขืจ ื“ื™ ืงืœืึธืฅ ืคื™ืœื˜ืขืจ (ืคึผืึทืกืขืจ).

ืฆื• ื˜ืึธืŸ ื“ืึธืก, ืžื™ืจ ื•ื•ืขืœืŸ ื ื•ืฆืŸ ืึท ืคื™ืœื˜ืขืจ ื•ื•ืึธืก ืึทื•ื˜ืคึผื•ืฅ ื“ื™ ืจืขื–ื•ืœื˜ืึทื˜ ืฆื• ืกื˜ื“ืึธื•ื˜ ืฆื• ื–ืขืŸ ื“ื™ ืึธืจื™ื’ื™ื ืขืœ ืึธื ื–ืึธื’; ื“ื™ ื’ืึทื ืฅ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืื™ืŸ ื“ืขื ืžืึธืžืขื ื˜ ื•ื•ืขื˜ ืงื•ืงืŸ ื•ื•ื™ ื“ืึธืก:

input 
{
         tcp 
         {
                port => 5555
  	  	type => "checkpoint"
    		mode => "server"
                host => โ€œ10.10.1.205โ€
   	 }
}

output 
{
	if [type] == "checkpoint" 
       {
		stdout { codec=> json }
	}
}

ืœื•ื™ืคืŸ ื“ื™ ื‘ืึทืคึฟืขืœ ืฆื• ืงืึธื ื˜ืจืึธืœื™ืจืŸ:
sudo /usr/share/logstash/bin//logstash -f /etc/logstash/conf.d/checkpoint.conf
ืžื™ืจ ื–ืขืŸ ื“ื™ ืจืขื–ื•ืœื˜ืึทื˜, ื“ื™ ื‘ื™ืœื“ ืื™ื– ืงืœื™ืงืงืึทื‘ืœืข:

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ืื•ื™ื‘ ืื™ืจ ื ืึธื›ืžืึทื›ืŸ ืขืก, ืขืก ื•ื•ืขื˜ ืงื•ืงืŸ ื•ื•ื™ ื“ืึธืก:

action="Accept" conn_direction="Internal" contextnum="1" ifdir="outbound" ifname="bond1.101" logid="0" loguid="{0x5dfb8c13,0x5,0xfe0a0a0a,0xc0000000}" origin="10.10.10.254" originsicname="CN=ts-spb-cpgw-01,O=cp-spb-mgmt-01.tssolution.local.kncafb" sequencenum="8" time="1576766483" version="5" context_num="1" dst="10.10.10.10" dst_machine_name="[email protected]" layer_name="TSS-Standard Security" layer_name="TSS-Standard Application" layer_uuid="dae7f01c-4c98-4c3a-a643-bfbb8fcf40f0" layer_uuid="dbee3718-cf2f-4de0-8681-529cb75be9a6" match_id="8" match_id="33554431" parent_rule="0" parent_rule="0" rule_action="Accept" rule_action="Accept" rule_name="Implicit Cleanup" rule_uid="6dc2396f-9644-4546-8f32-95d98a3344e6" product="VPN-1 & FireWall-1" proto="17" s_port="37317" service="53" service_id="domain-udp" src="10.10.1.180" ","type":"qqqqq","host":"10.10.10.250","@version":"1","port":50620}{"@timestamp":"2019-12-19T14:50:12.153Z","message":"time="1576766483" action="Accept" conn_direction="Internal" contextnum="1" ifdir="outbound" ifname="bond1.101" logid="0" loguid="{0x5dfb8c13,

ืงื•ืงืŸ ืื™ืŸ ื“ื™ ืึทืจื˜ื™ืงืœืขืŸ, ืžื™ืจ ืคึฟืึทืจืฉื˜ื™ื™ืŸ ืึทื– ื“ื™ ืœืึธื’ืก ืงื•ืงืŸ ื•ื•ื™: ืคืขืœื“ = ื•ื•ืขืจื˜ ืึธื“ืขืจ ืฉืœื™ืกืœ = ื•ื•ืขืจื˜, ื•ื•ืึธืก ืžื™ื˜ืœ ืึท ืคื™ืœื˜ืขืจ ื’ืขืจื•ืคืŸ kv ืื™ื– ืคึผืึทืกื™ืง. ืื™ืŸ ืกื“ืจ ืฆื• ืงืœื™ื™ึทื‘ืŸ ื“ื™ ืจืขื›ื˜ ืคื™ืœื˜ืขืจ ืคึฟืึทืจ ื™ืขื“ืขืจ ืกืคึผืขืฆื™ืคื™ืฉ ืคืึทืœ, ืขืก ื•ื•ืึธืœื˜ ื–ื™ื™ืŸ ืึท ื’ื•ื˜ืข ื’ืขื“ืึทื ืง ืฆื• ื–ื™ื™ืŸ ื‘ืึทืงืึทื ื˜ ืžื™ื˜ ื–ื™ื™ ืื™ืŸ ื“ื™ ื˜ืขื›ื ื™ืฉ ื“ืึทืงื™ื•ืžืขื ื˜ื™ื™ืฉืึทืŸ, ืึธื“ืขืจ ืคืจืขื’ืŸ ืึท ืคืจื™ื™ึทื ื“.

ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ืคื™ืœื˜ืขืจ

ืื™ืŸ ื“ื™ ืœืขืฆื˜ืข ื‘ื™ื ืข ืžื™ืจ ืื•ื™ืกื’ืขืงืœื™ื‘ืŸ ืงื•ื•, ื“ื™ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ืคื•ืŸ ื“ืขื ืคื™ืœื˜ืขืจ ืื™ื– ื“ืขืจืœืื ื’ื˜ ืื•ื ื˜ืŸ:

filter {
if [type] == "checkpoint"{
	kv {
		value_split => "="
		allow_duplicate_values => false
	}
}
}

ืžื™ืจ ืกืขืœืขืงื˜ื™ืจืŸ ื“ืขื ืกื™ืžื‘ืึธืœ ืžื™ื˜ ื•ื•ืึธืก ืžื™ืจ ื˜ื™ื™ืœืŸ ื“ื™ ืคืขืœื“ ืื•ืŸ ื•ื•ืขืจื˜ - "=". ืื•ื™ื‘ ืžื™ืจ ื”ืึธื‘ืŸ ื™ื™ื“ืขื ื™ืงืึทืœ ืื™ื™ื ืกืŸ ืื™ืŸ ื“ื™ ืงืœืึธืฅ, ืžื™ืจ ืจืึทื˜ืขื•ื•ืขืŸ ื‘ืœื•ื™ื– ืื™ื™ืŸ ื‘ื™ื™ึทืฉืคึผื™ืœ ืื™ืŸ ื“ื™ ื“ืึทื˜ืึทื‘ื™ื™ืก, ืึทื ื“ืขืจืฉ ืื™ืจ ื•ื•ืขื˜ ืกื•ืฃ ืึทืจื•ื™ืฃ ืžื™ื˜ ืึท ืžืขื ื’ืข ืคื•ืŸ โ€‹โ€‹ื™ื™ื“ืขื ื™ืงืึทืœ ื•ื•ืึทืœื•ืขืก, ื“ืึธืก ืื™ื–, ืื•ื™ื‘ ืžื™ืจ ื”ืึธื‘ืŸ ื“ื™ ืึธื ื–ืึธื’ "foo = some foo = some" ืžื™ืจ ืฉืจื™ื™ึทื‘ืŸ ื‘ืœื•ื™ื– foo. = ืขื˜ืœืขื›ืข.

ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ื“ื™ ืจื™ื›ื˜ื™ืง ืจืขื–ื•ืœื˜ืึทื˜ ืื™ืŸ ElasticSearch

ืึทืžืึธืœ ืคื™ืœื˜ืขืจ ืื™ื– ืงืึทื ืคื™ื’ื™ืขืจื“, ืื™ืจ ืงืขื ืขืŸ ื•ืคึผืœืึธืึทื“ ืœืึธื’ืก ืฆื• ื“ื™ ื“ืึทื˜ืึทื‘ื™ื™ืก ื’ื•ืžืข ื–ื•ื›ืŸ:

output 
{
if [type] == "checkpoint"
{
 	elasticsearch 
        {
		hosts => ["10.10.1.200:9200"]
		index => "checkpoint-%{+YYYY.MM.dd}"
    		user => "tssolution"
    		password => "cool"
  	}
}
}

ืื•ื™ื‘ ื“ืขืจ ื“ืึธืงื•ืžืขื ื˜ ืื™ื– ื’ืขื—ืชืžืขื˜ ืžื™ื˜ ื“ื™ ื˜ืฉืขืงืคึผื•ื™ื ื˜ ื˜ื™ืคึผ, ืžื™ืจ ืจืึทื˜ืขื•ื•ืขืŸ ื“ื™ ื’ืขืฉืขืขื ื™ืฉ ืื™ืŸ ื“ื™ Elasticsearch ื“ืึทื˜ืึทื‘ื™ื™ืก, ื•ื•ืึธืก ืึทืงืกืขืคึผืฅ ืงืึทื ืขืงืฉืึทื ื– ืื•ื™ืฃ 10.10.1.200 ืื•ื™ืฃ ืคึผืึธืจื˜ 9200 ื“ื•ืจืš ืคืขืœื™ืงื™ื™ึทื˜. ื™ืขื“ืขืจ ื“ืึธืงื•ืžืขื ื˜ ืื™ื– ื’ืขืจืื˜ืขื•ื•ืขื˜ ืฆื• ืึท ืกืคึผืขืฆื™ืคื™ืฉ ืื™ื ื“ืขืงืก, ืื™ืŸ ื“ืขื ืคืึทืœ ืžื™ืจ ืจืึทื˜ืขื•ื•ืขืŸ ืฆื• ื“ื™ ืื™ื ื“ืขืงืก "ื˜ืฉืขืงืคึผื•ื™ื ื˜-" + ืงืจืึทื ื˜ ืฆื™ื™ื˜ ื˜ืึธื’. ื™ืขื“ืขืจ ืื™ื ื“ืขืงืก ืงืขื ืขืŸ ื”ืึธื‘ืŸ ืึท ืกืคึผืขืฆื™ืคื™ืฉ ื’ืึทื ื’ ืคื•ืŸ ืคืขืœื“ืขืจ, ืึธื“ืขืจ ืื™ื– ื‘ืืฉืืคืŸ ืื•ื™ื˜ืึธืžืึทื˜ื™ืฉ ื•ื•ืขืŸ ืึท ื ื™ื™ึทืข ืคืขืœื“ ืื™ื– ืืจื•ื™ืก ืื™ืŸ ืึท ืึธื ื–ืึธื’; ืคืขืœื“ ืกืขื˜ื˜ื™ื ื’ืก ืื•ืŸ ื–ื™ื™ืขืจ ื˜ื™ืคึผ ืงืขื ืขืŸ ื–ื™ื™ืŸ ื•ื•ื™ื•ื“ ืื™ืŸ ืžืึทืคึผื™ื ื’ื–.

ืื•ื™ื‘ ืื™ืจ ื”ืึธื‘ืŸ ืึธื˜ืขื ื˜ืึทืงื™ื™ืฉืึทืŸ ืงืึทื ืคื™ื’ื™ืขืจื“ (ืžื™ืจ ื•ื•ืขืœืŸ ื–ืขืŸ ืขืก ืฉืคึผืขื˜ืขืจ), ื“ื™ ืงืจืึทื“ืขื ื˜ืฉืึทืœื– ืคึฟืึทืจ ืฉืจื™ื™ื‘ืŸ ืฆื• ืึท ืกืคึผืขืฆื™ืคื™ืฉ ืื™ื ื“ืขืงืก ืžื•ื–ืŸ ื–ื™ื™ืŸ ืกืคึผืขืกื™ืคื™ืขื“, ืื™ืŸ ื“ืขื ื‘ื™ื™ึทืฉืคึผื™ืœ ืขืก ืื™ื– "ืฆืกืึทืœื•ืฉืึทืŸ" ืžื™ื˜ ื“ื™ ืคึผืึทืจืึธืœ "ืงื™ืœ". ืื™ืจ ืงืขื ืขืŸ ื“ื™ืคืขืจืขื ืฉื™ื™ื™ื˜ ื‘ืึทื ื™ืฆืขืจ ืจืขื›ื˜ ืฆื• ืฉืจื™ื™ึทื‘ืŸ ืœืึธื’ืก ื‘ืœื•ื™ื– ืฆื• ืึท ืกืคึผืขืฆื™ืคื™ืฉ ืื™ื ื“ืขืงืก ืื•ืŸ ื ื™ื˜ ืžืขืจ.

ืงืึทื˜ืขืจ Logstash.

Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข:

input 
{
         tcp 
         {
                port => 5555
  	  	type => "checkpoint"
    		mode => "server"
                host => โ€œ10.10.1.205โ€
   	 }
}

filter {
        if [type] == "checkpoint"{
	kv {
		value_split => "="
		allow_duplicate_values => false
	}
        }
}

output 
{
if [type] == "checkpoint"
{
 	elasticsearch 
        {
		hosts => ["10.10.1.200:9200"]
		index => "checkpoint-%{+YYYY.MM.dd}"
    		user => "tssolution"
    		password => "cool"
  	}
}
}

ืžื™ืจ ืงืึธื ื˜ืจืึธืœื™ืจืŸ ื“ื™ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืคึฟืึทืจ ืจื™ื›ื˜ื™ืง:
/usr/share/logstash/bin//logstash -f checkpoint.conf
2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ืึธื ื”ื™ื™ื‘ ื“ืขื Logstash ืคึผืจืึธืฆืขืก:
ืกื•ื“ืึธ ืกื™ืกื˜ืขืžืงื˜ืœ ืึธื ื”ื™ื™ื‘ ืœืึธื’ืกื˜ืึทืฉ

ืžื™ืจ ืงืึธื ื˜ืจืึธืœื™ืจืŸ ืึทื– ื“ืขืจ ืคึผืจืึธืฆืขืก ืื™ื– ืกื˜ืึทืจื˜ืขื“:
sudo systemctl ืกื˜ืึทื˜ื•ืก ืœืึธื’ืกื˜ืึทืฉ

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ื–ืืœ ืก ื˜ืฉืขืง ืื•ื™ื‘ ื“ื™ ื›ืึธืœืขืœ ืื™ื– ืึทืจื•ื™ืฃ:
netstat -nat |grep 5555

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ืงืึธื ื˜ืจืึธืœื™ืจืŸ ื“ื™ ืœืึธื’ืก ืื™ืŸ ืงื™ื‘ืึทื ืึท.

ื ืึธืš ืึทืœืฅ ืื™ื– ืคืœื™ืกื ื“ื™ืง, ื’ื™ื™ืŸ ืฆื• Kibana - ืึทื ื˜ื“ืขืงืŸ, ืžืึทื›ืŸ ื–ื™ื›ืขืจ ืึทื– ืึทืœืฅ ืื™ื– ืงืึทื ืคื™ื’ื™ืขืจื“ ืจื™ื›ื˜ื™ืง, ื“ื™ ื‘ื™ืœื“ ืื™ื– ืงืœื™ืงืงืึทื‘ืœืข!

2. ื’ื•ืžืข ืึธื ืœื™ื™ื’ืŸ: ืึทื ืึทืœื™ืกื™ืก ืคื•ืŸ ื–ื™ื›ืขืจื”ื™ื™ึทื˜ ืœืึธื’ืก. Logstash

ืึทืœืข ืœืึธื’ืก ื–ืขื ืขืŸ ืื™ืŸ ืคึผืœืึทืฅ ืื•ืŸ ืžื™ืจ ืงืขื ืขืŸ ื–ืขืŸ ืึทืœืข ื“ื™ ืคืขืœื“ืขืจ ืื•ืŸ ื–ื™ื™ืขืจ ื•ื•ืึทืœื•ืขืก!

ืกืึธืฃ

ืžื™ืจ ื’ืขืงื•ืงื˜ ืื•ื™ืฃ ื•ื•ื™ ืฆื• ืฉืจื™ื™ึทื‘ืŸ ืึท Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข, ืื•ืŸ ื•ื•ื™ ืึท ืจืขื–ื•ืœื˜ืึทื˜ ืžื™ืจ ื‘ืึทืงื•ืžืขืŸ ืึท ืคึผืึทืจืกืขืจ ืคื•ืŸ ืึทืœืข ืคืขืœื“ืขืจ ืื•ืŸ ื•ื•ืึทืœื•ืขืก. ืื™ืฆื˜ ืžื™ืจ ืงืขื ืขืŸ ืึทืจื‘ืขื˜ืŸ ืžื™ื˜ ื–ื•ื›ืŸ ืื•ืŸ ืคึผืœืึทื˜ื™ื ื’ ืคึฟืึทืจ ืกืคึผืขืฆื™ืคื™ืฉ ืคืขืœื“ืขืจ. ื•ื•ื™ื™ึทื˜ืขืจ ืื™ืŸ ื“ืขื ืงื•ืจืก ืžื™ืจ ื•ื•ืขืœืŸ ืงื•ืงืŸ ืื™ืŸ ื•ื•ื™ื–ืฉื•ื•ืึทืœืึทื–ื™ื™ืฉืึทืŸ ืื™ืŸ ืงื™ื‘ืึทื ืึท ืื•ืŸ ืžืึทื›ืŸ ืึท ืคึผืฉื•ื˜ ื“ืึทืฉื‘ืึธืจื“. ืขืก ืื™ื– ื›ื“ืื™ ืฆื• ื“ืขืจืžืึธื ืขืŸ ืึทื– ื“ื™ Logstash ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ื“ืึทืจืฃ ืงืขืกื™ื™ื“ืขืจ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงื˜ ืื™ืŸ ื–ื™ื›ืขืจ ืกื™ื˜ื•ืึทื˜ื™ืึธื ืก, ืœืžืฉืœ, ื•ื•ืขืŸ ืžื™ืจ ื•ื•ื™ืœืŸ ืฆื• ืคืึทืจื‘ื™ื™ึทื˜ืŸ ื“ื™ ื•ื•ืขืจื˜ ืคื•ืŸ ืึท ืคืขืœื“ ืคื•ืŸ ืึท ื ื•ืžืขืจ ืฆื• ืึท ื•ื•ืึธืจื˜. ืื™ืŸ ืกืึทื‘ืกืึทืงื•ื•ืึทื ื˜ ืึทืจื˜ื™ืงืœืขืŸ ืžื™ืจ ื•ื•ืขืœืŸ ื˜ืึธืŸ ื“ืึธืก ืงืขืกื™ื™ื“ืขืจ.

ืึทื–ื•ื™ ื‘ืœื™ื™ื‘ืŸ ื˜ื•ื ื“ (ื˜ืขืœืขื’ืจืึทื, facebook, VK, TS ืœื™ื™ื–ื•ื ื’ ื‘ืœืึธื’), Yandex Zen.

ืžืงื•ืจ: www.habr.com

ืœื™ื™ื’ืŸ ืึท ื‘ืึทืžืขืจืงื•ื ื’