AOL yatulutsa Moloch 2.3 network indexing system

Kampani ya AOL anamasulidwa kutulutsidwa kwa dongosolo lojambulira, kusunga ndi kuloza mapaketi a netiweki Moloch 2.3, yomwe imapereka zida zowunika momwe magalimoto amayendera ndikufufuza zambiri zokhudzana ndi ntchito zapaintaneti. Khodiyo imalembedwa m'chinenero cha C (mawonekedwe mu Node.js/JavaScript) ndi wogawidwa ndi zololedwa pansi pa Apache 2.0. Imathandizira ntchito pa Linux ndi FreeBSD. Okonzeka phukusi adakonzekera mitundu yosiyanasiyana ya CentOS ndi Ubuntu.

Pulojekitiyi idapangidwa mu 2012 ndi cholinga chokhazikitsa njira yotseguka yosinthira mapaketi amtundu wamalonda omwe atha kupitilira kuchuluka kwa magalimoto a AOL. Kukhazikitsidwa kwa dongosolo latsopano mu AOL kunapangitsa kuti zitheke kuwongolera magwiridwe antchito chifukwa cha kutumizidwa kwa ma seva ake ndikuchepetsa kwambiri ndalama - kugwiritsa ntchito Moloch kuti agwire magalimoto onse mumaneti onse a AOL amawononga ndalama zofananira ndikugwiritsa ntchito. njira zamalonda M'mbuyomu, zidagwiritsidwa ntchito kujambula magalimoto pamaneti amodzi okha. Dongosololi limatha kukulitsa kuchuluka kwa magalimoto pa liwiro la magigabiti makumi pamphindikati. Kuchuluka kwa deta yosungidwa kumakhala kochepa kokha ndi kukula kwa disk yomwe ilipo.
Metadata ya Session imayikidwa mumagulu otengera injini Elasticsearch.

Moloch imaphatikizapo zida zojambulira ndikulozera kuchuluka kwa magalimoto mumtundu wa PCAP, komanso kupeza mwachangu deta yolondolera. Kuti muwunike zambiri zomwe zasonkhanitsidwa, mawonekedwe apaintaneti amaperekedwa omwe amakupatsani mwayi wofufuza, kufufuza ndi kutumiza zitsanzo. Zoperekedwanso API, zomwe zimakulolani kusamutsa zambiri za mapaketi ogwidwa mumtundu wa PCAP ndi magawo ogawidwa mumtundu wa JSON kupita kuzinthu zina. Kugwiritsa ntchito mawonekedwe a PCAP kumathandizira kwambiri kuphatikizana ndi zowunikira zomwe zilipo kale monga Wireshark.

Moloch ili ndi zigawo zitatu zofunika:

  • Makina ojambulira magalimoto ndi pulogalamu yamitundu yambiri ya C yowunikira kuchuluka kwa magalimoto, kulemba zotayira mu mtundu wa PCAP kupita ku disk, kugawa mapaketi ogwidwa ndikutumiza metadata yokhudza magawo (SPI, Stateful paketi inspection) ndi ma protocol ku gulu la Elasticsearch. Ndizotheka kusunga mafayilo a PCAP mu mawonekedwe obisika.
  • Mawonekedwe a intaneti ozikidwa pa nsanja ya Node.js, yomwe imayenda pa seva iliyonse yojambulira magalimoto ndikuchita zopempha zokhudzana ndi kupeza ma indexed indexed ndikusamutsa mafayilo a PCAP kudzera. API.
  • Kusungidwa kwa metadata kutengera Elasticsearch.

Mawonekedwe a intaneti amapereka mitundu ingapo yowonera - kuchokera ku ziwerengero zonse, mamapu olumikizirana ndi ma graph owoneka ndi data pakusintha kwa ntchito zapaintaneti kupita ku zida zophunzirira magawo amunthu payekhapayekha, kusanthula zochitika malinga ndi ma protocol omwe amagwiritsidwa ntchito komanso kugawa deta kuchokera kuzinthu zotayidwa za PCAP.

AOL yatulutsa Moloch 2.3 network indexing system

AOL yatulutsa Moloch 2.3 network indexing system

AOL yatulutsa Moloch 2.3 network indexing system

AOL yatulutsa Moloch 2.3 network indexing system

Π’ nkhani yatsopano:

  • Kusintha kwapangidwa kuti agwiritse ntchito mtundu wopanda cholembera pa indexing mu Elasticsearch.
  • Zitsanzo zowonjezera za zosefera zamagalimoto ku Lua.
  • Thandizo la 46-draft version ya QUIC protocol yakhazikitsidwa.
  • Khodi yoyika ma protocol asinthidwanso, ndikupangitsa kuti zitheke kulemba zolembera za ma protocol a Ethernet ndi IP.
  • Zolemba zatsopano za arp, bgp, igmp, isis, lldp, ospf ndi pim protocol, komanso zopangira ma protocol osadziwika a unkEthernet ndi unkIpProtocol, aperekedwa.
  • Adawonjeza njira yoletsa zophatikiza (disableParsers).
  • Kutha kuwonetsa gawo lililonse lachiwerengero pamachati, omwe ali patsamba la zoikamo, awonjezedwa pa intaneti.
  • Ma graph ndi mitu zitha kuzimitsidwa ndipo osasunthika mukamayenda patsamba.
  • Ma navigation bar ambiri amabisika kapena kugwa mwachisawawa.

Source: opennet.ru

Kuwonjezera ndemanga