Rspamd 2.0 spam filtering system muaj

Xa los ntawm tso tawm spam filtering system Rspamd 2.0, uas muab cov cuab yeej rau kev ntsuam xyuas cov lus tawm tsam ntau yam, suav nrog cov cai, cov txheej txheem kev txheeb cais thiab cov npe dub, raws li qhov kawg ntawm cov lus hnyav yog tsim, uas yog siv los txiav txim siab seb puas yuav thaiv. Rspamd txhawb nqa yuav luag tag nrho cov yam ntxwv siv hauv SpamAssassin, thiab muaj ntau tus yam ntxwv uas tso cai rau koj lim cov ntawv ntawm qhov nruab nrab 10 npaug sai dua SpamAssassin, nrog rau muab cov lim dej zoo dua. Qhov system code sau hauv C thiab faib los ntawm muaj ntawv tso cai nyob rau hauv Apache 2.0.

Rspamd yog tsim los siv ib qho kev tshwm sim-tsav architecture thiab yog thawj zaug tsim los siv rau hauv cov tshuab ua haujlwm siab, tso cai rau nws ua haujlwm ntau pua cov lus ib ob. Cov cai rau kev txheeb xyuas cov cim ntawm spam yog qhov hloov pauv tau yooj yim thiab hauv lawv daim ntawv yooj yim tshaj plaws tuaj yeem muaj cov lus qhia tsis tu ncua, thiab hauv cov xwm txheej nyuaj lawv tuaj yeem sau rau hauv Lua. Kev nthuav dav ua haujlwm thiab ntxiv hom kev kuaj xyuas tshiab yog siv los ntawm cov qauv uas tuaj yeem tsim hauv hom lus C thiab Lua. Piv txwv li, cov qauv muaj rau kev txheeb xyuas tus neeg xa khoom siv SPF, lees paub tus neeg xa ntawv sau npe ntawm DKIM, thiab tsim kev thov rau DNSBL cov npe. Txhawm rau kom yooj yim teeb tsa, tsim cov cai thiab taug qab cov txheeb cais, muaj kev tswj hwm lub vev xaib.

Main innovations:

  • Ib qho kev hloov pauv tau ua rau qhov teeb meem tshiab ntawm tus lej. Txij li thawj tus lej hauv tus lej version tsis tau hloov pauv rau ntau xyoo, thiab qhov ntsuas tiag tiag yog tus lej thib ob, nws tau txiav txim siab hloov mus rau hom "yz" es tsis yog "xyz" tswvyim;
  • Rau qhov kev tshwm sim voj xwb Libevent tsev qiv ntawv koom nrog libev, uas tshem tawm qee qhov kev txwv libevent thiab tso cai rau kev ua haujlwm zoo dua. Kev siv
    libev tau ua kom yooj yim cov cai, txhim kho cov teeb liab thiab lub sijhawm ua haujlwm, thiab sib koom ua ke cov ntaub ntawv hloov pauv kev taug qab siv cov txheej txheem inotify (tsis yog txhua qhov kev tso tawm libevent xa mus rau cov platform txhawb nqa tuaj yeem ua haujlwm nrog inotify);

  • Kev them nyiaj yug rau cov lus qhia kev faib tawm uas siv lub Torch sib sib zog nqus tshuab kev kawm lub tsev qiv ntawv tau raug txiav lawm. Yog vim li cas hais yog qhov nyuaj heev ntawm Torch thiab qhov nyuaj ntawm kev ua kom nws mus txog hnub tim. Ib daim ntawv sau rov qab tag nrho yog npaj los ua ib qho kev hloov pauv rau kev faib tawm siv cov txheej txheem kev kawm tshuab Neural, nyob rau hauv uas lub tsev qiv ntawv yog siv los xyuas kom meej lub lag luam ntawm lub neural network tau, uas suav nrog tsuas yog 4000 kab ntawm C code. Qhov kev siv tshiab daws teeb meem ntau yam nrog rau qhov tshwm sim ntawm kev tuag thaum lub sij hawm kev cob qhia;
  • Module RBL hloov lub SURBL thiab Emails modules, uas ua rau nws muaj peev xwm mus koom ua ke ntawm tag nrho cov blacklist checks. RBL lub peev xwm tau nthuav dav kom suav nrog kev txhawb nqa rau lwm hom, xws li cov neeg xaiv, thiab cov cuab yeej siv tau yooj yim txuas ntxiv cov cai uas twb muaj lawm. Email thaiv cov cai raws li daim ntawv qhia npe hloov DNS RBL tsis tau txais kev txhawb nqa lawm; nws raug pom zoo kom siv ntau daim ntawv qhia nrog cov xaiv xaiv;
  • Txhawm rau txiav txim siab cov ntaub ntawv raws li cov ntsiab lus, lub tsev qiv ntawv Lua Magic tshiab yog siv, siv Lua thiab Hyperscan es tsis txhob libmagic.
    Cov laj thawj ntawm kev tsim koj tus kheej lub tsev qiv ntawv suav nrog kev xav ua kom tau txais kev ua tau zoo dua, tshem tawm cov kev ua tsis tiav thaum txheeb xyuas cov ntaub ntawv docx, tau txais API tsim nyog dua thiab ntxiv cov hom tshiab ntawm heuristics uas tsis txwv los ntawm cov cai nruj;

  • Txhim kho module rau khaws cov ntaub ntawv hauv DBMS clickhouse. Ntxiv LowCardinality teb thiab txhim kho kev nco zoo heev;
  • Module muaj peev xwm nthuav dav Multimap, nyob rau hauv qhov kev txhawb nqa tshwm ua ke ΠΈ nyob kev sib piv;
  • Maillist module tau txhim kho lub ntsiab lus ntawm kev xa ntawv;
  • Cov txheej txheem ntawm cov neeg ua haujlwm tam sim no muaj peev xwm xa cov lus ntawm lub plawv mus rau cov txheej txheem tseem ceeb, lees paub kev ua haujlwm ib txwm muaj. Yog tias tsis muaj cov lus zoo li no rau ib lub sijhawm, cov txheej txheem tseem ceeb tuaj yeem cuam tshuam cov txheej txheem neeg ua haujlwm. Los ntawm lub neej ntawd, hom no yog neeg xiam rau tam sim no;
  • Ib tug series ntawm scanners tshiab nyob rau hauv lus Lua tau ntxiv. Piv txwv li, cov qauv tau ntxiv rau kev xa cov lus hauv Kaspersky ScanEngine, Trend Micro IWSVA (ntawm icap) thiab
    F-Secure Internet Gatekeeper (ntawm icap), thiab tseem muaj cov khoom siv sab nraud rau Razor, oletools thiab P0F;

  • Ntxiv lub peev xwm los hloov cov lus ntawm Lua API. Ib qho module tau raug thov kom hloov pauv rau MIME blocks lib_mim;
  • Kev sib cais ntawm cov chaw teeb tsa los ntawm "Settings-Id:" tau muab, piv txwv li, tam sim no koj tuaj yeem khi cov cai tsuas yog rau qee qhov chaw cim;
  • Optimizations tau ua rau kev ua tau zoo ntawm Lua cav, base64 decoding thiab nrhiav cov lus rau cov ntawv nyeem. Ntxiv kev txhawb nqa rau caching complex maps. Kev them nyiaj yug tau siv
    HTTP kom ciaj sia.

Tau qhov twg los: opennet.ru

Ntxiv ib saib