🥇Not New Relic ib leeg: saib Datadog thiab Atatus

Nyob rau hauv ib puag ncig ntawm SRE / DevOps engineers, nws yuav tsis surprise leej twg uas muaj ib hnub ib tug neeg (los yog ib tug saib xyuas system) tshwm sim thiab ceeb toom tias "txhua yam ploj lawm": lub site tsis ua hauj lwm, kev them nyiaj tsis mus, lub neej yog lwj. ... Txawm hais tias koj xav pab ntau npaum li cas hauv qhov xwm txheej no, nws tuaj yeem nyuaj ua qhov no yam tsis muaj cuab yeej yooj yim thiab nkag siab. Feem ntau qhov teeb meem yog muab zais rau hauv daim ntawv thov code nws tus kheej; koj tsuas yog yuav tsum tau localize nws.

Thiab hauv kev tu siab thiab kev xyiv fab…

Nws thiaj li tshwm sim uas peb tau ntev thiab poob rau hauv kev hlub nrog New Relic. Nws yog thiab tseem yog ib qho cuab yeej zoo heev rau kev soj ntsuam daim ntawv thov kev ua tau zoo, thiab tseem tso cai rau koj los ntsuas cov kev pabcuam microservice architecture (siv nws tus neeg sawv cev) thiab ntau, ntau ntxiv. Thiab txhua yam tuaj yeem ua tau zoo yog tias nws tsis yog rau kev hloov pauv hauv kev pabcuam tus nqi txoj cai: nws nqi los ntawm 2013 xyoo loj hlob 3+ zaug. Tsis tas li ntawd, txij li xyoo tas los, tau txais tus account mus sib hais yuav tsum muaj kev sib txuas lus nrog tus thawj tswj hwm tus kheej, uas ua rau nws nyuaj rau nthuav tawm cov khoom rau cov neeg siv khoom.

Qhov xwm txheej ib txwm muaj: New Relic tsis xav tau ntawm "lub hauv paus ruaj khov"; lawv nco ntsoov nws tsuas yog lub sijhawm thaum muaj teeb meem pib. Tab sis koj tseem yuav tsum tau them nyiaj tsis tu ncua (140 USD ib tus neeg rau zaub mov hauv ib hlis), thiab hauv ib qho kev txiav txim siab scaling huab infrastructure cov sums ntxiv loj heev. Txawm hais tias muaj kev xaiv Them-As-You-Go, enabling New Relic yuav kom koj rov pib dua daim ntawv thov, uas yuav ua rau poob ntawm qhov teeb meem uas nws tau pib tag nrho. Tsis ntev tas los no, New Relic tau tshaj tawm txoj kev npaj se tshiab - Yam, - uas thaum xub thawj siab ib muag zoo li ib tug tsim nyog lwm txoj rau Professional ... tab sis raws li kev soj ntsuam ze nws tau pom tias ib co tseem ceeb functions yog ploj lawm (tshwj xeeb, nws tsis muaj. Kev lag luam tseem ceeb, Cross Application Tracing, Distributed Tracing).

Yog li ntawd, peb pib xav txog kev nrhiav lwm txoj hauv kev pheej yig dua, thiab peb qhov kev xaiv poob rau ob qhov kev pabcuam: Datadog thiab Atatus. Vim li cas rau lawv?

Hais txog cov neeg sib tw

Cia kuv hais tam sim ntawd tias muaj lwm yam kev daws teeb meem ntawm kev ua lag luam. Peb txawm xav tias Open Source xaiv, tab sis tsis yog txhua tus neeg siv khoom muaj peev xwm pub dawb los tuav cov kev daws teeb meem rau tus kheej ... - Ntxiv rau, lawv yuav xav tau kev saib xyuas ntxiv. Cov khub niam txiv uas peb xaiv tau los ua qhov ze tshaj plaws peb cov kev xav tau:

built-in thiab tsim kev txhawb nqa rau PHP daim ntawv thov (peb cov neeg siv khoom pawg muaj ntau haiv neeg, tab sis qhov no yog tus thawj coj meej hauv cov ntsiab lus ntawm kev tshawb nrhiav lwm txoj hauv kev rau New Relic);
tus nqi pheej yig (tsawg dua 100 USD ib hlis ib tus tswv tsev);
tsis siv neeg ntsuas;
kev koom ua ke nrog Kubernetes;
Qhov zoo sib xws rau New Relic interface yog qhov pom tau ntxiv (vim peb cov engineers tau siv rau nws).

Yog li ntawd, nyob rau theem pib xaiv, peb tshem tawm ob peb lwm yam kev daws teeb meem, thiab tshwj xeeb:

Tideways, AppDynamics thiab Dynatrace - rau nqi;
Stackify yog thaiv hauv Lavxias Federation thiab qhia cov ntaub ntawv tsawg dhau.

Cov seem ntawm tsab xov xwm yog tsim nyob rau hauv xws li ib txoj kev uas cov kev daws teeb meem nyob rau hauv nqe lus nug yuav xub qhia luv luv, tom qab uas kuv yuav tham txog peb cov kev sib raug zoo nrog New Relic thiab kev paub / kev xav los ntawm kev ua haujlwm zoo sib xws hauv lwm cov kev pabcuam.

Kev nthuav qhia ntawm cov neeg sib tw xaiv

rau Nyab Tshiab, tej zaum sawv daws tau hnov? Qhov kev pabcuam no tau pib nws txoj kev loj hlob ntau dua 10 xyoo dhau los, xyoo 2008. Peb tau nquag siv nws txij li xyoo 2012 thiab tsis muaj teeb meem kev koom ua ke ntau ntawm cov ntawv thov hauv PHP, Ruby thiab Python, thiab peb kuj tau muaj kev koom ua ke nrog C# thiab Go. Cov kws sau ntawv ntawm cov kev pabcuam muaj cov kev daws teebmeem rau kev saib xyuas cov ntawv thov, kev tsim kho vaj tse, taug qab microservice infrastructures, tsim cov ntawv thov yooj yim rau cov neeg siv khoom siv, thiab ntau ntxiv.

Txawm li cas los xij, tus neeg sawv cev tshiab Relic khiav ntawm cov txheej txheem tsim khoom thiab tsis txhawb OpenTracing. Kev ntsuas qib siab xav tau kev kho tshwj xeeb rau New Relic. Thaum kawg, kev txhawb nqa Kubernetes tseem tab tom sim.

Pib nws txoj kev loj hlob hauv 2010 datadog zoo nkaus li nthuav dav dua li New Relic qhov tseeb ntawm kev siv hauv Kubernetes ib puag ncig. Tshwj xeeb, nws txhawb kev koom ua ke nrog NGINX Ingress, sau cov ntawv sau, statsd thiab OpenTracing raws tu qauv, uas tso cai rau koj taug qab tus neeg siv kev thov los ntawm lub sijhawm nws txuas nrog ua tiav, nrog rau nrhiav cov cav rau qhov kev thov no (ob leeg ntawm lub vev xaib server sab thiab ntawm cov neeg siv khoom).

Thaum siv Datadog, peb tau ntsib tias qee zaum nws tsim daim ntawv qhia microservice tsis raug, thiab qee qhov kev tsis txaus ntseeg. Piv txwv li, nws misidentified hom kev pab cuam (mistaking Django rau ib tug caching kev pab cuam) thiab ua rau 500 yuam kev nyob rau hauv ib tug PHP daim ntawv thov siv lub nrov Predis lub tsev qiv ntawv.

Atatus - cov cuab yeej yau tshaj plaws; qhov kev pabcuam tau tsim tawm hauv xyoo 2014. Nws cov peev nyiaj lag luam tau pom meej meej qis dua rau cov npe sib tw, cov lus hais tsis tshua muaj ntau. Txawm li cas los xij, lub cuab yeej nws tus kheej zoo ib yam li New Relic, tsis tsuas yog hauv nws lub peev xwm (APM, Browser saib, thiab lwm yam), tab sis kuj zoo li.

Qhov teeb meem tseem ceeb yog tias nws tsuas yog txhawb nqa Node.js thiab PHP. Ntawm qhov tod tes, nws tau ua tiav zoo dua li Datadog. Tsis zoo li yav tas los, Atatus tsis xav tau cov ntawv thov los hloov kho lossis ntxiv cov ntawv sau ntxiv rau cov cai.

Yuav ua li cas peb ua haujlwm nrog New Relic

Tam sim no cia saib seb peb feem ntau siv New Relic li cas. Cia peb hais tias peb muaj ib qho teeb meem uas xav tau kev daws teeb meem:

Nws yooj yim pom ntawm daim duab txaws - Cia peb tsom xam. Hauv New Relic, lub vev xaib kev lag luam raug xaiv tam sim rau lub vev xaib thov, txhua yam khoom tau qhia hauv daim duab ua haujlwm, muaj qhov yuam kev-tus nqi, thov-tus nqi vaj huam sib luag... Qhov tseem ceeb tshaj plaws yog ncaj qha los ntawm cov vaj huam sib luag no koj tuaj yeem txav ntawm qhov sib txawv. qhov chaw ntawm daim ntawv thov (piv txwv li, nyem rau ntawm MySQL yuav ua rau seem database).

Txij li thaum nyob rau hauv qhov piv txwv nyob rau hauv kev txiav txim siab peb pom ib tug surge nyob rau hauv kev ua si PHP, nyem rau ntawm daim ntawv qhia no thiab cia li mus rau Kev Sib Tham:

Daim ntawv teev cov kev lag luam, uas yog cov tswj hwm los ntawm MVC qauv, twb tau txheeb xyuas los ntawm Feem ntau siv sijhawm, uas yog yooj yim heev: peb tam sim ntawd pom dab tsi daim ntawv thov ua. Nov yog cov piv txwv ntawm cov lus nug ntev uas tau txais los ntawm New Relic. Los ntawm kev hloov sorting, nws yooj yim los nrhiav:

lub feem ntau loaded daim ntawv thov maub los;
feem ntau thov xws li;
qhov qeeb tshaj ntawm cov tswj.

Tsis tas li ntawd, koj tuaj yeem nthuav tawm txhua qhov kev sib pauv thiab pom tias daim ntawv thov tau ua li cas thaum lub sijhawm ua tiav:

Thaum kawg, daim ntawv thov khaws cov piv txwv ntawm kev thov ntev (cov uas siv sijhawm ntau dua 2 vib nas this). Ntawm no yog lub vaj huam sib luag rau kev lag luam ntev:

Nws tuaj yeem pom tias ob txoj hauv kev siv sijhawm ntau, thiab tib lub sijhawm thaum qhov kev thov raug ua tiav, nws URI thiab tus sau kuj tau qhia. Feem ntau qhov no yuav pab nrhiav kev thov hauv cov cav. Mus rau Taug qab cov ntsiab lus, koj tuaj yeem pom qhov twg cov txheej txheem no raug hu los ntawm:

Thiab nyob rau hauv Database queries - ntsuam xyuas cov lus nug rau cov ntaub ntawv uas tau ua tiav thaum daim ntawv thov ua haujlwm:

Armed nrog cov kev paub no, peb tuaj yeem ntsuas vim li cas daim ntawv thov qeeb thiab ua haujlwm nrog tus tsim tawm los nrog lub tswv yim los daws qhov teeb meem. Hauv kev muaj tiag, New Relic tsis yog ib txwm muab cov duab meej, tab sis nws pab xaiv vector ntawm kev tshawb xyuas:

ntev PDO::Construct coj peb mus rau kev ua haujlwm txawv txawv ntawm pgpoll;
instability nyob rau lub sij hawm Memcache::Get qhia tias lub tshuab virtual tau teeb tsa tsis raug;
lub sij hawm tsis txaus ntseeg ntxiv rau kev ua cov qauv coj mus rau lub voj voog nested tshawb xyuas qhov muaj 500 avatars hauv cov khoom cia;
lwm yam…

Nws kuj tshwm sim uas tsis yog kev ua raws cai, ib yam dab tsi cuam tshuam nrog cov ntaub ntawv sab nraud loj hlob ntawm lub vijtsam tseem ceeb - thiab nws tsis muaj teeb meem dab tsi nws yuav yog: Redis lossis PostgreSQL - lawv txhua tus tau muab zais rau hauv tab. databases.

Koj tuaj yeem xaiv lub hauv paus tshwj xeeb rau kev tshawb fawb thiab txheeb cov lus nug - zoo ib yam li nws ua tiav hauv Kev Ua Lag Luam. Thiab los ntawm kev mus rau qhov kev thov tab, koj tuaj yeem pom pes tsawg zaus qhov kev thov no tshwm sim hauv txhua daim ntawv thov tswj hwm, thiab kuj kwv yees tias nws raug hu ntau npaum li cas. Nws yooj yim heev:

Lub tab muaj cov ntaub ntawv zoo sib xws Kev Pabcuam Sab Nraud, uas zais kev thov rau cov kev pabcuam HTTP sab nraud, xws li nkag mus rau cov khoom khaws cia, xa cov xwm txheej mus rau sendry, lossis lwm yam. Cov ntsiab lus ntawm tab yog kiag li zoo ib yam li Databases:

Cov neeg sib tw: lub sijhawm thiab kev xav

Tam sim no qhov nthuav tshaj plaws yog los sib piv cov peev txheej ntawm New Relic nrog rau cov neeg sib tw muab. Hmoov tsis zoo, peb tsis tuaj yeem sim tag nrho peb cov cuab yeej ntawm ib lub version ntawm ib daim ntawv thov khiav hauv kev tsim khoom. Txawm li cas los xij, peb tau sim sib piv cov xwm txheej / kev teeb tsa uas zoo ib yam li qhov ua tau.

1.Datadog

Datadog txais tos peb nrog lub vaj huam sib luag nrog phab ntsa ntawm cov kev pabcuam:

Nws sim ua txhaum cov ntawv thov rau hauv cov khoom siv / microservices, yog li hauv qhov piv txwv Django daim ntawv thov peb yuav pom 2 kev sib txuas rau PostgreSQL (defaultdb и postgres), as well as Celery, Redis. Ua haujlwm nrog Datadog xav kom koj muaj kev paub tsawg kawg ntawm MVC cov hauv paus ntsiab lus: koj yuav tsum nkag siab qhov twg cov neeg siv thov feem ntau tuaj ntawm. Qhov no feem ntau yuav pab tau daim ntawv qhia kev pabcuam:

Los ntawm txoj kev, muaj qee yam zoo sib xws hauv New Relic:

... thiab lawv daim ntawv qhia, hauv kuv lub tswv yim, yog ua kom yooj yim dua thiab pom tseeb: nws tsis tso cov khoom ntawm ib daim ntawv thov (uas yuav ua rau nws nthuav dav, xws li Datadog), tab sis tsuas yog cov kev pabcuam tshwj xeeb lossis microservices.

Cia peb rov qab mus rau Datadog: los ntawm daim ntawv qhia kev pabcuam peb tuaj yeem pom tias cov neeg siv thov tuaj rau Django. Cia peb mus rau qhov kev pabcuam Django thiab thaum kawg pom qhov peb xav tau:

Hmoov tsis zoo, tsis muaj daim duab ntawm no los ntawm lub neej ntawd Lub sijhawm ua haujlwm hauv lub vev xaib, zoo ib yam li peb pom ntawm lub ntsiab New Relic vaj huam sib luag. Txawm li cas los xij, nws tuaj yeem raug teeb tsa nyob rau hauv qhov chaw ntawm lub sijhawm % ntawm Sijhawm siv. Nws txaus los hloov nws mus Avg sij hawm ib qho kev thov los ntawm Hom... thiab tam sim no cov duab paub tab saib peb!

Vim li cas Datadog xaiv ib daim duab sib txawv yog qhov paub tsis meej rau peb. Lwm qhov kev ntxhov siab yog tias lub kaw lus tsis nco qab tus neeg siv kev xaiv (tsis zoo li ob tus neeg sib tw), thiab yog li ntawd qhov kev daws teeb meem nkaus xwb yog los tsim cov kev cai panels.

Tab sis kuv txaus siab rau qhov muaj peev xwm hauv Datadog hloov los ntawm cov duab no mus rau qhov ntsuas ntawm cov servers cuam tshuam, nyeem cov cav thiab ntsuas qhov load ntawm lub web server handlers (Gunicorn). Txhua yam yuav luag zoo ib yam li hauv New Relic... thiab txawm me ntsis ntxiv (cov ntawv teev lus)!

Hauv qab no cov duab yog kev hloov pauv zoo ib yam li New Relic:

Hauv Datadog, kev lag luam hu ua peev txheej. Koj tuaj yeem txheeb cov tswj los ntawm tus lej ntawm kev thov, los ntawm lub sijhawm teb nruab nrab, thiab los ntawm lub sijhawm siab tshaj plaws siv rau lub sijhawm xaiv.

Koj tuaj yeem nthuav cov peev txheej thiab pom txhua yam uas peb tau pom hauv New Relic:

Muaj cov txheeb cais ntawm cov peev txheej, cov npe dav dav ntawm kev hu xov tooj sab hauv, thiab cov piv txwv ntawm kev thov uas tuaj yeem txheeb xyuas los ntawm cov lus teb ... Los ntawm txoj kev, peb cov engineers nyiam qhov kev txheeb xyuas no.

Ib qho piv txwv peev txheej hauv Datadog tuaj yeem qhib thiab kawm:

Thov tsis pub dhau, daim ntawv qhia luv luv ntawm lub sijhawm siv ntawm txhua qhov sib xyaw, thiab daim ntawv qhia dej tsaws tsag uas qhia cov kab ke ntawm kev hu tau nthuav tawm. Koj tuaj yeem hloov mus rau tsob ntoo saib ntawm daim ntawv qhia dej tsaws tsag:

Thiab qhov nthuav tshaj plaws yog saib cov khoom thauj ntawm tus tswv tsev uas qhov kev thov raug tua thiab saib cov ntawv thov.

Kev koom ua ke zoo heev!

Tej zaum koj yuav xav tias cov tabs nyob qhov twg databases и Kev Pabcuam Sab Nraud, zoo li hauv New Relic. Tsis muaj ib qho ntawm no: txij li Datadog decomposes daim ntawv thov rau hauv cov khoom, PostgreSQL yuav raug txiav txim siab ib qho kev pabcuam cais, thiab hloov cov Kev Pabcuam Sab Nraud nws tsim nyog nrhiav aws.storage (nws yuav zoo ib yam rau txhua qhov kev pabcuam sab nraud uas daim ntawv thov nkag tau).

Ntawm no yog ib qho piv txwv nrog postgres:

Qhov tseem ceeb muaj txhua yam peb xav tau:

Koj tuaj yeem pom qhov "kev pabcuam" qhov kev thov tuaj ntawm.

Nws yuav tsis ua rau koj nco qab tias Datadog koom ua ke zoo kawg nkaus nrog NGINX Ingress thiab tso cai rau koj ua qhov kawg-rau-kawg tracing txij thaum lub sijhawm thov tuaj txog hauv pawg, thiab tseem tso cai rau koj kom tau txais statsd metrics, sau cov cav thiab tus tswv tsev ntsuas. .

Ib qho ntxiv ntawm Datadog yog tias nws tus nqi txhim kho los ntawm kev saib xyuas kev tsim kho vaj tse, APM, Log Management thiab Synthetics test, i.e. Koj tuaj yeem xaiv koj txoj kev npaj tau yooj yim.

2. Atatus

Pab neeg Atatus thov tias lawv cov kev pabcuam yog "zoo ib yam li New Relic, tab sis zoo dua." Cia peb saib seb qhov no puas yog tiag.

Lub vaj huam sib luag tseem ceeb zoo sib xws, tab sis nws tsis tuaj yeem txiav txim siab Redis thiab memcached siv hauv daim ntawv thov.

APM xaiv txhua qhov kev lag luam los ntawm lub neej ntawd, txawm hais tias feem ntau tsuas yog xav tau kev lag luam hauv Web. Zoo li Datadog, tsis muaj txoj hauv kev los mus rau qhov kev pabcuam xav tau los ntawm lub ntsiab vaj huam sib luag. Ntxiv mus, kev hloov pauv tau teev tseg tom qab ua yuam kev, uas tsis zoo li muaj laj thawj rau APM.

Hauv Atatus kev lag luam, txhua yam zoo ib yam li qhov ua tau rau New Relic. Lub downside yog tias qhov dynamics rau txhua tus maub los tsis pom tam sim ntawd. Koj yuav tsum nrhiav nws nyob rau hauv lub rooj tswj, sorting los ntawm Feem ntau siv sijhawm:

Cov npe ntawm cov tswj hwm ib txwm muaj nyob hauv tab tshawb:

Hauv qee txoj kev, lub rooj no yog nco txog Datadog thiab kuv nyiam nws zoo dua li qhov zoo sib xws hauv New Relic.

Koj tuaj yeem nthuav tawm txhua qhov kev sib pauv thiab pom tias daim ntawv thov tau ua dab tsi:

Lub vaj huam sib luag kuj tseem nco txog Datadog: muaj ntau qhov kev thov, daim duab dav dav ntawm kev hu. Sab saum toj vaj huam sib luag muab qhov yuam kev tab HTTP Failures thiab piv txwv ntawm cov lus nug qeeb Session Traces:

Yog tias koj mus rau qhov kev lag luam, koj tuaj yeem pom ib qho piv txwv ntawm kab, koj tuaj yeem tau txais ib daim ntawv thov rau cov ntaub ntawv thiab saib cov ntawv thov headers. Txhua yam zoo ib yam li New Relic:

Nyob rau hauv dav dav, Atatus txaus siab nrog cov ncauj lus kom ntxaws - yam tsis muaj tus tshiab Relic gluing ntawm kev hu rau hauv kev ceeb toom thaiv:

Txawm li cas los xij, nws tsis muaj lub lim dej uas (zoo li New Relic) yuav txiav tawm kev thov ceev ceev (<5ms). Ntawm qhov tod tes, kuv nyiam cov zaub ntawm cov lus teb thaum kawg (kev ua tiav lossis kev ua yuam kev).

Vaj huam sib luag databases yuav pab koj kawm cov kev thov rau cov ntaub ntawv sab nraud uas daim ntawv thov ua. Cia kuv ceeb toom rau koj tias Atatus pom tsuas yog PostgreSQL thiab MySQL, txawm hais tias Redis thiab memcached kuj koom nrog hauv qhov project.

Kev thov raug txheeb raws li cov txheej txheem ib txwm muaj: teb zaus, lub sijhawm teb nruab nrab, thiab lwm yam. Kuv kuj xav hais txog lub tab nrog cov lus nug qeeb - nws yooj yim heev. Ntxiv mus, cov ntaub ntawv nyob rau hauv no tab rau PostgreSQL coincided nrog cov ntaub ntawv los ntawm lub extension pg_statements - zoo heev tshwm sim!

Tab Kev thov sab nraud tag nrho zoo tib yam rau Databases.

tshawb pom

Ob qho kev nthuav qhia cov cuab yeej ua tau zoo hauv lub luag haujlwm ntawm APM. Ib qho ntawm lawv tuaj yeem muab qhov tsawg kawg nkaus uas xav tau. Peb cov kev xav tau tuaj yeem sau luv luv raws li hauv qab no:

datadog

Tshaj:

yooj yim tariff lub sij hawm (APM nqi 31 USD ib tug tswv tsev);
ua haujlwm zoo nrog Python;
Muaj peev xwm ntawm kev koom ua ke nrog OpenTracing
kev koom ua ke nrog Kubernetes;
kev koom ua ke nrog NGINX Ingress.

Txais:

tsuas yog APM uas ua rau daim ntawv thov ua tsis tau vim yog qhov yuam kev module (predis);
tsis muaj zog PHP auto-instrumentation;
ib feem txawv txawv txhais ntawm cov kev pab cuam thiab lawv lub hom phiaj.

Atatus