DevOps yog dab tsi

Lub ntsiab lus ntawm DevOps yog qhov nyuaj heev, yog li peb yuav tsum pib sib tham txog nws dua txhua zaus. Muaj ntau txhiab qhov kev tshaj tawm ntawm cov ncauj lus no ntawm Habre ib leeg. Tab sis yog tias koj nyeem qhov no, tej zaum koj yuav paub tias DevOps yog dab tsi. Vim kuv tsis yog. Nyob zoo kuv lub npe yog Alexander Titov (@osminog), thiab peb mam li tham txog DevOps thiab kuv mam li qhia kuv qhov kev paub.

DevOps yog dab tsi

Kuv tau xav ntev ntev txog yuav ua li cas kuv zaj dab neeg muaj txiaj ntsig, yog li yuav muaj ntau cov lus nug ntawm no - cov uas kuv nug kuv tus kheej thiab cov uas kuv nug peb cov tuam txhab cov neeg siv khoom. Los ntawm kev teb cov lus nug no, kev nkag siab zoo dua. Kuv yuav qhia koj tias vim li cas DevOps xav tau los ntawm kuv qhov kev xav, nws yog dab tsi, dua, ntawm kuv qhov kev xav, thiab yuav ua li cas nkag siab tias koj tab tom mus rau DevOps dua los ntawm kuv qhov kev xav. Cov ntsiab lus kawg yuav yog los ntawm cov lus nug. Los ntawm kev teb lawv rau koj tus kheej, koj tuaj yeem nkag siab seb koj lub tuam txhab puas tab tom mus rau DevOps lossis seb puas muaj teeb meem hauv qee txoj kev.


Muaj ib zaug kuv tau caij nthwv dej ntawm kev sib koom ua ke thiab kev yuav khoom. Ua ntej, kuv tau ua haujlwm rau kev pib me me hu ua Qik, tom qab ntawd nws tau yuav los ntawm lub tuam txhab loj me me hu ua Skype, uas tom qab ntawd tau yuav los ntawm lub tuam txhab loj me me hu ua Microsoft. Lub sijhawm ntawd, kuv pib pom tias lub tswv yim ntawm DevOps tau hloov pauv li cas hauv cov tuam txhab loj sib txawv. Tom qab ntawd, kuv tau nyiam saib DevOps los ntawm qhov kev xav ntawm kev ua lag luam, thiab kuv cov npoj yaig thiab kuv tau tsim lub tuam txhab Express 42. Rau 6 xyoo tam sim no peb tau tsiv mus raws cov nthwv dej ntawm kev ua lag luam.

Ntawm lwm yam, kuv yog ib tus neeg koom nrog DevOps Moscow zej zog thiab tus tsim ntawm DevOps-Hnub 2017, tab sis kuv tsis tau npaj 2018. Express 42 ua haujlwm nrog ntau lub tuam txhab. Peb loj hlob DevOps nyob ntawd, saib seb nws tshwm sim li cas, kos cov lus xaus, tshuaj xyuas, qhia txhua tus neeg peb cov lus xaus, thiab cob qhia tib neeg hauv DevOps kev coj ua. Feem ntau, peb ua qhov zoo tshaj plaws los ua kom peb cov kev paub dhau los thiab kev txawj ntse hauv qhov no.

Vim li cas DevOps

Thawj lo lus nug uas haunts txhua leej txhua tus thiab ib txwm yog - yog vim li cas? Ntau tus neeg xav tias DevOps tsuas yog automation lossis zoo ib yam uas txhua lub tuam txhab twb muaj lawm.

- Peb muaj Kev Sib Txuas Ntxiv - qhov no txhais tau tias peb twb muaj DevOps, thiab vim li cas txhua yam khoom no xav tau? Lawv muaj kev lom zem txawv teb chaws, tab sis lawv txwv tsis pub peb ua haujlwm!

Tshaj li 9 xyoo ntawm txoj kev loj hlob ntawm cov zej zog thiab cov txheej txheem, nws twb tau paub meej tias qhov no tseem tsis yog kev lag luam glitter, tab sis nws tseem tsis tau meej meej vim li cas nws thiaj xav tau. Zoo li txhua yam cuab yeej thiab txheej txheem, DevOps muaj cov hom phiaj tshwj xeeb uas nws qhov kawg ua tiav.

Tag nrho cov no yog vim lub fact tias lub ntiaj teb no hloov. Nws txav deb ntawm kev ua lag luam mus kom ze, thaum cov tuam txhab txav mus ncaj nraim ntawm kev npau suav, raws li peb cov St. Petersburg classic hu nkauj, los ntawm taw tes A mus rau taw tes B raws li ib tug tej yam zoo, nrog ib tug tej yam qauv tsim rau qhov no.

DevOps yog dab tsi

Hauv txoj ntsiab cai, txhua yam hauv IT yuav tsum tau ua raws li txoj hauv kev no. Ntawm no IT yog siv tshwj xeeb rau automate txheej txheem.

Automation tsis hloov ntau zaus, vim hais tias thaum lub tuam txhab poob mus rau qhov zoo-trodden rut, dab tsi yuav hloov? Nws ua haujlwm - tsis txhob kov nws. Tam sim no txoj hauv kev hauv ntiaj teb tab tom hloov pauv, thiab tus hu ua Agile qhia tias qhov kawg point B tsis pom tam sim ntawd.

DevOps yog dab tsi

Thaum lub tuam txhab dhau los ntawm kev ua lag luam, ua haujlwm nrog cov neeg siv khoom, nws niaj hnub tshawb nrhiav kev lag luam thiab hloov qhov kawg point B. Ntxiv mus, ntau lub tuam txhab hloov nws cov kev taw qhia, qhov kev vam meej yog qhov kawg, vim nws xaiv ntau lub lag luam. niches.

Lub tswv yim yog qhia los ntawm ib lub tuam txhab nthuav uas kuv nyuam qhuav kawm txog. One Box Shave yog ib qho kev xa khoom xa tuaj rau cov chais thiab shaving accessories hauv ib lub thawv. Lawv paub yuav ua li cas kho lawv "lub thawv" rau cov neeg siv khoom sib txawv. Qhov no yog ua los ntawm ib qho software, uas tom qab ntawd xa cov xaj mus rau Kauslim lub Hoobkas uas tsim cov khoom.

Cov khoom no tau yuav los ntawm Unilever rau $ 1 nphom. Tam sim no nws sib tw nrog Gillette thiab tau tshem tawm ib feem tseem ceeb ntawm cov neeg siv khoom hauv Asmeskas kev lag luam. Ib Box Shave hais tias:

β€” 4 daim? Koj puas yog tiag? Vim li cas koj xav tau qhov no - nws tsis txhim kho qhov zoo ntawm shaving. Ib qho tshwj xeeb xaiv cream, tshuaj tsw qab thiab rab chais zoo nrog ob lub ntsej muag daws teeb meem ntau dua li cov ruam 4 Gillette hniav! Peb puas yuav mus txog 10 sai sai?

Qhov no yog li cas lub ntiaj teb hloov. Unilever hais tias lawv muaj qhov txias IT system uas tso cai rau koj ua qhov no. Thaum kawg nws zoo li lub tswvyim Lub sijhawm ua lag luam, uas tsis muaj leej twg tau tham txog.

DevOps yog dab tsi

Lub ntsiab lus ntawm Sijhawm-rau-kev ua lag luam tsis yog ntau npaum li cas peb xa mus. Koj tuaj yeem siv ntau zaus, tab sis qhov kev tso tawm yuav ntev. Yog tias peb lub hlis tso tawm mus rau ib leeg, hloov lawv los ntawm ib lub lim tiam, nws hloov tawm tias lub tuam txhab zoo li yuav tsum tau xa tawm ib hlis ib zaug. Thiab los ntawm lub tswv yim mus rau qhov kawg kev siv nws yuav siv sij hawm 3 lub hlis.

Sijhawm-rau-kev ua lag luam yog hais txog kev txo lub sijhawm los ntawm lub tswv yim mus rau qhov kawg ua tiav.

Hauv qhov no, software cuam tshuam nrog kev ua lag luam. Nov yog qhov One Box Shave lub vev xaib cuam tshuam nrog tus neeg siv khoom. Lawv tsis muaj cov neeg muag khoom - tsuas yog lub vev xaib uas cov neeg tuaj saib nyem thiab tawm ntawm kev xav. Raws li, ib yam dab tsi tshiab yuav tsum tau muab tso rau hauv lub xaib tas li thiab hloov kho raws li qhov xav tau. Piv txwv li, nyob rau hauv South Kauslim lawv shaving txawv tshaj nyob rau hauv Russia, thiab lawv nyiam cov ntxhiab tsw ntawm ntoo thuv, tab sis, piv txwv li, ntawm carrots thiab vanilla.

Txij li thaum nws yog ib qho tsim nyog los hloov cov ntsiab lus ntawm lub xaib sai sai, kev txhim kho software hloov pauv zoo heev. Los ntawm software peb yuav tsum paub seb tus neeg siv khoom xav tau dab tsi. Yav dhau los, peb tau kawm qhov no los ntawm qee txoj hauv kev ncig, piv txwv li, los ntawm kev tswj hwm kev lag luam. Tom qab ntawd peb tsim nws, muab cov kev xav tau rau hauv IT system, thiab txhua yam yog txias. Tam sim no nws txawv - software yog tsim los ntawm txhua tus neeg uas koom nrog hauv cov txheej txheem, suav nrog cov kws tshaj lij, vim tias los ntawm cov kev qhia tshwj xeeb lawv kawm paub txog kev ua lag luam ua haujlwm li cas thiab tseem qhia lawv cov kev nkag siab nrog kev lag luam.

Piv txwv li, ntawm Qik peb mam li nco dheev paub tias tib neeg nyiam upload cov npe hu rau tus neeg rau zaub mov, thiab lawv muab peb daim ntawv thov. Thaum xub thawj peb tsis xav txog nws. Nyob rau hauv ib lub tuam txhab classic, txhua leej txhua tus yuav tau txiav txim siab tias qhov no yog kab laum, txij li cov spec tsis tau hais tias nws yuav tsum ua haujlwm zoo thiab feem ntau siv rau ntawm lub hauv caug, lawv yuav tau tua lub feature thiab hais tias: "Tsis muaj leej twg xav tau qhov no, Qhov tseem ceeb tshaj plaws yog qhov kev ua haujlwm tseem ceeb ua haujlwm. " Thiab lub tuam txhab thev naus laus zis pom qhov no yog lub sijhawm thiab pib hloov cov software raws li qhov no.

DevOps yog dab tsi

Xyoo 1968, ib tug txiv neej pom kev, Melvin Conway, tsim lub tswv yim hauv qab no.

Lub koom haum uas tsim cov kab ke yog txwv los ntawm tus qauv tsim uas rov ua dua lub koom haum cov qauv kev sib txuas lus.

Hauv kev nthuav dav ntxiv, txhawm rau tsim cov tshuab ntawm ntau hom sib txawv, koj yuav tsum muaj cov qauv kev sib txuas lus hauv ib lub tuam txhab ntawm ntau hom. Yog tias koj cov qauv kev sib txuas lus yog qhov saum toj-hierarchical, qhov no yuav tsis tso cai rau koj los tsim cov txheej txheem uas tuaj yeem muab qhov ntsuas lub sij hawm-rau-Market siab heev.

Nyeem hais txog Conway txoj cai tau ntawm qhov txuas. Nws yog ib qho tseem ceeb rau kev nkag siab txog DevOps kab lis kev cai lossis kev xav vim tib yam uas hloov pauv hauv DevOps yog cov qauv kev sib txuas lus ntawm pab pawg.

Los ntawm cov txheej txheem ntawm kev pom, ua ntej DevOps, txhua theem: analytics, kev loj hlob, kev sim, kev ua haujlwm, yog linear.DevOps yog dab tsi
Nyob rau hauv rooj plaub ntawm DevOps, tag nrho cov txheej txheem no tshwm sim ib txhij.

DevOps yog dab tsi

Lub sij hawm-rau-kev ua lag luam yog tib txoj kev uas nws yuav ua tau. Rau cov neeg uas ua haujlwm hauv cov txheej txheem qub, qhov no zoo li cosmic, thiab feem ntau yog li ntawd.

Yog li vim li cas koj thiaj xav tau DevOps?

Rau kev txhim kho cov khoom lag luam digital. Yog tias koj lub tuam txhab tsis muaj cov khoom lag luam digital, DevOps tsis xav tau - nws tseem ceeb heev.

DevOps overcomes cov kev txwv ceev ntawm sequential software ntau lawm. Nyob rau hauv nws tag nrho cov txheej txheem tshwm sim ib txhij.

Nyuaj nce. Thaum DevOps evangelists qhia rau koj tias nws yuav ua rau nws yooj yim dua rau koj tso software, qhov no tsis muaj tseeb.

Nrog DevOps, txhua yam tsuas yog yuav nyuaj dua.

Ntawm lub rooj sib tham ntawm Avito sawv ntsug, koj tuaj yeem pom tias nws zoo li cas rau xa Docker thawv - ib txoj haujlwm tsis muaj tseeb. Qhov nyuaj dhau los ua txwv tsis pub; koj yuav tsum juggle ntau lub npas tib lub sijhawm.

DevOps hloov tag nrho cov txheej txheem thiab lub koom haum hauv lub tuam txhab - Ntau qhov tseeb, nws tsis yog DevOps uas hloov pauv, tab sis cov khoom lag luam digital. Los rau DevOps, koj tseem yuav tsum tau hloov tag nrho cov txheej txheem no.

Cov lus nug rau tus kws tshaj lij

Koj muaj dab tsi? Cov lus nug uas koj tuaj yeem nug koj tus kheej thaum ua haujlwm hauv lub tuam txhab thiab txhim kho raws li tus kws tshaj lij.

Koj puas muaj lub tswv yim los tsim cov khoom lag luam digital? Yog tias muaj, qhov ntawd yog qhov zoo. Qhov no txhais tau tias koj lub tuam txhab tab tom mus rau DevOps.

Puas yog koj lub tuam txhab twb tsim cov khoom lag luam digital? Qhov no txhais tau hais tias koj tuaj yeem nce qib siab dua thiab ua tej yam zoo dua - dua los ntawm DevOps qhov kev pom. Kuv tsuas hais los ntawm qhov kev xav no xwb.

Puas yog koj lub tuam txhab yog ib tus thawj coj ua lag luam hauv cov khoom lag luam digital? Spotify, Yandex, Uber yog cov tuam txhab uas nyob rau lub ncov ntawm kev vam meej technology tam sim no.

Nug koj tus kheej cov lus nug no, thiab yog tias tag nrho cov lus teb tsis yog, tej zaum koj yuav tsum tsis txhob ua DevOps ntawm lub tuam txhab no. Yog tias lub ntsiab lus ntawm DevOps yog qhov txaus siab rau koj, tej zaum ... koj yuav tsum tsiv mus rau lwm lub tuam txhab? Yog tias koj lub tuam txhab xav mus rau hauv DevOps, tab sis koj teb tias "Tsis yog" rau tag nrho cov lus nug, ces nws zoo li lub rhinoceros zoo nkauj uas yuav tsis hloov.

DevOps yog dab tsi

lub koom haum

Raws li kuv tau hais, raws li Conway Txoj Cai, lub koom haum ntawm lub tuam txhab hloov pauv. Kuv yuav pib nrog dab tsi tiv thaiv DevOps los ntawm kev nkag mus rau hauv lub tuam txhab los ntawm lub koom haum qhov kev pom.

Qhov teeb meem ntawm "qhov dej"

Lo lus Askiv "Silo" yog txhais ntawm no ua lus Lavxias li "zoo". Lub ntsiab lus ntawm qhov teeb meem no yog qhov ntawd tsis muaj kev sib pauv ntaub ntawv ntawm pab pawg. Txhua pab neeg nkag mus tob rau hauv nws cov kev txawj ntse, yam tsis tau tsim ib daim ntawv qhia dav dav rau kev taw qhia.

Nyob rau hauv qee txoj kev, qhov no ua rau kuv nco txog ib tug neeg uas nyuam qhuav tuaj txog hauv Moscow thiab tseem tsis tau paub yuav ua li cas mus rau hauv daim ntawv qhia metro. Muscovites feem ntau paub lawv thaj chaw zoo heev, thiab thoob plaws Moscow lawv tuaj yeem taug kev siv daim ntawv qhia metro. Thaum koj tuaj rau Moscow thawj zaug, koj tsis muaj txuj ci no, thiab koj tsuas yog disoriented.

DevOps qhia kom dhau los ntawm lub sijhawm no ntawm kev tsis sib haum xeeb thiab txhua lub koom haum ua haujlwm ua ke los tsim ib daim ntawv qhia kev sib raug zoo.

Ob yam cuam tshuam qhov no.

Qhov tshwm sim ntawm kev tswj hwm kev lag luam. Nws yog tsim nyob rau hauv nyias hierarchical "qhov dej". Piv txwv li, muaj qee qhov KPIs hauv cov tuam txhab uas txhawb nqa qhov system no. Ntawm qhov tod tes, lub hlwb ntawm tus neeg uas pom tias nws nyuaj rau mus dhau ntawm cov ciam teb ntawm lawv cov kev txawj ntse thiab taw qhia tag nrho cov txheej txheem tau txais txoj hauv kev. Nws tsuas yog tsis xis nyob xwb. Xav txog tias koj nyob ntawm tshav dav hlau Bangkok - koj yuav tsis pom koj txoj hauv kev sai. DevOps kuj nyuaj rau kev taw qhia, thiab yog vim li cas tib neeg hais tias koj yuav tsum nrhiav kev qhia kom mus txog qhov ntawd.

Tab sis qhov tseem ceeb tshaj plaws yog qhov teeb meem ntawm "qhov dej" rau ib tus kws ua haujlwm uas raug kev txom nyem nrog tus ntsuj plig ntawm DevOps, tau nyeem Fowler thiab ib pawg ntawm lwm phau ntawv, tau qhia hauv qhov tseeb tias. "qhov dej" tsis tso cai rau koj ua "pom tseeb" yam. Peb feem ntau tau ua ke tom qab DevOps Moscow, sib tham, thiab tib neeg yws:

- Peb tsuas yog xav tso tawm CI, tab sis nws tau pom tias kev tswj hwm tsis xav tau.

Qhov no tshwm sim precisely vim CI ΠΈ Kev xa khoom tsis tu ncua yog nyob rau ciam teb ntawm ntau qhov kev xeem. Tsuas yog tsis muaj kev kov yeej qhov teeb meem ntawm "qhov dej" ntawm lub koom haum, koj yuav tsis tuaj yeem mus tom ntej, txawm koj ua dab tsi thiab txawm tias nws yuav tu siab npaum li cas.

DevOps yog dab tsi

Txhua tus neeg koom nrog hauv cov txheej txheem hauv lub tuam txhab: backend thiab frontend developers, kuaj, DBA, kev ua haujlwm, network, khawb hauv lawv tus kheej cov kev taw qhia, thiab tsis muaj leej twg muaj ib daim duab qhia tshwj tsis yog tus thawj tswj hwm, leej twg saib xyuas lawv thiab tswj lawv siv "sib faib thiab kov yeej” txoj kev.

Tib neeg tab tom tawm tsam rau qee lub hnub qub lossis chij, txhua tus tab tom khawb lawv cov kev txawj ntse.

Yog li ntawd, thaum txoj hauj lwm tshwm sim ntawm kev sib txuas tag nrho cov no ua ke thiab tsim ib qho kev sib txuas, thiab tsis tas yuav muaj kev sib ntaus rau hnub qub thiab chij, cov lus nug tshwm sim - yuav ua li cas ntxiv? Peb yuav tsum tau ua raws li kev pom zoo, tab sis tsis muaj leej twg qhia peb yuav ua li cas hauv tsev kawm ntawv. Peb tau qhia txij thaum kawm ntawv: qib yim - wow! - piv rau qib xya! Nws zoo ib yam ntawm no.

Puas yog tib yam hauv koj lub tuam txhab?

Txhawm rau kuaj xyuas qhov no, koj tuaj yeem nug koj tus kheej cov lus nug hauv qab no.

Cov pab pawg puas siv cov cuab yeej sib xws thiab pab hloov pauv rau cov cuab yeej siv no?

Yuav ua li cas pab pawg rov txhim kho-qee cov kws tshaj lij los ntawm ib pab pawg txav mus rau lwm pab pawg? Nws yog nyob rau hauv ib puag ncig DevOps uas qhov no dhau los ua ib txwm muaj, vim tias qee zaum ib tus neeg tsis tuaj yeem nkag siab tias lwm qhov kev txawj ntse ua dab tsi. Nws tsiv mus rau lwm lub tuam tsev, ua haujlwm rau ob lub lis piam los tsim nws tus kheej ib daim ntawv qhia kev taw qhia thiab kev cuam tshuam nrog lub tuam tsev no.

Puas muaj peev xwm tsim ib pawg neeg hloov pauv thiab hloov khoom? Los yog nws puas yuav tsum tau muaj zog txhais tes ntawm kev tswj hwm thiab kev coj ua siab tshaj? Tsis ntev los no kuv tau sau rau hauv Facebook li cas ib lub txhab nyiaj me me tau siv cov cuab yeej los ntawm kev xaj: peb sau ib qho kev txiav txim, peb siv nws rau ib xyoos, thiab pom tias muaj dab tsi tshwm sim. Qhov no, ntawm chav kawm, yog ntev thiab tu siab.

Nws tseem ceeb npaum li cas rau cov thawj coj kom tau txais kev ua tiav ntawm tus kheej yam tsis xav txog lub tuam txhab kev ua tiav?

Yog tias koj teb cov lus nug no rau koj tus kheej, nws yuav pom tseeb dua seb koj puas muaj teeb meem zoo li no hauv koj lub tuam txhab.

Infrastructure li code

Tom qab qhov teeb meem no dhau lawm, thawj qhov kev coj ua tseem ceeb, yam tsis muaj qhov nyuaj rau kev nce qib ntxiv hauv DevOps, yog infrastructure li code.

Feem ntau, kev tsim kho vaj tse raws li cov cai tau pom raws li hauv qab no:

- Cia automate txhua yam hauv bash, npog peb tus kheej nrog cov ntawv sau kom cov neeg ua haujlwm tsis muaj phau ntawv ua haujlwm!

Tab sis qhov ntawd tsis muaj tseeb.

Infrastructure li code txhais tau hais tias koj piav qhia txog IT system koj ua haujlwm nrog rau hauv daim ntawv code txhawm rau txhawm rau nkag siab nws lub xeev tas li.

Ua ke nrog lwm pab pawg, koj tsim ib daim ntawv qhia hauv daim ntawv code uas txhua tus tuaj yeem nkag siab thiab tuaj yeem taug kev thiab taug kev. Nws tsis muaj teeb meem dab tsi nws tau ua rau - Kws ua zaub mov, Ansible, ntsev, lossis siv YAML cov ntaub ntawv hauv Kubernetes - tsis muaj qhov sib txawv.

Ntawm lub rooj sib tham, ib tug npoj yaig los ntawm 2GIS tau hais tias lawv tau ua lawv tus kheej li cas rau Kubernetes, uas piav qhia txog cov qauv ntawm tus kheej. Los piav txog 500 lub tshuab, lawv xav tau ib lub cuab yeej cais uas tsim cov lus piav qhia no. Thaum muaj cov lus piav qhia no, txhua tus tuaj yeem tshawb xyuas nrog ib leeg, saib xyuas cov kev hloov pauv, yuav hloov li cas thiab txhim kho nws, dab tsi ploj.

Pom zoo, tus kheej bash scripts feem ntau tsis muab qhov kev nkag siab no. Hauv ib lub tuam txhab uas kuv ua haujlwm, txawm tias muaj lub npe "sau nkaus xwb" tsab ntawv - thaum sau ntawv, tab sis nws tsis tuaj yeem nyeem nws. Kuv xav tias qhov no yeej paub koj thiab.

Infrastructure li code yog code uas piav txog lub xeev tam sim no ntawm cov infrastructure. Ntau yam khoom, kev tsim kho vaj tse, thiab pab pawg ua haujlwm ua haujlwm ua ke ntawm cov cai no, thiab qhov tseem ceeb tshaj plaws, lawv txhua tus yuav tsum nkag siab tias txoj cai no ua haujlwm li cas.

Txoj cai tswj hwm raws li kev coj ua zoo tshaj plaws: kev txhim kho kev sib koom ua ke, kev tshuaj xyuas cov lej, XP-kev ua haujlwm, kev sim, rub cov lus thov, CI rau cov qauv tsim qauv - txhua qhov no tsim nyog thiab siv tau.

Code dhau los ua ib hom lus rau txhua tus engineers.

Hloov cov txheej txheem hauv cov lej tsis siv sijhawm ntau. Yog lawm, infrastructure code kuj tuaj yeem muaj nuj nqis technical. Feem ntau cov pab pawg ntsib nws ib xyoos thiab ib nrab tom qab lawv pib siv "infrastructure li code" nyob rau hauv daim ntawv ntawm ib pawg ntawm cov ntawv los yog txawm Ansible, uas lawv sau zoo li spaghetti code, thiab lawv kuj muab bash scripts rau hauv mix!

ib qho tseem ceeb: Yog tias koj tseem tsis tau sim cov khoom no, nco ntsoov qhov ntawd Ansible tsis yog bash! Nyeem cov ntaub ntawv kom zoo, kawm seb lawv sau dab tsi txog nws.

Infrastructure li code yog kev sib cais ntawm infrastructure code rau hauv nyias txheej.

Hauv peb lub tuam txhab, peb paub qhov txawv ntawm 3 cov txheej txheem yooj yim, uas yog qhov tseeb thiab yooj yim, tab sis yuav muaj ntau dua. Koj tuaj yeem saib koj cov cai hauv vaj tse thiab qhia seb koj puas muaj tus mob no lossis tsis yog. Yog tias tsis muaj cov khaubncaws sab nraud povtseg, ces koj yuav tsum tau siv sijhawm ntev thiab refactor me ntsis.
DevOps yog dab tsi

puag txheej - qhov no yog li cas OS, thaub qab thiab lwm yam khoom qis tau teeb tsa, piv txwv li, yuav ua li cas Kubernetes tau xa mus rau theem pib.

Qib kev pabcuam - Cov no yog cov kev pabcuam uas koj muab rau tus tsim tawm: nkag mus ua ib qho kev pabcuam, saib xyuas raws li kev pabcuam, database raws li kev pabcuam, kev sib npaug li kev pabcuam, kev pabcuam raws li kev pabcuam, Kev xa tawm tsis tu ncua raws li kev pabcuam - ib pawg ntawm cov kev pabcuam uas ib pab pawg tuaj yeem muab rau kev txhim kho. Qhov no txhua yam yuav tsum tau piav qhia nyob rau hauv nyias modules nyob rau hauv koj configuration tswj system.

Lub txheej uas cov ntawv thov raug tsim thiab piav qhia txog yuav ua li cas lawv yuav nthuav tawm saum toj ntawm ob txheej dhau los.

Tswj cov lus nug

Koj lub tuam txhab puas muaj cov chaw khaws ntaub ntawv hauv vaj tse? Puas yog koj tswj hwm cov nuj nqis technical hauv koj cov infrastructure? Koj puas siv cov kev coj ua hauv kev txhim kho hauv qhov chaw cia khoom hauv tsev? Puas yog koj cov infrastructure hlais rau hauv cov khaubncaws sab nraud povtseg? Koj tuaj yeem tshawb xyuas daim duab Base-service-APP. Nws nyuaj npaum li cas los hloov?

Yog tias koj tau ntsib tias nws tau siv ib hnub thiab ib nrab los hloov pauv, qhov no txhais tau tias koj muaj nuj nqis technical thiab yuav tsum tau ua haujlwm nrog nws. Koj nyuam qhuav stumbled raws li ib tug technical nuj nqis rake nyob rau hauv koj infrastructure code. Kuv nco qab ntau cov dab neeg zoo li no thaum, txhawm rau hloov qee qhov CCTL, koj yuav tsum rov sau ib nrab ntawm cov txheej txheem kev tsim kho, vim tias kev muaj tswv yim thiab kev xav ua kom txhua yam ua rau lub fact tias txhua yam yog corroded nyob txhua qhov chaw, tag nrho cov tuav tau raug tshem tawm, thiab nws yog tsim nyog rau refactor.

Kev xa khoom tsis tu ncua

Cia peb piv cov debit nrog credit. Ua ntej los ntawm kev piav qhia ntawm cov infrastructure, uas tuaj yeem yooj yim heev. Koj tsis tas yuav piav txhua yam kom ntxaws, tab sis qee qhov kev piav qhia yooj yim yuav tsum tau ua kom koj tuaj yeem ua haujlwm nrog nws. Txwv tsis pub, nws tsis paub meej tias yuav ua li cas nrog kev xa khoom tas mus li tom ntej. Tag nrho cov kev coj ua no nthuav tawm ib txhij thaum koj tuaj rau DevOps, tab sis nws pib nrog kev nkag siab tias koj muaj dab tsi thiab yuav tswj nws li cas. Qhov no yog precisely kev xyaum ntawm infrastructure li code.

Thaum nws paub meej tias koj muaj nws thiab yuav ua li cas tswj nws, koj pib paub yuav ua li cas xa tus tsim tawm code rau ntau lawm sai li sai tau. Kuv txhais tau tias ua ke nrog tus tsim tawm - peb nco ntsoov txog qhov teeb meem ntawm "qhov dej", uas yog, nws tsis yog ib tus neeg uas tuaj nrog qhov no, tab sis ib pab neeg.

Thaum peb nrog Vanya Evtukhovich pom thawj phau ntawv Jez Humble thiab pawg kws sau ntawv "Kev xa khoom tsis tu ncua", uas tau tso tawm xyoo 2009, peb tau xav ntev ntev txog kev txhais nws lub npe rau hauv Lavxias. Lawv xav txhais nws li "Kev xa khoom tas mus li", tab sis, hmoov tsis, nws tau muab txhais ua "Kev xa mus tas li". Zoo li kuv hais tias muaj ib yam dab tsi Lavxias teb sab nyob rau hauv peb lub npe, nrog rau siab.

Tsis tu ncua muab txhais tau tias

Code uas nyob rau hauv cov khoom repository yeej ib txwm muab downloaded rau ntau lawm. Tej zaum nws yuav tsis deflated, tab sis nws yeej ib txwm npaj rau nws. Raws li, koj ib txwm sau cov lej nrog qhov nyuaj piav qhia ntawm qee qhov kev ntxhov siab nyob hauv koj lub pob txha. Nws feem ntau tshwm thaum koj dov tawm infrastructure code. Qhov kev xav ntawm qee qhov kev ntxhov siab no yuav tsum muaj - nws ua rau cov txheej txheem hauv hlwb uas tso cai rau koj sau cov lej sib txawv me ntsis. Qhov no yuav tsum tau sau tseg hauv cov cai hauv kev txhim kho.

Txhawm rau xa tawm tsis tu ncua, koj xav tau cov khoom cuav uas khiav thoob plaws lub platform platform. Yog tias koj pov "lub neej pov tseg" ntawm cov qauv sib txawv thoob plaws lub hauv paus txheej txheem, tom qab ntawd nws dhau los ua kev sib koom ua ke, nws nyuaj rau kev tswj hwm, thiab teeb meem ntawm cov nuj nqis technical tshwm sim. Cov qauv ntawm cov khoom cuav yuav tsum tau ua kom haum - qhov no kuj yog ib qho kev sib koom ua ke: peb txhua tus yuav tsum tau ua ke, rustle peb lub hlwb thiab tuaj nrog hom ntawv no.

Cov khoom qub tau raug txhim kho tas li thiab hloov pauv kom haum rau qhov chaw tsim khoom thaum nws txav mus los ntawm kev xa cov raj xa dej. Thaum cov khoom cuav txav mus los ntawm cov raj xa dej, nws niaj hnub ntsib qee yam tsis yooj yim rau nws, uas zoo ib yam li cov khoom cuav uas koj muab tso rau hauv kev sib ntsib. Yog hais tias nyob rau hauv classical txoj kev loj hlob no yog ua los ntawm ib tug system tus thawj coj uas ua lub rollout, ces nyob rau hauv cov txheej txheem DevOps qhov no tshwm sim txhua lub sij hawm: ntawm no lawv sim nws nrog ib co kev ntsuam xyuas, ntawm no lawv muab pov rau hauv lub Kubernetes pawg, uas yog ntau dua los yog tsawg zoo sib xws. mus rau ntau lawm, ces mam li nco dheev lawv pib load xeem.

Qhov no yog me ntsis reminiscent ntawm Pac-Man game - lub artifact mus los ntawm qee yam ntawm zaj dab neeg. Nyob rau tib lub sijhawm, nws yog ib qho tseem ceeb uas yuav tsum tswj xyuas seb cov cai puas tau dhau los ntawm zaj dab neeg thiab seb nws puas muaj feem cuam tshuam rau koj cov khoom. Cov dab neeg los ntawm kev tsim khoom tuaj yeem raug rub mus rau hauv Cov Txheej Txheem Kev Xa Mus Ntxiv: nws zoo li qhov no thaum muaj qee yam poob, tam sim no cia peb tsuas yog program qhov xwm txheej hauv lub system. Txhua zaus tus lej yuav dhau los ntawm qhov xwm txheej no, thiab koj yuav tsis ntsib qhov teeb meem no ntxiv rau lwm zaus. Koj yuav kawm txog nws ua ntej nws mus txog koj cov neeg siv khoom.

Txawv cov tswv yim xa tawm. Piv txwv li, koj siv AB xeem lossis canary deployments los ntsuam xyuas cov cai sib txawv ntawm cov neeg sib txawv, tau txais cov ntaub ntawv hais txog yuav ua li cas code ua hauj lwm, thiab ntau npaum li cas ntxov tshaj thaum nws yog dov tawm mus rau 100 lab cov neeg siv.

"Kev xa khoom tsis tu ncua" zoo li qhov no.

DevOps yog dab tsi

Cov txheej txheem xa khoom Dev, CI, Test, PreProd, Prod tsis yog ib puag ncig ib puag ncig, cov no yog theem lossis chaw nres tsheb nrog cov nyiaj hluav taws xob uas koj cov khoom pov thawj dhau.

Yog tias koj muaj cov txheej txheem kev tsim kho uas tau piav qhia tias Base Service APP ces nws yuav pab tau tsis txhob hnov ​​qab tag nrho cov scripts, thiab sau lawv li code rau cov khoom cuav no, txhawb artifact thiab hloov nws thaum koj mus.

Cov lus nug ntawm tus kheej

Lub sijhawm los ntawm cov lus piav qhia txog kev tso tawm rau hauv kev tsim khoom hauv 95% ntawm cov neeg mob tsawg dua ib lub lis piam? Puas yog qhov zoo ntawm cov khoom cuav txhim kho ntawm txhua theem ntawm cov kav dej? Puas muaj zaj dab neeg uas nws dhau mus? Koj puas siv cov tswv yim sib txawv?

Yog hais tias tag nrho cov lus teb yog, ces koj yog incredibly txias! Sau koj cov lus teb hauv cov lus - Kuv yuav zoo siab).

Tswv yim

Qhov no yog qhov kev xyaum nyuaj tshaj plaws ntawm txhua tus. Ntawm lub rooj sib tham DevOpsConf, ib tug npoj yaig los ntawm Infobip, tham txog nws, tsis meej pem me ntsis ntawm nws cov lus, vim tias qhov no yog qhov kev coj ua nyuaj heev txog qhov tseeb tias koj yuav tsum tau saib xyuas txhua yam!

DevOps yog dab tsi

Piv txwv li, ntev dhau los, thaum kuv ua haujlwm ntawm Qik thiab peb pom tau tias peb yuav tsum tau saib xyuas txhua yam. Peb tau ua qhov no, thiab tam sim no peb muaj 150 yam khoom hauv Zabbix, uas tau saib xyuas tas li. Nws yog ib qho txaus ntshai, tus thawj coj tau muab nws tus ntiv tes rau ntawm nws lub tuam tsev:

- Cov txiv neej, vim li cas koj raping server nrog tej yam tsis meej?

Tab sis tom qab ntawd muaj qhov xwm txheej tshwm sim uas pom tau tias qhov no yog lub tswv yim zoo heev.

Ib qho ntawm cov kev pabcuam pib poob tas li. Thaum xub thawj, nws tsis poob, uas yog qhov nthuav, cov lej tsis tau ntxiv rau qhov ntawd, vim tias nws yog tus broker yooj yim, uas tau xyaum tsis muaj kev ua lag luam - nws tsuas yog xa cov lus ntawm ib tus neeg pabcuam. Cov kev pabcuam tsis hloov pauv rau 4 lub hlis, thiab tam sim ntawd nws pib tsoo nrog "Segmentation fault" yuam kev.

Peb xav tsis thoob, qhib peb cov kab kos hauv Zabbix, thiab nws tau pom tias ib lub lim tiam thiab ib nrab dhau los, tus cwj pwm ntawm kev thov hauv API qhov kev pabcuam uas tus broker no siv tau hloov pauv ntau. Tom ntej no peb pom tias qhov zaus ntawm kev xa ib hom lus tau hloov pauv. Tom qab ntawd peb pom tias cov no yog cov neeg siv khoom hauv Android. Peb nug:

- Cov txiv neej, ua li cas rau koj ib lub lim tiam thiab ib nrab dhau los?

Hauv kev teb, peb tau hnov ​​​​ib zaj dab neeg nthuav txog yuav ua li cas lawv tau rov tsim kho UI. Nws tsis zoo li leej twg yuav hais tam sim ntawd tias lawv hloov lub tsev qiv ntawv HTTP. Rau cov neeg siv khoom hauv Android, nws zoo li hloov xab npum hauv chav dej - lawv tsuas yog tsis nco qab. Yog li ntawd, tom qab 40 feeb ntawm kev sib tham, peb pom tias lawv tau hloov lub tsev qiv ntawv HTTP, thiab nws lub sijhawm ua haujlwm tau hloov pauv. Qhov no tau ua rau kev coj tus cwj pwm ntawm API server hloov pauv, uas ua rau muaj qhov xwm txheej uas ua rau muaj kev sib tw hauv tus broker, thiab nws pib tsoo.

Yog tsis muaj kev soj ntsuam tob nws feem ntau tsis tuaj yeem qhib qhov no. Yog tias lub koom haum tseem muaj teeb meem ntawm "qhov dej", thaum sawv daws cuam tshuam nyiaj rau ib leeg, qhov no tuaj yeem nyob tau ntau xyoo. Koj tsuas yog rov pib dua lub server vim nws tsis tuaj yeem daws qhov teeb meem. Thaum koj saib xyuas, taug qab, taug qab txhua yam xwm txheej uas koj muaj, thiab siv kev soj ntsuam raws li kev sim - sau cov lej thiab tam sim ntawd qhia yuav ua li cas saib xyuas nws, kuj nyob rau hauv daim ntawv code (peb twb muaj cov txheej txheem raws li code), txhua yam yuav paub meej li cas. ntawm xib teg. Txawm tias tej teeb meem nyuaj no yooj yim taug qab.

DevOps yog dab tsi

Sau tag nrho cov ntaub ntawv hais txog dab tsi tshwm sim rau cov khoom qub ntawm txhua theem ntawm kev xa khoom - tsis yog hauv kev tsim khoom.

Rub tawm qhov kev soj ntsuam mus rau CI, thiab qee yam tseem ceeb yuav pom nyob rau ntawd. Tom qab ntawd koj yuav pom lawv nyob rau hauv Test, PredProd, thiab load testing. Sau cov ntaub ntawv nyob rau hauv txhua theem, tsis tsuas yog metrics, txheeb cais, tab sis kuj teev: yuav ua li cas daim ntawv thov dov tawm, anomalies - sau txhua yam.

Txwv tsis pub nws yuav nyuaj rau kev txiav txim siab. Kuv twb tau hais tias DevOps yog qhov nyuaj dua. Txhawm rau tiv nrog qhov nyuaj no, koj yuav tsum muaj kev tshuaj ntsuam ib txwm.

Cov lus nug rau kev tswj tus kheej

Puas yog koj qhov kev saib xyuas thiab txiav txim siab cov cuab yeej tsim kho rau koj? Thaum sau cov lej, koj cov neeg tsim khoom puas, suav nrog koj, xav txog yuav saib xyuas nws li cas?

Koj puas hnov ​​​​txog teeb meem los ntawm cov neeg siv khoom? Koj puas nkag siab tus neeg siv khoom zoo dua los ntawm kev saib xyuas thiab txiav tawm? Koj puas nkag siab txog qhov system zoo dua los ntawm kev saib xyuas thiab sau npe? Koj puas hloov lub kaw lus tsuas yog vim koj pom tias qhov sib txawv hauv qhov system loj hlob thiab koj nkag siab tias lwm 3 lub lis piam txhua yam yuav tuag?

Thaum koj muaj peb lub ntsiab lus no, koj tuaj yeem xav txog hom kev tsim kho vaj tse uas koj muaj hauv koj lub tuam txhab.

Infrastructure platform

Lub ntsiab lus tsis yog tias nws yog ib txheej ntawm cov cuab yeej sib txawv uas txhua lub tuam txhab muaj.

Lub ntsiab lus ntawm lub hauv paus txheej txheem yog tias txhua pab pawg siv cov cuab yeej no thiab txhim kho lawv ua ke.

Nws yog qhov tseeb tias muaj cov pab pawg sib cais uas yog lub luag haujlwm rau kev txhim kho ntawm tus kheej cov khoom ntawm lub platform platform. Tab sis tib lub sij hawm, txhua tus engineer dais lub luag haujlwm rau kev txhim kho, kev ua tau zoo, thiab kev txhawb nqa ntawm lub platform platform. Nyob rau theem sab hauv nws dhau los ua ib qho cuab yeej siv.

Txhua pab pawg tsim cov txheej txheem tsim kho thiab kho nws nrog kev saib xyuas raws li lawv tus kheej IDE. Hauv koj lub IDE koj nruab cov plugins sib txawv los ua kom txhua yam zoo thiab nrawm, thiab teeb tsa hotkeys. Thaum koj qhib Sublime, Atom lossis Visual Studio Code, cov cai yuam kev yog nchuav rau hauv thiab koj paub tias nws tsis tuaj yeem ua haujlwm txhua, koj tu siab tam sim ntawd thiab koj khiav los kho koj IDE.

Kho koj lub platform infrastructure tib yam nkaus. Yog tias koj nkag siab tias muaj ib yam dab tsi tsis ncaj ncees lawm, tawm hauv qhov kev thov yog tias koj kho tsis tau koj tus kheej. Yog tias muaj qee yam yooj yim, kho nws tus kheej, xa daim ntawv thov rub, cov txiv neej yuav xav txog nws thiab ntxiv nws. Qhov no yog ib qho txawv me ntsis rau cov cuab yeej engineering hauv tus tsim tawm lub taub hau.

Lub infrastructure platform ua kom cov kev hloov ntawm artifact los ntawm txoj kev loj hlob mus rau tus neeg siv nrog tas li txhim kho nyob rau hauv zoo. IP yog programmed nrog ib txheej dab neeg uas tshwm sim rau cov cai hauv kev tsim khoom. Tau ntau xyoo ntawm kev txhim kho, muaj ntau cov dab neeg no, qee qhov tshwj xeeb thiab cuam tshuam rau koj nkaus xwb - lawv tsis tuaj yeem ua Googled.

Nyob rau ntawm no, lub infrastructure platform dhau los ua koj qhov kev sib tw kom zoo dua, vim hais tias nws muaj ib yam dab tsi ua rau nws uas tsis yog nyob rau hauv tus neeg sib tw cov cuab yeej. Qhov tob dua koj tus IP, qhov ntau dua koj qhov kev sib tw kom zoo dua ntawm Lub Sijhawm-rau-kev ua lag luam. tshwm ntawm no tus neeg muag khoom xauv qhov teeb meem: Koj tuaj yeem coj lwm tus lub platform, tab sis siv lwm tus kev paub dhau los, koj yuav tsis nkag siab tias nws cuam tshuam rau koj li cas. Yog lawm, tsis yog txhua lub tuam txhab tuaj yeem tsim lub platform zoo li Amazon. Qhov no yog ib txoj kab nyuaj uas lub tuam txhab kev paub dhau los cuam tshuam rau nws txoj haujlwm hauv kev ua lag luam, thiab koj tsis tuaj yeem siv tus neeg muag khoom kaw rau ntawd. Qhov no kuj tseem ceeb heev uas yuav tau xav txog.

Lub tswv yim

Nov yog daim duab qhia txog kev tsim kho vaj tse uas yuav pab koj teeb tsa txhua qhov kev coj ua thiab cov txheej txheem hauv DevOps tuam txhab.

DevOps yog dab tsi

Cia peb saib seb nws muaj dab tsi.

Resource orchestration system, uas muab CPU, nco, disk rau cov ntawv thov thiab lwm yam kev pabcuam. Nyob rau ntawm no - cov kev pabcuam qis: saib xyuas, txiav, CI/CD Cav, artifact storage, infrastructure as system code.

Cov kev pabcuam siab dua: database as a service, queues as a service, Load Balance as a service, duab resizing as a service, Big Data factory as a service. Nyob rau ntawm no - pipeline uas xa tas li hloov code rau koj cov neeg siv khoom.

Koj tau txais cov ntaub ntawv hais txog yuav ua li cas koj cov software ua haujlwm rau cov neeg siv khoom, hloov nws, muab cov cai no dua, tau txais cov ntaub ntawv - thiab yog li koj niaj hnub tsim ob qho tib si infrastructure thiab koj software.

Hauv daim duab, lub raj xa dej muaj ntau theem. Tab sis qhov no yog daim duab schematic uas tau muab ua piv txwv - tsis tas yuav rov ua dua ib qho los ntawm ib qho. Cov theem sib cuam tshuam nrog cov kev pabcuam zoo li lawv yog cov kev pabcuam - txhua lub cib ntawm lub platform nqa nws tus kheej zaj dab neeg: yuav ua li cas cov peev txheej tau faib, yuav ua li cas daim ntawv thov raug tso tawm, ua haujlwm nrog cov peev txheej, raug saib xyuas, thiab hloov pauv.

Nws yog ib qho tseem ceeb kom nkag siab tias txhua feem ntawm lub platform nqa ib zaj dab neeg, thiab nug koj tus kheej seb dab neeg li cas lub cib nqa no, tej zaum nws yuav tsum tau muab pov tseg thiab hloov nrog kev pabcuam thib peb. Piv txwv li, nws puas tuaj yeem nruab Okmeter hloov lub cib? Tej zaum cov txiv neej twb tau tsim qhov kev txawj ntse no ntau dua li peb muaj. Tab sis tej zaum tsis yog - tej zaum peb muaj kev txawj ntse tshwj xeeb, peb yuav tsum tau nruab Prometheus thiab txhim kho nws ntxiv.

Tsim lub platform

Qhov no yog txheej txheem kev sib txuas lus nyuaj. Thaum koj muaj cov kev coj ua yooj yim, koj pib sib txuas lus ntawm cov engineers sib txawv thiab cov kws tshaj lij uas tsim cov kev cai thiab cov qauv, thiab hloov pauv mus tas li rau cov cuab yeej sib txawv thiab cov txheej txheem. Cov kab lis kev cai uas peb muaj hauv DevOps yog qhov tseem ceeb ntawm no.

DevOps yog dab tsi
Nrog kab lis kev cai txhua yam yog yooj yim heev - nws yog hais txog kev sib koom tes thiab kev sib txuas lus, uas yog, lub siab xav ua hauj lwm nyob rau hauv ib qho chaw ua hauj lwm nrog ib leeg, lub siab xav wield ib tug instrument ua ke. Tsis muaj foob pob hluav taws science ntawm no - txhua yam yog yooj yim heev, banal. Piv txwv li, peb txhua tus nyob hauv qhov nkag thiab ua kom huv si - xws li ib theem ntawm kab lis kev cai.

Koj muaj dab tsi?

Ntxiv dua thiab, cov lus nug koj tuaj yeem nug koj tus kheej.

Puas yog lub tuam txhab tsim kho vaj tse tshwj xeeb? Leej twg yog tus lav ris rau nws txoj kev loj hlob? Koj puas nkag siab qhov kev sib tw zoo ntawm koj lub platform platform?

Koj yuav tsum nug koj tus kheej cov lus nug no tas li. Yog tias ib yam dab tsi tuaj yeem hloov mus rau cov kev pabcuam thib peb, nws yuav tsum raug xa mus; yog tias qhov kev pabcuam thib peb pib los thaiv koj txoj kev txav mus los, koj yuav tsum tsim kom muaj lub kaw lus hauv koj tus kheej.

Yog li, DevOps ...

... Qhov no yog ib tug complex system, nws yuav tsum muaj:

  • Cov khoom siv digital.
  • Cov lag luam modules uas tsim cov khoom digital no.
  • Pawg khoom uas sau cov cai.
  • Kev coj ua tsis tu ncua.
  • Platforms raws li kev pabcuam.
  • Infrastructure ua ib qho kev pabcuam.
  • Infrastructure li code.
  • Cais cov kev coj ua kom muaj kev ntseeg siab, ua rau DevOps.
  • Ib qho kev tawm tswv yim uas piav qhia txhua yam.

DevOps yog dab tsi

Koj tuaj yeem siv daim duab qhia no, qhia txog qhov koj twb muaj nyob hauv koj lub tuam txhab hauv qee daim ntawv: nws puas tau tsim lossis tseem xav tau tsim.

Nws yuav dhau ob peb lub lis piam DevOpsConf 2019. raws li ib feem ntawm RIT ++. Tuaj rau lub rooj sib tham, qhov chaw koj yuav pom ntau cov lus ceeb toom txog kev xa khoom tas mus li, kev tsim kho vaj tse raws li cov cai thiab DevOps kev hloov pauv. Book koj daim pib, Hnub kawg ntawm tus nqi yog lub Tsib Hlis 20

Tau qhov twg los: www.hab.com

Ntxiv ib saib