Kunamakhulu ezindatshana ku-inthanethi mayelana nezinzuzo zokuhlaziya ukuziphatha kwamakhasimende. Ngokuvamile lokhu kuthinta umkhakha wezokudayisa. Kusukela ekuhlaziyweni kukabhasikidi wokudla, ukuhlaziya kwe-ABC ne-XYZ kuye ekukhangiseni kokugcinwa kanye nokunikezwayo komuntu siqu. Kusetshenziswe amasu ahlukahlukene amashumi eminyaka, ama-algorithms acatshangelwe, ikhodi ibhaliwe futhi yalungiswa - yithathe futhi uyisebenzise. Kithina, kuvele inkinga eyodwa ebalulekile - thina kwa-ISPsystem simatasa nokuthuthukiswa kwesoftware, hhayi ukudayisa.
Igama lami ngingu-Denis futhi okwamanje nginomthwalo wemfanelo wokubuyisela emuva amasistimu okuhlaziya ku-ISPsystem. Futhi lena indaba yokuthi mina nozakwethu
Ekuqaleni kwakukhona igama, futhi igama elithi "Sizozama?"
Ngaleso sikhathi ngangisebenza njengonjiniyela emnyangweni we-R&D. Konke kwaqala lapho uDanil efunda lapha kuHabré
Kodwa iningi lemikhiqizo yethu iqondiswe emakethe yokubamba. Lawa ngamakhasimende amakhulu, futhi umnyango wokuthuthukiswa kwebhizinisi uyawaluleka ngamakhono omkhiqizo. Futhi kulandela ukuthi ngesikhathi sokuthenga, amakhasimende ethu aseyazi kakade ukuthi yiziphi izinkinga isofthiwe yethu ezobasiza ukuzixazulula. Imizila yabo kuhlelo lokusebenza kufanele ihambisane ne-CJM eshumekwe emkhiqizweni, futhi izixazululo ze-UX zizobasiza ukuthi bahlale endleleni. Spoiler: akwenzeki njalo. Ukwethulwa komtapo wolwazi kuhlehlisiwe... kodwa akubanga isikhathi eside.
Konke kwashintsha ngokukhululwa kwesiqalo sethu -
Imiphumela yokuqala noma lapho ungathola khona imibono
Ithimba labathuthukisi kanye nami sixhume umkhiqizo kusistimu yokuqoqa imicimbi ngokoqobo ngosuku. Ngizosho ngokushesha ukuthi i-ISPsystem isebenzisa isistimu yayo yokuqoqa imicimbi mayelana nokuvakasha kwekhasi, kodwa akukho lutho olukuvimbela ekusebenziseni i-Yandex.Metrica ngezinhloso ezifanayo, okukuvumela ukuthi ulande idatha eluhlaza mahhala. Izibonelo zokusebenzisa umtapo wolwazi zacwaningwa, futhi ngemva kweviki lokuqoqwa kwedatha sathola igrafu yoshintsho.
Igrafu yoguquko. Ukusebenza okuyisisekelo, ezinye izinguquko zisusiwe ukuze zicace
Kwavela njengesibonelo: ipulani, icacile, inhle. Kusukela kule grafu, sikwazile ukuhlonza imizila evame kakhulu nokuwela lapho abantu bechitha isikhathi eside kakhulu. Lokhu kwasivumela ukuba siqonde okulandelayo:
- Esikhundleni se-CJM enkulu, ehlanganisa izinhlangano eziyishumi nambili, zimbili kuphela ezisetshenziswa ngenkuthalo. Kuyadingeka futhi ukuqondisa abasebenzisi ezindaweni esizidingayo sisebenzisa izixazululo ze-UX.
- Amanye amakhasi, aklanywe abaklami be-UX ukuthi abe ukuphela kuya kwesinye, agcina esenabantu abachitha isikhathi esingenangqondo kuwo. Udinga ukuthola ukuthi yiziphi izici zokumisa ekhasini elithile futhi uzilungise.
- Ngemuva kwezinguquko eziyi-10, abantu abangama-20% baqala ukukhathala futhi bayeka iseshini kuhlelo lokusebenza. Futhi lokhu kucabangela iqiniso lokuthi sibe namakhasi angafinyelela kwangu-5 ohlelweni lwethu lokusebenza! Udinga ukukhomba amakhasi lapho abasebenzisi bewashiya khona njalo amaseshini futhi ufinyeze indlela eya kuwo. Okungcono nakakhulu: khomba noma yimiphi imizila evamile futhi uvumele ukuguqulwa okusheshayo ukusuka ekhasini lomthombo ukuya ekhasini okuyiwa kulo. Okuthile okufanayo nokuhlaziywa kwe-ABC nokuhlaziywa kwenqola elahliwe, awucabangi?
Futhi lapha siphinde sacubungula isimo sethu sengqondo ngokusebenza kwaleli thuluzi emikhiqizweni yasendaweni. Kunqunywe ukuhlaziya umkhiqizo odayisiwe futhi osetshenzisiwe -
Mayelana nokudumazeka nezikhuthazo
Ukudumala #1
Kwaba ukuphela kosuku lokusebenza, ukuphela kwenyanga nokuphela konyaka ngesikhathi esifanayo - 27 December. Idatha iqoqiwe, imibuzo ibhaliwe. Kwase kusele imizuzwana ngaphambi kokuthi kucutshungulwe yonke into futhi singabheka umphumela wokusebenza kwethu ukuthola ukuthi unyaka olandelayo wokusebenza uzoqala kuphi. Umnyango we-R&D, umphathi womkhiqizo, abaklami be-UX, umholi weqembu, abathuthukisi bahlangana phambi komqapha ukuze babone ukuthi izindlela zabasebenzisi zibukeka kanjani emkhiqizweni wabo, kodwa... sibonile lokhu:
Igrafu yoguquko eyakhiwe ilabhulali ye-Retentioneering
Ugqozi #1
Ixhumeke kakhulu, inqwaba yezinhlangano, izimo ezingacacile. Kwaba sobala nje ukuthi unyaka omusha wokusebenza wawungeke uqale ngokuhlaziya, kodwa ngokusungulwa kwendlela yokwenza umsebenzi ube lula ngegrafu enjalo. Kodwa angikwazanga ukunyakazisa umuzwa wokuthi yonke into yayilula kakhulu kunalokho okwakubonakala. Futhi ngemva kwemizuzu eyishumi nanhlanu yokufunda ikhodi yomthombo Wokugcinwa Kwezinto Ezigcinwayo, sikwazile ukuthekelisa igrafu eyakhiwe kufomethi yamachashazi. Lokhu kwenze kwaba nokwenzeka ukulayisha igrafu kwelinye ithuluzi - i-Gephi. Futhi sekukhona kakade umkhakha wokuhlaziya amagrafu: izakhiwo, izihlungi, izibalo - okumele ukwenze ukulungisa amapharamitha adingekayo kusixhumi esibonakalayo. Sinalo mcabango engqondweni, sahamba ngempelasonto kaNcibijane.
Ukudumala #2
Ngemva kokubuyela emsebenzini, kuvele ukuthi ngesikhathi wonke umuntu ephumule, amakhasimende ethu ayefunda ngalo mkhiqizo. Yebo, kanzima kangangokuthi izenzakalo zavela endaweni yokugcina eyayingekho ngaphambili. Lokhu kwakusho ukuthi imibuzo idinga ukubuyekezwa.
Isizinda esincane sokuqonda ukudabuka kwaleli qiniso. Sidlulisa kokubili imicimbi esiyimakile (isibonelo, ukuchofoza kwezinye izinkinobho) kanye nama-URL wamakhasi avakashelwe umsebenzisi. Endabeni yeCartbee, imodeli "yesenzo esisodwa - ikhasi elilodwa" yasebenza. Kodwa nge-VMmanager isimo sasihluke ngokuphelele: amafasitela amaningi e-modal ayengavuleka ekhasini elilodwa. Kuzo umsebenzisi angaxazulula izinkinga ezihlukahlukene. Isibonelo, i-URL:
/host/item/24/ip(modal:modal/host/item/ip/create)
kusho ukuthi ekhasini elithi “Amakheli E-IP” umsebenzisi wengeze ikheli le-IP. Futhi lapha izinkinga ezimbili zibonakala ngesikhathi esisodwa:
- I-URL iqukethe uhlobo oluthile lwepharamitha yendlela - i-ID yomshini obonakalayo. Idinga ukukhishwa.
- I-URL iqukethe i-ID yewindi le-modal. Udinga "ukuqaqa" ama-URL anjalo ngandlela thile.
Enye inkinga kwaba ukuthi yona kanye imicimbi esiyimakile yayinemingcele. Isibonelo, bekunezindlela ezinhlanu ezihlukene zokufika ekhasini ngolwazi mayelana nomshini obonakalayo ovela ohlwini. Ngokufanelekile, umcimbi owodwa wathunyelwa, kodwa ngepharamitha ebonisa ukuthi iyiphi indlela umsebenzisi alenze ngayo ushintsho. Kwakunemicimbi eminingi enjalo, futhi yonke imingcele yayihlukile. Futhi sinayo yonke i-logic yokubuyiswa kwedatha kulimi lwe-SQL lwe-Clickhouse. Imibuzo yemigqa engu-150-200 yayisiqala ukubonakala njengento evamile. Izinkinga zazisihaqile.
Ugqozi #2
Ngolunye usuku entathakusa, uDanil, ngokudabukisayo ephenya isicelo somzuzu wesibili, wasikisela kimi: “Masibhale amapayipi okucubungula idatha?” Sacabanga ngakho futhi sanquma ukuthi uma sizokwenza, kuzoba into efana ne-ETL. Ukuze ihlunge ngokushesha futhi ikhiphe idatha edingekayo kweminye imithombo. Yile ndlela isevisi yethu yokuqala yokuhlaziya ene-backend egcwele yazalwa. Isebenzisa izigaba ezinhlanu eziyinhloko zokucubungula idatha:
- Ikhipha imicimbi endaweni yokugcina idatha futhi ilungiselelwa ukucutshungulwa.
- Ukucaciswa “ukuqaqa” kwalezo zihlonzi zamafasitela e-modal, amapharamitha womcimbi neminye imininingwane ecacisa umcimbi.
- Ukucebisa (kusuka egameni elithi “ukuceba”) ukungezwa kwemicimbi ngedatha evela emithonjeni yezinkampani zangaphandle. Ngaleso sikhathi, lokhu kwakuhlanganisa kuphela i-BILLmanager yesistimu yethu yokukhokha.
- Ukuhlunga kuyinqubo yokuhlunga izehlakalo ezihlanekezela imiphumela yokuhlaziya (imicimbi evela ezindlini zangaphakathi, izinto ezingaphandle, njll.).
- Ilayisha imicimbi etholiwe endaweni yokugcina, esiyibize ngedatha ehlanzekile.
Manje bekungenzeka ukugcina ukuhambisana ngokungeza imithetho yokucubungula umcimbi noma amaqembu emicimbi efanayo. Isibonelo, kusukela lapho asikaze sibuyekeze ukuqaqa i-URL. Nakuba, phakathi nalesi sikhathi ukuhluka kwama-URL amaningana kungeziwe. Zihambisana nemithetho esezibekiwe enkonzweni futhi zicutshungulwa ngendlela efanele.
Ukudumala #3
Lapho sesiqalile ukuhlaziya, sabona ukuthi kungani igrafu yayihambisana kangaka. Iqiniso liwukuthi cishe yonke i-N-gram iqukethe izinguquko ezingakwazi ukwenziwa ngokusebenzisa isikhombimsebenzisi.
Kwaqala uphenyo oluncane. Ngididekile ukuthi bekungekho izinguquko ezingenakwenzeka ngaphakathi kwebhizinisi elilodwa. Lokhu kusho ukuthi lesi akusona isiphazamisi ohlelweni lokuqoqa imicimbi noma isevisi yethu ye-ETL. Kube nomuzwa wokuthi umsebenzisi ubesebenza ngesikhathi esisodwa ezinkampanini ezimbalwa, ngaphandle kokusuka kwesinye ukuya kwesinye. Ukufeza kanjani lokhu? Ukusebenzisa amathebhu ahlukene kusiphequluli.
Lapho sihlaziya i-Cartbee, sisindiswa ukucaciswa kwayo. Uhlelo lokusebenza lusetshenziswe kumadivayisi eselula, lapho ukusebenza kusuka kumathebhu amaningana kumane kuphazamise. Lapha sinedeskithophu futhi ngenkathi umsebenzi wenziwa enhlanganweni eyodwa, kunengqondo ukufuna ukuchitha lesi sikhathi ukusetha noma ukuqapha isimo kwenye. Futhi ukuze ungalahlekelwa ukuqhubeka, vele uvule enye ithebhu.
Ugqozi #3
Ozakwethu abavela ekuthuthukisweni okuphambili bafundise isistimu yokuqoqa imicimbi ukuhlukanisa phakathi kwamathebhu. Ukuhlaziya kungase kuqale. Futhi saqala. Njengoba bekulindelekile, i-CJM ayizange ifane nezindlela zangempela: abasebenzisi bachithe isikhathi esiningi emakhasini ohla lwemibhalo, izikhathi ezilahliwe namathebhu ezindaweni ezingalindelekile kakhulu. Ngokusebenzisa ukuhlaziywa koshintsho, sikwazile ukuthola izinkinga kwezinye izakhiwo ze-Mozilla. Kuzo, ngenxa yezici zokuqalisa, izici zokuzulazula zanyamalala noma amakhasi angenalutho abonisiwe, okufanele afinyeleleke kuphela kumlawuli. Ikhasi livuliwe, kodwa akukho okuqukethwe okuvela ngemuva. Ukubala izinguquko kwenze kwaba nokwenzeka ukuhlola ukuthi yiziphi izici ezisetshenziswe ngempela. Amaketanga akwenza kube nokwenzeka ukuqonda ukuthi umsebenzisi uthole kanjani leli phutha noma lelo phutha. Idatha evunyelwe ukuhlolwa ngokusekelwe ekuziphatheni komsebenzisi. Kwaba yimpumelelo, umqondo awuzange ube yize.
Izibalo ezizenzakalelayo
Komunye wemibukiso yemiphumela, sibonise ukuthi i-Gephi isetshenziswa kanjani ekuhlaziyeni igrafu. Kuleli thuluzi, idatha yokuguqulwa ingaboniswa kuthebula. Futhi inhloko yomnyango we-UX yasho umcabango owodwa obaluleke kakhulu owathonya ukuthuthukiswa kwayo yonke isiqondiso sokuhlaziya ukuziphatha enkampanini: "Masenze okufanayo, kodwa eTableau kanye nezihlungi - kuzoba lula kakhulu."
Ngabe sengicabanga: kungani kungenjalo, I-Retentioneering igcina yonke idatha ku-pandas.Isakhiwo se-DataFrame. Futhi lokhu, ngokuvamile, itafula. Yavela kanje enye isevisi: Umhlinzeki Wedatha. Akagcinanga nje ngokwenza ithebula kusuka kugrafu, kodwa futhi ubale ukuthi lidume kangakanani ikhasi kanye nokusebenza okuhlotshaniswa nalo, ukuthi likuthinta kanjani ukugcinwa komsebenzisi, ukuthi abasebenzisi bahlala isikhathi esingakanani kulo, nokuthi yimaphi amakhasi abasebenzisi abawashiya kaningi. Futhi ukusetshenziswa kokubuka ngeso lengqondo ku-Tableau kwehlise izindleko zokufunda igrafu kangangokuthi isikhathi sokuphindaphinda sokuhlaziywa kokuziphatha emkhiqizweni sicishe sancipha.
U-Danil uzokhuluma ngokuthi lokhu kuboniswa kusetshenziswe kanjani nokuthi yiziphi iziphetho ezivumela ukudweba.
Amatafula amaningi kankulunkulu wetafula!
Ngefomu elenziwe lula, umsebenzi wakhiwe ngendlela elandelayo: bonisa igrafu yoshintsho ku-Tableau, nikeza ikhono lokuhlunga, futhi ulenze licace futhi libe lula ngangokunokwenzeka.
Bengingafuni ngempela ukudweba igrafu eqondisiwe ku-Tableau. Futhi noma ngabe uphumelele, ukuzuza, uma kuqhathaniswa noGefi, akuzange kubonakale kusobala. Besidinga okuthile okulula nokufinyeleleka kalula. Ithebula! Phela, igrafu ingamelwa kalula ngendlela yemigqa yethebula, lapho irowu ngayinye iwumkhawulo wohlobo "lwendawo-yomthombo". Ngaphezu kwalokho, sesivele sililungise ngokucophelela ithebula elinjalo sisebenzisa amathuluzi Okugcinwa Kwezinto Ezigcinwayo kanye Nomhlinzeki Wedatha. Okwase kusele ukuthi kwenziwe wukuveza itafula eTableau nokuphenya umbiko.
Ekhuluma ngokuthi wonke umuntu uthanda amatafula.
Nokho, lapha sibhekene nenye inkinga. Yini okufanele uyenze ngomthombo wedatha? Bekungenakwenzeka ukuxhuma ama-pandas.DataFrame; I-Tableau ayinaso isixhumi esinjalo. Ukuphakamisa isisekelo esihlukile sokugcina igrafu kubonakala kuyisixazululo esinamandla kakhulu esinamathemba angacacile. Futhi izinketho zendawo zokuthulula bezingafaneleki ngenxa yesidingo sokusebenza ngesandla njalo. Sibheke ohlwini lwezixhumi ezitholakalayo, futhi amehlo ethu awela entweni
I-Tableau inokukhethwa okucebile kwezixhumi. Sithole eyodwa exazulule inkinga yethu
Isilwane esinjani? Amathebhu ambalwa avuliwe esipheqululini - futhi kwacaca ukuthi lesi sixhumi sikuvumela ukuthi uthole idatha lapho ufinyelela i-URL. I-backend yokubala idatha ngokwayo yayicishe isilungile, okwasala nje ukwenza ubungane ne-WDC. Izinsuku ezimbalwa uDenis wafunda imibhalo futhi walwa nezindlela zeTableau, wabe esengithumelela isixhumanisi engisinamathisele efasiteleni lokuxhuma.
Ifomu lokuxhuma ku-WDC yethu. UDenis wenza ingaphambili lakhe futhi wanakekela ukuphepha
Ngemva kwemizuzu embalwa yokulinda (idatha ibalwa ngokushintshashintshayo lapho iceliwe), ithebula lavela:
Yilokhu okubukeka kuhlelo lwedatha eluhlaza kusixhumi esibonakalayo se-Tableau
Njengoba kuthenjisiwe, umugqa ngamunye wethebula elinjalo wawumelela unqenqema lwegrafu, okungukuthi, uguquko oluqondile lomsebenzisi. Futhi yayiqukethe izici ezimbalwa ezengeziwe. Isibonelo, inombolo yabasebenzisi abahlukile, inani eliphelele loshintsho, nokunye.
Kungenzeka ukuthi kuboniswe leli thebula embikweni njengoba linjalo, ufafaze izihlungi ngokukhululekile futhi uthumele ithuluzi lihamba ngomkhumbi. Kuzwakala kunengqondo. Yini ongayenza ngetafula? Kodwa lena akuyona indlela yethu, ngoba asenzi nje itafula, kodwa ithuluzi lokuhlaziya nokwenza izinqumo zomkhiqizo.
Ngokuvamile, lapho uhlaziya idatha, umuntu ufuna ukuthola izimpendulo zemibuzo. Kuhle. Ake siqale ngabo.
- Yiziphi izinguquko ezivame kakhulu?
- Ziyaphi emakhasini athile?
- Uchitha isikhathi esingakanani ngokwesilinganiso kuleli khasi ngaphambi kokuhamba?
- Ulwenza kangaki uguquko usuka ku-A uye ku-B?
- Iseshini iphela ngamakhasi maphi?
Umbiko ngamunye noma inhlanganisela yawo kufanele ivumele umsebenzisi ukuthi azitholele izimpendulo zale mibuzo ngokuzimela. Isu elibalulekile lapha ukukunikeza amathuluzi ukuze uzenzele ngokwakho. Lokhu kuwusizo kokubili ekunciphiseni umthwalo emnyangweni we-analytics kanye nokunciphisa isikhathi sokwenza izinqumo - ngemva kwakho konke, awusadingi ukuya ku-Youtrack futhi udale umsebenzi womhlaziyi, udinga nje ukuvula umbiko.
Sitholeni?
Abantu bavame ukuhlukana kuphi kudeshibhodi?
Isiqephu sombiko wethu. Ngemva kwedeshibhodi, wonke umuntu waya ohlwini lwama-VM noma ohlwini lwama-node
Ake sithathe ithebula elivamile elinezinguquko kanye nesihlungi ngekhasi lomthombo. Ngokuvamile, zisuka kudeshibhodi ziye ohlwini lwemishini ebonakalayo. Ngaphezu kwalokho, ikholomu ye-Regularity iphakamisa ukuthi lesi isenzo esiphindayo.
Zivelaphi ohlwini lwamaqoqo?
Izihlungi emibikweni zisebenza kuzo zombili izinkomba: ungathola lapho ushiye khona, noma lapho oye khona
Kusukela ezibonelweni kuyacaca ukuthi ngisho nokuba khona kwezihlungi ezimbili ezilula kanye nemigqa yokukala ngamanani ikuvumela ukuthi uthole ulwazi ngokushesha.
Ake sibuze okunye okunzima kakhulu.
Abasebenzisi bavame ukuyishiya kuphi isikhathi sabo?
Abasebenzisi be-VMmanager bavame ukusebenza kumathebhu ahlukene
Ukuze senze lokhu, sidinga umbiko lapho idatha yayo ihlanganiswa imithombo yokudlulisela. Futhi lokho okubizwa ngokuthi ama-breakepoints athathwa njengezabelo - imicimbi esebenza njengokuphela kochungechunge lwezinguquko.
Kubalulekile ukuqaphela lapha ukuthi lokhu kungaba ukuphela kweseshini noma ukuvulwa kwethebhu entsha. Isibonelo sibonisa ukuthi iketango livame ukuphelela etafuleni elinohlu lwemishini ebonakalayo. Kulesi simo, ukuziphatha kwesici kushintshela kwenye ithebhu, ehambisana nephethini elindelekile.
Okokuqala sahlola ukuba wusizo kwale mibiko kithina lapho sihlaziya ngendlela efanayo
Lapho sithuthukisa imibiko, asizange sikhohlwe mayelana nomklamo obonakalayo. Lapho usebenza namatafula alo sayizi, lokhu kuyisici esibalulekile. Ngokwesibonelo, sasebenzisa uhla oluzolile lwemibala, olubonakala kalula
Ithebula liphenduke lavuleka kakhulu, kodwa siyethemba ukuthi alikayeki ukufundeka
Kuhle ukubalula ngokwehlukana mayelana nokuqeqeshwa kwamakhasimende ethu angaphakathi: ochwepheshe bemikhiqizo nabaqambi be-UX. Amamanyuwali anezibonelo zokuhlaziya namathiphu okusebenza ngezihlungi alungiselelwa wona ngokukhethekile. Sifake izixhumanisi kumamanyuwali ngqo emakhasini ombiko.
Senze imanuwali njengephrezentheshini ku-Google Amadokhumenti. Amathuluzi e-Tableau akuvumela ukuthi ubonise amakhasi ewebhu ngqo ngaphakathi kwebhuku lokusebenzela lombiko.
Esikhundleni se-epilogue
Yini esemqondweni? Sikwazile ukuthola ithuluzi lansuku zonke ngokushesha nangokushibhile. Yebo, lokhu akukona neze ukumiselela igrafu ngokwayo, imephu yokushisa yokuchofoza noma isibukeli sewebhu. Kodwa imibiko enjalo ihambisana kakhulu namathuluzi asohlwini futhi inikeza ukudla okucatshangwayo kanye nemibono emisha yomkhiqizo ne-interface.
Le ndaba isebenze kuphela njengesiqalo sokuthuthukiswa kwezibalo ku-ISPsystem. Ezinyangeni eziyisithupha ezedlule, kuvele ezinye izinsiza eziyisikhombisa ezintsha, okuhlanganisa nokuma ngobude kwedijithali komsebenzisi emkhiqizweni kanye nensizakalo yokudala imininingwane yolwazi yokukhomba ngokufana, kodwa sizokhuluma ngazo eziqeshini ezilandelayo.
Source: www.habr.com