Qhov teeb meem technical ntawm Mail.ru Group 2019

Qhov teeb meem technical ntawm Mail.ru Group 2019

Thaum kawg ntawm lub Tsib Hlis, peb cov neeg kawm tiav hauv Technopark (Bauman MSTU), Technotrack (MIPT), Technosphere (Lomonosov Moscow State University) thiab Technopolis (Peter the Great St. Petersburg Polytechnic University) tiv thaiv lawv cov phiaj xwm diploma. Peb lub hlis tau muab faib rau kev ua haujlwm, thiab cov menyuam yaus tau nqis peev hauv lawv lub hlwb cov kev paub thiab kev txawj ntse uas tau txais ntau dua ob xyoos ntawm kev kawm.

Nyob rau hauv tag nrho, muaj 13 txoj haujlwm ntawm kev tiv thaiv, daws teeb meem ntau yam hauv kev lag luam sib txawv. Piv txwv li:

  • huab cia nrog cryptographic ntaub ntawv encryption;
  • platform rau tsim cov yeeb yaj duab sib tham sib (nrog sib txawv xaus);
  • ntse board rau kev ua si tiag chess hla lub network;
  • architecture rau ntse retrieval ntawm cov khoom kho mob;
  • Software rau kev qhia cov menyuam yaus hauv tsev kawm ntawv theem pib ntawm algorithmization.

Raws li qhov project los ntawm cov tuam txhab lag luam:

  • CRM system rau TamTam tub txib;
  • kev pabcuam web rau kev tshawb nrhiav cov duab thematic ntawm daim ntawv qhia rau Odnoklassniki;
  • chaw nyob geocoding kev pabcuam rau MAPS.ME.

Hnub no peb yuav qhia rau koj paub ntau ntxiv txog tsib txoj haujlwm ntawm peb cov neeg kawm tiav.

Tshawb nrhiav cov ntawv kho mob

Qhov teeb meem technical ntawm Mail.ru Group 2019

Muaj ntau qhov chaw hauv kev tshawb fawb, nyob rau hauv txhua qhov kev tshawb fawb tau ua, ntau cov ntawv xov xwm tau luam tawm nyob rau hauv ntau cov ntawv xov xwm. Cov no yog cov ntaub ntawv technology, physics, lej, biology, tshuaj thiab ntau lwm yam.

sau phau ntawv peb tes num txiav txim siab tsom mus rau kev kho mob. Yuav luag tag nrho cov ncauj lus ntawm cov ncauj lus kho mob tau sau rau ntawm PubMed portal. Lub portal muab nws tus kheej tshawb nrhiav. Txawm li cas los xij, nws lub peev xwm muaj tsawg heev. Yog li ntawd, cov txiv neej tau txhim kho txoj kev tshawb nrhiav, ntxiv kev txhawb nqa rau cov lus nug ntev thiab muaj peev xwm los kho cov lus nug uas siv cov qauv qauv.

Qhov teeb meem technical ntawm Mail.ru Group 2019
SERP muaj cov ntawv teev npe ntawm cov ntaub ntawv nrog lawv cov ntsiab lus tau hais tseg, thiab cov lus thiab cov ntsiab lus muaj feem xyuam rau cov ncauj lus no tau hais txog kev siv cov qauv tsim qauv. Tus neeg siv tuaj yeem nyem rau ntawm cov ntsiab lus tseem ceeb kom nqaim cov lus nug tshawb fawb.

Qhov teeb meem technical ntawm Mail.ru Group 2019
Txhawm rau tshawb nrhiav los ntawm PubMed cov ntaub ntawv loj loj sai, cov kws sau ntawv tau sau lawv tus kheej lub tshuab tshawb nrhiav uas tuaj yeem yooj yim sib xyaw rau hauv ib qho kev tsim kho.

Kev tshawb nrhiav yog ua nyob rau hauv peb theem:

  1. Cov ntaub ntawv sib tw raug xaiv siv qhov ntsuas rov qab.
  2. Cov neeg sib tw tau qeb duas siv BM25F algorithm, uas coj mus rau hauv tus account ntau yam hauv cov ntaub ntawv thaum tshawb nrhiav. Yog li, cov lus hauv lub npe muaj qhov hnyav dua li cov lus hauv kev paub daws teeb meem.
  3. Lub kaw lus caching kuj tseem siv los ua kom ceev cov kev thov nquag.

Qhov teeb meem technical ntawm Mail.ru Group 2019

Microservice architecture:

Qhov teeb meem technical ntawm Mail.ru Group 2019
Hauv paus, cov ntaub ntawv sau tau raug xa mus ntawm cov kev pabcuam. Rau kev hloov pauv siab ceev, GRPC yog siv - lub hauv paus rau kev sib txuas cov modules hauv microservice architecture. Cov ntaub ntawv serialization kuj tseem siv tau siv Protobuf lus pauv hom ntawv.

Cov yam ntxwv ntawm qhov system muaj xws li:

  • Server rau kev ua cov neeg siv khoom thov ntawm Node.js.
  • Load balancing thov siv nginx proxy server.
  • Flask server siv REST API thiab tau txais kev thov xa los ntawm Node.js.
  • Tag nrho cov ntaub ntawv nyoos thiab ua tiav, nrog rau cov ntaub ntawv nug, yog khaws cia hauv MongoDB.
  • Txhua qhov kev thov rau cov txiaj ntsig cuam tshuam rau cov ntaub ntawv thematization mus rau RabbitMQ.

Piv txwv ntawm kev tshawb nrhiav:

Qhov teeb meem technical ntawm Mail.ru Group 2019

Peb npaj yuav ua li cas ntxiv:

  • Cov lus pom zoo thaum sau cov kev tshuaj xyuas ntawm ib lub ntsiab lus (nrhiav cov ntsiab lus tseem ceeb hauv cov ntaub ntawv thiab tshawb xyuas los ntawm cov ntaub ntawv me me).
  • Nrhiav cov ntaub ntawv PDF.
  • Semantic text segmentation.
  • Taug qab cov ncauj lus thiab cov kev xav tau dhau sijhawm.

Pab pawg ua haujlwm: Fedor Petryaykin, Vladislav Dorozhinsky, Maxim Nakhodnov, Maxim Filin

Thaiv Log

Qhov teeb meem technical ntawm Mail.ru Group 2019

Niaj hnub no, thaum qhia programming thiab computer science, cov menyuam yaus hnub nyoog kawm ntawv qib pib (qib 5–7) muaj teeb meem rau kev paub cov khoom. Tsis tas li ntawd, yog tias cov tub ntxhais kawm xav ua kom tiav cov haujlwm hauv tsev, lawv yuav tsum tau nruab software ntxiv rau hauv lawv lub computer. Cov kws qhia ntawv yuav tsum tau tshuaj xyuas ntau cov kev daws teeb meem zoo sib xws, thiab nyob rau hauv cov ntaub ntawv ntawm kev kawm nyob deb, lawv kuj yuav tsum tsim ib txoj hauv kev kom tau txais cov haujlwm los ntawm cov tub ntxhais kawm.

Cov kws sau ntawv ntawm Block Log project tuaj txog qhov xaus: thaum qhia cov menyuam yaus hauv tsev kawm ntawv lub hnub nyoog pib lub hauv paus ntawm algorithmization, qhov tseem ceeb yuav tsum tsis txhob nco txog qhov programming lus txib, tab sis ntawm kev tsim cov duab kos duab algorithm. Qhov no yuav tso cai rau cov tub ntxhais kawm siv sijhawm thiab siv zog los tsim cov txheej txheem algorithm, tsis yog ntaus ntawv hauv cov qauv sib xyaw ua ke.

Platform Thaiv Log tso cai:

  1. Tsim thiab kho cov kab kos.
  2. Khiav cov kab kos tsim thiab pom qhov tshwm sim ntawm lawv cov haujlwm (cov ntaub ntawv tso tawm).
  3. Txuag thiab thauj cov haujlwm tsim.
  4. Kos duab raster (tsim ib daim duab raws li tus algorithm tsim los ntawm tus menyuam).
  5. Tau txais cov ntaub ntawv hais txog qhov nyuaj ntawm qhov tsim algorithm (raws li tus naj npawb ntawm kev ua haujlwm hauv algorithm).

Yuav tsum muaj kev faib cov luag haujlwm rau cov kws qhia ntawv thiab cov tub ntxhais kawm. Txhua tus neeg siv tau txais cov tub ntxhais kawm raws li txoj cai; kom tau txais cov kws qhia ntawv raws li txoj cai, koj yuav tsum hu rau tus thawj tswj hwm. Tus kws qhia ntawv tuaj yeem tsis tsuas yog nkag mus rau cov lus piav qhia thiab cov xwm txheej ntawm cov teeb meem, tab sis kuj tseem tsim cov kev xeem automated uas yuav raug tso tawm thaum tus tub ntxhais kawm xa cov kev daws teeb meem rau hauv qhov system.

Browser Block Log Editor:

Qhov teeb meem technical ntawm Mail.ru Group 2019

Tom qab daws qhov teeb meem, tus tub ntxhais kawm tuaj yeem rub tawm qhov kev daws teeb meem thiab pom cov txiaj ntsig:

Qhov teeb meem technical ntawm Mail.ru Group 2019

Lub platform muaj cov ntawv thov pem hauv ntej hauv Vue.js thiab daim ntawv thov rov qab hauv Ruby ntawm Rails. PostgreSQL yog siv los ua database. Txhawm rau kom yooj yim rau kev xa tawm, tag nrho cov khoom siv tau ntim rau hauv Docker ntim thiab sib sau ua ke siv Docker Compose. Lub desktop version ntawm Block Log yog raws li Electron moj khaum. Webpack tau siv los tsim JavaScript code.

Pab pawg ua haujlwm: Alexander Barulev, Maxim Kolotovkin, Kirill Kucherov.

CRM system rau TamTam tub txib

Qhov teeb meem technical ntawm Mail.ru Group 2019

CRM yog lub cuab yeej rau kev sib cuam tshuam yooj yim ntawm kev lag luam thiab TamTam cov neeg siv. Cov haujlwm hauv qab no tau ua tiav:

  • Tus tsim bot uas tso cai rau koj los tsim bots yam tsis muaj kev txawj ua haujlwm. Hauv ob peb feeb koj tuaj yeem tau txais kev ua haujlwm tag nrho uas tuaj yeem tsis tsuas yog qhia qee cov ntaub ntawv rau cov neeg siv, tab sis kuj sau cov ntaub ntawv, suav nrog. cov ntaub ntawv uas tus thawj coj saib tau tom qab.
  • RSS. Koj tuaj yeem yooj yim txuas RSS rau txhua qhov channel.
  • ncua kev tshaj tawm. Tso cai rau koj xa thiab rho tawm cov lus ntawm lub sijhawm preset.

Pab neeg no kuj tau koom nrog hauv kev sim Bot API, tsim ntau lub bots sau tus kheej, xws li bots rau 2019 World Cup of Hockey, bot rau npe / tso cai hauv peb qhov kev pabcuam, thiab bot rau CI / CD.

Kev daws teeb meem infrastructure:

  • Cov neeg rau zaub mov tswj hwm muaj cov kev saib xyuas rau txhua tus neeg rau zaub mov thiab txhua lub thawv Docker ntawm nws txhawm rau txhawm rau txhawm rau pom qhov teeb meem sai thiab yooj yim los daws nws, saib ntau yam kev ntsuas thiab kev siv txheeb cais. Kuj tseem muaj qhov system rau kev tswj xyuas tej thaj chaw deb ntawm peb daim ntawv thov.
  • Lub staging server muaj cov qauv tam sim no ntawm peb daim ntawv thov, muaj rau kev sim dav dav los ntawm pab pawg txhim kho.
  • Kev tswj hwm thiab kev tswj hwm cov servers tsuas yog muaj nyob ntawm VPN rau cov neeg tsim khoom, thiab cov servers ntau lawm muaj qhov tso tawm ntawm daim ntawv thov. Nws raug cais tawm ntawm txhais tes ntawm cov neeg tsim khoom thiab tsuas yog muaj rau cov neeg siv kawg nkaus xwb.
  • CI / CD system tau siv los siv Github thiab Travis, ceeb toom siv cov kev cai bot hauv TamTam.

Qhov teeb meem technical ntawm Mail.ru Group 2019

Daim ntawv thov architecture yog ib qho kev daws teeb meem. Daim ntawv thov, database, configuration manager thiab saib xyuas yog launched nyob rau hauv cais Docker ntim, uas tso cai rau koj mus rau abstract los ntawm lub community launch ib puag ncig, hloov los yog restart ib tug nyias ntim. Tsim lub network topology thiab tswj cov thawv yog ua tiav siv Docker Compose.

Qhov teeb meem technical ntawm Mail.ru Group 2019

Pab pawg ua haujlwm: Alexey Antufiev, Egor Gorbatov, Alexey Kotelevsky.

ForkMe

Qhov teeb meem technical ntawm Mail.ru Group 2019

Qhov project ForkMe yog lub platform rau kev saib cov yeeb yaj kiab sib tham sib, uas koj tuaj yeem tsim koj tus kheej video thiab qhia rau koj cov phooj ywg. Vim li cas peb thiaj xav tau cov yeeb yaj kiab sib tham yog tias muaj cov tsis tu ncua?

Cov yeeb yaj kiab uas tsis yog-linear ntawm cov yeeb yaj kiab thiab muaj peev xwm xaiv qhov txuas ntxiv lawv tus kheej tso cai rau cov neeg saib koom nrog, thiab cov neeg tsim cov ntsiab lus yuav tuaj yeem qhia cov dab neeg tshwj xeeb, cov phiaj xwm uas yuav cuam tshuam los ntawm cov neeg siv. Tsis tas li ntawd, cov neeg tsim cov ntsiab lus, los ntawm kev kawm cov ntaub ntawv hloov dua siab tshiab, yuav nkag siab qhov twg cov neeg tuaj saib nyiam tshaj plaws thiab ua cov ntaub ntawv zoo nkauj dua.

Thaum tsim qhov project, cov txiv neej tau txais kev tshoov siab los ntawm kev sib tham ua yeeb yaj kiab Bandersnatch los ntawm Netflix, uas tau txais ntau qhov kev pom thiab kev tshuaj xyuas zoo. Thaum MVP twb tau sau tseg lawm, xov xwm tshwm sim tias Youtube tau npaj los tsim lub platform rau kev sib tham sib, uas ib zaug lees paub qhov nrov ntawm cov kev taw qhia no.

MVP muaj xws li: sib tham sib player, video constructor, nrhiav los ntawm cov ntsiab lus thiab cim npe, video collections, lus, views, ratings, channel thiab cov neeg siv profiles.

Qhov teeb meem technical ntawm Mail.ru Group 2019

Technology stack siv nyob rau hauv qhov project:

Qhov teeb meem technical ntawm Mail.ru Group 2019

Yuav ua li cas yog nws npaj los tsim qhov project:

  • sau cov txheeb cais thiab infographics txog kev hloov mus rau video;
  • cov ntawv ceeb toom thiab cov lus ntawm tus kheej rau cov neeg siv qhov chaw;
  • versions rau Android thiab iOS.

Tom qab no peb npaj yuav ntxiv:

  • tsim video dab neeg ntawm koj lub xov tooj;
  • kho cov downloaded video fragments (piv txwv li trimming);
  • tsim thiab tso tawm kev sib tham sib tshaj tawm hauv cov neeg ua si.

Pab pawg ua haujlwm: Maxim Morev (tus tsim tawm fullstack, ua haujlwm ntawm qhov project architecture) thiab Roman Maslov (tus tsim tawm fullstack, ua haujlwm ntawm qhov project tsim).

On-Line-On-Board

Qhov teeb meem technical ntawm Mail.ru Group 2019

Qhov teeb meem technical ntawm Mail.ru Group 2019

Niaj hnub no, cov niam txiv tau saib xyuas zoo rau kev loj hlob ntawm lub hlwb ntawm lawv cov menyuam, thiab cov menyuam nyiam kev txawj ntse ua si. Yog li ntawd, chess tau txais koob meej dua. Thiab txawm hais tias chess feem ntau nrov heev, nrhiav tus neeg sib tw tsis tu ncua rau kev ua si yog teeb meem. Yog li ntawd, ntau tus neeg siv cov kev pabcuam chess hauv online, txawm tias muaj ntau tus players nyiam ua si "nyob" nrog cov khoom tiag. Txawm li cas los xij, thaum ua si chess, ib tus neeg siv ntau lub hlwb rau siab thiab nkees, thiab qhov qaug zog no tau ua tiav los ntawm qhov tsis zoo ntawm zaum ntawm lub computer lossis smartphone. Raws li qhov tshwm sim, lub hlwb ua dhau los tom qab tsuas yog ob qho kev ua si.

Tag nrho cov xwm txheej no tau thawb cov neeg sau ntawv mus rau lub tswv yim ntawm On-Line-On-Board project, uas muaj peb ntu: lub cev chessboard, daim ntawv thov desktop thiab lub vev xaib kev pabcuam. Lub rooj tsavxwm yog ib qho chess tsis tu ncua, uas paub txog txoj haujlwm ntawm cov khoom thiab, nrog kev pab los ntawm lub teeb pom kev, qhia tus neeg sib tw txav. Lub rooj tsavxwm txuas nrog USB rau PC thiab sib txuas lus nrog daim ntawv thov desktop. Hauv hom kev cob qhia (thiab rau cov menyuam yaus), koj qhov kev txav mus los tau tseem ceeb.

Daim ntawv thov siv lub luag haujlwm tseem ceeb ntawm kev tswj hwm lub rooj tsavxwm, uas tso cai rau koj kom txo qis nws cov nqi thiab coj cov kev ua haujlwm ntawm feem ntau mus rau qib software. Daim ntawv thov sib txuas lus nrog lub vev xaib kev pabcuam uas nws tus nqi tseem ceeb yog kev hloov kho dynamic.

Qhov xwm txheej tseem ceeb ntawm kev siv cov khoom siv: ib tus neeg ua si ntawm qhov kev pabcuam, qhov thib ob ntawm lub rooj tsavxwm lub cev txuas nrog kev pabcuam. Ntawd yog, qhov kev pabcuam siv rau kev sib txuas lus.

Pab neeg ua haujlwm: Daniil Tuchin, Anton Dmitriev, Sasha Kuznetsov.

Koj tuaj yeem nyeem ntxiv txog peb cov haujlwm kev kawm ntawm qhov txuas no. Thiab mus saib cov channel ntau zaus Technostream, cov yeeb yaj kiab kev kawm tshiab hais txog kev ua haujlwm, kev txhim kho thiab lwm yam kev qhuab qhia tshwm sim muaj tsis tu ncua.

Tau qhov twg los: www.hab.com

Ntxiv ib saib