Kuyankhulana kwapang'ono ndi Oleg Anastasyev: kulekerera zolakwika mu Apache Cassandra

Kuyankhulana kwapang'ono ndi Oleg Anastasyev: kulekerera zolakwika mu Apache Cassandra

Odnoklassniki ndiye wogwiritsa ntchito kwambiri Apache Cassandra pa RuNet komanso m'modzi wamkulu kwambiri padziko lonse lapansi. Tinayamba kugwiritsa ntchito Cassandra mu 2010 kuti tisunge zithunzi, ndipo tsopano Cassandra amayang'anira ma petabytes a data pa masauzande ambiri, makamaka, tinapanga zathu. NewSQL transaction database.
Pa September 12 mu ofesi yathu ku St msonkhano wachiwiri woperekedwa kwa Apache Cassandra. Wokamba wamkulu wa mwambowu adzakhala injiniya wamkulu wa Odnoklassniki Oleg Anastasyev. Oleg ndi katswiri pantchito yogawa komanso kulolera zolakwika; wakhala akugwira ntchito ndi Cassandra kwa zaka zopitilira 10 komanso mobwerezabwereza. adalankhula za momwe angagwiritsire ntchito mankhwalawa pamisonkhano.

Madzulo a msonkhanowo, tinakambirana ndi Oleg za kulekerera zolakwika kwa machitidwe omwe amafalitsidwa ndi Cassandra, adafunsa zomwe angakambirane pamsonkhanowo komanso chifukwa chake kunali koyenera kupezekapo.

Oleg anayamba ntchito yake mapulogalamu mu 1995. Anapanga mapulogalamu a mabanki, telecom, ndi transport. Wakhala akugwira ntchito yotsogolera ku Odnoklassniki kuyambira 2007 pagulu la nsanja. Maudindo ake akuphatikizapo kupanga zomangamanga ndi zothetsera machitidwe olemetsa kwambiri, malo osungiramo deta akuluakulu, ndi kuthetsa mavuto a ntchito ya portal ndi kudalirika. Amaphunzitsanso opanga mkati mwa kampani.

- Oleg, moni! Mu May chinachitika kukumana koyamba, operekedwa kwa Apache Cassandra, ophunzirawo akunena kuti zokambirana zinapitirira mpaka usiku, chonde ndiuzeni, kodi mumawona bwanji pa msonkhano woyamba?

Madivelopa okhala ndi miyambo yosiyana kuchokera kumakampani osiyanasiyana adadza ndi zowawa zawo, mayankho osayembekezeka kumavuto ndi nkhani zodabwitsa. Tinakwanitsa kuchititsa misonkhano yambiri m’njira yokambitsirana, koma panali zokambirana zambiri moti tinangotha ​​kukhudza gawo limodzi mwa magawo atatu a mitu yomwe inakonzedwa. Tinapereka chidwi kwambiri pa momwe ndi zomwe timayang'anira pogwiritsa ntchito chitsanzo cha ntchito zathu zenizeni zopanga.

Ndinali ndi chidwi ndipo ndinachikonda kwambiri.

- Kutengera chilengezocho, msonkhano wachiwiri adzakhala odzipereka kwathunthu pakulekerera zolakwika, chifukwa chiyani mwasankha mutuwu?

Cassandra ndi njira yogawa yotanganidwa yomwe imakhala ndi magwiridwe antchito ambiri kuposa kugwiritsa ntchito mwachindunji zopempha za ogwiritsa ntchito: miseche, kuzindikira kulephera, kufalitsa kusintha kwa schema, kukula kwamagulu / kuchepa, anti-entropy, zosunga zobwezeretsera ndi kuchira, ndi zina zambiri. Monga m'dongosolo lililonse logawidwa, kuchuluka kwa ma hardware kumawonjezeka, mwayi wolephera ukuwonjezeka, kotero kuti ntchito yamagulu opangira Cassandra imafuna kumvetsetsa kwakukulu kwa kapangidwe kake kuti adziwiretu khalidwe pakakhala zolephera ndi zochita za oyendetsa. Titagwiritsa ntchito Cassandra kwa zaka zambiri, ife apeza ukatswiri wofunikira, zomwe ndife okonzeka kugawana, ndipo tikufunanso kukambirana momwe anzathu mu shopu amathetsera mavuto.

- Pankhani ya Cassandra, ukutanthauza chiyani ponena za kulolerana zolakwa?

Choyamba, ndithudi, kuthekera kwa dongosololi kupulumuka kulephera kwa hardware: kutayika kwa makina, ma disks, kapena kugwirizanitsa maukonde ndi node / malo a deta. Koma mutu womwewo ndi wotakata kwambiri ndipo makamaka umaphatikizapo kuchira kuchokera ku zolephera, kuphatikizapo zolephera zomwe anthu sakonzekera kawirikawiri, mwachitsanzo, zolakwika za oyendetsa.

- Kodi mungapereke chitsanzo cha gulu lodzaza kwambiri komanso lalikulu kwambiri?

Limodzi mwamagulu athu akuluakulu ndi gulu lamphatso: ma node opitilira 200 ndi mazana a data ya TB. Koma sizodzaza kwambiri, chifukwa zimaphimbidwa ndi cache yogawidwa. Magulu athu otanganidwa kwambiri amagwira ma RPS masauzande ambiri polemba ndi masauzande a RPS kuti awerenge.

- Oo! Kodi chinthu chimasweka kangati?

Inde nthawi zonse! Pazonse, tili ndi ma seva opitilira 6, ndipo sabata iliyonse ma seva angapo ndi ma disks angapo amasinthidwa (popanda kuganizira njira zofananira za kukweza ndi kukulitsa makina amakina). Pazolephera zamtundu uliwonse, pali malangizo omveka bwino oti achite komanso momwe angayendetsere, chilichonse chimakhala chokhazikika ngati kuli kotheka, chifukwa chake zolephera zimakhala zachizoloŵezi ndipo mu 99% ya milandu imachitika mosadziwika ndi ogwiritsa ntchito.

- Kodi mumatani mukakana zimenezi?

Kuyambira pachiyambi cha ntchito ya Cassandra ndi zochitika zoyamba, tidagwiritsa ntchito njira zosungira ndi kubwezeretsa kuchokera kwa iwo, tinamanga njira zotumizira zomwe zimaganizira zamagulu a Cassandra ndipo, mwachitsanzo, musalole kuti ma node ayambitsidwenso. ngati kutaya deta ndi kotheka. Tikukonzekera kukambirana zonsezi pamisonkhano.

- Monga mudanenera, palibe machitidwe odalirika. Ndi zolephera zotani zomwe mumakonzekera ndipo mutha kupulumuka?

Ngati tilankhula za kukhazikitsa kwathu magulu a Cassandra, ogwiritsa ntchito sangazindikire chilichonse ngati titaya makina angapo mu DC imodzi kapena DC imodzi yonse (izi zachitika). Ndi kuwonjezeka kwa chiwerengero cha ma DC, tikuganiza zoyamba kuonetsetsa kuti tikugwira ntchito ngati ma DC awiri akulephera.

- Kodi mukuganiza kuti Cassandra alibe chiyani pankhani yolekerera zolakwika?

Cassandra, monga masitolo ena ambiri oyambilira a NoSQL, amafunikira kumvetsetsa mozama za kapangidwe kake kamkati ndi njira zosinthira zomwe zikuchitika. Ndinganene kuti ilibe kuphweka, kulosera komanso kuwonera. Koma zidzakhala zosangalatsa kumva maganizo a otenga nawo mbali pa msonkhano!

Oleg, zikomo kwambiri chifukwa chopatula nthawi kuti muyankhe mafunso!

Tikuyembekezera aliyense amene akufuna kulankhulana ndi akatswiri pa ntchito ya Apache Cassandra pamsonkhano wa September 12 mu ofesi yathu ya St.

Bwerani, zidzakhala zosangalatsa!

Kulembetsa kwa chochitika.

Source: www.habr.com

Kuwonjezera ndemanga