Mini-kubvunzurudza naOleg Anastasyev: kukanganisa kushivirira muApache Cassandra

Odnoklassniki ndiye mushandisi mukuru weApache Cassandra paRuNet uye imwe yemakuru pasirese. Takatanga kushandisa Cassandra muna 2010 kuchengetedza mafoto ratings, uye ikozvino Cassandra inobata petabytes yedata pazviuru zvenode, kutaura zvazviri, takatogadzira zvedu. NewSQL transactional database.
Musi waSeptember 12 muhofisi yedu yeSt musangano wechipiri wakatsaurirwa kuna Apache Cassandra. Mukurukuri mukuru wechiitiko chacho achava injiniya mukuru weOdnoklassniki Oleg Anastasyev. Oleg inyanzvi mumunda weakagoverwa uye anoshivirira masisitimu; anga achishanda naCassandra kweanopfuura makore gumi uye kakawanda. akataura nezve maficha ekushandisa chigadzirwa ichi pamisangano.

Manheru emusangano, takataura naOleg nezve kushivirira kwekukanganisa kwemaitiro akaparadzirwa naCassandra, akabvunza kuti aizotaura nezvei pamusangano uye nei zvakakosha kuenda kuchiitiko ichi.

Oleg akatanga basa rake rekugadzira kumashure muna 1995. Akagadzira software mumabhangi, telecom, uye transport. Anga achishanda semugadziri anotungamira kuOdnoklassniki kubvira 2007 pachikwata chepuratifomu. Mabasa ake anosanganisira kugadzira zvivakwa uye zvigadziriso zveakakwira-mutoro masisitimu, makuru matura data, uye kugadzirisa matambudziko ekuita portal uye kuvimbika. Anodzidzisawo vanogadzira mukati mekambani.

- Oleg, mhoro! Muna May zvakaitika kusangana kwekutanga, yakatsaurirwa kuna Apache Cassandra, vatori vechikamu vanoti nhaurirano dzakaenderera kusvika pakati pehusiku, ndapota ndiudze, ndezvipi zvaunofunga nezvemusangano wekutanga?

Vagadziri vane mamiriro akasiyana kubva kumakambani akasiyana vakauya nemarwadzo avo, mhinduro dzisingatarisirwi kumatambudziko uye nyaya dzinoshamisa. Takakwanisa kuitisa musangano wakawanda mumutauro wekurukurirano, asi paiva nekurukurirano dzakawanda zvokuti takangokwanisa kubata chikamu chimwe muzvitatu chemisoro yakarongwa. Isu takatarisisa zvakanyanya kuti sei uye chii chatinotarisa tichishandisa muenzaniso wemasevhisi edu chaiwo ekugadzira.

Ndakaifarira uye ndaiifarira chaizvo.

- Tichitarisa nechiziviso, musangano wechipiri ichave yakazvipira zvachose kushivirira kukanganisa, sei wakasarudza iyi musoro?

Cassandra yakajairika yakabatikana yakagovaniswa sisitimu ine huwandu hukuru hwekuita kunze kwekushandira zvakananga zvikumbiro zvemushandisi: makuhwa, kutadza kuona, kuparadzira shanduko ye schema, kuwedzera kwesumbu / kuderera, anti-entropy, backups uye kudzoreredza, nezvimwe. Sezviri mune chero system yakagoverwa, sezvo huwandu hwehardware hunowedzera, mukana wekutadza unowedzera, saka mashandiro eCassandra masumbu ekugadzira anoda kunzwisisa kwakadzama kwechimiro chayo kufanotaura maitiro kana paine kutadza uye zviito zvemushandisi. Mushure mekushandisa Cassandra kwemakore mazhinji, isu vakawana hunyanzvi hwakakosha, iyo yatakagadzirira kugovera, uye tinodawo kukurukura kuti vatinoshanda navo muchitoro vanogadzirisa sei matambudziko.

- Kana zvasvika kuna Cassandra, unorevei nekushivirira mhosva?

Chekutanga pane zvese, hongu, kugona kweiyo sisitimu yekupona yakajairwa hardware kukundikana: kurasikirwa kwemichina, disks, kana network yekubatanidza ine node / data data. Asi musoro wacho pachawo wakafara zvikuru uye kunyanya unosanganisira kupora kubva mukukundikana, kusanganisira kukundikana uko vanhu vasingawanzo gadzirirwa, semuenzaniso, zvikanganiso zvevashandisi.

- Unogona kupa muenzaniso weiyo yakanyanya kurodha uye yakakura data cluster?

Imwe yemasumbu edu makuru ndeye chipo cluster: anopfuura mazana maviri node uye mazana eTB yedata. Asi haisi iyo yakanyanya kutakurwa, sezvo yakafukidzwa neyakagoverwa cache. Masumbu edu akabatikana anobata makumi ezviuru zveRPS zvekunyora uye zviuru zveRPS zvekuverenga.

- Wow! Kangani chinhu chinotyoka?

Hongu nguva dzose! Pakazara, isu tine anopfuura zviuru zvitanhatu maseva, uye svondo rega rega maseva akati wandei uye akati wandei madhisiki anotsiviwa (pasina kutarisisa maitiro akafanana ekusimudzira nekuwedzera kwemashini ngarava). Pamhando yega yega yekukundikana, kune mirairo yakajeka pamusoro pezvinofanira kuita uye mukurongeka kupi, zvese zvinongoitwa chero pazvinogoneka, saka kutadza kunoitika uye mu6% yezviitiko zvinoitika zvisingaonekwe nevashandisi.

— Iwe unobata sei nekuramba kwakadaro?

Kubva pakutanga kwekushanda kweCassandra uye zviitiko zvekutanga, takashanda pane nzira dzekuchengetedza uye kudzoreredza kubva kwavari, takavaka nzira dzekutumira dzinofunga nezvenzvimbo yeCassandra masumbu uye, semuenzaniso, usabvumire node kuti itangezve. kana kurasikirwa kwedata kuchibvira. Tinoronga kutaura nezvese izvi pamusangano.

- Sezvawataura, hapana masisitimu akavimbika. Ndedzipi mhando dzekukundikana dzaunogadzirira uye unokwanisa kurarama?

Kana tikataura nezve kumisikidzwa kwedu kweCassandra masumbu, vashandisi havazocherechedze chero chinhu kana tikarasikirwa nemichina yakati wandei mune imwe DC kana imwe chete DC (izvi zvaitika). Nekuwedzera kwenhamba yeDDC, isu tiri kufunga nezve kutanga kuve nechokwadi chekushanda muchiitiko chekukundikana kwemaDC maviri.

- Iwe unofunga kuti Cassandra anoshaya chii maererano nekushivirira mhosva?

Cassandra, sezvimwe zvitoro zvakawanda zveNoSQL, inoda kunzwisisa kwakadzama kwechimiro chayo chemukati uye maitiro ane simba ari kuitika. Ndingati inoshaya nyore, kufanotaura uye kucherechedzwa. Asi zvichave zvinonakidza kunzwa pfungwa dzevamwe vatori vechikamu pamusangano!

Oleg, ndinokutendai zvikuru nekutora nguva yekupindura mibvunzo!

Isu takamirira munhu wese anoda kutaurirana nenyanzvi mumunda wekushandisa Apache Cassandra pamusangano weSeptember 12 muhofisi yedu yeSt.

Uya, zvichave zvinonakidza!

Bhalisa kune chiitiko.

Source: www.habr.com