Udliwano-ndlebe oluncinci kunye no-Oleg Anastasyev: ukunyamezela impazamo kwi-Apache Cassandra

Udliwano-ndlebe oluncinci kunye no-Oleg Anastasyev: ukunyamezela impazamo kwi-Apache Cassandra

I-Odnoklassniki ngoyena msebenzisi mkhulu we-Apache Cassandra kwi-RuNet kwaye yenye yezona zinkulu emhlabeni. Saqala ukusebenzisa iCassandra ngo-2010 ukugcina iireyithingi zeefoto, kwaye ngoku iCassandra ilawula iipetabytes zedatha kumawaka eendawo, enyanisweni, saze saphuhlisa ezethu. Isiseko sedatha yentengiselwano yeNewSQL.
NgoSeptemba 12 kwiofisi yethu yaseSt intlanganiso yesibini enikezelwe kwiApache Cassandra. Isithethi esiphambili kweso siganeko siya kuba yinjineli eyintloko ye-Odnoklassniki Oleg Anastasyev. U-Oleg uyingcali kwicandelo leenkqubo ezisasazwayo kunye nokunyamezela iimpazamo; usebenze noCassandra iminyaka engaphezu kwe-10 kwaye ngokuphindaphindiweyo. wathetha ngeempawu zokusebenzisa le mveliso kwiinkomfa.

Ngobusuku bokuhlangana, sathetha no-Oleg malunga nokunyamezela impazamo kwiinkqubo ezisasazwayo kunye noCassandra, wabuza ukuba uya kuthetha ngantoni kwintlanganiso kwaye kutheni kufanelekile ukuya kulo mcimbi.

U-Oleg waqala umsebenzi wakhe weprogram ngo-1995. Uphuhlise isoftware kwiibhanki, i-telecom, kunye nezothutho. Usebenze njengomphuhlisi ohamba phambili kwi-Odnoklassniki ukususela ngo-2007 kwiqela leqonga. Uxanduva lwakhe lubandakanya ukuphuhlisa izakhiwo kunye nezisombululo zeenkqubo zomthwalo ophezulu, iindawo zokugcina idatha ezinkulu, kunye nokusombulula iingxaki zokusebenza kwe-portal kunye nokuthembeka. Ukwaqeqesha abaphuhlisi ngaphakathi kwinkampani.

-Oleg, molo! NgoMeyi kwenzeka indibano yokuqala, ezinikezelwe kwi-Apache Cassandra, abathathi-nxaxheba bathi iingxoxo ziqhubekile kwaze kwaba sebusuku kakhulu, nceda undixelele, zithini iimbono zakho zokuhlangana kokuqala?

Abaphuhlisi abaneemvelaphi ezahlukeneyo kwiinkampani ezahlukeneyo beza nentlungu yabo, izisombululo ezingalindelekanga kwiingxaki kunye namabali amangalisayo. Sikwazile ukuqhuba uninzi lweentlanganiso kwifomathi yengxoxo, kodwa kwakukho iingxoxo ezininzi kangangokuba sakwazi ukuchukumisa isithathu sezihloko ezicwangcisiweyo. Sinike ingqwalasela enkulu kwindlela kunye nento esiyijonga ngayo sisebenzisa umzekelo weenkonzo zethu zokwenyani zemveliso.

Ndandinomdla kwaye ndayithanda ngokwenene.

-Ngokujonga isibhengezo, indibano yesibini iya kuzinikela ngokupheleleyo ekunyamezeleni impazamo, kutheni ukhethe esi sihloko?

I-Cassandra yinkqubo eqhelekileyo esasazwayo exakekileyo enomthamo omkhulu wokusebenza ngaphaya kokunikezela ngokuthe ngqo kwizicelo zabasebenzisi: intlebendwane, ukufumanisa ukungaphumeleli, ukusasazwa kotshintsho lweschema, ukwandiswa kweqela / ukunciphisa, ukuchasana ne-entropy, i-backups kunye nokubuyisela, njl. Njengakuyo nayiphi na inkqubo esasazwayo, njengoko inani le-hardware linyuka, amathuba okuhluleka ayanda, ngoko ke ukusebenza kwamaqela okuvelisa iCassandra kufuna ukuqonda okunzulu kwesakhiwo sayo ukuqikelela ukuziphatha kwimeko yokungaphumeleli kunye nezenzo zabaqhubi. Emva kokusebenzisa uCassandra iminyaka emininzi, thina baye baqokelela ubuchule obubalulekileyo, esilungele ukwabelana ngayo, kwaye sifuna ukuxoxa ngendlela oogxa bethu evenkileni abasombulula ngayo iingxaki eziqhelekileyo.

— Xa kufikwa kuCassandra, uthetha ukuthini ngokunyamezela iimpazamo?

Okokuqala, ngokuqinisekileyo, amandla enkqubo yokusinda kwiintsilelo eziqhelekileyo ze-hardware: ukulahlekelwa koomatshini, iidiski, okanye uxhulumaniso lwenethiwekhi kunye nodes / amaziko edatha. Kodwa isihloko ngokwaso sibanzi kwaye ngokukodwa sibandakanya ukubuyiswa kokungaphumeleli, kubandakanywa ukungaphumeleli apho abantu abafane balungiselele, umzekelo, iimpazamo zabaqhubi.

— Ngaba unokunika umzekelo weyona datha igcweleyo nenkulu?

Elinye lamaqela ethu amakhulu liqela lezipho: ngaphezulu kweendawo ezingama-200 kunye namakhulu edatha ye-TB. Kodwa ayisiyiyo eyona ilayishiweyo, kuba igutyungelwe yi-cache esasaziweyo. Amaqela ethu axakekileyo aphatha amashumi amawaka e-RPS yokubhala kunye namawaka e-RPS yokufunda.

- Wowu! Kukangaphi into yophuka?

Ewe ngamaxesha onke! Lilonke, sinabancedisi abangaphezu kwamawaka ama-6, kwaye veki nganye iiseva ezimbalwa kunye neediski ezininzi zitshintshwa (ngaphandle kokuthathela ingqalelo iinkqubo ezihambelanayo zokuphucula kunye nokwandiswa kweenqanawa zoomatshini). Kuhlobo ngalunye lokungaphumeleli, kukho imiyalelo ecacileyo malunga nokuba wenzeni kwaye ulandelelanise, yonke into izenzekelayo xa kunokwenzeka, ngoko ke ukungaphumeleli kuyinkqubo kwaye kwi-99% yeemeko zenzeke zingabonakali ngabasebenzisi.

— Uhlangabezana njani nokwala okunjalo?

Ukususela ekuqaleni kokusebenza kweCassandra kunye neziganeko zokuqala, sisebenze kwiindlela zokugcinwa kwe-backups kunye nokubuyisela kubo, sakha iinkqubo zokuthunyelwa ezithathela ingqalelo imeko yamaqela eCassandra kwaye, umzekelo, ungavumeli ii-nodes ukuba ziqaliswe kwakhona. ukuba ilahleko yedatha inokwenzeka. Siceba ukuthetha ngayo yonke le nto kwintlanganiso.

- Njengoko ubutshilo, akukho sistim ethembekileyo ngokupheleleyo. Zeziphi iintlobo zokusilela ozilungiselelayo kwaye uyakwazi ukusinda?

Ukuba sithetha ngofakelo lwethu lwamaqela eCassandra, abasebenzisi abayi kuqaphela nantoni na ukuba silahlekelwa ngoomatshini abaninzi kwi-DC enye okanye kwi-DC enye (oku kwenzekile). Ngokunyuka kwenani le-DCs, sicinga ngokuqala ukuqinisekisa ukusebenza kwimeko yokungaphumeleli kwee-DC ezimbini.

— Ucinga ukuba uCassandra uswele ntoni malunga nokunyamezela iimpazamo?

I-Cassandra, njengezinye iivenkile ezininzi zangaphambili ze-NoSQL, ifuna ukuqonda okunzulu kwesakhiwo sayo sangaphakathi kunye neenkqubo eziguqukayo ezenzekayo. Ndingatsho ukuba iswele ukulula, ukuqikelela kunye nokubonwa. Kodwa kuya kuba mnandi ukuva izimvo zabanye abathathi-nxaxheba beentlanganiso!

Oleg, enkosi kakhulu ngokuthatha ixesha lokuphendula imibuzo!

Silindele wonke umntu ofuna ukunxibelelana neengcali kwintsimi yokusebenza kwe-Apache Cassandra kwintlanganiso ngoSeptemba 12 kwiofisi yethu yaseSt.

Yiza, kuya kuba nomdla!

Bhalisela umsitho.

umthombo: www.habr.com

Yongeza izimvo