Gine-ginen cikin ƙwaƙwalwar ajiya don ayyukan gidan yanar gizo: tushen fasaha da ƙa'idodi

In-Memory wani tsari ne na ra'ayoyi don adana bayanai lokacin da aka adana su a cikin RAM na aikace-aikacen, kuma ana amfani da faifan don ajiyar waje. A cikin hanyoyin gargajiya, ana adana bayanai akan faifai kuma ana adana ƙwaƙwalwar ajiya a cikin cache. Misali, aikace-aikacen gidan yanar gizo tare da bangon baya don sarrafa bayanai yana buƙace shi zuwa ajiya: yana karɓar shi, yana canza shi, kuma ana canja wurin bayanai da yawa akan hanyar sadarwar. A cikin Memory, ana aika ƙididdiga zuwa bayanan - zuwa ajiya, inda ake sarrafa su kuma cibiyar sadarwa ta ragu.

Godiya ga gine-ginensa, In-Memory yana haɓaka samun damar bayanai ta sau da yawa, kuma wani lokacin har ma da oda mai girma, da sauri. Misali, manazartan banki suna son ganin a cikin aikace-aikacen nazari rahoto kan lamuni da aka bayar a yau da kullun na shekarar da ta gabata. Wannan tsari zai ɗauki mintuna akan DBMS na yau da kullun, amma tare da In-Memory zai bayyana kusan nan da nan. Wannan saboda tsarin yana ba ku damar adana bayanai da yawa kuma ana adana shi a cikin RAM "a hannu". Aikace-aikacen baya buƙatar buƙatar bayanai daga rumbun kwamfutarka, wadatar wanda ke iyakance ta hanyar hanyar sadarwa da saurin diski.

Wadanne dama ne akwai tare da In-Memory kuma wace irin hanya ce wannan? Vladimir Pligin Injiniya a GridGain. Wannan kayan bita zai zama da amfani ga masu haɓakawa na baya na aikace-aikacen yanar gizo waɗanda ba su yi aiki tare da In-Memory ba kuma suna son gwadawa, ko kuma suna sha'awar abubuwan zamani na haɓaka software da ƙirar gine-gine.

Примечание. Labarin ya dogara ne akan kwafin rahoton Vladimir a #GetIT Conf. Kafin gabatarwar warewar kai, muna gudanar da taro akai-akai da taro don masu haɓakawa a Moscow da St. Ba zai yiwu a gudanar da taro a yanzu ba, amma lokaci yayi da za a raba kayan amfani daga waɗanda suka gabata.

Wanda ke amfani da In-Memory da kuma yadda

Ana amfani da In-Memory galibi inda ake buƙatar hulɗar mai amfani da sauri ko sarrafa bayanai masu yawa.

• Banks yi amfani da In-Memory, misali, don rage jinkiri lokacin da abokan ciniki ke amfani da aikace-aikace ko don nazarin abokin ciniki kafin bayar da lamuni.
• Fintech yana amfani da In-Memory don inganta ayyukan ayyuka da aikace-aikace na bankuna waɗanda ke fitar da sarrafa bayanai da bincike. 
• Kamfanonin inshora: don ƙididdige haɗari, misali, ta hanyar nazarin bayanan abokin ciniki a cikin shekaru da yawa.
• Kamfanonin dabaru. Suna aiwatar da bayanai da yawa, alal misali, don ƙididdige mafi kyawun hanyoyi don jigilar kaya da jigilar fasinja tare da dubban sigogi, da bin diddigin matsayin jigilar kaya.
• Retail. In-Memory mafita suna taimaka wa abokan ciniki hidima cikin sauri da aiwatar da manyan bayanai: jigilar kaya, daftari, ma'amaloli, kasancewar dubunnan kayayyaki a cikin ɗakunan ajiya, da shirya rahotannin nazari.
• В IoT In-Memory yana maye gurbin bayanan bayanan gargajiya.
• Magunguna Kamfanoni suna amfani da In-Memory, alal misali, don warwarewa ta hanyar haɗin haɗin magunguna. 

Zan gaya muku ƴan misalan yadda abokan cinikinmu ke amfani da hanyoyin In-Memory da yadda zaku iya aiwatar da su da kanku.

In-Memory azaman maajiyar farko

Ɗaya daga cikin abokan cinikinmu babban mai ba da kayan aikin kimiyyar likita ne daga Amurka. Suna amfani da maganin In-Memory azaman babban ma'ajiyar bayanan su. Ana adana duk bayanan akan faifai, kuma ɓangarorin bayanan da ake amfani da su sosai ana adana su a cikin RAM. Hanyoyin samun ma'ajiyar ma'auni ne - GDBC (Generic Database Connector) da harshen tambaya na SQL.

Gaba ɗaya ana kiran wannan In-Memory Database (IMDB) ko Ma'ajiya-Cintric Storage. Wannan aji na mafita yana da sunaye da yawa, ba waɗannan kaɗai ba. 

Fasalolin IMDB:

• Bayanan da aka adana a In-Memory kuma ana samun dama ta hanyar SQL iri ɗaya ne da sauran hanyoyin. An daidaita su, kawai hanyar gabatarwa, hanyar magance su ta bambanta. Ma'amala yana aiki tsakanin bayanai.

• IMDB yana da sauri fiye da bayanan alaƙa saboda yana da sauri don dawo da bayanai daga RAM fiye da diski. 
• Algorithms ingantawa na ciki suna da ƙarancin umarni.
• IMDBs sun dace don sarrafa bayanai, abubuwan da suka faru da ma'amaloli a aikace-aikace.

IMDBs suna goyan bayan wani bangare na ACID: Atomity, Consistency, and Warewa. Amma ba su goyi bayan "dorewa" - lokacin da aka kashe wutar lantarki, duk bayanan sun ɓace. Don magance matsalar, zaku iya amfani da hotuna - “snapshot” na bayanan, kwatankwacin ajiyar bayanai akan rumbun kwamfyuta, ko yin rikodin ma'amaloli (logs) don dawo da bayanai bayan sake kunnawa.

Don ƙirƙirar aikace-aikace masu jurewa kuskure

Bari mu yi tunanin tsarin gine-gine na yau da kullun na aikace-aikacen yanar gizo mai jurewa kuskure. Yana aiki kamar haka: duk buƙatun ana rarraba su ta hanyar ma'aunin yanar gizo tsakanin sabobin. Wannan tsarin ya tsaya tsayin daka saboda sabobin suna kwafi juna kuma suna ajiyewa idan abin ya faru.

Ma'auni yana jagorantar duk buƙatun daga zama ɗaya kai tsaye zuwa sabar ɗaya. Wannan tsarin zaman sanda ne: kowane zama yana da alaƙa da uwar garken inda aka adana shi da sarrafa shi a cikin gida. 

Me zai faru idan ɗaya daga cikin sabobin ya gaza?

Ba za a shafi sabis ɗin ba saboda ana kwafin gine-ginen. Amma za mu rasa wani yanki na zaman mataccen uwar garken. Kuma a lokaci guda, masu amfani waɗanda ke daure ga waɗannan zaman. Misali, abokin ciniki ya ba da oda kuma ba zato ba tsammani ya jefa shi daga ofis. Ba zai ji daɗi ba idan ya sake shiga kuma ya ga cewa za a sake yin komai.

Ana buƙatar aikace-aikacen yanar gizo don tallafawa ɗimbin masu amfani kuma kada a rage gudu don su iya aiki cikin kwanciyar hankali. Amma idan aka ƙi, tare da kowane buƙatar na gaba lokacin da ake ɗauka don sadarwa tare da kantin sayar da zaman zai ƙaru. Wannan yana ƙara matsakaicin latency ga sauran masu amfani. Amma ba sa son jira fiye da yadda suka saba.

Ana iya magance wannan matsalar kamar sauran abokin cinikinmu, babban mai bada PASS daga Amurka. Yana amfani da In-Memory don tara zaman gidan yanar gizo. Don yin wannan, yana adana su ba a cikin gida ba, amma a tsakiya - a cikin gungu na In-Memory. A wannan yanayin, ana samun zaman da sauri saboda sun riga sun kasance cikin RAM.

Lokacin da uwar garken ya yi karo, mai daidaitawa yana aika buƙatun daga uwar garken da ya fadi zuwa wasu sabar, kamar yadda yake a cikin gine-ginen gargajiya. Amma akwai bambanci mai mahimmanci: Ana adana zaman a cikin gungu na In-Memory kuma sabobin suna samun damar zuwa zaman sabar da ta fadi.

Wannan gine-gine yana ƙara haƙuri ga kuskuren dukan tsarin. Bugu da ƙari, yana yiwuwa a watsar da tsarin zaman sanda gaba ɗaya.

Haɓaka Ma'amalar Analytical Processing (HTAP)

Yawanci, tsarin ma'amala da na nazari an ware su daban. Lokacin da suka rabu, babban tushe yana zuwa ƙarƙashin kaya. Don sarrafa nazari, ana kwafin bayanai zuwa kwafi don kada sarrafa bayanai ya tsoma baki tare da hanyoyin ciniki. Amma kwafi yana faruwa tare da lag-ba shi yiwuwa a yi kwafi ba tare da lag ba. Idan muka yi wannan aiki tare, hakanan zai rage jinkirin babban tushe kuma ba za mu sami nasara ba.

A cikin HTAP, komai yana aiki daban-daban - ana amfani da kantin sayar da bayanai iri ɗaya don ɗaukar kaya daga aikace-aikacen, da kuma tambayoyin nazari waɗanda zasu iya ɗaukar lokaci mai tsawo don kammalawa. Lokacin da bayanai ke cikin RAM, ana aiwatar da tambayoyin bincike cikin sauri, kuma uwar garken da ke da bayanan ba ta da nauyi (a matsakaita).

Hanyar haɗaka ta rushe bango tsakanin sarrafa ma'amala da nazari. Idan muka yi nazari akan ajiya iri ɗaya, to ana ƙaddamar da tambayoyin nazari akan bayanai daga RAM. Sun fi daidai, mafi fassarori da wadatuwa.

Haɗe-haɗe na Maganin A-Memory

Hanya mai sauƙi (dangantacce) - bunkasa komai daga karce. Muna adana bayanai akan faifai kuma muna adana bayanai masu zafi a ƙwaƙwalwar ajiya. Wannan yana taimakawa tsira daga sake kunnawa uwar garken ko katsewa.

Akwai manyan yanayi guda biyu a wurin aiki anan lokacin da aka adana bayanai akan faifai. A cikin farko, muna so mu tsira daga hadarurruka ko sake yi na yau da kullun na tari ko sassa - muna son amfani da shi azaman bayanai mai sauƙi. A cikin yanayi na biyu, lokacin da bayanai suka yi yawa, wasu daga cikinsu suna cikin ƙwaƙwalwar ajiya.

Idan ba zai yiwu a gina komai daga karce ba, yana yiwuwa a haɗa In-Memory cikin riga data kasance gine. Amma ba duk In-Memory mafita ne dace da wannan. Akwai sharuɗɗa na wajibi guda uku. Maganin In-Memory dole ne ya goyi bayan:

• daidaitaccen hanyar haɗi zuwa bayanan bayanan da za su kasance a ƙarƙashinsa (misali, MySQL);
• daidaitaccen harshen tambaya, don kada a sake rubutawa da canza ma'anar hulɗa tare da ma'aji;
• ma'amala - adana ma'anar mu'amala.

Idan duk sharuɗɗan guda uku sun cika, to haɗin kai yana yiwuwa. Muna sanya Grid Data In-Memory tsakanin aikace-aikacen da bayanan bayanai. Yanzu rubuta buƙatun za a ba da su zuwa ga bayanan da ke ƙasa, kuma za a tura buƙatun karantawa zuwa bayanan da ke ƙasa idan bayanan ba a cikin cache.

Idan saurin samun bayanai da sarrafa shi yana da mahimmanci a gare ku, misali, don nazarin kasuwanci, zaku iya tunanin aiwatar da In-Memory. Kuma don aiwatarwa, zaku iya amfani da hanyoyi guda biyu lokacin zayyana sabon gine-gine.

source: www.habr.com