Ikhasimende belifuna i-VDI. Ngibheke ngempela inhlanganisela ye-SimpliVity + VDI Citrix Virtual Desktop. Kubo bonke opharetha, abasebenzi basehhovisi ledolobha, njalonjalo. Kunabasebenzisi abayizinkulungwane ezinhlanu kugagasi lokuqala lokufuduka kuphela, ngakho-ke baphikelela ekuhlolweni komthwalo. I-VDI ingaqala ukwehla, ingalala ngokuthula - futhi lokhu akwenzeki ngaso sonke isikhathi ngenxa yezinkinga esiteshini. Sithenge iphakheji yokuhlola enamandla kakhulu eqondiswe ngqo i-VDI futhi salayisha ingqalasizinda yaze yaba nzima kakhulu kumadiski nakuphrosesa.
Ngakho-ke, sizodinga ibhodlela lepulasitiki nesofthiwe ye-LoginVSI yokuhlolwa kwe-VDI okuyinkimbinkimbi. Sinayo enamalayisense abasebenzisi abangu-300. Sabe sesithatha ihadiwe ye-HPE SimpliVity 380 ephaketheni elifanele umsebenzi wokuminyana komsebenzisi ngeseva ngayinye, sasika imishini ebonakalayo ngokubhaliswa okuhle kakhulu, safaka isoftware yehhovisi kuWin10 kuyo futhi saqala ukuhlola.
Hamba!
Uhlelo
Amanodi amabili we-HPE SimpliVity 380 Gen10 (amaseva). Kokunye:
- 2 x Intel Xeon Platinum 8170 26c 2.1Ghz.
- I-RAM: 768GB, 12 x 64GB LRDIMMs DDR4 2666MHz.
- Isilawuli sediski esiyinhloko: HPE Smart Array P816i-a SR Gen10.
- Amadrayivu amakhulu: 9 x 1.92 TB SATA 6Gb/s SSD (ekucushweni kwe-RAID6 7+2, okungukuthi lena imodeli Emaphakathi ngokwemibandela ye-HPE SimpliVity).
- Amakhadi enethiwekhi: 4 x 1Gb Eth (idatha yomsebenzisi), 2 x 10Gb Eth (SimpliVity ne-vMotion backend).
- Amakhadi e-FPGA akhethekile akhelwe ngaphakathi endaweni ngayinye yokudonswa/ukucindezela.
Amanodi axhumene komunye nomunye nge-interconnect ye-10Gb Ethernet ngokuqondile ngaphandle kokushintsha kwangaphandle, okusetshenziselwa i-SimpliVity backend kanye nokudlulisa idatha yomshini ebonakalayo nge-NFS. Idatha yomshini we-virtual ku-cluster ihlale iboniswa phakathi kwamanodi amabili.
Amanodi ahlanganiswa abe yiqoqo le-Vmware vSphere eliphethwe yi-vCenter.
Ukuze kuhlolwe, kusetshenziswe isilawuli sesizinda kanye nomthengisi woxhumano lwe-Citrix. Isilawuli sesizinda, umdayisi kanye ne-vCenter zibekwe kuqoqo elihlukile.
Njengengqalasizinda yokuhlola, amadeskithophu angama-300 asetshenziswa ekucushweni kwe-Dedicated - Full Copy, okungukuthi, ideskithophu ngayinye iyikhophi ephelele yesithombe sokuqala somshini obonakalayo futhi ilondoloza zonke izinguquko ezenziwe abasebenzisi.
Umshini ngamunye obonakalayo une-2vCPU ne-4GB RAM:
Isofthiwe elandelayo edingekayo ukuze ihlolwe ifakwe emishinini ebonakalayo:
- Windows 10 (64-bit), inguqulo 1809.
- I-Adobe Reader XI.
- I-Citrix Virtual Delivery Agent 1811.1.
- I-Doro PDF 1.82.
- I-Java 7 Update 13.
- I-Microsoft Office Professional Plus 2016.
Phakathi kwamanodi - ukuphindaphinda okuvumelanayo. Ibhulokhi ngayinye yedatha kuqoqo inamakhophi amabili. Okusho ukuthi, manje kunesethi ephelele yedatha ku-node ngayinye. Ngeqoqo lamanodi amathathu noma ngaphezulu, amakhophi amabhlogo asezindaweni ezimbili ezihlukene. Lapho udala i-VM entsha, kwakhiwa ikhophi eyengeziwe kwenye yama-cluster node. Uma i-node eyodwa ihluleka, wonke ama-VM ayesebenza kuyo aqalwa kabusha ngokuzenzakalelayo kwamanye ama-node lapho anezifaniso. Uma i-node ihluleka isikhathi eside, khona-ke ukubuyiselwa kancane kancane kokuphindaphinda kuyaqala, futhi iqoqo libuyela ku-N+1 redundancy.
Ukulinganisa nokugcinwa kwedatha kwenzeka ezingeni lokugcina isofthiwe ye-SimpliVity ngokwayo.
Imishini ebonakalayo isebenzisa iqoqo le-virtualization, eliphinde libeke endaweni yokugcina isofthiwe. Amadeski ngokwawo athathwe ngokulandela isifanekiso esijwayelekile: amadeski osozimali kanye nezikhulu zokusebenza eze ukuze azohlolwa (lezi izifanekiso ezimbili ezihlukene).
Ukuhlola
Ukuze kuhlolwe, kusetshenziswe uhlelo lokuhlola lwesofthiwe ye-LoginVSI 4.1. I-LoginVSI complex, ehlanganisa iseva yokulawula kanye nemishini engu-12 yokuxhumeka kokuhlola, yasetshenziswa kumsingathi ohlukile ongokwenyama.
Ukuhlolwa kwenziwa ngezindlela ezintathu:
Imodi yebhentshimakhi - layisha amacala abasebenzi boLwazi abangama-300 kanye nabasebenzi beSitoreji abangama-300.
Imodi ejwayelekile - ikesi yokulayisha i-300 Power workers.
Ukuze izisebenzi zamandla zikwazi ukusebenza futhi zandise ukuhlukahluka komthwalo, ilabhulali yamafayela e-Power Library eyengeziwe yengezwe kunxanxathela ye-LoginVSI. Ukuqinisekisa ukuphinda kwemiphumela, zonke izilungiselelo zebhentshi lokuhlola zishiywe Njengokuzenzakalelayo.
Ukuhlolwa kwezisebenzi zolwazi kanye namandla kulingisa umthwalo wangempela wabasebenzisi abasebenza ezindaweni zokusebenza ezibonakalayo.
Ukuhlolwa kwezisebenzi zeSitoreji kwadalelwa ngokukhethekile ukuhlola amasistimu okugcina idatha; kukude nomthwalo wangempela womsebenzi futhi ikakhulukazi kuhilela umsebenzisi osebenza nenani elikhulu lamafayela anosayizi abahlukahlukene.
Ngesikhathi sokuhlola, abasebenzisi bangena kuziteshi zokusebenza imizuzu engama-48 ngenani elicishe libe ngumsebenzisi oyedwa njalo ngemizuzwana eyi-10.
Imiphumela
Umphumela oyinhloko wokuhlolwa kwe-LoginVSI imethrikhi ye-VSImax, ehlanganiswa kusukela esikhathini sokwenziwa semisebenzi ehlukahlukene eqaliswe umsebenzisi. Isibonelo: isikhathi sokuvula ifayela ku-Notepad, isikhathi sokucindezela ifayela ku-7-Zip, njll.
Incazelo enemininingwane yokubala kwamamethrikhi iyatholakala kumadokhumenti asemthethweni we .
Ngamanye amazwi, i-LoginVSI iphinda iphethini yokulayisha evamile, ilingisa izenzo zabasebenzisi ku-ofisi, ukufunda i-PDF, nokunye, futhi ikala ukubambezeleka okuhlukahlukene. Kunezinga elibalulekile lokubambezeleka "konke kuhamba kancane, akunakwenzeka ukusebenza"), ngaphambi kwalokho kubhekwa ukuthi inani eliphezulu labasebenzisi alifinyelelwanga. Uma isikhathi sokuphendula sishesha ngo-1 ms kunalesi simo sokuthi "yonke into ihamba kancane", isistimu ibhekwa njengesebenza ngokujwayelekile, futhi abasebenzisi abaningi bangangezwa.
Nawa amamethrikhi ayinhloko:
Amamethrikhi
Izenzo ezithathiwe
Okuningiliziwe incazelo
Izingxenye ezilayishiwe
N.S.L.D.
Isikhathi sokuvula umbhalo
ifayela elinesisindo esingu-1 KB
Inothiphedi iyavula futhi
ivula idokhumenti engahleliwe engu-1 KB ekopishwe echibini
izinsiza
CPU kanye I/O
I-NFO
Isikhathi sokuvula inkhulumomphendvulwano
amawindi ku-notepad
Ukuvula ifayela le-VSI-Notepad [Ctrl+O]
CPU, RAM kanye I/O
ZHC*
Isikhathi sokudala ifayela le-Zip elicindezelwe kakhulu
Ukucindezelwa kwendawo
okungahleliwe 5MB .pst ifayela elikopishwe kusuka
iphuli yezinsiza
CPU kanye I/O
I-ZLC*
Isikhathi sokudala ifayela le-Zip elicindezelwe kancane
Ukucindezelwa kwendawo
okungahleliwe 5MB .pst ifayela elikopishwe kusuka
iphuli yezinsiza
I / O
CPU
Ukubala okukhulu
uhlu lwedatha olungahleliwe
Ukwakha Uhlu Olukhulu
idatha engahleliwe ezosetshenziswa kusibali sikhathi sokufaka/sokukhiphayo (I/O timer)
CPU
Uma kwenziwa ukuhlola, i-metric ye-VSIbase eyisisekelo iqala ibalwa, ebonisa isivinini imisebenzi eyenziwa ngaso ngaphandle komthwalo ohlelweni. Ngokusekelwe kuyo, kunqunywa i-VSImax Threshold, elingana ne-VSIbase + 1ms.
Iziphetho mayelana nokusebenza kwesistimu zenziwa ngokusekelwe kumamethrikhi amabili: I-VSIbase, enquma isivinini sesistimu, kanye nomkhawulo we-VSImax, onquma inombolo enkulu yabasebenzisi isistimu engakwazi ukubaphatha ngaphandle kokuwohloka okukhulu.
300 abasebenzi Ulwazi benchmark
Izisebenzi zolwazi zingabasebenzisi abavame ukulayisha inkumbulo, iphrosesa kanye ne-IO ngeziqongo ezincane ezihlukahlukene. Isofthiwe ilingisa umthwalo womsebenzi wabasebenzisi basehhovisi abafuna ngenkani, njengokungathi bahlala behlohla okuthile (PDF, Java, office suite, ukubukwa kwesithombe, 7-Zip). Njengoba ungeza abasebenzisi ukusuka kuqanda ukuya ku-300, ukubambezeleka komunye nomunye kuyanda kancane kancane.
Idatha yezibalo ze-VSImax:
I-VSIbase = 986ms, i-VSI Threshold ayifinyelelwanga.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Ngalolu hlobo lomthwalo, isistimu ingakwazi ukumelana nomthwalo owengeziwe ngaphandle kokuwohloka ekusebenzeni. Isikhathi esisithathayo ukuqedela imisebenzi yomsebenzisi sikhula ngokushelela, isikhathi sokuphendula sesistimu asishintshi phakathi nokuhlolwa futhi sifika ku-3 ms ngokubhala futhi sifika ku-1 ms wokufunda.
Isiphetho: Abasebenzisi bolwazi abangu-300 basebenza kuqoqo lamanje ngaphandle kwezinkinga futhi abaphazamisi abanye, bafinyelela ukubhalisa ngokweqile kwe-pCPU/vCPU kokungu-1 kuya kokungu-6. Ukulibaziseka kukonke kukhula ngokulinganayo njengoba umthwalo ukhula, kodwa umkhawulo obekiwe awukafinyelelwa.
300 abasebenzi Storage benchmark
Laba abasebenzisi abahlale bebhala futhi befunda ngesilinganiso esingu-30 kuye ku-70, ngokulandelanayo. Lokhu kuhlola kwenziwa okwengeziwe ngenjongo yokuhlola. Idatha yezibalo ze-VSImax:
I-VSIbase = 1673, i-VSI Threshold ifinyelelwe kubasebenzisi abangama-240.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Lolu hlobo lomthwalo luyisivivinyo sokucindezeleka sesistimu yokugcina. Uma isenziwa, umsebenzisi ngamunye ubhala amafayela amaningi angahleliwe anosayizi abahlukene kudiski. Kulesi simo, kungase kubonakale ukuthi lapho umkhawulo othile wokulayisha udlula kwabanye abasebenzisi, isikhathi esithathayo ukuqedela imisebenzi yokubhala amafayela siyakhula. Ngesikhathi esifanayo, umthwalo ohlelweni lokugcina, iphrosesa kanye nenkumbulo yabasingathi akushintshi kakhulu, ngakho-ke okwamanje akunakwenzeka ukucacisa ukuthi yini ebangela ukubambezeleka.
Iziphetho mayelana nokusebenza kwesistimu kusetshenziswa lokhu kuhlola zingenziwa kuphela uma kuqhathaniswa nemiphumela yokuhlola kwamanye amasistimu, njengoba imithwalo enjalo iyenziwa futhi ayinangqondo. Nokho, sekukonke ukuhlolwa kuhambe kahle. Konke kuhambe kahle kwaze kwafika amaseshini angu-210, kwase kuqala izimpendulo eziyinqaba, ezingalandelwanga ndawo ngaphandle kwe-Login VSI.
Abasebenzi bakagesi abangama-300
Laba abasebenzisi abathanda i-CPU, inkumbulo ne-IO ephezulu. Laba “basebenzisi bamandla” bavame ukwenza imisebenzi eyinkimbinkimbi ngokuqhuma okude, njengokufaka isofthiwe entsha nokukhipha izingobo zomlando ezinkulu. Idatha yezibalo ze-VSImax:
I-VSIbase = 970, i-VSI Threshold ayifinyelelwanga.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Ngesikhathi sokuhlolwa, umkhawulo wokulayisha iphrosesa wafinyelelwa kwenye yezinhlelo zesistimu, kodwa lokhu akuzange kube nomthelela omkhulu ekusebenzeni kwayo:
Kulokhu, isistimu ingakwazi ukumelana nomthwalo owandayo ngaphandle kokuwohloka okuphawulekayo kokusebenza. Isikhathi esisithathayo ukuqedela imisebenzi yomsebenzisi sikhula ngokushelela, isikhathi sokuphendula kwesistimu asishintshi phakathi nokuhlolwa futhi sifika ku-3 ms ngokubhala futhi sifika ku-1 ms wokufunda.
Ukuhlola okuvamile kwakunganele kukhasimende, futhi saqhubeka: sandisa izici ze-VM (inani lama-vCPU ukuze sihlole ukwanda kokubhalisa ngokweqile kanye nosayizi wediski) futhi sengeza umthwalo owengeziwe.
Lapho kwenziwa izivivinyo ezengeziwe, ukucushwa kwesitendi okulandelayo kwasetshenziswa:
Amadeskithophu angama-300 asetshenziswa ku-4vCPU, 4GB RAM, 80GB HDD ukulungiselelwa.
Ukucushwa komunye wemishini yokuhlola:
Imishini isatshalaliswa kunketho ethi Dedicated - Full Copy:
Abasebenzi bolwazi abangama-300 benchmark ngokubhaliselwa ngokweqile 12
Idatha yezibalo ze-VSImax:
I-VSIbase = 921 ms, i-VSI Threshold ayifinyelelwanga.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Imiphumela etholiwe ifana nokuhlola ukucushwa kwe-VM kwangaphambilini.
Izisebenzi zamandla ezingu-300 ezinokubhalisela okungaphezu kuka-12
Idatha yezibalo ze-VSImax:
I-VSIbase = 933, i-VSI Threshold ayifinyelelwanga.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Phakathi nalokhu kuhlolwa, umkhawulo wokulayisha iphrosesa nawo ufinyelelwe, kodwa lokhu akuzange kube nomthelela omkhulu ekusebenzeni:
Imiphumela etholiwe ifana nokuhlola ukucushwa kwangaphambilini.
Kwenzekani uma ugijimisa umthwalo amahora angu-10?
Manje ake sibone ukuthi kuzoba khona yini "umphumela wokuqongelela" futhi siqhube izivivinyo amahora angu-10 ngokulandelana.
Ukuhlolwa kwesikhathi eside kanye nencazelo yesigaba kufanele kuhloswe ukuthi besifuna ukuhlola ukuthi ngabe zikhona yini izinkinga ezingavela nge-truss ngaphansi komthwalo omude kuwo.
300 abasebenzi Ulwazi benchmark + 10 amahora
Ukwengeza, kwahlolwa inqwaba yezisebenzi zolwazi, kwalandelwa umsebenzi wabasebenzisi amahora ayi-300.
Idatha yezibalo ze-VSImax:
I-VSIbase = 919 ms, i-VSI Threshold ayifinyelelwanga.
Idatha yezibalo enemininingwane ye-VSImax:
Igrafu ikhombisa ukuthi akukho ukwehliswa kokusebenza okubonwa kulo lonke isivivinyo.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Ukusebenza kwesistimu yesitoreji kuhlala kunjalo kulo lonke uhlolo.
Ukuhlola okwengeziwe ngokwengezwa komthwalo wokwenziwa
Ikhasimende licele ukwengeza umthwalo ongalawuleki kudiski. Ukwenza lokhu, umsebenzi wengezwe ohlelweni lwesitoreji emshinini ngamunye obonakalayo womsebenzisi ukuze kuqhutshwe umthwalo wokwenziwa kudiski lapho umsebenzisi engena ohlelweni. Umthwalo unikezwe insiza ye-fio, ekuvumela ukuthi ukhawulele umthwalo kudiski ngenombolo ye-IOPS. Emshinini ngamunye, kwaqalwa umsebenzi wokwethula umthwalo owengeziwe ngenani lama-22 IOPS 70%/30% Ukufunda/Bhala okungahleliwe.
300 abasebenzi Ulwazi benchmark + 22 IOPS umsebenzisi ngamunye
Ekuhlolweni kokuqala, i-fio yatholwa ibeka i-CPU ngaphezulu kwemishini ebonakalayo. Lokhu kuholele ekulayisheni ngokushesha kwe-CPU yabasingathi futhi kuthinte kakhulu ukusebenza kwesistimu lulonke.
Ibamba umthwalo we-CPU:
Ngesikhathi esifanayo, ukubambezeleka kwesistimu yokugcina nakho kukhuphuke ngokwemvelo:
Ukuntuleka kwamandla ekhompyutha kuye kwaba bucayi cishe kubasebenzisi abangama-240:
Ngenxa yemiphumela etholiwe, kwanqunywa ukuthi kwenziwe ukuhlola okwakungagxili kakhulu kwi-CPU.
230 abasebenzi basehhovisi benchmark + 22 IOPS ngomsebenzisi ngamunye
Ukuze kuncishiswe umthwalo ku-CPU, kwakhethwa uhlobo lokulayisha lwezisebenzi zaseHhovisi, futhi ama-IOPS angama-22 omthwalo wokwenziwa nawo angezwa kuseshini ngayinye.
Ukuhlola bekukhawulelwe kumaseshini angu-230 ukuze kungeqi ubukhulu bomthwalo we-CPU.
Ukuhlola kwenziwe nabasebenzisi abasebenzisa amahora angu-10 ukuze bahlole ukuzinza kwesistimu phakathi nokusebenza kwesikhathi eside eduze nomthwalo omkhulu.
Idatha yezibalo ze-VSImax:
I-VSIbase = 918 ms, i-VSI Threshold ayifinyelelwanga.
Idatha yezibalo enemininingwane ye-VSImax:
Igrafu ikhombisa ukuthi akukho ukwehliswa kokusebenza okubonwa kulo lonke isivivinyo.
Izibalo zokulayisha i-CPU:
Lapho kwenziwa lokhu kuhlola, umthwalo ku-CPU yabasingathi wawucishe ube mkhulu.
Izibalo zokulayisha isistimu yesitoreji kusukela ekuqaphelweni kwe-SimpliVity:
Ukusebenza kwesistimu yesitoreji kuhlala kunjalo kulo lonke uhlolo.
Umthwalo ohlelweni lwesitoreji ngesikhathi sokuhlolwa wawucishe ube ngu-6 IOPS esilinganisweni esingu-500/60 (40 IOPS ifundwe, 3 IOPS bhala), okungaba ngu-900 IOPS endaweni ngayinye yokusebenza.
Isikhathi sokuphendula sibe nesilinganiso esingu-3 ms ngokubhala futhi sifike ku-1 ms ukufunda.
Umphumela
Lapho kulingisa imithwalo yangempela engqalasizinda ye-HPE SimpliVity, kwatholwa imiphumela eqinisekisa ikhono lesistimu lokusekela amadeskithophu abonakalayo okungenani angu-300 wemishini egcwele ye-Clone kuma-node amabili e-SimpliVity. Ngesikhathi esifanayo, isikhathi sokuphendula sesistimu yesitoreji sagcinwa ezingeni eliphezulu kulo lonke ukuhlolwa.
Sihlatshwa umxhwele kakhulu indlela yokuhlola okude nokuqhathaniswa kwezixazululo ngaphambi kokuqaliswa. Singahlola ukusebenza komthwalo wakho futhi uma uthanda. Kubandakanya nezinye izixazululo ze-hyperconverged. Ikhasimende elishiwo manje seliqedela ukuhlolwa kwesinye isixazululo ngokuhambisana. Ingqalasizinda yayo yamanje imane iyinqwaba yama-PC, isizinda kanye nesofthiwe endaweni ngayinye yokusebenza. Ukuthuthela ku-VDI ngaphandle kokuhlolwa, kunjalo, kunzima kakhulu. Ngokuqondile, kunzima ukuqonda amakhono wangempela epulazi le-VDI ngaphandle kokuthutha abasebenzisi bangempela kulo. Futhi lezi zivivinyo zikuvumela ukuthi uhlole ngokushesha amakhono wangempela wesistimu ethile ngaphandle kwesidingo sokubandakanya abasebenzisi abajwayelekile. Kulapho lolu cwaningo luqhamuke khona.
Indlela yesibili ebalulekile ukuthi ikhasimende lizibophezele ngokushesha ekulinganiseni okufanele. Lapha ungathenga iseva eyengeziwe futhi wengeze ipulazi, isibonelo, kubasebenzisi abangu-100, konke kubikezelwa ngentengo yomsebenzisi. Isibonelo, lapho bedinga ukungeza abasebenzisi abangu-300 ngaphezulu, bazokwazi ukuthi badinga amaseva amabili ekucushweni osekuchaziwe, kunokuba bacabangele kabusha ukuthuthukisa yonke ingqalasizinda yabo.
Amathuba womfelandawonye we-HPE SimpliVity ayathandeka. Ibhizinisi lihlukene ngokwendawo, ngakho-ke kunengqondo ukufaka ihadiwe yakho ye-VDI ehlukile ehhovisi elikude. Emfelandawonye we-SimpliVity, umshini ngamunye we-virtual uphindaphindwa ngokuvumelana neshejuli enekhono lokuphindaphinda phakathi kwamaqoqo akude endaweni ngokushesha okukhulu futhi ngaphandle komthwalo esiteshini - lesi isipele esakhelwe ngaphakathi sezinga elihle kakhulu. Lapho kuphindaphindwa ama-VM phakathi kwamasayithi, isiteshi sisetshenziswa kancane ngangokunokwenzeka, futhi lokhu kwenza kube nokwenzeka ukwakha izakhiwo ze-DR ezithakazelisa kakhulu phambi kwesikhungo sokulawula esisodwa kanye nenqwaba yezindawo zokugcina ezihlukanisiwe.
Konke lokhu ndawonye kwenza kube nokwenzeka ukuhlola uhlangothi lwezezimali ngokuningiliziwe, kanye nokubeka phezulu izindleko ze-VDI ezinhlelweni zokukhula kwenkampani, nokuqonda ukuthi isisombululo sizokhokha ngokushesha kangakanani nokuthi sizosebenza kanjani. Ngoba noma iyiphi i-VDI iyisixazululo ekugcineni esigcina izinsiza eziningi, kodwa ngesikhathi esifanayo, cishe, ngaphandle kwethuba elingabizi kakhulu lokulishintsha phakathi neminyaka engu-5-7 yokusetshenziswa.
Ngokuvamile, uma unemibuzo okungeyona eyamazwana, ngibhalele nge-imeyili [i-imeyili ivikelwe].
Source: www.habr.com