HighLoad++, Evgeniy Kuzovlev (EcommPay IT): he aha ka mea e hana ai inā he $100000 ka manawa hoʻomaha.

Ke kamaʻilio nei nā mea a pau e pili ana i nā kaʻina hana o ka hoʻomohala ʻana a me ka hoʻāʻo ʻana, ka hoʻomaʻamaʻa ʻana i nā limahana, ka hoʻonui ʻana i ka hoʻoikaika ʻana, akā ʻaʻole lawa kēia mau kaʻina i ka wā e hoʻopau ai ka minuke o ka lawelawe ʻana i nā kālā he nui. He aha kāu e hana ai inā hoʻokō ʻoe i nā kālepa kālā ma lalo o kahi SLA koʻikoʻi? Pehea e hoʻonui ai i ka hilinaʻi a me ka hoʻomanawanui hewa o kāu mau ʻōnaehana, e lawe ana i ka hoʻomohala a me ka hoʻāʻo ʻana mai ka hoʻohālikelike?

E mālama ʻia ka hālāwai HighLoad++ aʻe ma ʻApelila 6 a me 7, 2020 ma St. Petersburg. Nā kikoʻī a me nā tiketi no loulou. Nowemapa 9, 18:00. HighLoad++ Moscow 2018, Delhi + Kolkata hale. Theses and hōʻikeʻike.

Evgeniy Kuzovlev (ma hope aku - EC): - E nā hoa, aloha! ʻO Kuzovlev Evgeniy koʻu inoa. No ka hui ʻo EcommPay wau, ʻo kahi mahele kikoʻī ʻo EcommPay IT, ka māhele IT o ka hui o nā hui. A i kēia lā e kamaʻilio mākou e pili ana i nā manawa haʻahaʻa - pehea e pale aku ai iā lākou, pehea e hōʻemi ai i kā lākou hopena inā ʻaʻole hiki ke pale ʻia. Ua ʻōlelo ʻia ke kumuhana penei: "He aha ka hana inā he $100 ka minuke o ka manawa hoʻomaha"? Ke nānā nei i mua, ua like kā mākou helu.

He aha ka hana a EcommPay IT?

ʻO wai mākou? No ke aha wau e kū nei i mua ou? No ke aha he kuleana koʻu e haʻi aku iā ʻoe ma ʻaneʻi? A he aha kā mākou e kamaʻilio hou ai ma ʻaneʻi?

ʻO ka hui ʻo EcommPay kahi mea kūʻai honua. Hana mākou i nā uku ma ka honua holoʻokoʻa - ma Rusia, ʻEulopa, Asia Hikina Hema (A puni ka Honua). Loaʻa iā mākou 9 mau keʻena, 500 mau limahana i ka huina, a ma kahi o ka hapalua o lākou he poʻe loea IT. ʻO nā mea a pau a mākou e hana ai, nā mea a pau a mākou e loaʻa kālā ai, hana mākou iā mākou iho.

Ua kākau mākou i kā mākou huahana āpau (a he nui loa mākou - ma kā mākou laina o nā huahana IT nui loaʻa iā mākou ma kahi o 16 mau mea like ʻole) iā mākou iho; Kākau mākou iā mākou iho, hoʻomohala mākou iā mākou iho. A i kēia manawa ke hana nei mākou ma kahi o hoʻokahi miliona mau hana i ka lā (miliona paha ke ala kūpono e ʻōlelo ai). He hui ʻōpio maikaʻi mākou - ʻeono wale nō makahiki o mākou.

ʻO 6 mau makahiki i hala aku nei he hoʻomaka ia i ka wā i hele mai ai nā kāne me ka ʻoihana. Hoʻohui ʻia lākou e kahi manaʻo (ʻaʻohe mea ʻē aʻe he manaʻo wale nō), a holo mākou. E like me kekahi hoʻomaka, holo wikiwiki mākou ... No mākou, ʻoi aku ka nui o ka wikiwiki ma mua o ka maikaʻi.

I kekahi manawa ua kū mākou: ua ʻike mākou ʻaʻole hiki iā mākou ke ola hou i kēlā wikiwiki a me kēlā ʻano maikaʻi a pono mākou e nānā mua i ka maikaʻi. I kēia manawa, ua hoʻoholo mākou e kākau i kahi paepae hou e pololei, hiki ke hoʻonui a hilinaʻi. Ua hoʻomaka lākou e kākau i kēia kahua (hoʻomaka lākou e hoʻopukapuka kālā, hoʻomohala i ka hoʻomohala ʻana, hoʻāʻo), akā i kekahi manawa ua ʻike lākou ʻaʻole hiki i ka hoʻomohala ʻana a me ka hoʻāʻo ʻana iā mākou ke hiki i kahi pae hou o ka maikaʻi o ka lawelawe.

Hana ʻoe i kahi huahana hou, hoʻokomo ʻoe iā ia i loko o ka hana, akā e hele hewa kekahi mea ma kahi. A i kēia lā e kamaʻilio mākou e pili ana i ka hiki ʻana i kahi pae maikaʻi hou (pehea mākou i hana ai, e pili ana i kā mākou ʻike), lawe i ka hoʻomohala ʻana a me ka hoʻāʻo ʻana mai ka hoʻohālikelike; e kamaʻilio mākou e pili ana i nā mea i loaʻa i ka hana - he aha ka hana e hiki ke hana iā ia iho, ka mea hiki ke hāʻawi i ka hoʻāʻo ʻana i mea e hoʻoikaika ai i ka maikaʻi.

Nā manawa hoʻomaha. Kauoha o ka hana.

ʻO ka pōhaku kihi nui, ʻo ka mea a mākou e kamaʻilio maoli ai i kēia lā he downtime. He ʻōlelo weliweli. Inā loaʻa iā mākou ka manawa haʻahaʻa, ʻino nā mea āpau iā mākou. Ke holo nei mākou e hoʻokiʻekiʻe, paʻa nā mea hoʻokele i ke kikowaena - ʻaʻole e hāʻule ke Akua, e like me kā lākou e ʻōlelo ai i kēlā mele. ʻO kēia kā mākou e kamaʻilio ai i kēia lā.

I ka wā i hoʻomaka ai mākou e hoʻololi i kā mākou ala, ua hana mākou i 4 mau kauoha. Ua hōʻike wau iā lākou ma nā kiʻi paheʻe:

He mea maʻalahi kēia mau kauoha:

• E ʻike koke i ka pilikia.
• E hoopau koke aku.
• Kōkua e hoʻomaopopo i ke kumu (ma hope, no nā mea hoʻomohala).
• A hoʻohālikelike i nā hoʻokokoke.

Makemake wau e huki i kou manaʻo i ka helu helu 2. Ke hoʻopau nei mākou i ka pilikia, ʻaʻole hoʻoholo. He lua ka hoʻoholo. No mākou, ʻo ka mea nui ka pale ʻia o ka mea hoʻohana mai kēia pilikia. E noho ana ia ma kekahi wahi kaawale, akā, ʻaʻole pili kēia kaiapuni me ia. ʻOiaʻiʻo, e hele mākou i kēia mau pūʻulu pilikia ʻehā (ʻoi aku ka kikoʻī o kekahi, ʻoi aku ka liʻiliʻi o kekahi), e haʻi wau iā ʻoe i ka mea a mākou e hoʻohana ai, he aha ka ʻike kūpono i loaʻa iā mākou i nā hoʻonā.

Hoʻoponopono pilikia: I ka manawa hea lākou e hana ai a pehea e hana ai iā lākou?

Akā, e hoʻomaka mākou ma waho o ke kauoha, e hoʻomaka mākou me ka helu 2 - pehea e hoʻopau koke ai i ka pilikia? Aia kahi pilikia - pono mākou e hoʻoponopono. "He aha kā mākou e hana ai no kēia?" - ka nīnau nui. A i ka wā i hoʻomaka ai mākou e noʻonoʻo pehea e hoʻoponopono ai i ka pilikia, ua kūkulu mākou no mākou iho i kekahi mau koi e pono ai ka hoʻoponopono ʻana.

No ka hoʻokumuʻana i kēia mau koi, ua hoʻoholo mākou e nīnau iā mākou iho i ka nīnau: "I ka manawa hea mākou e pilikia ai"? A ʻo nā pilikia, e like me ka mea i ʻike ʻia, hiki i nā hihia ʻehā:

• ʻAʻole paʻa paʻa.
• Ua hāʻule nā ​​lawelawe waho.
• Ke hoʻololi nei i ka polokalamu polokalamu (ka hoʻolaha like).
• ʻO ka ulu ʻana o ka ukana pahū.

ʻAʻole mākou e kamaʻilio e pili ana i nā mea mua ʻelua. Hiki ke hoʻoponopono maʻalahi ʻia kahi hana hewa ʻole: pono ʻoe e hoʻopili i nā mea āpau. Inā he disks kēia, pono e hōʻuluʻulu ʻia nā disks i RAID; inā he kikowaena kēia, pono e kope ʻia ke kikowaena; inā loaʻa iā ʻoe kahi ʻōnaehana pūnaewele, pono ʻoe e hāʻawi i kahi kope ʻelua o ka ʻoihana pūnaewele, ʻo ia hoʻi, lawe ʻoe a e palua. A inā hāʻule kekahi mea, hoʻololi ʻoe i ka mana mālama. He paʻakikī ke ʻōlelo hou aku ma aneʻi.

ʻO ka lua ka hāʻule ʻole o nā lawelawe o waho. No ka hapanui, ʻaʻole pilikia ka ʻōnaehana, akā ʻaʻole no mākou. Ma muli o kā mākou hana ʻana i nā uku, he mea hōʻuluʻulu mākou e kū nei ma waena o ka mea hoʻohana (e komo i kāna ʻikepili kāleka) a me nā panakō, nā ʻōnaehana uku (Visa, MasterCard, Mira, etc.). ʻO kā mākou mau lawelawe waho (nā ʻōnaehana uku, nā panakō) ʻaʻole hiki ke hāʻule. ʻAʻole mākou a ʻo ʻoe (inā loaʻa iā ʻoe nā lawelawe) hiki ke hoʻohuli i kēia.

He aha ka mea e hana ai? Elua mau koho maanei. ʻO ka mea mua, inā hiki iā ʻoe, pono ʻoe e kope i kēia lawelawe ma kekahi ʻano. No ka laʻana, inā hiki iā mākou, hoʻololi mākou i ke kaʻa mai kahi lawelawe i kekahi: no ka laʻana, ua hana ʻia nā kāleka ma o Sberbank, loaʻa iā Sberbank nā pilikia - hoʻololi mākou i ke kaʻa [conditionally] i Raiffeisen. ʻO ka lua o ka mea hiki iā mākou ke hana, ʻo ia ke ʻike i ka hiki ʻole o nā lawelawe o waho me ka wikiwiki, a no laila e kamaʻilio mākou e pili ana i ka wikiwiki o ka pane ma ka ʻaoʻao aʻe o ka hōʻike.

ʻO kaʻoiaʻiʻo, o kēia mau mea ʻehā, hiki iā mākou ke hoʻololi pono i ka hoʻololi ʻana o nā polokalamu polokalamu - e hana i nā hana e alakaʻi ai i ka hoʻomaikaʻi ʻana i ke kūlana i ka pōʻaiapili o ka hoʻolaha ʻana a i ka pōʻaiapili o ka ulu pahū i ka ukana. ʻOiaʻiʻo, ʻo ia kā mākou i hana ai. Eia hou, kahi leka liʻiliʻi...

ʻO kēia mau pilikia ʻehā, hoʻoponopono koke ʻia kekahi inā he ao kāu. Inā ʻoe i loko o ka Microsoft Azhur, nā ao Ozone, a i ʻole e hoʻohana i kā mākou ao, mai Yandex a i ʻole Mail, a laila ma ka liʻiliʻi loa ka pilikia o ka lako kamepiula a lilo nā mea āpau i mea maikaʻi no ʻoe i ka pōʻaiapili o kahi hana hewa ʻole.

He hui kuʻuna ʻole mākou. Eia nā mea a pau e kamaʻilio e pili ana i "Kubernets", e pili ana i nā ao - ʻaʻohe o mākou "Kubernets" a i ʻole nā ​​ao. Akā, loaʻa iā mākou nā ʻāpana o nā lako i nā kikowaena ʻikepili he nui, a ua koi ʻia mākou e noho ma kēia hāmeʻa, koi ʻia mākou e kuleana no ia mea a pau. No laila, e kamaʻilio mākou ma kēia ʻano. No laila, e pili ana i nā pilikia. Ua lawe ʻia nā mea mua ʻelua mai nā bracket.

Ke hoʻololi nei i ka mana polokalamu. Nā kumu

ʻAʻole loaʻa i kā mākou mau mea hoʻomohala i ka hana. No ke aha ia? ʻO mākou wale nō ka PCI DSS i hōʻoia ʻia, a ʻaʻohe kuleana o kā mākou mea hoʻomohala e komo i ka "huahana". ʻO ia ka manawa. I nā mea āpau. No laila, hoʻopau pololei ke kuleana hoʻomohala i ka manawa e waiho ai ka hoʻomohala ʻana i ke kūkulu no ka hoʻokuʻu ʻana.

ʻO kā mākou kumu ʻelua i loaʻa iā mākou, ʻo ia hoʻi ke kōkua nui iā mākou, ʻo ka nele o ka ʻike ʻike ʻole ʻole. Manaʻo wau ua like ia no ʻoe. No ka mea, inā ʻaʻole kēia, e loaʻa iā ʻoe nā pilikia. E kū mai ana nā pilikia ke loaʻa ʻole kēia ʻike kūʻokoʻa, palapala ʻole i ka manawa kūpono ma kahi kūpono. E ʻōlelo mākou he hoʻokahi kanaka ʻike i ka hoʻonohonoho ʻana i kahi mea kikoʻī - ʻaʻole i laila ke kanaka, aia ʻo ia i ka hoʻomaha a maʻi paha - ʻo ia nō, pilikia ʻoe.

A ʻo ke kumu ʻekolu a mākou i hele mai ai. Ua hele mai mākou ma o ka ʻeha, ke koko, ka waimaka - ua hiki mai mākou i ka hopena i loaʻa i kekahi o kā mākou kūkulu ʻana i nā hewa, ʻoiai inā ʻaʻole hewa. Ua hoʻoholo mākou i kēia no mākou iho: ke kau mākou i kahi mea, ke ʻōwili mākou i kahi mea i loko o ka hana, loaʻa iā mākou kahi kūkulu me nā hewa. Ua hoʻokumu mākou i nā koi e pono ai kā mākou ʻōnaehana e hoʻokō.

Nā koi no ka hoʻololi ʻana i ka mana polokalamu

ʻEkolu mau koi:

• Pono mākou e hoʻohuli koke i ka hoʻolaha.
• Pono mākou e hōʻemi i ka hopena o kahi hoʻonohonoho pono ʻole.
• A pono e hiki iā mākou ke hoʻonohonoho wikiwiki i ka like.
  Pono i kēlā ʻano! No ke aha mai? No ka mea, ʻo ka mea mua, i ka wā e kau ai i kahi mana hou, ʻaʻole nui ka wikiwiki, akā he mea nui iā ʻoe, inā hewa kekahi mea, e ʻōwili koke i hope a loaʻa ka hopena liʻiliʻi. Akā inā loaʻa iā ʻoe kahi hoʻonohonoho o nā mana i ka hana ʻana, no ka mea aia kahi hewa (ma waho o ka polū, ʻaʻohe hoʻolaha, akā aia kahi hewa) - he mea nui iā ʻoe ka wikiwiki o ka hoʻouna ʻana ma hope. He aha kā mākou i hana ai no ka hoʻokō ʻana i kēia mau koi? Ua hoʻohana mākou i kēia ʻano hana:

  
  
  Ua ʻike ʻia, ʻaʻole mākou i haku - ʻo Blue/Green deploy. He aha ia? Pono ʻoe i kope no kēlā me kēia pūʻulu kikowaena kahi i hoʻokomo ʻia ai kāu mau noi. He "mahana" ke kope: ʻaʻohe kaʻa ma luna, akā i kēlā me kēia manawa hiki ke hoʻouna ʻia kēia kaʻa i kēia kope. Aia kēia kope i ka mana mua. A i ka manawa o ka waiho ʻana, ʻōwili ʻoe i ke code i kahi kope hana ʻole. A laila hoʻololi ʻoe i kahi hapa o ke kaʻa (a i ʻole nā ​​​​mea āpau) i ka mana hou. No laila, i mea e hoʻololi ai i ke kahe o ke kaʻa mai ka mana kahiko i ka mea hou, pono ʻoe e hana hoʻokahi wale nō hana: pono ʻoe e hoʻololi i ka mea kaulike ma ka upstream, e hoʻololi i ke kuhikuhi - mai kahi upstream a i kekahi. He mea maʻalahi kēia a hoʻonā i ka pilikia o ka hoʻololi wikiwiki a me ka rollback wikiwiki.

  Eia ka hoʻonā ʻana i ka nīnau ʻelua ʻo ka hoʻēmi ʻana: hiki iā ʻoe ke hoʻouna i kahi hapa wale nō o kāu huakaʻi i kahi laina hou, i kahi laina me kahi code hou (e like me 2%). A ʻo kēia 2% ʻaʻole 100%! Inā nalowale ʻoe i ka 100% o kāu huakaʻi ma muli o kahi hoʻolaha kūleʻa ʻole, makaʻu ia; inā nalowale ʻoe i ka 2% o kāu huakaʻi, ʻoluʻolu ʻole ia, akā ʻaʻole makaʻu. Eia kekahi, ʻaʻole paha e ʻike nā mea hoʻohana i kēia, no ka mea, i kekahi mau hihia (ʻaʻole i nā mea āpau) ka mea hoʻohana like, kaomi ʻana i ka F5, e lawe ʻia i kahi ʻano hana.

  Polu/ʻōmaʻomaʻo hoʻolaha. Ke alahele

  Eia naʻe, ʻaʻole maʻalahi nā mea a pau "Blue/Green deploy"... Hiki ke hoʻokaʻawale ʻia kā mākou mau mea āpau i ʻekolu pūʻulu:

  • ʻO kēia ka frontend (ʻaoʻao uku i ʻike ʻia e kā mākou mea kūʻai aku);
  • ke kumu hana;
  • adapter no ka hana ʻana me nā ʻōnaehana uku (nā panakō, MasterCard, Visa...).

  A aia kahi nuance ma aneʻi - aia ka nuance i ke ala ala ma waena o nā laina. Inā hoʻololi wale ʻoe i ka 100% o ke kaʻa, ʻaʻohe ou pilikia. Akā inā makemake ʻoe e hoʻololi i ka 2%, hoʻomaka ʻoe e nīnau i nā nīnau: "Pehea e hana ai i kēia?" ʻO ka mea maʻalahi ka pololei i mua: hiki iā ʻoe ke hoʻonohonoho i ka Round Robin i ka nginx ma kahi koho koho, a loaʻa iā ʻoe ka 2% ma ka hema, 98% ma ka ʻākau. Akā ʻaʻole kūpono kēia i nā manawa a pau.

  No ka laʻana, i kā mākou hihia, pili ka mea hoʻohana me ka ʻōnaehana me ka noi ʻoi aku ma mua o hoʻokahi. He mea maʻamau kēia: 2, 3, 4, 5 noi - like paha kāu mau ʻōnaehana. A inā he mea nui iā ʻoe e hele mai nā noi a pau o ka mea hoʻohana i ka laina like i hiki mai ai ka noi mua, a i ʻole (helu ʻelua) hele mai nā noi a pau o ka mea hoʻohana i ka laina hou ma hope o ka hoʻololi (hiki iā ia ke hoʻomaka e hana ma mua me ka ʻōnaehana, ma mua o ka hoʻololi ʻana), - a laila ʻaʻole kūpono kēia puʻupuʻu manuahi iā ʻoe. A laila aia nā koho aʻe:

  
  
  ʻO ka koho mua, ka mea maʻalahi, e pili ana i nā ʻāpana kumu o ka mea kūʻai aku (IP Hash). Loaʻa iā ʻoe kahi IP, a hoʻokaʻawale iā ia mai ka ʻākau a i ka hema e ka IP address. A laila ʻo ka hihia ʻelua aʻu i wehewehe ai e hana no ʻoe, i ka wā i hoʻomaka ai ka hoʻolaha ʻana, hiki i ka mea hoʻohana ke hoʻomaka e hana me kāu ʻōnaehana, a mai ka manawa o ka hoʻokuʻu ʻana e hele nā ​​noi āpau i kahi laina hou (i ka mea like, e ʻōlelo).

  Inā no kekahi kumu ʻaʻole kūpono kēia iā ʻoe a pono ʻoe e hoʻouna i nā noi i ka laina kahi i hele mai ai ka mea hoʻohana, noi mua, a laila ʻelua mau koho ...
  ʻO ka koho mua: hiki iā ʻoe ke kūʻai i ka nginx + uku. Aia kahi ʻano hana Sticky sessions, ma ka noi mua a ka mea hoʻohana, hāʻawi i kahi hālāwai i ka mea hoʻohana a hoʻopaʻa iā ia i kekahi a i ʻole i luna. E hoʻouna ʻia nā noi mea hoʻohana a pau i loko o ke ola o ke kau i ka upstream kahi i kau ʻia ai ke kau.

  ʻAʻole kūpono kēia iā mākou no ka mea ua loaʻa iā mākou ka nginx maʻamau. ʻO ka hoʻololi ʻana i ka nginx + ʻaʻole ia he kumu kūʻai, akā he mea ʻeha ia no mākou a ʻaʻole pololei loa. "Sticks Sessions", no ka laʻana, ʻaʻole i hana no mākou no ke kumu maʻalahi ʻaʻole ʻae ʻo "Sticks Sessions" i ke alahele ma muli o "Either-or". Ma laila hiki iā ʻoe ke kuhikuhi i kā mākou "Sticks Sessions", no ka laʻana, ma ka IP address a i ʻole IP address a me nā kuki a i ʻole postparameter, akā ʻoi aku ka paʻakikī o "Either-or" ma laila.

  No laila, ua hiki mai mākou i ka koho ʻehā. Lawe mākou i ka nginx ma nā steroids (he openresty kēia) - ʻo ia ka nginx like, e kākoʻo pū ana i ka hoʻokomo ʻana i nā palapala hope. Hiki iā ʻoe ke kākau i kahi palapala hope, hāʻawi iā ia i kahi "hoʻomaha wehe", a e hoʻokō ʻia kēia palapala hope i ka wā e hiki mai ai ka mea hoʻohana.

  A ua kākau mākou, ʻoiaʻiʻo, kahi palapala, hoʻonoho iā mākou iho "openresti" a ma kēia ʻatikala mākou e hoʻokaʻawale i nā ʻāpana like ʻole 6 ma o ka concatenation "Or". Ma muli o ka hiki ʻana mai o kekahi a i ʻole nā ​​mea ʻē aʻe, ʻike mākou ua hele mai ka mea hoʻohana i kahi ʻaoʻao a i ʻole kekahi, hoʻokahi laina a i ʻole kekahi.

  Polu/ʻōmaʻomaʻo hoʻolaha. Nā pōmaikaʻi a me nā pōʻino

  ʻOiaʻiʻo, hiki paha ke maʻalahi (e hoʻohana i ka "Sticky Sessions") like, akā loaʻa iā mākou kahi nuance ʻaʻole wale ka mea hoʻohana e launa pū me mākou i loko o ka hoʻolālā o hoʻokahi kaʻina hana hoʻokahi ... Akā, pili pū nā ʻōnaehana uku me mākou: Ma hope o kā mākou hana ʻana i ke kālepa (ma ka hoʻouna ʻana i kahi noi i ka ʻōnaehana uku), loaʻa iā mākou kahi coolback.
  A e ʻōlelo mākou, inā i loko o kā mākou kaapuni hiki iā mākou ke hoʻouna i ka IP IP o ka mea hoʻohana i nā noi āpau a hoʻokaʻawale i nā mea hoʻohana e pili ana i ka IP address, a laila ʻaʻole mākou e haʻi i ka "Visa" like: "E ka hoa, he hui retro mākou, ʻike mākou. e lilo i honua (ma ka pūnaewele a ma Rusia) ... E ʻoluʻolu e hāʻawi mai iā mākou i ka IP address o ka mea hoʻohana ma kahi kahua hou, ua hoʻohālikelike ʻia kāu protocol "! Ua maopopo, aole lakou e ae.

  
  
  No laila, ʻaʻole i hana kēia no mākou - ua hana mākou i openresty. No laila, me ka routing ua loaʻa iā mākou kekahi mea e like me kēia:

  Loaʻa i ka Blue/Green Deployment nā pono aʻu i ʻōlelo ai a me nā hemahema.

  ʻElua mau hemahema:

  • pono ʻoe e hoʻopilikia i ke ala ala;
  • ʻo ka lua o ka hemahema nui, ʻo ia ka lilo.

  Pono ʻoe i ʻelua mau kikowaena, pono ʻoe i ʻelua mau kumuwaiwai hana, pono ʻoe e hoʻolilo ʻelua i ka nui o ka hoʻoikaika e mālama i kēia zoo holoʻokoʻa.

  Ma ke ala, ma waena o nā pōmaikaʻi aia kekahi mea ʻē aʻe aʻu i haʻi ʻole ai ma mua: loaʻa iā ʻoe kahi mālama inā ulu ka ukana. Inā loaʻa iā ʻoe kahi ulu pahū i ka ukana, loaʻa iā ʻoe ka nui o nā mea hoʻohana, a laila e hoʻokomo wale ʻoe i ka laina lua i ka mahele 50 a 50 - a loaʻa koke iā ʻoe nā kikowaena x2 i kāu hui a hiki i ka hoʻoponopono ʻana i ka pilikia o ka loaʻa ʻana o nā kikowaena.

  Pehea e hana wikiwiki ai?

  Ua kamaʻilio mākou e pili ana i ka hoʻoponopono ʻana i ka pilikia o ka hoʻemi ʻana a me ka rollback wikiwiki, akā mau ka nīnau: "Pehea e hoʻonohonoho wikiwiki ai?"

  
  
  He pōkole a maʻalahi maʻaneʻi.

  • Pono e loaʻa iā ʻoe kahi ʻōnaehana CD (Hoʻouna mau) - ʻaʻole hiki iā ʻoe ke ola me ka ʻole. Inā loaʻa iā ʻoe hoʻokahi kikowaena, hiki iā ʻoe ke kau me ka lima. Loaʻa iā mākou ma kahi o hoʻokahi a me ka hapa kaukani mau kikowaena a me hoʻokahi a me ka hapa tausani mau lima, ʻoiaʻiʻo - hiki iā mākou ke kanu i kahi keʻena e like me ka nui o kēia lumi e kau wale ai.
  • Pono e hoʻolālā like. Inā he sequential kāu kau ʻana, a laila hewa nā mea a pau. Hoʻokahi kikowaena maʻamau, e kau ana ʻoe i hoʻokahi a me ka hapa tausani mau kikowaena i ka lā āpau.
  • Eia hou, no ka wikiwiki, ʻaʻole pono paha kēia. I ka wā o ka hoʻolaha ʻana, kūkulu pinepine ʻia ka papahana. Loaʻa iā ʻoe kahi papahana pūnaewele, aia kahi ʻāpana mua (hana ʻoe i kahi pūnaewele pūnaewele ma laila, hoʻohui ʻoe i ka npm - kekahi mea like), a ʻo kēia kaʻina hana, ma ke kumu, pōkole - 5 mau minuke, akā hiki i kēia mau minuke 5 e hoohewahewa. ʻO ia ke kumu, no ka laʻana, ʻaʻole mākou e hana i kēlā: wehe mākou i kēia mau minuke 5, hoʻolaha mākou i nā artifact.

    He aha ke ʻano mea hana? ʻO kahi artifact kahi hale i hui ʻia i hoʻopau ʻia nā ʻāpana hui a pau. Hoʻopaʻa mākou i kēia mea hana i loko o ka waihona mea hana. I kekahi manawa ua hoʻohana mākou i ʻelua mau waihona - ʻo ia ʻo Nexus a i kēia manawa ʻo jFrog Artifactory). A laila hoʻokomo lākou i kekahi o nā noi i kākau ʻia ma PHP ma laila; a ʻaʻole kūpono hou ʻo "Nexus", a no laila ua koho mākou i ka jFrog Artefactory, hiki ke hana i nā mea āpau. Ua hōʻea mākou i kahi i loko o kēia waihona artifact mālama mākou i kā mākou mau pūʻulu binary a mākou e hōʻiliʻili ai no nā kikowaena.

  ʻO ka ulu ʻana o ka ukana pahū

  Ua kamaʻilio mākou e pili ana i ka hoʻololi ʻana i ka mana polokalamu. ʻO ka mea aʻe e loaʻa iā mākou he hoʻonui pahū i ka ukana. Eia paha, ʻo ka ulu pahū ʻana o ka ukana ʻaʻole ia ka mea kūpono loa...

  Ua kākau mākou i kahi ʻōnaehana hou - ʻo ia ka lawelawe lawelawe, ʻano, nani, nā limahana ma nā wahi āpau, queues ma nā wahi āpau, asynchrony ma nā wahi āpau. A i loko o ia mau ʻōnaehana, hiki ke kahe ka ʻikepili ma nā kahe like ʻole. No ka hana mua, hiki ke hoʻohana i ka mea hana 1, 3, 10, no ka lua o ka hana - ka 2, 4, 5. A i kēia lā, e ʻōlelo kākou, i ke kakahiaka, loaʻa iā ʻoe kahi kahe ʻikepili e hoʻohana ana i nā limahana mua ʻekolu, a i ke ahiahi e loli nui ia, a hoʻohana nā mea āpau i nā mea hana ʻekolu.

  A eia ka mea e pono ai ʻoe e hoʻonui i ka poʻe hana, pono ʻoe e hoʻonui i kāu mau lawelawe, akā i ka manawa like e pale i ka hoʻoulu waiwai.

  
  
  Ua wehewehe mākou i kā mākou mau koi. He mea maʻalahi kēia mau koi: aia kahi ʻike Service, parameterization - maʻamau nā mea āpau no ke kūkulu ʻana i nā ʻōnaehana scalable, koe wale nō kahi helu - hoʻemi waiwai. Ua ʻōlelo mākou ʻaʻole mākaukau mākou e hoʻokaʻawale i nā kumuwaiwai i mea e wela ai nā kikowaena i ka ea. Lawe mākou iā "Consul", lawe mākou iā "Nomad", nāna e mālama i kā mākou mau limahana.

  No ke aha kēia pilikia iā mākou? E hoʻihoʻi iki kāua. Loaʻa iā mākou ma kahi o 70 mau ʻōnaehana uku ma hope o mākou. I ke kakahiaka, hele ka huakaʻi ma Sberbank, a laila hāʻule ʻo Sberbank, no ka laʻana, a hoʻololi mākou iā ia i kahi ʻōnaehana uku. Loaʻa iā mākou he 100 mau limahana ma mua o Sberbank, a ma hope o ia mea pono mākou e hoʻonui nui i nā limahana 100 no kahi ʻōnaehana uku. A he mea makemake ia no keia mau mea a pau me ke komo ole o ke kanaka. No ka mea, inā he komo kanaka, pono e noho ka ʻenekinia ma laila 24/7, ʻo ia wale nō ke hana i kēia, no ka mea, ʻo ia mau hemahema, i ka wā 70 ʻōnaehana ma hope o ʻoe, e hana mau.

  No laila, ua nānā mākou iā Nomad, nona ka IP hāmama, a kākau i kā mākou mea ponoʻī, Scale-Nomad - ScaleNo, e hana ana ma kahi o kēia: nānā ʻo ia i ka ulu ʻana o ka pila a hoʻemi a hoʻonui paha i ka helu o nā limahana ma muli o ka dynamics. o ka laina. I kā mākou hana ʻana, manaʻo mākou: "Malia paha hiki iā mākou ke wehe i ke kumu?" A laila nānā lākou iā ia - ua maʻalahi ʻo ia e like me ʻelua kopecks.

  I kēia manawa ʻaʻole mākou i wehe i ke kumu, akā inā ma hope o ka hōʻike ʻana, ma hope o ka ʻike ʻana e pono ana ʻoe i kēlā mea, pono ʻoe, aia kaʻu mau pilina ma ka slide hope - e ʻoluʻolu e kākau mai iaʻu. Inā he 3-5 mau kānaka, e kākoʻo mākou iā ia.

  
  
  Pehea ia hana? E nānā kāua! Ke nānā nei i mua: ma ka ʻaoʻao hema kahi ʻāpana o kā mākou nānā ʻana: hoʻokahi laina kēia, ma luna ka manawa o ka hana hanana, ma waena ka helu o nā hana, ma lalo ka helu o nā limahana.

  Inā ʻoe e nānā, aia ka hewa ma kēia kiʻi. Ma ka pakuhi luna, ua hāʻule kekahi o nā pakuhi i 45 kekona - ua iho kekahi o nā ʻōnaehana uku. I ka manawa koke, ua lawe ʻia ke kaʻa i loko o 2 mau minuke a hoʻomaka ka pila ma luna o kahi ʻōnaehana uku ʻē aʻe, kahi ʻaʻohe limahana (ʻaʻole mākou i hoʻohana i nā kumuwaiwai - ma ke ʻano, ua hoʻopau pololei mākou i ka waiwai). ʻAʻole mākou i makemake e wela - aia kahi helu liʻiliʻi, ma kahi o 5-10 mau limahana, akā ʻaʻole hiki iā lākou ke hoʻokō.

  Hōʻike ka pakuhi hope i kahi "hump", ʻo ia hoʻi ua pālua ʻo "Skaleno" i kēia nui. A laila, i ka wā i hāʻule liʻiliʻi ai ka pakuhi, ua hoʻemi liʻiliʻi - ua hoʻololi ʻia ka helu o nā limahana. Pela ka hana ana o keia mea. Ua kamaʻilio mākou e pili ana i ka helu helu 2 - "Pehea e hoʻopau koke ai i nā kumu."

  Nānā. Pehea e ʻike koke ai i ka pilikia?

  I kēia manawa ʻo ka helu mua "Pehea e ʻike koke ai i ka pilikia?" Ke nānā nei! Pono mākou e hoʻomaopopo koke i kekahi mau mea. He aha nā mea e hoʻomaopopo koke ai kākou?

  
  
  ʻEkolu mea!

  • Pono mākou e hoʻomaopopo a hoʻomaopopo koke i ka hana o kā mākou waiwai ponoʻī.
  • Pono mākou e hoʻomaopopo koke i nā hemahema a nānā i ka hana o nā ʻōnaehana ma waho o mākou.
  • ʻO ke kolu o ka helu ʻo ka ʻike ʻana i nā hewa kūpono. ʻO kēia ka wā e hana ai ka ʻōnaehana iā ʻoe, maʻamau nā mea āpau e like me nā hōʻailona a pau, akā ua hewa kekahi mea.

  ʻAʻole paha wau e haʻi aku iā ʻoe i kekahi mea ʻoluʻolu ma aneʻi. E lilo wau i Kāpena Obvious. Ua ʻimi mākou i ka mea ma ka mākeke. Loaʻa iā mākou kahi "zoo leʻaleʻa". ʻO kēia ke ʻano o ka zoo iā mākou i kēia manawa:

  
  
  Hoʻohana mākou iā Zabbix e nānā i nā lako, e nānā i nā hōʻailona nui o nā kikowaena. Hoʻohana mākou iā Okmeter no nā waihona. Hoʻohana mākou iā "Grafana" a me "Prometheus" no nā hōʻailona ʻē aʻe ʻaʻole kūpono i nā mea mua ʻelua, ʻo kekahi me "Grafana" a me "Prometheus", a ʻo kekahi me "Grafana" me "Influx" a me Telegraf.

  I hoʻokahi makahiki i hala ua makemake mākou e hoʻohana i ka New Relic. He mea maikaʻi, hiki iā ia ke hana i nā mea a pau. Akā, e like me ka mea hiki iā ia ke hana i nā mea a pau, he pipiʻi loa ia. I ko mākou ulu ʻana i ka nui o 1,5 tausani mau kikowaena, hele mai kahi mea kūʻai aku iā mākou a ʻōlelo mai: "E hoʻopau i kahi kuʻikahi no ka makahiki aʻe." Nānā mākou i ke kumukūʻai a ʻōlelo mākou ʻaʻole, ʻaʻole mākou e hana i kēlā. I kēia manawa ke haʻalele nei mākou i ka New Relic, aia mākou ma kahi o 15 mau kikowaena i waiho ʻia ma lalo o ka nānā ʻana o New Relic. Ua lilo ke kumukūʻai i mea hihiu loa.

  A aia kekahi mea hana a mākou i hoʻokō ai iā mākou iho - ʻo Debugger kēia. I ka wā mua, kapa mākou iā ia ʻo “Bagger,” akā ma hope ua maʻalo kekahi kumu ʻōlelo Pelekania, ʻakaʻaka nui, a kapa ʻia ʻo ia ʻo “Debagger.” He aha ia? He mea hana kēia, ʻoiaʻiʻo, i loko o 15-30 kekona ma kēlā me kēia ʻāpana, e like me ka "pahu ʻeleʻele" o ka ʻōnaehana, holo i nā hoʻokolohua ma ka hana holoʻokoʻa o ka ʻāpana.

  No ka laʻana, inā he ʻaoʻao waho (ʻaoʻao uku), wehe wale ʻo ia a nānā i ke ʻano o kona ʻano. Inā hana kēia, hoʻouna ʻo ia i kahi "transaction" hoʻāʻo a hōʻoia i ka hiki ʻana mai o kēia "transaction". Inā pili kēia me nā ʻōnaehana uku, hoʻopau mākou i kahi noi hoʻāʻo e like me ia, ma kahi e hiki ai iā mākou, a ʻike ua maikaʻi nā mea āpau me mākou.

  He aha nā hōʻailona koʻikoʻi no ka nānā ʻana?

  He aha kā mākou e nānā nui ai? He aha nā hōʻailona koʻikoʻi iā mākou?

  
  

  • ʻO ka manawa pane / RPS ma mua he hōʻailona koʻikoʻi. Pane koke ʻo ia i kekahi mea iā ʻoe.
  • Ka helu o nā memo i hana ʻia ma nā pila a pau.
  • Ka helu o na limahana.
  • Nā anana pololei kumu.

  ʻO ka helu hope he "ʻoihana", "ʻoihana" metric. Inā makemake ʻoe e nānā i ka mea like, pono ʻoe e wehewehe i hoʻokahi a ʻelua paha metric nā mea hōʻailona nui iā ʻoe. ʻO kā mākou metric ka throughput (ʻo ia ka lakio o ka helu o nā hana kūleʻa i ka huina holo kaʻa). Inā hoʻololi kekahi mea i loko o ka manawa o 5-10-15 mau minuke, ʻo ia hoʻi he pilikia mākou (inā hoʻololi radically).

  ʻO ke ʻano o kā mākou papa he laʻana o kekahi o kā mākou papa:

  
  
  Aia ma ka ʻaoʻao hema he 6 kiʻi, e like kēia me nā laina - ka helu o nā limahana a me ka helu o nā leka i nā pila. Ma ka ʻaoʻao ʻākau - RPS, RTS. Aia ma lalo ka metric "ʻoihana" like. A ma ka metric "ʻoihana" hiki iā mākou ke ʻike koke ua hewa kekahi mea ma nā kiʻi waena ʻelua ... He ʻōnaehana ʻē aʻe kēia e kū nei ma hope o mākou i hāʻule.

  ʻO ka lua o ka mea a mākou e hana ai, ʻo ia ka nānā ʻana i ka hāʻule o nā ʻōnaehana uku waho. Maanei ua lawe mākou iā OpenTracing - he mīkini, maʻamau, paradigm e hiki ai iā ʻoe ke ʻimi i nā ʻōnaehana puʻupuʻu; a ua hoololi iki ia. Wahi a ka OpenTracing paradigm maʻamau, kūkulu mākou i kahi trace no kēlā me kēia noi. ʻAʻole pono mākou i kēia, a kāʻei mākou iā ia i kahi hōʻuluʻulu hōʻuluʻulu. Hana mākou i kahi mea hana e hiki ai iā mākou ke nānā i ka wikiwiki o nā ʻōnaehana ma hope o mākou.

  
  
  Hōʻike ka pakuhi iā mākou ua hoʻomaka kekahi o nā ʻōnaehana uku e pane i loko o 3 kekona - loaʻa iā mākou nā pilikia. Eia kekahi, e pane kēia mea i ka wā e hoʻomaka ai nā pilikia, ma kahi o 20-30 kekona.

  A ʻo ke kolu o ka papa o ka nānā ʻana i nā hewa i loaʻa ʻo ia ka nānā pono.

  ʻO kaʻoiaʻiʻo, ʻaʻole wau i ʻike i ka mea e huki ai ma kēia paheʻe, no ka mea ua lōʻihi mākou e ʻimi nei ma ka mākeke no kahi mea e kūpono iā mākou. ʻAʻole i loaʻa iā mākou kekahi mea, no laila pono mākou e hana iā mākou iho.

  
  
  He aha kaʻu e manaʻo ai me ka nānā pono? E noʻonoʻo: hoʻolilo ʻoe iā ʻoe iho i ʻōnaehana (no ka laʻana, kahi clone Tinder); ua hana ʻoe, hoʻolana. Hoʻokomo ka luna lanakila ʻo Vasya Pupkin i kāna kelepona, ʻike i kahi kaikamahine ma laila, makemake iā ia ... a ʻaʻole hele nā ​​mea like i ke kaikamahine - e like me ka hele ʻana i ke kiaʻi palekana ʻo Mikhalych mai ke kikowaena ʻoihana like. Piʻi ka luna i lalo, a noʻonoʻo: "No ke aha e ʻakaʻaka ʻoluʻolu ai kēia kiaʻi palekana ʻo Mikhalych iā ia?"

  Ma ia mau kūlana... No mākou, ʻokoʻa iki kēia kūlana, no ka mea (ua kākau wau) he pohō kaulana kēia i alakaʻi ʻole i nā poho kālā. He ʻokoʻa ko mākou kūlana: hiki iā mākou ke loaʻa nā poho kālā pololei - no ka laʻana, inā ua kūleʻa mākou i kahi kālepa, akā ʻaʻole i kūleʻa (a i ʻole. Pono wau e kākau i kaʻu mea hana ponoʻī e nānā i ka helu o nā hana kūleʻa i ka manawa me ka hoʻohana ʻana i nā hōʻailona ʻoihana. ʻAʻohe mea i loaʻa ma ka mākeke! ʻO kēia ka manaʻo aʻu i makemake ai e hōʻike. ʻAʻohe mea ma ka mākeke e hoʻoponopono i kēia ʻano pilikia.

  E pili ana kēia i ka ʻike koke ʻana i ka pilikia.

  Pehea e hoʻoholo ai i nā kumu o ka hoʻolaha

  ʻO ke kolu o ka hui o nā pilikia a mākou e hoʻoponopono ai, ʻo ia ma hope o ko mākou ʻike ʻana i ka pilikia, ma hope o ka pau ʻana o ia pilikia, pono e hoʻomaopopo i ke kumu o ka hoʻomohala ʻana, no ka hoʻāʻo ʻana, a hana i kekahi mea e pili ana. No laila, pono mākou e noiʻi, pono mākou e hāpai i nā lāʻau.

  
  
  Inā mākou e kamaʻilio e pili ana i nā lāʻau (ʻo ke kumu nui o nā lāʻau), aia ka nui o kā mākou mau lāʻau i ELK Stack - aneane like nā mea a pau. No kekahi, ʻaʻole paha ia ma ELK, akā inā kākau ʻoe i nā lāʻau ma nā gigabytes, a laila hiki koke ʻoe i ka ELK. Kākau mākou iā lākou i terabytes.

  
  
  Aia kahi pilikia ma ʻaneʻi. Hoʻoponopono mākou, hoʻoponopono i ka hewa no ka mea hoʻohana, hoʻomaka mākou e ʻeli i ka mea ma laila, piʻi i Kibana, hoʻokomo i ka id kālepa ma laila a loaʻa kahi lole wāwae e like me kēia (hōʻike nui). A ʻaʻohe mea maopopo loa i kēia lole wāwae. No ke aha mai? ʻAe, no ka mea, ʻaʻole maopopo ka ʻāpana o ka mea hana, ʻo ka ʻāpana o ka ʻāpana. A i kēlā manawa ua ʻike mākou he pono mākou e ʻimi - ʻo ia ka OpenTracing aʻu i ʻōlelo ai.

  Ua manaʻo mākou i kēia makahiki i hala aku nei, ua huli mākou i ka mākeke, a aia ʻelua mau mea hana ma laila - "Zipkin" a me "Jaeger". ʻO "Jager" ʻoiaʻiʻo he hoʻoilina hoʻoilina hoʻomanaʻo, kahi mea hoʻopiʻi ideological o "Zipkin". Maikaʻi nā mea a pau ma Zipkin, koe wale nō ʻaʻole ʻo ia i ʻike pehea e hōʻuluʻulu ai, ʻaʻole ʻo ia i ʻike pehea e hoʻokomo ai i nā lāʻau i ka trace, ʻo ka manawa wale nō. A kākoʻo ʻo "Jager" i kēia.

  Ua nānā mākou iā "Jager": hiki iā ʻoe ke hoʻohana i nā noi, hiki iā ʻoe ke kākau ma Api (ʻo ka maʻamau Api no PHP i kēlā manawa, ʻaʻole naʻe i ʻae ʻia - he makahiki i hala aku nei, akā i kēia manawa ua ʻae ʻia), akā aia ma laila. ʻaʻohe mea kūʻai aku. "ʻAe," manaʻo mākou, a kākau i kā mākou mea kūʻai aku. He aha kā mākou i loaʻa? ʻO kēia ke ʻano o kona ʻano:

  
  
  Ma Jaeger, hana ʻia nā spans no kēlā me kēia memo. ʻO ia hoʻi, i ka wā e wehe ai ka mea hoʻohana i ka ʻōnaehana, ʻike ʻo ia i hoʻokahi a ʻelua mau poloka no kēlā me kēia noi e komo mai ana (1-2-3 - ka helu o nā noi komo mai ka mea hoʻohana, ka helu o nā poloka). I mea e maʻalahi ai nā mea hoʻohana, ua hoʻohui mākou i nā hōʻailona i nā lāʻau a me nā meheu manawa. No laila, inā he hewa, e kaha kā mākou noi i ka log me ka inoa Hapa kūpono. Hiki iā ʻoe ke kānana e ka inoa Hapa a e hōʻike ʻia nā ʻāpana i loaʻa i kēia poloka me kahi hewa. ʻO kēia ke ʻano inā e hoʻonui mākou i ka span:

  
  
  Aia i loko o ka ʻāʻī he pūʻulu o nā meheu. I kēia hihia, ʻekolu mau ʻāpana hoʻāʻo kēia, a ʻo ke kolu o ka trace e haʻi mai iā mākou ua hewa. I ka manawa like, eia mākou e ʻike ai i kahi kaʻina manawa: loaʻa iā mākou kahi pālākiō manawa ma luna, a ʻike mākou i ka manawa manawa i hoʻopaʻa ʻia ai kēia a i ʻole kēlā log.

  No laila, ua maikaʻi nā mea iā mākou. Ua kākau mākou i kā mākou hoʻonui ponoʻī a wehe mākou i ke kumu. Inā makemake ʻoe e hana me ka huli ʻana, inā makemake ʻoe e hana pū me "Jager" ma PHP, aia kā mākou hoʻonui, hoʻokipa e hoʻohana, e like me kā lākou e ʻōlelo nei:

  
  
  Loaʻa iā mākou kēia hoʻonui - he mea kūʻai aku ia no ka OpenTracing Api, ua hana ʻia ma ke ʻano he php-extention, ʻo ia hoʻi, pono ʻoe e hōʻuluʻulu a hoʻokomo iā ia ma ka ʻōnaehana. ʻO kahi makahiki i hala aku nei ʻaʻohe mea ʻokoʻa. I kēia manawa aia nā mea kūʻai aku e like me nā ʻāpana. Eia iā ʻoe: e ʻoki ʻoe i nā ʻāpana me kahi haku mele, a i ʻole ʻoe e hoʻohana i ka hoʻonui iā ʻoe.

  Nā kūlana hui

  Ua kamaʻilio mākou no nā kauoha ʻekolu. ʻO ka hā o ke kauoha, ʻo ia ka hoʻohālikelike ʻana i nā ala. He aha kēia e pili ana? E pili ana i kēia:

  
  
  No ke aha i loaʻa ai ka huaʻōlelo "corporate" ma aneʻi? ʻAʻole no ka mea he ʻoihana nui a ʻoihana ʻoihana paha mākou, ʻaʻole! Makemake au e hoʻohana i ka huaʻōlelo "hui" ma ʻaneʻi i ka pōʻaiapili e loaʻa i kēlā me kēia hui, kēlā me kēia huahana kona mau kūlana ponoʻī, me ʻoe. He aha nā kūlana i loaʻa iā mākou?

  
  

  • Loaʻa iā mākou nā lula hoʻolaha. ʻAʻole mākou e neʻe i kahi me ka ʻole o ia, ʻaʻole hiki iā mākou. Hoʻolālā mākou ma kahi o 60 mau manawa i ka pule, ʻo ia hoʻi, hoʻolaha mākou i nā manawa a pau. I ka manawa like, loaʻa iā mākou, no ka laʻana, i ka hoʻonohonoho hoʻonohonoho ʻana i kahi kapu ma ka hoʻolaha ʻana i ka Pōʻalima - ma ke kumu, ʻaʻole mākou e kau.
  • Pono mākou i nā palapala. ʻAʻole hoʻokahi mea hou e komo i ka hana inā ʻaʻohe palapala no ia mea, ʻoiai inā i hānau ʻia ma lalo o ka peni o kā mākou mau loea RnD. Makemake mākou iā lākou i nā ʻōlelo aʻoaʻo, kahi palapala ʻāina nānā a me kahi wehewehe kikoʻī (maikaʻi, hiki i nā mea polokalamu ke kākau) pehea e hana ai kēia ʻāpana, pehea e hoʻoponopono ai.
  • ʻAʻole mākou e hoʻoponopono i ke kumu o ka pilikia, akā ʻo ka pilikia - ka mea aʻu i ʻōlelo ai. He mea nui iā mākou e pale i ka mea hoʻohana mai nā pilikia.
  • Loaʻa iā mākou nā ʻae. No ka laʻana, ʻaʻole mākou e noʻonoʻo i ka downtime inā nalowale mākou i ka 2% o ke kaʻa i loko o ʻelua mau minuke. ʻAʻole i hoʻokomo ʻia kēia i kā mākou helu helu. Inā ʻoi aku ka nui ma ka pākēneka a i ʻole ka manawa pōkole, ua helu mākou.
  • A kākau mau mākou i ka postmortems. ʻO nā mea a pau e loaʻa iā mākou, ʻo kēlā me kēia kūlana i hana hewa ʻole ai kekahi i ka hana ʻana e ʻike ʻia ma ka post-mortem. ʻO ka postmortem kahi palapala āu e kākau ai i ka mea i loaʻa iā ʻoe, kahi manawa kikoʻī, nā mea āu i hana ai no ka hoʻoponopono ʻana a (he poloka koi kēia!) He aha kāu e hana ai e pale aku i kēia mai ka wā e hiki mai ana. Pono kēia a pono no ka nānā ʻana ma hope.

  He aha ka mea i manaʻo ʻia he downtime?

  
  
  He aha ka hopena o kēia mau mea?

  Ua alakaʻi kēia i ka ʻoiaʻiʻo (ua loaʻa iā mākou kekahi mau pilikia me ke kūpaʻa, ʻaʻole kūpono kēia i nā mea kūʻai aku a i ʻole mākou) i nā mahina 6 i hala aku nei ʻo 99,97 kā mākou hōʻailona kūpaʻa. Hiki iā mākou ke ʻōlelo ʻaʻole nui loa kēia. ʻAe, he mea kā mākou e hoʻoikaika ai. ʻO kēia hōʻailona,ʻo ka hapalua ka paʻa, e like me ka mea,ʻaʻole no mākou, akā,ʻo kā mākou pūnaewele pūnaewele pūnaewele, e kū nei i mua o mākou a hoʻohanaʻia ma keʻano he lawelawe, akā,ʻaʻole mālama nā mea kūʻai i kēia.

  Ua aʻo mākou e hiamoe i ka pō. ʻO ka hope loa! ʻEono mahina aku nei ʻaʻole hiki iā mākou. A ma kēia memo me nā hopena, makemake wau e hana i hoʻokahi memo. I ka pō nei, ua hōʻike maikaʻi ʻia e pili ana i ka ʻōnaehana hoʻomalu no kahi reactor nuklea. Inā hiki i ka poʻe nāna i kākau i kēia ʻōnaehana ke lohe mai iaʻu, e ʻoluʻolu e poina i kaʻu mea i ʻōlelo ai e pili ana i ka "2% ʻaʻole ka manawa hoʻomaha." No ʻoe, ʻo 2% ka downtime, ʻoiai inā ʻelua mau minuke!

  ʻo ia wale nō! ʻO kāu mau nīnau.

  
  

  E pili ana i nā mea kaulike a me ka neʻe ʻana o ka waihona

  Nīnau mai ke anaina (ma hope aku – B): – Aloha ahiahi. Mahalo nui iā ʻoe no kēlā hōʻike admin! He nīnau pōkole e pili ana i kāu mea kaulike. Ua ʻōlelo ʻoe he WAF kāu, ʻo ia hoʻi, e like me kaʻu i hoʻomaopopo ai, hoʻohana ʻoe i kekahi ʻano kaulike o waho ...

  EK: - ʻAʻole, hoʻohana mākou i kā mākou lawelawe ma ke ʻano he kaulike. I kēia hihia, ʻo WAF wale nō kahi mea hana pale DDoS no mākou.

  IN: - Hiki iā ʻoe ke ʻōlelo i kekahi mau huaʻōlelo e pili ana i nā mea kaulike?

  EK: - E like me kaʻu i ʻōlelo ai, he hui kēia o nā kikowaena i openresty. Loaʻa iā mākou i kēia manawa he 5 mau pūʻulu hoʻopaʻa e pane kūʻokoʻa ... ʻo ia hoʻi, kahi kikowaena e holo wale ana i openresty, ʻo ia wale nō ka proxies traffic. No laila, no ka hoʻomaopopo ʻana i ka nui o kā mākou paʻa: i kēia manawa ua loaʻa iā mākou ke kahe maʻamau o nā haneli megabits. Hoʻopili lākou, maikaʻi lākou, ʻaʻole lākou e hoʻopaʻa iā lākou iho.

  IN: - He nīnau maʻalahi hoʻi. Eia ka hoʻolaha ʻana i ka Blue/Green. He aha kāu hana, no ka laʻana, me ka neʻe ʻana o ka waihona?

  EK: - He nīnau maikaʻi! E nānā, i ka Blue/Green deployment loaʻa iā mākou nā laina laina no kēlā me kēia laina. ʻO ia hoʻi, inā mākou e kamaʻilio e pili ana i nā laina hanana i hoʻouna ʻia mai ka mea hana i ka mea hana, aia nā laina kaʻawale no ka laina uliuli a no ka laina ʻōmaʻomaʻo. Inā mākou e kamaʻilio e pili ana i ka ʻikepili ponoʻī, a laila mākou e hoʻokaʻawale i lalo e like me ka mea hiki iā mākou, hoʻoneʻe i nā mea āpau i loko o nā queues; i loko o ka waihona ʻikepili mākou e mālama wale ai i kahi pūʻulu o nā kālepa. A ua like kā mākou waihona kālepa no nā laina āpau. Me ka waihona i loko o kēia pōʻaiapili: ʻaʻole mākou e puʻunaue i ka uliuli a me ka ʻōmaʻomaʻo, no ka mea pono e ʻike nā mana ʻelua o ke code i ka mea e hana nei me ke kālepa.

  E nā hoaaloha, he wahi makana liʻiliʻi kaʻu e hoʻoikaika ai iā ʻoe - he puke. A e hāʻawi ʻia iaʻu no ka nīnau maikaʻi loa.

  IN: - Aloha. Mahalo no ka hōʻike. ʻO ka nīnau kēia. Ke nānā nei ʻoe i nā uku, nānā ʻoe i nā lawelawe āu e kamaʻilio ai ... Akā pehea ʻoe e nānā ai i hiki mai kahi kanaka i kāu ʻaoʻao uku, uku, a hāʻawi ka papahana iā ia me ke kālā? ʻO ia hoʻi, pehea ʻoe e nānā ai i ka loaʻa ʻana o ka marchant a ua ʻae i kāu kelepona?

  EK: - "Merchant" no mākou i kēia hihia, ʻo ia ka lawelawe o waho e like me ka ʻōnaehana uku. Mālama mākou i ka wikiwiki pane o ka mea kūʻai aku.

  E pili ana i ka hoʻopili ʻikepili

  IN: - Aloha. He nīnau pili iki kaʻu. Loaʻa iā ʻoe ka ʻikepili koʻikoʻi PCI DSS. Makemake au e ʻike pehea ʻoe e mālama ai i nā PAN i nā pila e pono ai ʻoe e hoʻololi i loko? Ke hoʻohana nei ʻoe i kekahi hoʻopunipuni? A ke alakaʻi nei kēia i ka nīnau ʻelua: e like me ka PCI DSS, pono e hoʻopili hou i ka ʻikepili i ka wā e hoʻololi ai (ka hoʻokuʻu ʻana i nā luna hoʻomalu, a me nā mea ʻē aʻe) - he aha ka mea e hiki ai ke komo i kēia hihia?

  
  
  EK: - Nīnau kupanaha! ʻO ka mea mua, ʻaʻole mākou e mālama i nā PAN i nā pila. ʻAʻohe o mākou kuleana e mālama i ka PAN ma nā wahi āpau ma ke ʻano maʻalahi, ma ke kumu, no laila ke hoʻohana nei mākou i kahi lawelawe kūikawā (kapa mākou iā ia ʻo "Kademon") - he lawelawe kēia e hana i hoʻokahi mea: loaʻa iā ia kahi leka ma ke ʻano he hoʻokomo a hoʻouna. mai i kahi memo i hoʻopili ʻia. A mālama mākou i nā mea āpau me kēia memo i hoʻopili ʻia. No laila, ʻo ka lōʻihi o kā mākou kī ma lalo o ka kilobyte, no laila he koʻikoʻi a hilinaʻi kēia.

  IN: - Pono ʻoe i 2 kilobytes i kēia manawa?

  EK: – Me he mea lā i nehinei wale nō ka 256... ʻAe, ma hea ʻē aʻe?!

  No laila, ʻo ka mua kēia. A ʻo ka lua, ʻo ka hoʻonā e loaʻa nei, kākoʻo ia i ke kaʻina hana re-encryption - aia ʻelua mau "keks" (nā kī), e hāʻawi ana i nā "decks" e hoʻopili ai (key nā kī, ʻo dek nā derivatives o nā kī e hoʻopili ai) . A inā hoʻomaka ke kaʻina hana (e hana mau ana, mai 3 mau mahina a ± kekahi), hoʻoiho mākou i kahi pālua hou o "nā keke", a hoʻopili hou mākou i ka ʻikepili. Loaʻa iā mākou nā lawelawe kaʻawale e ʻoki i nā ʻikepili āpau a hoʻopili iā ia ma kahi ala hou; Mālama ʻia ka ʻikepili ma ka ʻaoʻao o ke kī i hoʻopili ʻia ai. No laila, ke hoʻopili mākou i ka ʻikepili me nā kī hou, holoi mākou i ke kī kahiko.

  I kekahi manawa pono e hana lima ʻia nā uku...

  IN: - ʻO ia hoʻi, inā ua hōʻea mai kahi hoʻihoʻi no kekahi hana, e hoʻokaʻawale paha ʻoe iā ia me ke kī kahiko?

  EK: - ʻAe.

  IN: – A laila hoʻokahi nīnau liʻiliʻi. Ke kū mai kekahi ʻano hāʻule, hāʻule, a i ʻole hanana, pono e hoʻokuʻi i ke kālepa me ka lima. Aia ke kūlana.

  EK: - ʻAe, i kekahi manawa.

  IN: – No hea mai ʻoe i kēia ʻikepili? A i ʻole e hele ʻoe iā ʻoe iho i kēia hale waihona?

  EK: - ʻAʻole, ʻoiaʻiʻo, loaʻa iā mākou kekahi ʻano ʻōnaehana back-office i loaʻa kahi interface no kā mākou kākoʻo. Ināʻaʻole mākou iʻike i ke kūlana o ke kālepa (e like paha, a hiki i ka paneʻana o ka pūnaewele uku me ka manawa manawa),ʻaʻole mākou iʻike i kahi priori,ʻo ia hoʻi, hāʻawi mākou i ke kūlana hope me ka hilinaʻi piha. I kēia hihia, hāʻawi mākou i ke kālepa i kahi kūlana kūikawā no ka hana lima. I ke kakahiaka, i ka lā aʻe, i ka manawa e loaʻa ai ke kākoʻo i ka ʻike e noho mau ana kēlā me kēia mau hana i loko o ka ʻōnaehana uku, hana lima lākou iā lākou i kēia interface.

  
  
  IN: – He mau nīnau kaʻu. ʻO kekahi o lākou ka hoʻomau ʻana o ka ʻāpana PCI DSS: pehea ʻoe e hoʻopaʻa ai i kā lākou kaapuni? ʻO kēia nīnau no ka mea hiki i ka mea hoʻomohala ke hoʻokomo i kekahi mea i loko o nā lāʻau! Nīnau ʻelua: pehea ʻoe e ʻōwili ai i nā hotfix? ʻO ka hoʻohana ʻana i nā lima i ka waihona kahi koho, akā aia paha nā hoʻoponopono wela manuahi - he aha ke kaʻina hana ma laila? A pili paha ka nīnau ʻekolu iā RTO, RPO. ʻO 99,97 kou loaʻa ʻana, aneane ʻehā ʻeiwa, akā i koʻu hoʻomaopopo ʻana, loaʻa iā ʻoe kahi kikowaena data lua, kahi kikowaena data ʻekolu, a me kahi kikowaena data ʻelima ... Pehea ʻoe e synchronize iā lākou, e hoʻopili iā lākou, a me nā mea ʻē aʻe?

  EK: - E hoʻomaka kākou me ka mea mua. ʻO ka nīnau mua e pili ana i nā lāʻau? Ke kākau mākou i nā lāʻau, loaʻa iā mākou kahi papa e uhi i nā ʻikepili koʻikoʻi āpau. Nānā ʻo ia i ka mask a me nā kahua ʻē aʻe. No laila, puka mai kā mākou mau lāʻau me ka ʻikepili huna a me kahi kaapuni PCI DSS. ʻO kēia kekahi o nā hana maʻamau i hāʻawi ʻia i ka ʻoihana hoʻāʻo. Pono lākou e nānā i kēlā me kēia hana, me nā lāʻau a lākou e kākau ai, a ʻo ia kekahi o nā hana maʻamau i ka wā o nā loiloi code, i mea e hoʻomalu ai ʻaʻole kākau ka mea hoʻomohala i kekahi mea. Hana ʻia nā loiloi ma hope o kēia e ka ʻoihana palekana ʻike e pili ana i hoʻokahi manawa i ka pule: koho ʻia nā lāʻau no ka lā hope a holo lākou ma o kahi scanner-analyzer kūikawā mai nā kikowaena hoʻāʻo e nānā i nā mea āpau.
  E pili ana i nā hoʻoponopono wela. Hoʻokomo ʻia kēia i kā mākou hoʻonohonoho hoʻonohonoho. Loaʻa iā mākou kahi māhele ʻokoʻa e pili ana i nā hotfix. Manaʻo mākou e kau mākou i nā hotfix a puni ka uaki ke pono mākou. E like me ka manawa i hui 'ia ka mana, e like me ka mea e holo ana, i ka manawa e loaa ai ia makou he artifact, he luna hooponopono nenoaiu no makou ma ke kahea ana mai ke kākoʻo mai, a hoʻonoho ia i ka manawa e pono ai.

  Ma kahi o "ʻehā nines". Ua hoʻokō maoli ʻia ka helu i loaʻa iā mākou i kēia manawa, a ua hoʻoikaika mākou no ia mea ma kahi kikowaena data ʻē aʻe. I kēia manawa, loaʻa iā mākou kahi kikowaena ʻikepili ʻelua, a ke hoʻomaka nei mākou e ala i waena o lākou, a ʻo ka hoʻopuka ʻana i ka hoʻopiʻi ʻana i ke kikowaena data cross he nīnau noʻonoʻo ʻole. Ua ho'āʻo mākou e hoʻoponopono i ka manawa hoʻokahi me ka hoʻohana ʻana i nā ʻano like ʻole: ua hoʻāʻo mākou e hoʻohana i ka "Tarantula" hoʻokahi - ʻaʻole i kūpono iā mākou, e haʻi koke wau iā ʻoe. ʻO ia ke kumu i hoʻopau ai mākou i ke kauoha lima i nā "sens". ʻO ka ʻoiaʻiʻo, ke holo nei kēlā me kēia noi i kā mākou ʻōnaehana i ka "hoʻololi - hana ʻia" pono ma waena o nā kikowaena data asynchronously.

  IN: - Inā loaʻa iā ʻoe ka lua, no ke aha ʻaʻole i loaʻa iā ʻoe ke kolu? No ka mea, ʻaʻohe kanaka i wehe i ka lolo i kēia manawa ...

  EK: - Akā ʻaʻole mākou Split Brain. Ma muli o ke alakaʻi ʻia ʻana o kēlā me kēia noi e kahi multimaster, ʻaʻole ia he mea nui iā mākou i ke kikowaena i hele mai ai ka noi. Mākaukau mākou no ka ʻoiaʻiʻo inā hāʻule kekahi o kā mākou mau kikowaena data (ke hilinaʻi nei mākou i kēia) a ma ka waena o kahi noi mea hoʻohana e hoʻololi i ke kikowaena ʻikepili ʻelua, ua mākaukau mākou e nalowale i kēia mea hoʻohana, ʻoiaʻiʻo; akā, e lilo kēia mau ʻāpana, ʻāpana kūʻokoʻa.

  IN: - Aloha ahiahi. Mahalo no ka hōʻike. Ua kamaʻilio ʻoe e pili ana i kāu debugger, e holo ana i kekahi mau hana hoʻāʻo i ka hana. Akā e haʻi mai iā mākou e pili ana i nā hana hoʻāʻo! Pehea ka hohonu?

  EK: - Ke hele nei i ka pōʻai holoʻokoʻa o ka ʻāpana holoʻokoʻa. No kahi ʻāpana, ʻaʻohe ʻokoʻa ma waena o kahi hana hoʻāʻo a me kahi hana hana. Akā mai kahi ʻano loiloi, he papahana kaʻawale kēia i ka ʻōnaehana, kahi e holo ai nā hana hoʻāʻo.

  IN: - Ma hea ʻoe e ʻoki ai? Ma ʻaneʻi ua hoʻouna ʻo Core...

  EK: - Aia mākou ma hope o "Kor" i kēia hihia no ka hoʻāʻo ʻana ... Loaʻa iā mākou kahi mea e like me ke ala ʻana: ʻike ʻo "Kor" i ka ʻōnaehana uku e hoʻouna ai - hoʻouna mākou i kahi ʻōnaehana uku hoʻopunipuni, e hāʻawi wale i kahi hōʻailona http a ʻo ia wale nō.

  IN: - E haʻi mai iaʻu, e ʻoluʻolu, ua kākau ʻia kāu palapala noi i hoʻokahi monolith nui, a i ʻole ʻoe i ʻoki i loko o kekahi mau lawelawe a i ʻole microservices?

  EK: - ʻAʻohe o mākou monolith, ʻoiaʻiʻo, loaʻa iā mākou kahi noi lawelawe lawelawe. Hoʻohenehene mākou ua hana ʻia kā mākou lawelawe i nā monoliths - he nui maoli lākou. He mea paʻakikī ke kapa ʻia he microservices, akā he mau lawelawe kēia e hana ai nā limahana o nā mīkini hoʻolaha.

  Inā pili ka lawelawe ma ka kikowaena...

  IN: – A laila, loaʻa iaʻu ka nīnau aʻe. ʻOiai he monolith ia, ua ʻōlelo mau ʻoe he nui kāu o kēia mau kikowaena wikiwiki, hana lākou āpau i ka ʻikepili, a ʻo ka nīnau: "I ka hopena o ka hoʻololi ʻana o kekahi o nā kikowaena wikiwiki a i ʻole kahi noi, kēlā me kēia loulou. , loaʻa iā lākou kekahi ʻano o ka mana ʻae? ʻO wai o lākou e hiki ke hana i ke aha? ʻO wai kaʻu e hoʻokaʻaʻike aku ai no ka ʻike hea?

  
  
  EK: - ʻAe, maopopo. He koʻikoʻi nā koi palekana. ʻO ka mea mua, loaʻa iā mākou nā neʻe ʻikepili wehe, a ʻo nā awa wale nō nā mea a mākou e manaʻo ai i ka neʻe ʻana o ke kaʻa ma mua. Inā kamaʻilio kekahi ʻāpana me ka waihona (e ʻōlelo, me Muskul) ma o 5-4-3-2, ʻo 5-4-3-2 wale nō e wehe ʻia iā ia, a ʻaʻole loaʻa nā awa ʻē aʻe a me nā kuhikuhi ʻē aʻe. Eia hou, ponoʻoe e hoʻomaopopo i kā mākou hanaʻana aia ma kahi o 10 mau puka palekana likeʻole. A inā paha i hoʻohālikelike ʻia ka noi, ʻaʻole hiki i ka mea hoʻouka ke komo i ka console hoʻokele server, no ka mea, he wahi ʻokoʻa kēia.

  IN: – A ma kēia pōʻaiapili, ʻo ka mea hoihoi loa iaʻu, ʻo ia ka loaʻa ʻana o kekahi mau ʻaelike me nā lawelawe - ʻo ka mea hiki iā lākou ke hana, ma o nā "hana" hiki iā lākou ke hoʻopili i kekahi i kekahi... A ma kahi kahe maʻamau, noi kekahi mau lawelawe kikoʻī i kekahi lālani, he papa inoa o nā "hana" ma kekahi. ʻAʻole lākou e huli i nā mea ʻē aʻe i kahi kūlana maʻamau, a loaʻa iā lākou nā kuleana ʻē aʻe. Inā hoʻopili ʻia kekahi o lākou, hiki anei iā ia ke hoʻopau i nā "hana" o kēlā lawelawe?..

  EK: - Maopopo iaʻu. Inā ma kahi kūlana maʻamau me kahi kamaʻilio kikowaena ʻē aʻe i ʻae ʻia, a laila ʻae. Wahi a ka ʻaelike SLA, ʻaʻole mākou e nānā e ʻae wale ʻia ʻoe i nā "hana" 3 mua, ʻaʻole ʻae ʻia ʻoe i ka "hana" 4. He mea nui paha kēia no mākou, no ka mea, ua loaʻa iā mākou kahi ʻōnaehana pale 4-level, ma ke kumu, no nā kaapuni. Makemake mākou e pale aku iā mākou iho me nā contours, ma mua o ka pae o loko.

  Pehea e hana ai ʻo Visa, MasterCard a me Sberbank

  IN: - Makemake wau e wehewehe i kahi kikoʻī e pili ana i ka hoʻololi ʻana i kahi mea hoʻohana mai kahi kikowaena data i kekahi. E like me kaʻu i ʻike ai, hana ʻo Visa a me MasterCard me ka hoʻohana ʻana i ka 8583 binary synchronous protocol, a aia nā hui ʻana ma laila. A makemake wau e ʻike, i kēia manawa ke manaʻo nei mākou e hoʻololi - pololei "Visa" a me "MasterCard" a i ʻole ma mua o nā ʻōnaehana uku, ma mua o ka hana ʻana?

  EK: - ʻO kēia ma mua o ka hui ʻana. Aia kā mākou hui ʻana ma ka kikowaena ʻikepili like.

  IN: – ʻO ka ʻōlelo koʻikoʻi, loaʻa iā ʻoe hoʻokahi wahi pili?

  EK: - "Visa" a me "MasterCard" - ʻae. No ka mea, koi ʻo Visa a me MasterCard i nā hoʻopukapuka koʻikoʻi i ka ʻoihana e hoʻopau i nā ʻaelike ʻokoʻa no ka loaʻa ʻana o kahi hui lua, no ka laʻana. Hoʻopaʻa ʻia lākou i loko o hoʻokahi kikowaena data, akā inā, ʻaʻole ke Akua, ʻo kā mākou kikowaena data, kahi i hui ʻia no ka hoʻopili ʻana iā Visa a me MasterCard, make, a laila e loaʻa iā mākou kahi pilina me Visa a me MasterCard nalowale ...

  IN: - Pehea e hiki ai ke mālama ʻia? ʻIke wau e ʻae ʻo Visa i hoʻokahi pilina ma ke kumu!

  EK: - Hāʻawi lākou i nā lako ponoʻī. ʻO kēlā me kēia hihia, ua loaʻa iā mākou nā lako i hoʻopau piha ʻia i loko.

  IN: - No laila ke kū nei mai kā lākou Connects Orange?..

  EK: - ʻAe.

  IN: - Akā pehea kēia hihia: inā nalowale kāu kikowaena data, pehea ʻoe e hoʻomau ai i ka hoʻohana ʻana? A i ʻole ke kū wale nei ke kaʻa?

  EK: - ʻAʻole. I kēia hihia, e hoʻololi wale mākou i ke kaʻa i kahi ala ʻē aʻe, ʻo ia hoʻi, e ʻoi aku ke kumukūʻai no mākou a ʻoi aku ka pipiʻi no kā mākou mea kūʻai aku. Akā ʻaʻole e hele ka huakaʻi ma o kā mākou pilina pili iā Visa, MasterCard, akā ma o ka Sberbank conditional (nui loa).

  Ke kala aku nei au inā ua hōʻeha au i nā limahana Sberbank. Akā, e like me kā mākou helu, ma waena o nā panakō Lūkini, hāʻule pinepine ʻo Sberbank. ʻAʻole i hala ka mahina me ka hāʻule ʻole o kekahi mea ma Sberbank.

  
  
  

  Kekahi mau hoʻolaha 🙂

  Mahalo no kou noho pū ʻana me mākou. Makemake ʻoe i kā mākou ʻatikala? Makemake ʻoe e ʻike i nā mea hoihoi hou aʻe? E kākoʻo iā mākou ma ke kau ʻana i kahi kauoha a i ʻole ka ʻōlelo ʻana i nā hoaaloha, cloud VPS no nā mea hoʻomohala mai $4.99, he analogue kū hoʻokahi o nā kikowaena hoʻokomo-level, i hana ʻia e mākou no ʻoe: ʻO ka ʻoiaʻiʻo holoʻokoʻa e pili ana iā VPS (KVM) E5-2697 v3 (6 Cores) 10GB DDR4 480GB SSD 1Gbps mai $ 19 a pehea e kaʻana like ai i kahi kikowaena? (loaʻa me RAID1 a me RAID10, a hiki i 24 cores a hiki i 40GB DDR4).

  ʻO Dell R730xd 2 mau manawa maʻalahi ma Equinix Tier IV kikowaena data ma Amsterdam? Eia wale nō 2 x Intel TetraDeca-Core Xeon 2x E5-2697v3 2.6GHz 14C 64GB DDR4 4x960GB SSD 1Gbps 100 TV mai $199 ma Netherlands! Dell R420 - 2x E5-2430 2.2Ghz 6C 128GB DDR3 2x960GB SSD 1Gbps 100TB - mai $99! Heluhelu e pili ana Pehea e kūkulu ai i ka ʻoihana ʻoihana. papa me ka hoʻohana 'ana o Dell R730xd E5-2650 v4 kikowaena waiwai 9000 euros no ka peni?

Source: www.habr.com