Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

В mea i hala ua noʻonoʻo mākou i ka nīnau o "E hoʻohana anei mākou iā RAID ma SSD" me ka hoʻohana ʻana i ka hiʻohiʻona o Kingston drives, akā ua hana mākou i loko o ka pae zero. Ma ka ʻatikala o kēia manawa, e loiloi mākou i nā koho no ka hoʻohana ʻana i nā ʻoihana a me ka home NVMe solutions i nā ʻano kaulana loa o ka RAID arrays a kamaʻilio e pili ana i ka hoʻoponopono hoʻoponopono. E ho'olaha me nā hoʻokele Kingston.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

No ke aha ʻoe e pono ai iā RAID ma kahi SSD?

ʻO nā mea maikaʻi o ka SSD-based storage arrays ma luna o ka HDD storage arrays e loaʻa i nā manawa wikiwiki i ka ʻikepili ma ka drive a me ka hana heluhelu / kākau maikaʻi. Eia nō naʻe, pono kahi hana RAID e pili ana i ka SSD kūpono i kahi hui maikaʻi loa o ka kaʻina hana, cache, lako polokalamu, a me nā lako. Ke hana maikaʻi kēia mau mea āpau, hiki i kahi SSD RAID ke hoʻokō nui i kahi hoʻonohonoho hoʻohālikelike me ka hoʻohana ʻana i nā HDD kuʻuna.

Hoʻohana ka SSD maʻamau i ka mana liʻiliʻi ma mua o nā HDD, no laila ke hoʻohui ʻoe i kahi helu nui o SSD i kahi pūʻulu RAID, hiki i ka mālama ʻana i ka ikehu ke hoʻohālikelike ʻia me kahi pūʻulu HDD RAID hiki ke unuhi ʻia i nā kumukūʻai haʻahaʻa ma nā bila ikehu hui.

Eia nō naʻe, he mau palena a me nā hemahema ʻo SSD RAID, ʻoi aku ka nui o ke kumukūʻai kiʻekiʻe o kēlā me kēia gigabyte o ka lewa i hoʻohālikelike ʻia i nā pahu paʻakikī o ka hiki ke hoʻohālikelike. A ua kaupalena ʻia ka manawa ma waena o nā hemahema o ka hoʻomanaʻo flash i kekahi helu o nā pōʻai kākau hou. ʻO ia hoʻi, he ola lawelawe ka SSD drive, e hilinaʻi ana i ka hana: ʻoi aku ka nui o ka ʻike ma luna o ia mea, ʻoi aku ka wikiwiki o ka holo ʻana. Ma ka ʻaoʻao ʻē aʻe, loaʻa i nā SSDs ʻoihana kahi ola kūpono e hoʻohālikelike ʻia me nā mīkini paʻakikī.

Pehea ka noho ʻana o Kingston SSDs i ke ʻano RAID me nā mea hoʻokele Broadcom

I nā lā mua o SSDs, nui nā nuances i nā hoʻolālā RAID. Hoʻopili ʻia ma muli o ka hoʻohana ʻana i nā HDD ʻaʻohe hewa. ʻOi aku ka hilinaʻi o nā mea hoʻokele paʻa ma mua o ko lākou mau hoa pili i nā disk magnetic. E like me kā mākou e ʻike ai, ʻaʻohe wahi neʻe i nā hoʻonā SSD, no laila ua hoʻemi ʻia ka pōʻino mechanical i ka ʻole. ʻAʻole hiki ke hoʻokō ʻia ka hemahema o nā kaʻa paʻa ma muli o ka piʻi ʻana o ka mana, no ka mea ma ka pae o kahi PC home a me kekahi kikowaena, UPS, nā mea pale pale, a me kahi lako mana e pale aku iā ʻoe.

I ka manawa like, loaʻa i nā drive solid-state kahi mea nui ʻē aʻe: ʻoiai inā pau nā cell memory no ke kākau ʻana, hiki ke heluhelu ʻia ka ʻikepili mai ia mau mea, akā inā ua pōʻino ka disk magnetic, auwe.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

I kēia lā, he hana maʻamau ka hoʻohana ʻana i nā hoʻonā SSD i nā arrays RAID o nā pae like ʻole. ʻO ka mea nui, ʻo ke koho ʻana i nā SSD kūpono, ʻoi aku ka liʻiliʻi o ka latency. A maikaʻi, e hoʻohana i nā SSD o ka mea hana like a me ke ʻano hoʻohālike i ʻole ʻoe e hoʻopau i kahi hodgepodge o nā drive e kākoʻo ana i nā ʻano ukana like ʻole a kūkulu ʻia ma ke kumu o nā ʻano hoʻomanaʻo like ʻole, nā mea hoʻokele a me nā ʻenehana ʻē aʻe. ʻO ia, inā hoʻoholo mākou e kūʻai i ʻehā a i ʻole 16 NVMe SSDs mai Kingston e hana i kahi pūʻulu RAID, ʻoi aku ka maikaʻi inā hele mai lākou a pau mai ka pūʻulu like a me ke ʻano hoʻohālike.

Ma ke ala, ma ʻatikala hope loa Ua haʻi mākou i nā mea hoʻokele Broadcom no kahi kumu i kamaʻilio mākou e pili ana iā NVMe SSD mai Kingston. ʻO ka ʻoiaʻiʻo, ʻo nā manual no kēia mau mea hana e kuhikuhi koke i nā drive kūpono (me nā hoʻonā mai ka mea hana SSD ʻAmelika i ʻōlelo ʻia aʻe nei), kahi e hana pono ai ka mea hoʻoponopono. Pono e hilinaʻi ʻia kēia ʻike i ke koho ʻana i kahi pūʻulu mana-SSD no RAID.

Hoʻopili mākou i ka hana a SSD Kingston i nā ʻano kaulana loa o RAID - "1", "5", "10", "50"

No laila, ʻaʻole hāʻawi ka pae "zero" RAID i ka redundancy data, akā hoʻonui wale i ka hana. ʻAʻole hāʻawi ʻo RAID 0 i kahi pale ʻikepili, no laila ʻaʻole mākou e noʻonoʻo i loko o ka ʻāpana hui. ʻO RAID 1, ma ka ʻaoʻao ʻē aʻe, hāʻawi i ka redundancy piha akā loaʻa nā hana haʻahaʻa haʻahaʻa, a no laila pono e noʻonoʻo ʻia inā ʻaʻole i manaʻo nui ka loaʻa ʻana o ka hana i ke kūkulu ʻana i kahi array SSD RAID.

RAID 1 e pili ana i Kingston SSDs a me Broadcom kaohi

No laila, ʻo ka pae mua RAID array e pili ana i ka Broadcom MegaRAID 9460-16i ka mea hoʻokele e hui pū mai ʻelua a 32 Kingston drive, ʻo ia nā kope o kēlā me kēia, a hāʻawi i ka redundancy piha. Inā i ka wā e hoʻohana ai i nā HDD kuʻuna, ua mau ka wikiwiki o ka kākau ʻana a me ka heluhelu ʻana i ka ʻikepili i ke kiʻekiʻe o kēia HDD ponoʻī, a laila me ka hoʻohana ʻana i nā hoʻonā NVMe SSD loaʻa iā mākou ka piʻi ʻana o ka hana. ʻOi aku ma ke ʻano o ka manawa komo ʻikepili. No ka laʻana, me ʻelua Kingston DC1000M U.2 NVMe SSDs i ka server RAID 1, loaʻa iā mākou he 350 heluhelu maʻamau IOPS a me 000 kākau IOPS.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

Ma ke ʻano o ka wikiwiki heluhelu ʻana, e kūlike nā hopena i nā ʻano o ka drive - 3200 MB / s. Akā ʻoiai ʻo nā NVMe SSD ʻelua i ka hana hana, hiki ke heluhelu ʻia ka ʻikepili mai iā lākou i ka manawa like, e wikiwiki ana nā hana heluhelu. Akā ʻoi aku ka lohi o ka wikiwiki kākau (i ʻōlelo ʻia ʻo 2000 MB / s), no ka mea, ua hana ʻia kēlā me kēia hana kākau ʻelua.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

He kūpono ʻo RAID 1 no nā ʻikepili liʻiliʻi a i ʻole nā ​​​​kaiapuni ʻē aʻe e koi ai i ka hoʻomanawanui hewa akā haʻahaʻa haʻahaʻa. He mea kōkua nui ka hoʻohālikelike ʻana i ka drive i nā hiʻohiʻona hoʻihoʻi pōʻino (ua hoʻohaʻahaʻa iki ka hana) no ka mea e hāʻawi koke i ka "resuscitation" o nā ʻikepili koʻikoʻi inā hāʻule kekahi o nā drive i ka array. Akā, no ka mea e koi ana kēia pae o ka palekana i ka pālua ʻana i ka hiki ke mālama ʻia o ka ʻikepili i hoʻohālikelike ʻia (100 TB e koi i 200 TB o ka waiho ʻana), nui nā ʻōnaehana ʻoihana e hoʻohana i nā koho mālama waiwai ʻoi aku ka maikaʻi: RAID 5 a me RAID 6.

RAID 5 e pili ana i Kingston SSDs a me Broadcom kaohi

No ka hoʻonohonoho ʻana i kahi papa RAID pae ʻelima, pono mākou i ʻekolu mau drive, ʻo ka ʻikepili i hoʻopili ʻia (i kākau ʻia i nā drive āpau i ka array), akā ʻaʻole i kope ʻia. I ka hoʻonohonoho ʻana iā lākou, pono e noʻonoʻo kekahi i kā lākou ʻano paʻakikī, no ka mea e ʻike ʻia kahi manaʻo e like me "checksum" (a i ʻole "parity"). ʻO kēia manaʻo ke ʻano o ka hana XOR algebraic logic (aka kūʻokoʻa "OR"), e kuhikuhi ana i ka hoʻohana ʻana i ka liʻiliʻi o ʻekolu mau kaʻa i loko o ka laha (kiʻekiʻe - 32). I kēia hihia, kākau ʻia ka ʻike parity i nā "disks" āpau i ka array.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

No kahi papa o ʻehā Kingston DC500R SATA SSDs me ka mana o 3,84 TB i kēlā me kēia, loaʻa iā mākou ka 11,52 TB o ka lewa a me 3,84 no nā checksums. A inā ʻoe e hui pū me 16 Kingston DC1000M U.2 NVMe drive me ka mana o 7,68 TB i kahi Level 115,2 RAID, e aʻo mākou i ka 7,68 TB me ka nalowale o 5 TB. E like me kāu e ʻike ai, ʻoi aku ka nui o nā drive, ʻoi aku ka maikaʻi ma ka hopena. ʻOi aku ka maikaʻi no ka mea ʻoi aku ka nui o nā drive ma RAID 0, ʻoi aku ka kiʻekiʻe o ka hana kākau holoʻokoʻa. A hiki i ka heluhelu laina laina i ka pae o RAID XNUMX.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

Hāʻawi kahi pūʻulu disk RAID 5 i ka throughput kiʻekiʻe (ʻoi loa no nā faila nui) a me ka redundancy me ka emi o ka mana. Ua kūpono kēia ʻano hui pūʻulu no nā ʻupena e hana ana i nā hana hoʻokomo/puka liʻiliʻi (I / O) i ka manawa like. Akā ʻaʻole pono ʻoe e hoʻohana iā ia no nā hana e koi ai i ka nui o nā hana kākau no nā poloka liʻiliʻi a liʻiliʻi paha.
Aia kekahi nuance hou aʻe: inā ʻaʻole i liʻiliʻi kekahi o nā drive NVMe, hele ʻo RAID 5 i ke ʻano degradation a hiki ke lilo i mea koʻikoʻi no ka ʻikepili āpau. Inā hāʻule kekahi kaʻa i ka laha, hoʻohana ka mea hoʻokele RAID i ka ʻike parity e hana hou i nā ʻikepili i nalowale.

RAID 10 e pili ana i Kingston SSDs a me Broadcom kaohi

No laila, hāʻawi ʻo RAID 0 iā mākou i ka piʻi pālua o ka wikiwiki a me ka manawa komo, a hāʻawi ʻo RAID 1 i ka hilinaʻi. Ma ke kūpono, e hui pū ʻia lākou, a eia ʻo RAID 10 (a i ʻole 1 + 0) hele mai e hoʻopakele. Hoʻohui ʻia ʻo "Ten" mai ʻehā SATA SSD a i ʻole NVMe drive (kiʻekiʻe - 32) a hōʻike i kahi ʻano o nā "mirror", ʻo ka helu o nā drive e pono mau i ka nui o ʻehā. Ua kākau ʻia ka ʻikepili i loko o kēia ʻano me ka hoʻohana ʻana i ka hoʻokaʻawale poloka paʻa (e like me ka hihia o RAID 0) a me ka wehe ʻana i waena o nā drive, e hoʻolaha ana i nā kope ma nā "drives" i kahi array RAID 1. A me ka hiki ke komo i nā pūʻulu lehulehu ma ka ʻO ka manawa like, hōʻike ʻo RAID 10 i ka hana kiʻekiʻe.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

No ka mea hiki iā RAID 10 ke wehe i ka ʻikepili ma waena o nā hui like ʻole, ʻo ia ka mea hiki ke ʻae i ka hiki ʻole o hoʻokahi kaʻa i kahi pālua. Eia nō naʻe, inā hāʻule nā ​​paʻi aniani ʻelua (ʻo ia hoʻi, nā ʻehā ʻehā) e nalowale ana ka ʻikepili. ʻO ka hopena, loaʻa iā mākou ka hoʻomanawanui a me ka hilinaʻi maikaʻi. Akā, e hoʻomanaʻo ʻoe, e like me RAID 1, hoʻohana ka ʻumi o ka pae i ka hapalua o ka nui o ka nui, a no laila he hopena kumukūʻai. A paʻakikī hoʻi e hoʻonohonoho.

Ua kūpono ʻo RAID 10 no ka hoʻohana ʻana me nā waihona ʻikepili e koi ana i ka 100% redundancy o nā pūʻulu diski aniani, a me ka hoʻonui ʻana i ka hana I/O o RAID 0. ʻO ia ka hopena maikaʻi loa no nā waihona kikowaena waena a i ʻole kekahi ʻona e koi ai i ka hoʻomanawanui hewa kiʻekiʻe. ma mua o RAID 5.

RAID 50 e pili ana i Kingston SSDs a me Broadcom kaohi

ʻO kahi pūʻulu i hui pū ʻia e like me ka pae 5 RAID, ʻo ia ka pae kiʻekiʻe 50 i kūkulu ʻia mai nā papa kiʻekiʻe 5. E like me ka wā ma mua, ʻo ka pahuhopu nui o kēia pūʻulu ʻo ia ka hoʻokō pālua i ka hana me ka mālama ʻana i ka hilinaʻi ʻikepili i nā arrays RAID XNUMX. Ma ka manawa like, hāʻawi ʻo RAID XNUMX i ka hana kākau i hoʻomaikaʻi ʻia a me ka pale ʻikepili ʻoi aku ka maikaʻi ma mua o ka RAID XNUMX maʻamau i ka wā o ka holo kaʻa. , a hiki nō hoʻi iā ia ke hoʻihoʻi wikiwiki i ka hihia o ka hemahema o kekahi o nā drive.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

Hoʻokaʻawale ka pūʻulu hoʻokele RAID 50 i ka ʻikepili i nā poloka liʻiliʻi a laila ʻokiʻoki iā ia ma kēlā me kēia pūʻulu RAID 5. ʻO ka pūʻulu hoʻokele RAID 5 hoʻi e hoʻokaʻawale i ka ʻikepili i nā poloka liʻiliʻi, e helu i ka parity, e hana i kahi hana logical OR ma nā poloka, a laila. hana i ka palapala poloka ikepili a me nā hana parity no kēlā me kēia disk i loko o ka pūʻulu disk.

A ʻoiai e hoʻohaʻahaʻa ʻole ʻia ka hana inā hāʻule kekahi o nā kaʻa, ʻaʻole ia he mea koʻikoʻi e like me ka RAID 5 array, no ka mea e pili ana kekahi hemahema i hoʻokahi o nā arrays, e waiho ana i ka hana holoʻokoʻa. ʻO ka ʻoiaʻiʻo, hiki i ka RAID 50 ke ola a hiki i ʻewalu HDD/SSD/NVMe drive hemahema inā hāʻule kēlā me kēia "disk" i kahi ʻāpana RAID 5 ʻokoʻa.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

Hoʻohana maikaʻi ʻia ʻo RAID 50 no nā noi e koi ana i ka hilinaʻi kiʻekiʻe a pono e hana i kahi helu kiʻekiʻe o nā noi me ka mālama ʻana i nā helu hoʻoili ʻikepili kiʻekiʻe a me nā kumukūʻai kaʻa haʻahaʻa ma mua o RAID 10. Eia naʻe, no ka mea e koi ʻia ka liʻiliʻi o ʻeono mau pahu e hoʻonohonoho i kahi array RAID 50. , 'a'ole ho'opau loa 'ia ke kumukū'ai ma ke 'ano he kumu. ʻO kahi hemahema o RAID 50 ʻo ia, e like me RAID 5, pono ia i kahi mea hoʻoponopono paʻakikī: e like me i ʻōlelo ʻia e mākou ma ka ʻatikala hope loa MegaRAID 9460-16i mai Broadcom.

He mea kūpono hoʻi e ʻike ʻia ʻo RAID 50 ka liʻiliʻi o ka hoʻohana ʻana i ka disk space ma mua o RAID 5 ma muli o ka hoʻokaʻawale ʻana o ka hiki ke hoʻopaʻa i nā moʻolelo parity. Eia nō naʻe, ʻoi aku ka nui o nā wahi i hoʻohana ʻia ma mua o nā pae RAID ʻē aʻe, ʻoi aku ka poʻe e hoʻohana ana i ka mirroring. Me ka palena liʻiliʻi o ʻeono mau kaʻa, hiki i ka RAID 50 ke koho i ke kumu kūʻai, akā ʻo ke kikowaena disk keu e hōʻoia i ke kumukūʻai ma ka pale ʻana i ka ʻikepili hui. Manaʻo ʻia kēia ʻano o ka laha no ka ʻikepili e koi ana i ka hilinaʻi mālama kiʻekiʻe, nā noi noi kiʻekiʻe, nā uku hoʻololi kiʻekiʻe, a me ka hiki ke mālama nui.

RAID 6 a me RAID 60: ʻaʻole mākou i poina iā lākou

No ka mea, ua kamaʻilio mākou e pili ana i nā ʻāpana o ka pae ʻelima a me kanalima, he hewa ia ʻaʻole e haʻi i nā ʻano o ka hui pū ʻana e like me RAID 6 a me RAID 60.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

ʻO ka hana o RAID 6 e like me RAID 5, akā ma ʻaneʻi ma kahi o ʻelua mau drive i hāʻawi ʻia i ka parity, e hiki ai i ka array ke ola i ka hāʻule ʻole o nā pahu ʻelua me ka nalowale ʻole o ka ʻikepili (ma RAID 5, ʻaʻole makemake ʻia kēia kūlana). ʻO kēia ka hopena i ka hilinaʻi kiʻekiʻe. Inā ʻaʻole, ua like nā mea a pau me ka pae ʻelima: i ka wā o ka hāʻule ʻole o hoʻokahi a ʻelua paha disks, hoʻohana ka mea hoʻokele RAID i nā poloka parity e hana hou i nā ʻike āpau i nalowale. Inā hāʻule nā ​​pahu ʻelua, ʻaʻole hiki ke hoʻihoʻi i ka manawa like: ʻo ka mua, hoʻāla hou ʻia ka pahu mua, a laila ka lua. No laila, hana ʻia ʻelua mau hana hoʻihoʻi data.

Kaʻana like mākou i kā mākou ʻike, pehea ka hana ʻana o SSD i loko o ke kāʻei o RAID a ʻoi aku ka maikaʻi o ka pae array

He mea maʻalahi ke koho inā ʻo RAID 50 kahi pae kiʻekiʻe 60 o nā pae kiʻekiʻe 6, a laila ʻo RAID 50 kahi pae kiʻekiʻe 8 o nā pae kiʻekiʻe 16 a mākou i kamaʻilio ai. ʻO ia hoʻi, ʻo kēia hui o ka waihona RAID e hiki ai iā ʻoe ke ola i ka nalowale o ʻelua SSDs i kēlā me kēia pūʻulu o nā drive RAID XNUMX. ʻO ke kumumanaʻo o ka hana e like me ka mea a mākou i kamaʻilio ai ma ka ʻāpana RAID XNUMX, akā ʻo ka helu o nā hāʻule i kahi. hiki i ka pae XNUMX ke kū i ka ulu ʻana mai ka XNUMX a hiki i ka XNUMX drive. ʻO ka maʻamau, hoʻohana ʻia ia mau arrays no ka lawelawe mea kūʻai aku ma ka pūnaewele, e koi ana i ka hoʻomanawanui hewa kiʻekiʻe.

E hōʻuluʻulu ana:

ʻOiai e hāʻawi ana ka mirroring i ka hoʻomanawanui hewa ma mua o RAID 50/60, pono nō hoʻi ka nui o ka manawa. Ma muli o ka pālua ʻana o ka nui o ka ʻikepili, loaʻa iā ʻoe he 50% wale nō o ka nui o ka mana o nā drive i hoʻokomo ʻia i ka kikowaena no ka hoʻopaʻa ʻana a me ka mālama ʻana i ka ʻike. ʻO ke koho ʻana ma waena o RAID 50/60 a me RAID 10 e hilinaʻi nui ʻia i nā waihona kālā i loaʻa, ka mana o ka server, a me kāu pono pale ʻikepili. Eia kekahi, hiki mai ke kumukūʻai i ka wā e kamaʻilio ai mākou e pili ana i nā hoʻonā SSD (ʻo ka hui ʻoihana a me nā mea kūʻai aku).

E like me ka mea nui, ʻike maopopo mākou ʻo SSD-based RAID kahi hopena palekana a he hana maʻamau no ka ʻoihana o kēia lā. Ma ke ʻano o ka hoʻohana ʻana i ka home, aia kekahi kumu e hoʻololi ai iā NVMe, inā ʻae nā kālā. A inā he nīnau kāu, no ke aha e pono ai kēia mau mea a pau, e hoʻi i ka hoʻomaka o ka ʻatikala - ua pane mākou i nā kikoʻī.

Ua hoʻomākaukau ʻia kēia ʻatikala me ke kākoʻo o kā mākou mau hoa hana ma Broadcom, nāna e hāʻawi i kā lākou mau mea hoʻokele i nā ʻenekini Kingston no ka hoʻāʻo ʻana me nā drive SATA/SAS/NVMe papa hana. Mahalo i kēia symbiosis aloha, ʻaʻole pono nā mea kūʻai aku e kānalua i ka hilinaʻi a me ka paʻa o nā hoʻokele Kingston me ka HBA a me nā mea hoʻokele RAID mai ka hana ʻana. E ho'olaha.

Hiki ke loaʻa ka ʻike hou aku e pili ana i nā huahana Kingston ma kahua pūnaewele pūaina.

Source: www.habr.com

Pākuʻi i ka manaʻo hoʻopuka