"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™

Southbridge ืขื Slurm ืฉืœื” ื”ื™ื ื”ื—ื‘ืจื” ื”ื™ื—ื™ื“ื” ื‘ืจื•ืกื™ื” ืฉื™ืฉ ืœื” ืื™ืฉื•ืจ KTP (ืกืคืง ื”ื“ืจื›ื” ืฉืœ Kubernetes).

Slurm ื”ื•ื ื‘ืŸ ืฉื ื”. ื‘ืžื”ืœืš ืชืงื•ืคื” ื–ื•, 800 ืื ืฉื™ื ืกื™ื™ืžื• ืืช ื”ืงื•ืจืกื™ื ื”ืื™ื ื˜ื ืกื™ื‘ื™ื™ื ืฉืœื ื• Kubernetes. ื”ื’ื™ืข ื”ื–ืžืŸ ืœื”ืชื—ื™ืœ ืœื›ืชื•ื‘ ืืช ื”ื–ื™ื›ืจื•ื ื•ืช ืฉืœืš.

ื‘-9-11 ื‘ืกืคื˜ืžื‘ืจ ื‘ืกื ื˜ ืคื˜ืจืกื‘ื•ืจื’, ื‘ืื•ืœื ื”ื›ื ืกื™ื Selectel, ื”ื‘ื ืขื™ืœืคื•ืŸ, ื”ื—ืžื™ืฉื™ ื‘ืจืฆื™ืคื•ืช. ืชืชืงื™ื™ื ื”ื™ื›ืจื•ืช ืขื Kubernetes: ื›ืœ ืžืฉืชืชืฃ ื™ืฆื•ืจ ืืฉื›ื•ืœ ื‘ืขื ืŸ Selectel ื•ื™ืคืจื•ืก ืืช ื”ืืคืœื™ืงืฆื™ื” ืฉื.

ืžืชื—ืช ืœื’ื–ืจื” ื™ืฉ ืืช ื”ื”ื™ืกื˜ื•ืจื™ื” ืฉืœ Slurm, ืžื”ืจืขื™ื•ืŸ ื•ืขื“ ื”ื™ื•ื.

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
Pavel Selivanov ื‘ืคืชื™ื—ืช Slurm-4

ื•ืงื•ื‘ืจื ื˜ืก ืคื’ืข

ื‘ืฉื ืช 2014 ืฉื•ื—ืจืจื” ื”ื’ืจืกื” ื”ืจืืฉื•ื ื” ืฉืœ Kubernetes. ื‘ืฉื ืช 2018 ื”ืชืขื•ืจืจ ื”ื™ื™ืค ื‘ืจื•ืกื™ื”: ื‘-Yandex, ืžืกืคืจ ื”ื‘ืงืฉื•ืช ืฉืœ Kubernetes ื’ื“ืœ ืž-1000 ืœื—ื•ื“ืฉ ืœ-5000, ื•ื”ืžื™ืœื” ื”ื–ื• ื ืฉืžืขื” ื™ื•ืชืจ ื•ื™ื•ืชืจ ื‘ืžืฉื ื•ืžืชืŸ. ืขืกืงื™ื ืขื“ื™ื™ืŸ ืœื ื”ืืžื™ื ื• ื‘- Kubernetes, ืื‘ืœ ื›ื‘ืจ ื”ืกืชื›ืœื• ืขืœ ื–ื” ื‘ืื•ืคืŸ ืคืขื™ืœ.

ื‘-2018 ืจืื™ื ื• ืฉ-Kubernetes ืฆื•ื‘ืจ ืชืื•ืฆื”, ื•ืจืง ื›ืžื” ืื ืฉื™ื ื‘ื—ื‘ืจื” ื”ื™ื• ื‘ื‘ืขืœื•ืช ืžืœืื”. ืฉื ื™ ืื ืฉื™ื ื”ืจื‘ื” ื™ื•ืชืจ ื˜ื•ื‘ื™ื ืžืืฃ ืื—ื“, ืื‘ืœ ื”ืจื‘ื” ืคื—ื•ืช ืžืžื” ืฉืื ื—ื ื• ืฆืจื™ื›ื™ื. ืคืฉื•ื˜ ืื™ืŸ ืงื•ืจืกื™ื ืจืื•ื™ื™ื ื‘ืฉื•ืง. ืื™ืŸ ืœืืŸ ืœืฉืœื•ื— ืื ืฉื™ื. ื•ืงื™ื‘ืœื ื• ืืช ื”ื”ื—ืœื˜ื” ื”ืžืชื‘ืงืฉืช: ืื ื—ื ื• ืขื•ืฉื™ื ืงื•ืจืกื™ื ืคื ื™ืžื™ื™ื ื›ื“ื™ ืฉื”ืžืืกื˜ืจื™ื ื™ื•ื›ืœื• ืœืœืžื“ ืื—ืจื™ื.

ืื™ื’ื•ืจ ืื•ืœืžืกืงื•ื™
ืžื ื›"ืœ ืกืื•ืช'ื‘ืจื™ื“ื’'

ืื‘ืœ ืืชื” ืœื ื™ื›ื•ืœ ืคืฉื•ื˜ ืœืœื›ืช ื•ืœืœืžื“ ืื ืฉื™ื. ื‘ืกืื•ืช'ื‘ืจื™ื“ื’' ื›ื•ืœื ืขื•ื‘ื“ื™ื ืžืจื—ื•ืง; ืืชื” ืœื ื™ื›ื•ืœ ืœืืกื•ืฃ ืื ืฉื™ื ื‘ืžืฉืจื“; ืฆืจื™ืš ืœื”ืขื‘ื™ืจ ืื•ืชื ืžืฆ'ืœื™ืื‘ื™ื ืกืง, ื—ื‘ืจื•ื‘ืกืง ื•ืงืœื™ื ื™ื ื’ืจื“. Kubernetes ื”ื•ื ื ื•ืฉื ืžื•ืจื›ื‘; ืืชื” ืœื ื™ื›ื•ืœ ืœืฉืœื•ื˜ ื‘ื• ืชื•ืš ื›ืžื” ืฉืขื•ืช, ื•ืœื ื›ื•ืœื ืžืกื•ื’ืœื™ื ืœื“ื—ื•ืช ื”ื›ืœ ืœืฉื‘ื•ืข.

ื•ื–ื” ืœื ื›ืœ ื›ืš ืงืœ ืœื”ืขื‘ื™ืจ ื™ื“ืข; ืืชื” ืœื ื™ื›ื•ืœ ืœืฉื‘ืช ืžื•ืœ ืžืฆืœืžืช ืื™ื ื˜ืจื ื˜ ื•ืœื”ื›ื ื™ืก ืœืจืืฉ ืฉืœ ืขืžื™ืชื™ืš ืืช ื›ืœ ืžื” ืฉืืชื” ื™ื•ื“ืข ื‘ืขืฆืžืš. ืฆืจื™ืš ืœื‘ื ื•ืช ืืช ื”ื—ื•ืžืจ, ืœืชื›ื ืŸ ื”ืจืฆืื”, ืœื”ื›ื™ืŸ ืžืฆื’ืช, ืœื”ืžืฆื™ื ืžืฉื™ืžื” ืžืขืฉื™ืช.

ื›ื“ื™ ืฉื”ื”ื›ืฉืจื” ืชืชืงื™ื™ื ืฆืจื™ืš ืœื”ื›ื™ืŸ ืชื•ื›ื ื™ืช, ืœืฉื›ื•ืจ ื‘ื™ืช ืžืœื•ืŸ, ืœื”ื•ืฆื™ื ืืช ื›ื•ืœื ืžื”ืฉื’ืจื”, ืœื”ื•ืฉื™ื‘ ืื•ืชื ื‘ื—ื“ืจ ื™ืฉื™ื‘ื•ืช ื•ืœื”ืฉืชืžืฉ ื‘ืฉื™ื˜ื” ืืงืกืคืจืก ืœื”ื•ืจื“ืช ื™ื“ืข ืœืจืืฉ.

ื•ืื ื ืฉื›ื•ืจ ืœืขืฆืžื ื• ืžืœื•ืŸ ื•ื—ื“ืจ ื™ืฉื™ื‘ื•ืช, ืœืžื” ืœื ืœืžื›ื•ืจ ืชืจื™ืกืจ ืžืงื•ืžื•ืช? ื‘ื•ื ื ืฉื™ื’ ืงืฆืช ื›ืกืฃ ืœื›ืจื˜ื™ืกื™ื.

ื›ืš ื ื•ืœื“ ื”ืจืขื™ื•ืŸ ืฉืœ Slurm.

"ืกืœืื 1": ื”ืคืขื ื”ืจืืฉื•ื ื” ืชืžื™ื“ ื›ื•ืื‘ืช

ื”ืงื•ื ืกืคื˜ ืฉืœ Slurm ื”ืจืืฉื•ืŸ ื”ืฉืชื ื” ืœืœื ื”ืจืฃ. ื ืงื™ื™ื ืื•ืชื• ื‘ื›ืคืจ ื”ืžืชื›ื ืชื™ื ืœื™ื“ ืงื™ืจื•ื‘. ืœื, ืื ื—ื ื• ืขื•ื‘ืจื™ื ืœืžืœื•ืŸ ืœื™ื“ ืžื•ืกืงื‘ื”. ืื ื—ื ื• ืžื›ื™ื ื™ื ืชื•ื›ื ื™ืช ืœืฉื‘ื•ืข. ืœื, ืœ-3 ื™ืžื™ื. ืื ื—ื ื• ื‘ื•ื ื™ื ืขืœ 30 ืžืฉืชืชืคื™ื. ืœื, 50. ืื ื—ื ื• ืžืชืืžื ื™ื ืขืœ ืžื—ืฉื‘ื™ื ื ื™ื™ื“ื™ื. ืœื, ื‘ืฆื‘ื™ืจ ืขื ื ื™ื.

ื›ื‘ืจ ื”ื™ื” ืœื™ ื ื™ืกื™ื•ืŸ ืœืœืžื“ ืื ืฉื™ื ืื™ืš ืœื”ืฉืชืžืฉ ื‘-Kubernetes, ืื– ื”ืชื•ื›ื ื™ืช ื”ืจืืฉื•ื ื” ื›ืœืœื” ืืช ืžื” ืฉื‘ื“ืจืš ื›ืœืœ ืœื™ืžื“ืชื™ ืœืžื ื”ืœื™ื ืื—ืจื™ื. ื•ื”ื•ื ืชื•ื›ื ืŸ ืœืฉื‘ื•ืข. ื•ืื– ื”ืชื‘ืจืจ ืฉืืฃ ืื—ื“ ืœื ืจืฆื” ืœืงื—ืช ืฉื‘ื•ืข ืžื—ื™ื™ื• ืœืžืขืŸ ื”ื”ื›ืฉืจื” ืฉืœื ื•, ื•ื™ื—ื“ ืฆืžืฆืžื ื• ืืช ื”ืชื•ื›ื ื™ืช ืœ-3 ื™ืžื™ื: ื”ื•ืฆืื ื• ืืช ื›ืœ ื”ืžื™ื, ื”ื—ืœืคื ื• ืืช ื”ืชื™ืื•ืจื™ื” ื‘ืžืฉื™ืžื•ืช ืžืขืฉื™ื•ืช ื›ื›ืœ ืฉื ื™ืชืŸ, ื• ื‘ืžืงื‘ื™ืœ ืžื‘ื ื” ืžื—ื“ืฉ ืืช ื”ืชื•ื›ื ื™ืช ื›ืš ืฉืชื”ื™ื” ืฉื™ืžื•ืฉื™ืช ืœื ืจืง ืœืžื ื”ืœื™ ืžืขืจื›ืช, ืืœื ื’ื ืœืžืคืชื—ื™ื ืฉื”ื™ื™ืฉื•ืžื™ื ืฉืœื”ื ืคื•ืขืœื™ื ื‘-k8s.

ืคืื‘ืœ ืกืœื™ื•ื•ื ื•ื‘
ืจืžืงื•ืœ ืกืœื•ืจื

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
ืขื•ื‘ื“ื™ ืกืื•ืช'ื‘ืจื™ื“ื’' ื ืคื’ืฉื• ื‘ืื•ืคืŸ ืื™ืฉื™ ื‘ืคืขื ื”ืจืืฉื•ื ื”

20 ืื ืฉื™ื ืžืกืื•ืช'ื‘ืจื™ื“ื’' ื”ื’ื™ืขื• ืœืœืžื•ื“ ื‘ืกืœืจื. ืžื›ืจื ื• ืขื•ื“ 30 ื›ืจื˜ื™ืกื™ื ื‘-25 ืจื•ื‘ืœ ื›ืžืขื˜ ืœืœื ืคืจืกื•ื (ื•ื–ื•ืœ ืžืื•ื“ ื‘ื”ืชื—ืฉื‘ ืœืœื™ื ื”), ื•ืขื•ื“ 000 ืื™ืฉ ื ืจืฉืžื• ื‘ืชื•ืจ ื”ื”ืžืชื ื”. ื”ืชื‘ืจืจ ืฉื”ื‘ื™ืงื•ืฉ ืœืงื•ืจืกื™ื ื›ืืœื” ื”ื•ื ืขืฆื•ื.

ื‘-2 ื‘ืื•ื’ื•ืกื˜ 2018 ืžื’ื™ืขื™ื ื”ืžืฉืชืชืคื™ื ืœืžืœื•ืŸ, ื•ืฉื˜ืฃ ืฉืœ ื‘ืขื™ื•ืช ืืจื’ื•ื ื™ื•ืช ืžื›ื” ืื•ืชื ื• ื‘ื›ืื‘ ืžืขืœ ื”ืจืืฉ.

ื—ื“ืจ ื”ื™ืฉื™ื‘ื•ืช ืฉื‘ื• ืืžื•ืจ ืœื”ืชืงื™ื™ื ืกืœื•ืจื ืขื“ื™ื™ืŸ ืœื ื’ืžื•ืจ. ืื™ืŸ ืฉื•ืœื—ื ื•ืช: ืื• ืฉื”ืžืฉืœื•ื— ืžืื™ืงืื” ื”ืชืขื›ื‘, ืื• ืฉื”ืžืœื•ืŸ ืœื ื”ืชื›ื•ื•ืŸ ืœืงื ื•ืช ืื•ืชื, ื•ื”ื ื”ื•ืœื™ื›ื• ืื•ืชื ื• ืฉื•ืœืœ. ืฉืœื™ืฉ ืžื”ื—ื“ืจื™ื ืื™ื ื ืจืื•ื™ื™ื ืœืžื’ื•ืจื™ื. ื”ื ื”ืœืช ื”ืžืœื•ืŸ ื ืจืื™ืช ื›ืื™ืœื• ืจืง ืืชืžื•ืœ ื—ื•ืœื‘ื• ืืช ื”ืคืจืกื•ืžื•ืช, ื•ื”ื‘ื ื•ืช ื‘ืงื‘ืœื” ืžืขื•ื ื•ืช ื›ืžื• ืื•ืชืŸ ืคืจืกื•ืžื•ืช.

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
Slurm ื™ืชื—ื™ืœ ื‘ืื•ืœื ื”ื–ื” ื‘ืขื•ื“ 20 ืฉืขื•ืช

ืœืื—ืจ ื”ืฉืคืœ ื”ืจืืฉื•ืŸ ืฉืœื™, ืคื™ืชื—ืชื™ ืืช ืชืกืžื•ื ืช ื•ื™ื™ื˜ื ืื. ืื ื™ ืื™ืฉื™ืช ื‘ื•ื“ืง ืืช ื”ื—ื“ืจื™ื ืฉืื ื• ืฉื•ื›ืจื™ื, ืกื•ืคืจ ืืช ื”ืฉื•ืœื—ื ื•ืช, ื™ื•ืฉื‘ ืขืœ ื›ื™ืกืื•ืช ืžืงื•ืžื™ื™ื, ื˜ื•ืขื ืืช ื”ืื•ื›ืœ, ืžื‘ืงืฉ ืœืจืื•ืช ืืช ื”ื—ื“ืจื™ื.

ืื ื˜ื•ืŸ ืกืงื•ื‘ื™ืŸ
ืžื ื”ืœ ืžืกื—ืจื™ Southbrdige

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
ืื ื—ื ื• ื›ืžืขื˜ ื™ื•ืฉื‘ื™ื ืื—ื“ ืขืœ ื”ื‘ืจื›ื™ื™ื ืฉืœ ื–ื”

ืขื ื–ืืช, ื‘ื™ื•ื ื”ืจืืฉื•ืŸ, ื›ืœ ื”ื‘ืขื™ื•ืช ื”ื“ื•ื—ืงื•ืช ื ืคืชืจื•: ืฉื•ืœื—ื ื•ืช ื ืืกืคื• ืžื›ืœ ืจื—ื‘ื™ ื”ืžืœื•ืŸ, "ืฉื“ื“ื•" ืืช ื“ืœืคืง ื”ืงื‘ืœื” ื•ื—ื“ืจ ื”ืื•ื›ืœ, ื”ืื•ืจื—ื™ื ื”ืžื•ืฉืคืขื™ื ื‘ื™ื•ืชืจ ืื•ื›ืกื ื• ื‘"ืงื•ืจืกื˜ื•ืŸ" ืฉื‘ืกืจืคื•ืฆื•ื‘ ื”ืกืžื•ื›ื”, ื‘ืžืงื‘ื™ืœ. ื”ื ืฉื™ืœืžื• ืขื‘ื•ืจ ืžื•ื ื™ืช, ืืกืคืงืช ืžื™ื ื•ืื•ื›ืœ ืกื•ื“ืจื•.

ื‘ื™ื•ื ื”ืฉื ื™, ื›ืฉื”ืžืฆื‘ ื ืจื’ืข, ื”ื—ืœื˜ื ื• ืฉืฆืจื™ืš ืœื”ืชื ืฆืœ ื‘ืคื ื™ ื”ืื•ืจื—ื™ื. ื”ืœื›ื ื• ืœืžื˜ืจื• ื•ืงื ื™ื ื• 100 ืœื™ื˜ืจ ื’ื™ื ืก. ืื ืœื ื™ื›ื•ืœื ื• ืœืกืคืง ื ื•ื—ื•ืช ื‘ืื•ืœื ื•ื‘ื—ื“ืจื™ื, ืœืคื—ื•ืช ื ืื™ืจ ืืช ื”ืขืจื‘ ืฉืœ ื”ืื ืฉื™ื.

ืื™ื’ื•ืจ ืื•ืœืžืกืงื•ื™

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
ืžื” ืขื•ืฉื™ื ืžื ื”ืœื™ ืžืขืจื›ืช ืื—ืจื™ ื™ื•ื ืงืฉื” ื‘ืขื‘ื•ื“ื”?

ืœืžืจื•ืช ื›ืœ ื”ื‘ืขื™ื•ืช, ืื ืฉื™ื ืื”ื‘ื• ืืช ืžื” ืฉื‘ืื• ื‘ืฉื‘ื™ืœื•: ื”ืชื•ื›ืŸ. ืœื›ืŸ, ื‘ื™ื•ื ื”ืฉืœื™ืฉื™ ืฉืœ Slurm ื”ื—ืœื˜ื ื• ืœื—ื–ื•ืจ ืขืœ ื–ื” ื‘ืกืชื™ื•. ืขืœ ื”ื“ืจืš ืจืื™ื™ื ื• ืžืฉืชืชืคื™ื ื‘ื ื•ืฉืื™ื ืžืขื ื™ื™ื ื™ื ื•ืืกืคื ื• ืืช ื”ื‘ืกื™ืก ืœืชื›ื ื™ืช ืžืชืงื“ืžืช. ืงืจืื ื• ืœื–ื” "MegaSlurm".

Slurm-2: ืขื•ื‘ื“ื™ื ืขืœ ื˜ืขื•ื™ื•ืช

Slurm ืฆืจื™ืš ืžืœื•ืŸ ืจืื•ื™. ืื ื• ื‘ื•ื—ืจื™ื ืืช "Tsargrad" ื‘ืขืœ ื—ืžื™ืฉื” ื›ื•ื›ื‘ื™ื.

ื™ืฉ ื™ื•ืชืจ ืžื•ืขืžื“ื™ื ืžืžื” ืฉื”ืื•ืœื ื™ื›ื•ืœ ืœื”ื›ื™ืœ, ื•ืœื ื›ืœ ืื—ื“ ื™ื›ื•ืœ ืœื”ืจืฉื•ืช ืœืขืฆืžื• ื ืกื™ืขืช ืขืกืงื™ื. ืื ื• ืžืืจื’ื ื™ื ืฉื™ืขื•ืจื™ื ืžืจื•ื—ืงื™ื: ืฉื™ื“ื•ืจ ืžืงื•ื•ืŸ, ืชืงืฉื•ืจืช ื‘ืขืจื•ืฅ ื˜ืœื’ืจื, ืงื‘ื•ืฆืช ืชืžื™ื›ื” ืœืขื–ืจื” ืœืชืœืžื™ื“ื™ื ืžืจื•ื—ืงื™ื.

ื™ืฉ ื”ืจื‘ื” ื™ื•ืชืจ ืชืœืžื™ื“ื™ื. ืื ื• ืžื‘ืฆืขื™ื ืฉื™ื˜ืชื™ื•ืช ื•ืื•ื˜ื•ืžืฆื™ื” ืฉืœ ืชื”ืœื™ื›ื™ื: ื™ืฆื™ืจืช ืืฉื›ื•ืœื•ืช, ื”ืคืฆืช ื’ื™ืฉื”, ืื™ืกื•ืฃ ืฉืืœื•ืช ืžื”ืงื”ืœ.

ื›ื‘ืจ ืœื ืงื™ื‘ืœื ื• ื”ื—ืœื˜ื•ืช ืืจื’ื•ื ื™ื•ืช ื‘ื—ื™ืคื–ื•ืŸ, ืืœื ื™ืฆืจื ื• ืืช ื”ื˜ื›ื ื•ืœื•ื’ื™ื” ืœืื™ืจื•ืข.

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
ื™ืฉ ื›ืืŸ ื›ื‘ืจ ืื•ืœื ืžื›ื•ื‘ื“, ื•ื™ืฉ ืžืกืคื™ืง ืฉื•ืœื—ื ื•ืช ืœื›ื•ืœื

ื›ืขืช ืžืชื’ืœื•ืช ื‘ืขื™ื•ืช ืžื•ืฉื’ื™ื•ืช.

ืื ืฉื™ื ืœื ืจื•ืฆื™ื ืœืœื›ืช ืœืžืœื•ืŸ ื›ืคืจื™. ื—ืฉื‘ื ื• ืฉื–ื” ืžื’ื ื™ื‘: ืœืฆืืช ืžื”ืฉื’ืจื”, ืœืœื›ืช ืœืžืงื•ื ืฉื‘ื• ืžื˜ืœื•ืช ื”ืขื‘ื•ื“ื” ื•ื”ืžื˜ืœื•ืช ื”ื‘ื™ืชื™ื•ืช ืœื ื™ืฉื™ื’ื• ืื•ืชืš, ื•ืœืฉืงื•ืข ื‘ืงื•ื‘ืจื ื˜ืก ืขื“ ืžืขืœ ื”ืจืืฉ. ื”ืชื‘ืจืจ ืฉืžื“ื•ื‘ืจ ื‘ืžืชื— ื ื•ืกืฃ. ื‘ื ื•ืกืฃ, ื”ืžืœื•ืŸ ืคื•ื’ืข ื‘ืชืงืฆื™ื‘ ื”ืื™ืจื•ืข.

ืžื—ืœืงื•ืช ื”ื›ืกืคื™ื ืœื ืจื•ืฆื•ืช ืœืฉืœื ืœืขื•ื‘ื“ื™ื ื›ื“ื™ ืœืœืžื•ื“ ื‘ื›ื™ืชื” ื›ืฉื™ืฉ ืืคืฉืจื•ืช ื–ื•ืœื” ื™ื•ืชืจ ื‘ืื™ื ื˜ืจื ื˜. ืื‘ืœ ื—ืฉื‘ื ื• ื‘ืื™ื ื˜ืจื ื˜ ื›ืืžืฆืขื™ ืคืœื™ืื˜ื™ื‘ื™ ืขื‘ื•ืจ ืืœื” ืฉื’ืจื™ื ื‘ืคื™ื ื•ืช ื”ืจื—ื•ืงื•ืช ืฉืœ ืจื•ืกื™ื” ื•ืžื“ื™ื ื•ืช ืื—ืจื•ืช, ื•ืœื ื”ืชื›ื•ื•ื ื• ืœื”ืคื•ืš ืืช Slurm ืœืกืžื™ื ืจ ืื™ื ื˜ืจื ื˜ื™ ื‘ืŸ ืฉืœื•ืฉื” ื™ืžื™ื.

ืฉืžื—ืชื™ ื‘ืžื™ื•ื—ื“ ืฉื”ื’ื™ืขื• ืœ-MegaSlurm 40 ืื ืฉื™ื, ืœืžืจื•ืช ืฉื‘ื”ืชื—ืœื” ืฆื™ืคื™ื ื• ืœ-15-20. ื‘ื™ื ื™ื”ื ืžืฉืชืชืคื™ื ืจื‘ื™ื ืžื”ืกืœืจื•ื ื”ืจืืฉื•ืŸ.

ื”ืžื›ื™ืจื” ื”ืจืืฉื•ื ื” ื”ื™ื ืฉื™ื•ื•ืง. ื”ืžื›ื™ืจื” ื”ืฉื ื™ื™ื” ื”ื™ื ืื™ื›ื•ืช ื”ืžื•ืฆืจ. ืžืื– ื”ืกืœืจื•ื ื”ืฉื ื™, ืžื“ื“ื ื• ืืช ื”ืขื‘ื•ื“ื” ืฉืœื ื• ืœืคื™ ื”ืื ืฉื™ื ืฉื ืจืฉืžื™ื ืœื›ืœ ื”ืชื•ื›ื ื™ื•ืช ืฉืœื ื• ื•ืœืคื™ ื”ื—ื‘ืจื•ืช ืฉืฉื•ืœื—ื•ืช ืืœื™ื ื• ืขื•ื‘ื“ื™ื ืฉื•ื‘ ื•ืฉื•ื‘. ื›ื‘ืจ ืขืฉื™ื ื• ืœื”ื ืจืฉืžื™ืช ื”ื ื—ืช ืžื•ืขื“ื•ืŸ.

ืื ื˜ื•ืŸ ืกืงื•ื‘ื™ืŸ

Slurm-3: ืฉืœื•ื, ืคื™ื˜ืจ!

ืื ื—ื ื• ืžืงื™ื™ืžื™ื ืกืœื•ืจื ื‘ืกื ื˜ ืคื˜ืจืกื‘ื•ืจื’. ืื ื—ื ื• ืขื•ืฉื™ื ืืช ืื•ืชื• ื”ืžื—ื™ืจ ืขื‘ื•ืจ ื”ืฉืชืชืคื•ืช "ื—ื™ื”" ื•ืžืจื•ื—ืงืช.

ื•ืื ื—ื ื• ืžืชื’ืขื’ืขื™ื ืœื’ื•ื“ืœ ื”ืื•ืœื.

ืื ื—ื ื• ื‘ื•ื—ืจื™ื ื—ื“ืจ ืงื˜ืŸ ื•ืžืกื•ื“ืจ ืœ-50 ืื™ืฉ. ื™ื™ืฉื•ืžื™ื ื–ื•ืœื’ื™ื ืœืื˜ ืœืื˜, ื•ืคืชืื•ื ื–ื” ืกื•ืฃ ื“ืฆืžื‘ืจ. ื—ื‘ืจื•ืช ืžื ืฆืœื•ืช ื‘ืžื”ื™ืจื•ืช ืืช ื”ืชืงืฆื™ื‘ื™ื ืฉืœ 18 ื•ืžืžืฉ ืจื•ื›ืฉื•ืช ืืช ื›ืœ ื”ืžืงื•ืžื•ืช ื‘ืฉื‘ื•ืข.

ื‘ืžื”ืœืš ื—ื•ื“ืฉ ื™ื ื•ืืจ, ืื ืฉื™ื ื›ื•ืชื‘ื™ื: "ืื ื—ื ื• ืžืกื ื˜ ืคื˜ืจืกื‘ื•ืจื’, ื–ื” ืขืชื” ื’ื™ืœื™ื ื•, ืื ื—ื ื• ืจื•ืฆื™ื ืœืœื›ืช ืœื—ื“ืจ ื›ื•ืฉืจ, ื‘ื‘ืงืฉื” ืžืฆืื• ืžืงื•ื." ื•ืื ื—ื ื• ืžื•ืกื™ืคื™ื ืขื•ื“ 20 ืžืงื•ืžื•ืช. ืœืคื™ ื—ื™ืฉื•ื‘ื™ื ื”ืชื‘ืจืจ ืฉื›ื•ืœื ื™ืชืื™ืžื•, ืื‘ืœ ื›ืฉืžืชื—ื™ืœื™ื ืœืกื“ืจ ืืช ื”ืฉื•ืœื—ื ื•ืช ื™ื•ืฆื ืฆืคื•ืฃ ืžืื•ื“.

ื‘-Slurm ื”ืฉืœื™ืฉื™ ืžืชื’ื‘ืฉื•ืช ื”ื“ืจื™ืฉื•ืช ืœื’ื•ื“ืœ, ืคืจื™ืกื” ื•ืฆื™ื•ื“ ืฉืœ ื”ืื•ืœื.

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™

ื›ืจื’ื™ืœ, ืžืชื’ืœื” ืฉื›ื‘ื” ื—ื“ืฉื” ืฉืœ ื‘ืขื™ื•ืช: ื”ื“ื•ื‘ืจื™ื ืฉืœื ื• ืžื’ื ื™ื‘ื™ื ื‘ืชื•ืจ ืื ืฉื™ ื˜ื›ื ื•ืœื•ื’ื™ื”, ืื‘ืœ ืœื ื›ืžื•ืจื™ื. ืœื ืžืกืคื™ืง ืฉืชื”ื™ื” ืชื•ื›ื ื™ืช ื˜ื•ื‘ื”, ืฆืจื™ืš ืœื”ืขื‘ื™ืจ ืื•ืชื” ืœืงื”ืœ.

ืœืื—ืจ ื”-Slurm ื”ืฉืœื™ืฉื™, ื”ืคืจื•ื™ืงื˜ ืžืงื‘ืœ ืชืžื™ื›ื” ืžืชื•ื“ื•ืœื•ื’ื™ืช.

ืื—ื•ืชื™ ืขื•ื‘ื“ืช ื‘ื—ื™ื ื•ืš: ื”ื™ื ืžืืจื’ื ืช ื•ืžืขื‘ื™ืจื” ื›ื™ืชื•ืช ืืžืŸ, ืกืžื™ื ืจื™ื ื•ืงื•ืจืกื™ื ืื™ื ื˜ื ืกื™ื‘ื™ื™ื. ื–ื” ื›ื•ืœืœ ื”ื›ืฉืจืช ืžื•ืจื™ื ื•ืจืžืงื•ืœื™ื ื‘ื‘ืชื™ ืกืคืจ. ื”ืชืงืฉืจืชื™ ืืœื™ื” ืœืขื–ืจื”.

ืื ื˜ื•ืŸ ืกืงื•ื‘ื™ืŸ

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™

ืขื‘ื“ืชื™ ืขื ื”ื“ื•ื‘ืจื™ื, ื”ืกื‘ืจืชื™ ืื™ืš ื ืจืื” ื”ืชื”ืœื™ืš ื”ื—ื™ื ื•ื›ื™, ืกื™ืคืจืชื™ ืœื™ ืžื”ื™ ื”ืจืฆืื” ืื™ื ื˜ืจืืงื˜ื™ื‘ื™ืช ื•ืื™ืš ืœืฉืžื•ืจ ืขืœ ืชืฉื•ืžืช ื”ืœื‘ ืฉืœ ื”ืชืœืžื™ื“ื™ื. ืœื“ื•ื’ืžื”, ืื ืืชื” ืžื“ื‘ืจ ืœืœื ื”ืคืกืงื” ื‘ืžืฉืš ื–ืžืŸ ืจื‘, ื”ื™ื” ื‘ื˜ื•ื— ืฉืื ืฉื™ื ื™ื—ืžื™ืฆื• ื—ืฆื™ ืžื–ื”. ืขื‘ื“ื ื• ืขืœ ืžืฆื’ื•ืช ื•ืคืขื™ืœื•ื™ื•ืช ืื™ื ื˜ืจืืงื˜ื™ื‘ื™ื•ืช. ืืจื’ื ื• ืœื™ืœื“ื™ื ืฉื™ืขื•ืจื™ ื“ื™ื‘ื•ืจ ื‘ืคื ื™ ืงื”ืœ.

ื‘ืžืงื‘ื™ืœ, ื”ื—ืœื˜ื ื• ืœื”ื–ืžื™ืŸ ื“ื•ื‘ืจื™ื ืžื‘ื—ื•ืฅ ื›ื“ื™ ืœื ืœื”ื™ืชืœื•ืช ืžื”ื ื™ืกื™ื•ืŸ ื•ื”ืคืจืงื˜ื™ืงื•ืช ืฉืœ ืกืื•ืช'ื‘ืจื™ื“ื’'.

ืื•ืœื’ื” ืกืงื•ื‘ื™ื ื”
ืกืœื•ืจื ืžืชื•ื“ื™ืกื˜

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™

ื›ืฉืื ื™ ืžืชื›ื•ื ืŸ, ืงื•ื“ื ื›ืœ ืื ื™ ืžื ืกื” ืœื”ื‘ื™ืŸ ืื™ืš ื”ื’ืขืชื™ ื‘ืขืฆืžื™ ืœื™ื“ืข ื”ื–ื”. ืœืžื” ื”ื™ื™ืชื™ ืฆืจื™ืš ืืช ื–ื” ื•ื‘ืื™ืœื• ืงืฉื™ื™ื ื ืชืงืœืชื™? ืื—ืจ ื›ืš ืื ื™ ืžื ืกื” ืœืกื“ืจ ืืช ื›ืœ ื–ื”, ืœืคื ื•ืช ืœืชื™ืขื•ื“, ืœื”ื‘ื”ื™ืจ ืœืขืฆืžื™ ื›ืžื” ื ืงื•ื“ื•ืช ืฉืœื ืฉืžืชื™ ืœื‘ ืืœื™ื”ืŸ ืงื•ื“ื. ืื ื™ ืžืงืคื™ื“ ืœื—ืฉื•ื‘ ืขืœ ืžืฉื™ืžื•ืช ืžืขืฉื™ื•ืช ื›ื“ื™ ืฉืื ืฉื™ื ืœื ืจืง ื™ืงืฉื™ื‘ื•, ืืœื ื™ืขืฉื• ืื•ืชืŸ ืขื ื”ื™ื“ื™ื™ื. ืื– ืฆืจื™ืš ืœื”ืžื—ื™ืฉ ืืช ื”ื“ื‘ืจื™ื ื”ืžื•ืจื›ื‘ื™ื ื‘ื™ื•ืชืจ ื‘ืฉืงื•ืคื™ื•ืช. ื•ืœื ื”ืœ ื—ื–ืจื” ืขื ืื ืฉื™ื ืืžื™ืชื™ื™ื. ื‘ื“ืจืš ื›ืœืœ ืื ื• ืžื‘ืงืฉื™ื ืžืื—ื“ ืžืขืžื™ืชื™ื ื• ืœื”ืงืฉื™ื‘ ืœื—ื•ืžืจ, ืœืขื‘ื•ืจ ืขืœ ืžืฉื™ืžื•ืช ืžืขืฉื™ื•ืช ื•ืœื”ื‘ื™ืข ืขื“ ื›ืžื” ื”ื›ืœ ื‘ืจื•ืจ, ืงืฉื” ื•ืฉื™ืžื•ืฉื™.

ืคืื‘ืœ ืกืœื™ื•ื•ื ื•ื‘

ืกืœื•ืจ 4: ื”ื›ืจื™ืกืœื™ืก ื”ืคืš ืœืคืจืคืจ

ื”ืกืœืจื•ื ื”ืจื‘ื™ืขื™ ื”ื™ื” ืคืจื™ืฆืช ื“ืจืš: 120 ืžืฉืชืชืคื™ื ื‘ืื•ืœื, ืžื ื—ื”, ืžืชื•ื“ื•ืœื•ื’ื™ืช, ืงื‘ื•ืฆืช ืชืžื™ื›ื” ืฉืœ 20 ืื™ืฉ, ื”ื›ืœ ืขื‘ืจ ืœื™ื˜ื•ืฉ ื•ื—ื–ืจื•ืช.

... ืื ื™ ื–ื•ื›ืจ ืืช Slurm-4 ื‘ืžื•ืกืงื‘ื”. ืื™ื›ืฉื”ื• ืงืจื” ืฉืฉื ื‘ืคืขื ื”ืจืืฉื•ื ื” ื”ืชื—ืœืชื™ ืœื—ืฉื•ื‘ ืœื ืขืœ ืื™ืš ืื ื™ ื™ื ื”ืœ ืืช ื”ืฉื™ืขื•ืจ, ื”ืื ืื’ื™ื“ ื”ื›ืœ ื‘ื˜ืงืกื˜, ื”ืื ืืฉื›ื— ืžืฉื”ื•, ืืœื ืขืœ ื›ืžื” ื˜ื•ื‘ ื”ืžืื–ื™ื ื™ื ืžื‘ื™ื ื™ื ืื•ืชื™. ืขื“ ื›ืžื” ืฉื”ืฆืœื—ืชื™ ืœื”ืขื‘ื™ืจ ืืช ื”ืžื—ืฉื‘ื•ืช ืฉืœื™ ื•ืœื”ืกื‘ื™ืจ ืื™ืš ื”ื˜ื›ื ื•ืœื•ื’ื™ื” ืขื•ื‘ื“ืช. ื–ื” ืฉื™ื ื•ื™ ื“ื™ ืžืขื ื™ื™ืŸ ืฉืงืจื” ื‘ืชื•ื›ื™. ื”ืชื—ืœืชื™ ืœื”ืกืชื›ืœ ืื—ืจืช ืขืœ ืชื”ืœื™ืš ื”ื”ื›ื ื”, ื•ืขืœ ื”ืงื•ืจืกื™ื ืฉืœื ื• ืขืฆืžื.

ืคืื‘ืœ ืกืœื™ื•ื•ื ื•ื‘

"ืกืœืื" ืžืžื›ืจ ืžืื•ื“. ืื™ืš ืœื”ืคื•ืš ืžืคื’ืฉ ืœืคืจื•ื™ืงื˜ ื’ืœื•ื‘ืœื™
ื›ืžื” ืจื—ื•ืง ื”ื’ืขื ื• ืžื”ืกืœืจื•ื ื”ืจืืฉื•ืŸ...

ื”ื™ื™ืชื” ื‘ื–ื” ืงืฆืช ื‘ื•ืฉื”. ื‘ืžื™ืœื™ื "ืื ื—ื ื• ืžื ื”ืœื™ื, ืื ืฉื™ ืจืฉืช, ืขื›ืฉื™ื• ืื ื—ื ื• ื”ื•ืœื›ื™ื ืœื”ืคื™ืฅ ืืช ื”-Super Wi-Fi ืฉืœื ื•," ื”ืชืงื ื• ื ืงื•ื“ื•ืช ื’ื™ืฉื”, ื•ืื– ืžื™ืฉื”ื• ื ื’ืข ื‘ื—ื•ื˜ ื”ืจืฉืช ืฉืขื•ื‘ืจ ืœืžื™ืงืจื•ื˜ื™ืง ื‘ืจื’ืœ, ื”ื•ื ื”ืชื—ื‘ืจ ื‘ืืžืฆืขื•ืช Wi-Fi ืœ- ื ืงื•ื“ื” ืฉื›ื ื”, ื•ื ื•ืฆืจื” ื˜ื‘ืขืช. ื›ืชื•ืฆืื” ืžื›ืš, ื‘ืžื—ืฆื™ืช ื”ืจืืฉื•ื ื” ืฉืœ ื”ื™ื•ื, "ื”-Wi-Fi ื”ืžืคื•ืืจ ืฉืœื ื•" ื‘ืงื•ืฉื™ ืขื‘ื“.

ื”ืกื™ืคื•ืจ ืฉืœ ื›ืœ ื—ื™ื™: ื‘ืจื’ืข ืฉืืชื” ืžืชื—ื™ืœ ืœื”ืฉื•ื•ื™ืฅ, ืžืชืจื—ืฉ ื–ื™ื•ืฃ ืขื–. ืœื ื”ื™ื” ืฆื•ืจืš ืœืฉื ื•ืช ืคืชืจื•ืŸ ืขื•ื‘ื“ ืจืง ื‘ื’ืœืœ ืฉื™ืฉ ืœื ื• ืฆื™ื•ื“ ืงืจื™ืจ ื™ื•ืชืจ <...>
ืื‘ืœ ืฉืžื—ืชื™ ืฉืื ืฉื™ื, ืชื•ืš ื›ื“ื™ ื”ืงื•ืจืก ื”ื‘ืกื™ืกื™, ืงื ื• ื›ืจื˜ื™ืกื™ื ืœืงื•ืจืก ืœืžืชืงื“ืžื™ื. ืื ืื“ื, ืฉืžืื–ื™ืŸ ืœืจืžืงื•ืœื™ื ืฉืœื ื•, ืžื•ื›ืŸ ื›ืืŸ ื•ืขื›ืฉื™ื• ืœืฉืœื 45 ืืœืฃ ื›ื“ื™ ืœื”ืื–ื™ืŸ ืœื”ื ืขื•ื“ 3 ื™ืžื™ื, ื–ื” ืื•ืžืจ ืžืฉื”ื•.

ืื ื˜ื•ืŸ ืกืงื•ื‘ื™ืŸ

ืกื•ื“ ื”ื”ืฆืœื—ื”

ืœืคื ื™ ืฉื ื” ื’ื ื‘ื ื• ืฉื•ืœื—ื ื•ืช ืžื”ืงืคื™ื˜ืจื™ื” ื›ื“ื™ ืœื”ื›ื™ืœ 50 ืžืฉืชืชืคื™ื.
ื›ืขืช ืงื™ื‘ืœื ื• ื”ืกืžื›ื” ืขืœ ื™ื“ื™ ืงืจืŸ Cloud Native Computing.
ื”-Slurm ื”ื‘ื ืžืชืจื—ืฉ ื‘ืกืคื˜ืžื‘ืจ ื‘ืกื ื˜ ืคื˜ืจืกื‘ื•ืจื’, ืกืœืงืœ ื”ื–ืžื™ืŸ ืื•ืชื ื• ืœื—ื“ืจ ื”ื™ืฉื™ื‘ื•ืช ืฉืœื•.
ื’ืจืกื” ืžืงื•ื•ื ืช ืฉืœ ื”ืงื•ืจืกื™ื ืžื•ืงืœื˜ืช ื•ื ืžื›ืจืช.
ืื ื—ื ื• ืžืกืชื›ืœื™ื ืขืœ ืžื“ื™ื ื•ืช ื–ืจื•ืช: ืื ื—ื ื• ืžื ื”ืœื™ื ืžืฉื ื•ืžืชืŸ ืขื ืงื–ื—ืกื˜ืŸ ื•ื’ืจืžื ื™ื”.

ื”ื’ื™ืข ื”ื–ืžืŸ ืœื—ืฉื•ืฃ ืืช ืกื•ื“ ื”ื”ืฆืœื—ื”.
ื•ื”ื•ื ืœื.

ืืคืฉืจ ืœื•ืžืจ: ืืชื” ืจืง ืฆืจื™ืš ืœืขืฉื•ืช ืืช ื”ืขื‘ื•ื“ื” ืฉืœืš ื”ื™ื˜ื‘. ืื‘ืœ ืขืฉื™ืชื™ ื”ืจื‘ื” ื“ื‘ืจื™ื ื˜ื•ื‘ื™ื ื‘ื—ื™ื™ื ืฉืœื™, ื•ืžื” ื”ื˜ืขื? ืืคืฉืจ ืœื•ืžืจ: ื”ืฆื•ื•ืช ืžื—ืœื™ื˜. ืื‘ืœ ื”ื™ื• ืงื‘ื•ืฆื•ืช ื—ื›ืžื•ืช ื‘ื—ื™ื™ ืฉืœื ื”ืฆืœื™ื—ื• ืœื”ืชื ืชืง ืžื”ืชื—ืชื™ืช. ื‘ื›ืœ ืกื™ืคื•ืจ ื”ืฆืœื—ื”, ืื ื™ ืจื•ืื” ืžืคื’ืฉ ืฉืœ ื ืกื™ื‘ื•ืช ื‘ืจ ืžื–ืœ. ื•ื‘ืฉืœื ื• - ืงื•ื“ื ื›ืœ.

ืื ื˜ื•ืŸ ืกืงื•ื‘ื™ืŸ

ื ื•ืฉื ื—ื ื”ื’ื™ืข ืœื™ื“ื™ืขืชื™ ื‘ื–ืžืŸ ื”ื ื›ื•ืŸ. ื”ื™ื• ืžื•ืžื—ื™ื ืฉืžื•ื›ื ื™ื ืœื”ืกื‘ื™ืจ ืืช ื–ื”. ื”ื ื”ืกื›ื™ืžื• ืœื”ื™ื•ืช ืคืจื–ื ื˜ื•ืจื™ื. ื”ื™ื” ื›ืกืฃ ืœืืจื’ื•ืŸ. ื‘ื›ืœ ืคืขื ืฉื ืชืงืœื ื• ื‘ื™ืจื™ื•ืช, ื”ืื“ื ื”ื ื›ื•ืŸ ื”ื•ืคื™ืข ื‘ืื•ืคืง. ื”ื›ืœ ืขืœื” ื‘ืงื ื” ืื—ื“ ื‘ืฆื•ืจื” ื”ื˜ื•ื‘ื” ื‘ื™ื•ืชืจ.

ื•ื”ื›ื™ ื—ืฉื•ื‘ - ืงื”ืœ ื ืคืœื. ืื ืฉื™ื ืฉืื ื• ื–ื•ื›ืจื™ื ื‘ืžืจืื” ื•ื‘ืฉื, ื•ืžื‘ืจื›ื™ื ืื•ืชื ื›ืฉื ืคื’ืฉื™ื ื‘ืžืงืจื”. ืื ื”ื™ื™ืชื” ืงืฆืช ื™ื•ืชืจ ื‘ื™ืงื•ืจืช ื•ืงืฆืช ืคื—ื•ืช ื”ื›ืจืช ืชื•ื“ื”, ืœื ื”ื™ื™ื ื• ืžืกืชื›ื ื™ื ืœื”ืžืฉื™ืš ืื—ืจื™ ื”ืกืœืจื•ื ื”ืจืืฉื•ืŸ.

ืื‘ืœ ืขื“ื™ื™ืŸโ€ฆ

ืชืื•ื ื•ืช ืื™ื ืŸ ืžืงืจื™ื•ืช.

ืื•ื’-ื“ืจืš

ืื ืงืจืืช ืขื“ ื”ืกื•ืฃ, ื”ื™ืจืฉื ืกืœื•ืจื ื‘ืกื ื˜ ืคื˜ืจื‘ื•ืจื’ ืืชื” ื™ื›ื•ืœ ืœืงื‘ืœ 15% ื”ื ื—ื” ื‘ืืžืฆืขื•ืช ืงื•ื“ ื”ืงื™ื“ื•ื habrapost.

ืžืงื•ืจ: www.habr.com

ื”ื•ืกืคืช ืชื’ื•ื‘ื”