"ืชืงื•ื•ื” ื”ื™ื ืืกื˜ืจื˜ื’ื™ื” ื’ืจื•ืขื”." SRE ืื™ื ื˜ื ืกื™ื‘ื™ ื‘ืžื•ืกืงื‘ื”, 3-5 ื‘ืคื‘ืจื•ืืจ

ืื ื• ืžื›ืจื™ื–ื™ื ืขืœ ื”ืงื•ืจืก ื”ืžืขืฉื™ ื”ืจืืฉื•ืŸ ื‘ื ื•ืฉื SRE ื‘ืจื•ืกื™ื”: Slurm SRE.

ื‘ืžื”ืœืš ื”ืื™ื ื˜ื ืกื™ื‘ื™ ื ืงื“ื™ืฉ ืฉืœื•ืฉื” ื™ืžื™ื ืœื‘ื ื™ื™ื”, ืฉื‘ื™ืจื”, ืชื™ืงื•ืŸ ื•ืฉื™ืคื•ืจ ืฉืœ ืืชืจ ืื’ืจื’ื˜ื•ืจ ืœืžื›ื™ืจืช ื›ืจื˜ื™ืกื™ ืงื•ืœื ื•ืข.

"ืชืงื•ื•ื” ื”ื™ื ืืกื˜ืจื˜ื’ื™ื” ื’ืจื•ืขื”." SRE ืื™ื ื˜ื ืกื™ื‘ื™ ื‘ืžื•ืกืงื‘ื”, 3-5 ื‘ืคื‘ืจื•ืืจ

ื‘ื—ืจื ื• ื‘ืื’ืจื’ื˜ื•ืจ ื›ืจื˜ื™ืกื™ื ื›ื™ ื™ืฉ ืœื• ืชืจื—ื™ืฉื™ ื›ืฉืœ ืจื‘ื™ื: ื–ืจื ืžื‘ืงืจื™ื ื•ื”ืชืงืคื•ืช DDoS, ื›ืฉืœ ืฉืœ ืื—ื“ ืžืฉื™ืจื•ืชื™ ื”ืžื™ืงืจื• ื”ืงืจื™ื˜ื™ื™ื ื”ืจื‘ื™ื (ื”ืจืฉืื”, ื”ื–ืžื ื•ืช, ืขื™ื‘ื•ื“ ืชืฉืœื•ืžื™ื), ื—ื•ืกืจ ื–ืžื™ื ื•ืช ืฉืœ ืื—ื“ ืžื‘ืชื™ ื”ืงื•ืœื ื•ืข ื”ืจื‘ื™ื (ื—ื™ืœื•ืคื™ ื ืชื•ื ื™ื ื‘ืขืจืš ืžืงื•ืžื•ืช ืคื ื•ื™ื™ื ื•ื”ื–ืžื ื•ืช), ื•ื‘ื”ืžืฉืš ื”ืจืฉื™ืžื”.

ื ื’ื‘ืฉ ืืช ืชืคื™ืกืช ื”ืืžื™ื ื•ืช ืขื‘ื•ืจ ืืชืจ ื”ืื’ืจื’ื˜ื•ืจ ืฉืœื ื•, ืื•ืชื• ื ืžืฉื™ืš ืœืคืชื— ื‘ื”ื ื“ืกื”, ื ื ืชื— ืืช ื”ืชื›ื ื•ืŸ ืžื ืงื•ื“ืช ืžื‘ื˜ ืฉืœ SRE, ื ื‘ื—ืจ ืžื“ื“ื™ื, ื ื’ื“ื™ืจ ืืช ื”ื ื™ื˜ื•ืจ ืฉืœื”ื, ื‘ื™ื˜ื•ืœ ืชืงืจื™ื•ืช ืฆืฆื•ืช, ื ืขืจื•ืš ื”ื“ืจื›ื” ืœืขื‘ื•ื“ืช ืฆื•ื•ืช ืขื ืชืงืจื™ื•ืช ื‘ืชื ืื™ื ืงืจื•ื‘ื™ื ืœืœื—ื™ืžื”, ืืจื’ืŸ ืชื—ืงื™ืจ.

ื”ืชื•ื›ื ื™ืช ืžื ื•ื”ืœืช ืขืœ ื™ื“ื™ ืขื•ื‘ื“ื™ Booking.com ื•-Google.
ื”ืคืขื ืœื ืชื”ื™ื” ื”ืฉืชืชืคื•ืช ืžืจื—ื•ืง: ื”ืงื•ืจืก ื‘ื ื•ื™ ืขืœ ืื™ื ื˜ืจืืงืฆื™ื” ืื™ืฉื™ืช ื•ืขื‘ื•ื“ืช ืฆื•ื•ืช.

ืคืจื˜ื™ื ืžืชื—ืช ืœื—ืชื•ืš

ืจืžืงื•ืœื™ื

ืื™ื‘ืŸ ืงืจื•ื’ืœื•ื‘
ืžืคืชื— ืจืืฉื™ ื‘-Booking.com (ื”ื•ืœื ื“)
ืžืื– ืฉื”ืฆื˜ืจืฃ ืœ-Booking.com ื‘-2013, ื”ื•ื ืขื‘ื“ ืขืœ ืคืจื•ื™ืงื˜ื™ ืชืฉืชื™ืช ื›ืžื• ืžืฉืœื•ื— ื•ืขื™ื‘ื•ื“ ื”ื•ื“ืขื•ืช ืžื‘ื•ื–ืจื•ืช, BigData ื•-web-stack, ื—ื™ืคื•ืฉ.
ื›ืจื’ืข ืขื•ื‘ื“ ืขืœ ื‘ืขื™ื•ืช ืฉืœ ื‘ื ื™ื™ืช ืขื ืŸ ืคื ื™ืžื™ ื•-Service Mesh.

ื‘ืŸ ื˜ื™ื™ืœืจ
ืžืคืชื— ืจืืฉื™ ื‘-Booking.com (ืืจื”"ื‘)
ืขื•ืกืง ื‘ืคื™ืชื•ื— ืคื ื™ืžื™ ืฉืœ ืคืœื˜ืคื•ืจืžืช Booking.com.
ืžืชืžื—ื” ื‘ืจืฉืช ืฉื™ืจื•ืช / ื’ื™ืœื•ื™ ืฉื™ืจื•ืช, ืชื–ืžื•ืŸ ืขื‘ื•ื“ื•ืช ืืฆื•ื•ื”, ืชื’ื•ื‘ื” ืœืื™ืจื•ืขื™ื ื•ืชื”ืœื™ืš ื ืชื™ื—ื” ืฉืœืื—ืจ ื”ืžื•ื•ืช.
ืžื“ื‘ืจ ื•ืžืœืžื“ ื‘ืจื•ืกื™ืช.

ื™ื‘ื’ื ื™ ื•ืจืื•ื•ื”
ืžืคืชื— ื›ืœืœื™ ื‘ื’ื•ื’ืœ (ืกืŸ ืคืจื ืกื™ืกืงื•).
ื ื™ืกื™ื•ืŸ ืžืคืจื•ื™ืงื˜ื™ ืื™ื ื˜ืจื ื˜ ื‘ืขื•ืžืก ื’ื‘ื•ื” ื•ืขื“ ืžื—ืงืจ ื‘ืจืื™ื™ื” ืžืžื•ื—ืฉื‘ืช ื•ืจื•ื‘ื•ื˜ื™ืงื”.
ืžืฉื ืช 2011 ืขื•ืกืง ื‘ื™ืฆื™ืจื” ื•ืชืคืขื•ืœ ืฉืœ ืžืขืจื›ื•ืช ืžื‘ื•ื–ืจื•ืช ื‘ื’ื•ื’ืœ, ืžืฉืชืชืฃ ื‘ืžื—ื–ื•ืจ ื”ื—ื™ื™ื ื”ืžืœื ืฉืœ ื”ืคืจื•ื™ืงื˜: ื”ืžืฉื’ื”, ืขื™ืฆื•ื‘ ื•ืืจื›ื™ื˜ืงื˜ื•ืจื”, ื”ืฉืงื”, ืงื™ืคื•ืœ ื•ื›ืœ ืฉืœื‘ื™ ื”ื‘ื™ื ื™ื™ื.

ืื“ื•ืืจื“ ืžื“ื‘ื“ื‘
CTO ื‘ืžืขื‘ื“ื•ืช Tungsten (ื’ืจืžื ื™ื”)
ืขื‘ื“ ื›ืžื”ื ื“ืก ื‘-StackStorm, ืื—ืจืื™ ืขืœ ื”ืคื•ื ืงืฆื™ื•ื ืœื™ื•ืช ืฉืœ ChatOps ืฉืœ ื”ืคืœื˜ืคื•ืจืžื”. ืคื™ืชื— ื•ื”ื˜ืžื™ืข ChatOps ืขื‘ื•ืจ ืื•ื˜ื•ืžืฆื™ื” ืฉืœ ืžืจื›ื–ื™ ื ืชื•ื ื™ื. ื“ื•ื‘ืจ ื‘ื›ื ืกื™ื ืจื•ืกื™ื™ื ื•ื‘ื™ื ืœืื•ืžื™ื™ื.

ืชื›ื ื™ืช

ื”ืชื•ื›ื ื™ืช ื ืžืฆืืช ื‘ืคื™ืชื•ื— ืคืขื™ืœ. ืขื›ืฉื™ื• ื–ื” ื ืจืื” ื›ืš, ืขื“ ืคื‘ืจื•ืืจ ื–ื” ืขืฉื•ื™ ืœื”ืฉืชืคืจ ื•ืœื”ืชืจื—ื‘.

ื ื•ืฉื ืžืก' 1: ืขืงืจื•ื ื•ืช ื•ืฉื™ื˜ื•ืช ื‘ืกื™ืกื™ื•ืช ืฉืœ SRE

  • ืžื” ืฆืจื™ืš ื›ื“ื™ ืœื”ืคื•ืš ืœ-SRE?
  • DevOps ืœืขื•ืžืช SRE
  • ืžื“ื•ืข ืžืคืชื—ื™ื ืžืขืจื™ื›ื™ื SRE ื•ื”ื ืขืฆื•ื‘ื™ื ืžืื•ื“ ื›ืฉื”ื ืœื ื‘ืคืจื•ื™ืงื˜
  • SLI, SLO ื•-SLA
  • ืชืงืฆื™ื‘ ืฉื’ื™ืื•ืช ื•ืชืคืงื™ื“ื• ื‘-SRE

ื ื•ืฉื #2: ืขื™ืฆื•ื‘ ืžืขืจื›ื•ืช ืžื‘ื•ื–ืจื•ืช

  • ืืจื›ื™ื˜ืงื˜ื•ืจืช ืืคืœื™ืงืฆื™ื•ืช ื•ืคื•ื ืงืฆื™ื•ื ืœื™ื•ืช
  • ืขื™ืฆื•ื‘ ืžืขืจื›ืช ื’ื“ื•ืœื” ืœื ืื‘ืกื˜ืจืงื˜ื™ืช
  • ืชืคืขื•ืœ / ืขื™ืฆื•ื‘ ืœื›ื™ืฉืœื•ืŸ
  • gRPC ืื• REST
  • ื’ื™ืจืกืื•ืช ื•ืชืื™ืžื•ืช ืœืื—ื•ืจ

ื ื•ืฉื ืžืก' 3: ื›ื™ืฆื“ ืžืชืงื‘ืœ ืคืจื•ื™ืงื˜ SRE

  • ืฉื™ื˜ื•ืช ืขื‘ื•ื“ื” ืžื•ืžืœืฆื•ืช ืž-SRE
  • ืจืฉื™ืžืช ืชื™ื•ื’ ืงื‘ืœื” ืœืคืจื•ื™ืงื˜
  • ืจื™ืฉื•ื, ืžื“ื“ื™ื, ืžืขืงื‘
  • ืœื•ืงื—ื™ื ืืช ื”-CI/CD ืœื™ื“ื™ื™ื ืฉืœื ื•

ื ื•ืฉื #4: ืขื™ืฆื•ื‘ ื•ื”ืฉืงื” ืฉืœ ืžืขืจื›ืช ืžื‘ื•ื–ืจืช

  • ื”ื ื“ืกื” ืœืื—ื•ืจ - ืื™ืš ื”ืžืขืจื›ืช ืขื•ื‘ื“ืช?
  • ืื ื—ื ื• ืžืกื›ื™ืžื™ื ืขืœ SLI ื•-SLO
  • ืชืจื’ื•ืœ ืชื›ื ื•ืŸ ื™ื›ื•ืœืช
  • ืžืฉื™ืง ืชืขื‘ื•ืจื” ืœืืคืœื™ืงืฆื™ื”, ื”ืžืฉืชืžืฉื™ื ืฉืœื ื• ืžืชื—ื™ืœื™ื "ืœื”ืฉืชืžืฉ" ื‘ื”
  • ื”ืฉืงืช Prometheus, Grafana, Elastic

ื ื•ืฉื ืžืก' 5: ื ื™ื˜ื•ืจ, ืฆืคื™ื™ื” ื•ื”ืชืจืื”

  • ื ื™ื˜ื•ืจ ืœืขื•ืžืช ื™ื›ื•ืœืช ืชืฆืคื™ืช
  • ื”ื’ื“ืจืช ื ื™ื˜ื•ืจ ื•ื”ืชืจืื” ืขื ืคืจื•ืžืชืื•ืก
  • ื ื™ื˜ื•ืจ ืžืขืฉื™ ืฉืœ SLI ื•-SLO
  • ืชืกืžื™ื ื™ื ืœืขื•ืžืช ื’ื•ืจื ืœ
  • Black-Box ืœืขื•ืžืช ื ื™ื˜ื•ืจ White-Box
  • ื ื™ื˜ื•ืจ ืžื‘ื•ื–ืจ ืฉืœ ื–ืžื™ื ื•ืช ืืคืœื™ืงืฆื™ื•ืช ื•ืฉืจืชื™ื
  • 4 ืื•ืชื•ืช ื–ื”ื‘ (ื–ื™ื”ื•ื™ ื—ืจื™ื’ื•ืช)

ื ื•ืฉื ืžืก' 6: ืชืจื’ื•ืœ ืฉืœ ื‘ื“ื™ืงืช ืืžื™ื ื•ืช ืžืขืจื›ืช

  • ืขื‘ื•ื“ื” ืชื—ืช ืœื—ืฅ
  • ื›ืฉืœ-ื”ื–ืจืงื”
  • ืงื•ืฃ ื›ืื•ืก

ื ื•ืฉื ืžืก' 7: ืชืจื’ื•ืœ ืชื’ื•ื‘ื” ืœืชืงืจื™ื•ืช

  • ืืœื’ื•ืจื™ืชื ืœื ื™ื”ื•ืœ ืžืชื—
  • ืื™ื ื˜ืจืืงืฆื™ื” ื‘ื™ืŸ ืžืฉืชืชืคื™ ื”ืื™ืจื•ืข
  • ื ืชื™ื—ื” ืฉืœืื—ืจ ื”ืžื•ื•ืช
  • ืฉื™ืชื•ืฃ ื™ื“ืข
  • ืขื™ืฆื•ื‘ ื”ืชืจื‘ื•ืช
  • ื ื™ื˜ื•ืจ ืชืงืœื•ืช
  • ื‘ื™ืฆื•ืข ืชื—ืงื™ืจ ืœืœื ืชืžื™ื

ื ื•ืฉื #8: ืฉื™ื˜ื•ืช ื ื™ื”ื•ืœ ืขื•ืžืกื™ื

  • ืื™ื–ื•ืŸ ืขื•ืžืกื™ื
  • ืกื•ื‘ืœื ื•ืช ืœืชืงืœื•ืช ื‘ื™ื™ืฉื•ื: ื ื™ืกื™ื•ืŸ ื—ื•ื–ืจ, ืคืกืง ื–ืžืŸ, ื”ื–ืจืงืช ื›ืฉืœ, ืžืคืกืง ื–ืจื
  • DDoS (ื™ืฆื™ืจืช ืขื•ืžืก) + ื›ืฉืœื™ื ืžื“ื•ืจื’ื™ื

ื ื•ืฉื ืžืก' 9: ืชื’ื•ื‘ื” ืœืื™ืจื•ืขื™ื

  • ืชึทื—ืงึดื™ืจ
  • ืชืจื’ื•ืœ ื›ื•ื ื ื•ืช
  • ืกื•ื’ื™ื ืฉื•ื ื™ื ืฉืœ ืชืื•ื ื•ืช (ื‘ื“ื™ืงื•ืช, ืฉื™ื ื•ื™ื™ ืชืฆื•ืจื”, ื›ืฉืœ ื‘ื—ื•ืžืจื”)
  • ืคืจื•ื˜ื•ืงื•ืœื™ ื ื™ื”ื•ืœ ืื™ืจื•ืขื™ื

ื ื•ืฉื ืžืก' 10: ืื‘ื—ื•ืŸ ื•ืคืชืจื•ืŸ ื‘ืขื™ื•ืช

  • ืจื™ืฉื•ื
  • ื ื™ืงื•ื™ ื‘ืื’ื™ื
  • ืชืจื’ืœ ื ื™ืชื•ื— ื•ื ื™ืคื•ื™ ื‘ืื’ื™ื ื‘ืืคืœื™ืงืฆื™ื” ืฉืœื ื•

ื ื•ืฉื ืžืก' 11: ื‘ื“ื™ืงืช ืืžื™ื ื•ืช ืžืขืจื›ืช

  • ืžื‘ื—ืŸ ืœื—ืฅ
  • ื‘ื“ื™ืงืช ืชืฆื•ืจื”
  • ื‘ื“ื™ืงืช ื‘ื™ืฆื•ืขื™ื
  • ืฉื—ืจื•ืจ ื”ืงื ืจื™ืช

ื ื•ืฉื ืžืก' 12: ืขื‘ื•ื“ื” ื•ืกืงื™ืจื” ืขืฆืžืื™ืช

ื”ืžืœืฆื•ืช ื•ื“ืจื™ืฉื•ืช ืœืžืฉืชืชืคื™ื

SRE ื”ื•ื ืžืืžืฅ ืงื‘ื•ืฆืชื™. ืื ื• ืžืžืœื™ืฆื™ื ื‘ื—ื•ื ืœืงื—ืช ืืช ื”ืงื•ืจืก ื›ืฆื•ื•ืช. ื–ื• ื”ืกื™ื‘ื” ืฉืื ื• ืžืฆื™ืขื™ื ื”ื ื—ื•ืช ื’ื“ื•ืœื•ืช ืœืฆื•ื•ืชื™ื ืžื•ื›ื ื™ื.

ืžื—ื™ืจ ื”ืงื•ืจืก 60 โ‚ฝ ืœืื“ื.
ืื ื—ื‘ืจื” ืฉื•ืœื—ืช ืงื‘ื•ืฆื” ืฉืœ 5+ ืื ืฉื™ื - 40 โ‚ฝ.

ื”ืงื•ืจืก ื‘ื ื•ื™ ืขืœ Kubernetes. ื›ื“ื™ ืœืขื‘ื•ืจ, ืืชื” ืฆืจื™ืš ืœื“ืขืช Kubernetes ื‘ืจืžื” ื‘ืกื™ืกื™ืช. ืื ืืชื” ืœื ืขื•ื‘ื“ ืื™ืชื•, ืืชื” ื™ื›ื•ืœ ืœืขื‘ื•ืจ ื“ืจืš Slurm Basic (ะพะฝะปะฐะนะฝ ืื• ืื™ื ื˜ื ืกื™ื‘ื™ 18-20 ื‘ื ื•ื‘ืžื‘ืจ).
ื‘ื ื•ืกืฃ, ืืชื” ืฆืจื™ืš ืœื”ื™ื•ืช ื‘ืงื™ื ื‘ืœื™ื ื•ืงืก ื•ืœื”ื›ื™ืจ ืืช Gitlab ื•-Prometheus.

ื”ืจืฉืžื”

ืื ื™ืฉ ืœื›ื ืจืขื™ื•ืŸ ืžื•ืจื›ื‘ ืœื”ืฉืชืชืคื•ืช, ืœืžืฉืœ, ืœืžื ื›"ืœ, CTO ื•ืฆื•ื•ืช ืžืคืชื—ื™ื ืฉื™ื’ื™ืขื• ืœืงื•ืจืก, ื•ืฉื”ื ื™ืขื‘ืจื• ื”ืชืžื—ื•ืช ืชื•ืš ื”ืชื—ืฉื‘ื•ืช ื‘ื•ื•ืจื˜ื™ืงืœ ื”ื ื™ื”ื•ืœ, ื›ืชื‘ื• ืœื™ ื‘ื”ื•ื“ืขื” ืื™ืฉื™ืช.

ืžืงื•ืจ: www.habr.com

ื”ื•ืกืคืช ืชื’ื•ื‘ื”