TL;DR: Cov lus qhia dav dav rau kev sib piv cov txheej txheem rau kev khiav haujlwm hauv cov thawv. Lub peev xwm ntawm Docker thiab lwm cov tshuab zoo sib xws yuav raug txiav txim siab.
Me ntsis keeb kwm ntawm qhov twg nws tag nrho tuaj
ΠΡΡΠΎΡΠΈΡ
Thawj txoj kev paub zoo rau kev cais ib daim ntawv thov yog chroot. Lub kaw lus hu ntawm tib lub npe ua kom ntseeg tau tias cov ntaub ntawv hauv paus hloov pauv - yog li ua kom ntseeg tau tias qhov kev pab cuam hu ua nws tsuas yog nkag mus rau cov ntaub ntawv hauv cov npe ntawd. Tab sis yog tias ib qho kev pab cuam tau txais cov cai hauv paus hauv, nws tuaj yeem muaj peev xwm "tshem tawm" chroot thiab nkag mus rau lub ntsiab kev ua haujlwm. Tsis tas li ntawd, ntxiv rau kev hloov pauv cov npe hauv paus, lwm cov peev txheej (RAM, processor), nrog rau kev nkag mus rau lub network, tsis txwv.
Cov txheej txheem tom ntej no yog tsim kom muaj kev ua haujlwm puv ntoob hauv ib lub thawv, siv cov txheej txheem ntawm cov txheej txheem ua haujlwm kernel. Txoj kev no yog hu ua txawv ntawm cov kev khiav hauj lwm sib txawv, tab sis cov ntsiab lus yog tib yam - launching ob peb ywj siab operating systems, txhua tus uas khiav tib lub kernel uas lub ntsiab operating system khiav. Cov no suav nrog FreeBSD Jails, Solaris Zones, OpenVZ thiab LXC rau Linux. Kev rho tawm tau lees paub tsis yog los ntawm qhov chaw disk nkaus xwb, tab sis kuj los ntawm lwm cov peev txheej; tshwj xeeb, txhua lub thawv yuav muaj kev txwv ntawm lub sijhawm processor, RAM, thiab network bandwidth. Piv rau chroot, tawm hauv lub thawv yog qhov nyuaj dua, vim tias tus superuser hauv lub thawv tau nkag mus rau cov ntsiab lus ntawm lub thawv nkaus xwb, txawm li cas los xij, vim qhov yuav tsum tau ua kom cov kev khiav hauj lwm hauv lub thawv mus txog hnub thiab kev siv cov ntawv qub. ntawm kernels (tseem ceeb rau Linux, mus rau qhov tsawg dua FreeBSD), muaj qhov tsis yog xoom qhov yuav ua rau "tawg dhau" cov kab ke cais tawm thiab nkag mus rau lub luag haujlwm tseem ceeb.
Hloov chaw ua haujlwm puv npo hauv lub thawv (nrog rau qhov pib pib, tus thawj tswj pob, thiab lwm yam), koj tuaj yeem tso cov ntawv thov tam sim ntawd, qhov tseem ceeb yog muab cov ntawv thov nrog lub sijhawm zoo li no (muaj cov tsev qiv ntawv tsim nyog. thiab lwm cov ntaub ntawv). Lub tswv yim no tau ua lub hauv paus rau ntim cov ntawv thov virtualization, tus neeg sawv cev tseem ceeb tshaj plaws thiab paub zoo uas yog Docker. Piv nrog rau cov txheej txheem dhau los, cov txheej txheem kev sib cais hloov tau yooj yim dua, ua ke nrog kev txhawb nqa hauv kev sib koom ua ke ntawm cov thawv ntim khoom thiab daim ntawv thov lub xeev taug qab hauv lub thawv, ua rau muaj peev xwm los tsim ib qho chaw sib koom ua ke los ntawm ntau lub cev servers rau cov thawv khiav - tsis tas yuav tsum muaj kev tswj xyuas cov peev txheej.
docker
Docker yog lub npe nrov tshaj plaws daim ntawv thov ntim software. Sau ua lus Go, nws siv tus qauv nta ntawm Linux ntsiav - cgroups, namespaces, peev xwm, thiab lwm yam, nrog rau Aufs cov ntaub ntawv systems thiab lwm yam zoo li ntawd kom txuag tau qhov chaw disk.
Source: wikimedia
architecture
Ua ntej version 1.11, Docker ua haujlwm raws li ib qho kev pabcuam uas ua tiav tag nrho cov haujlwm nrog cov thawv: rub tawm cov duab rau ntim, tso cov ntim, ua cov ntawv thov API. Pib nrog version 1.11, Docker tau muab faib ua ob peb ntu uas cuam tshuam nrog ib leeg: ntim khoom, rau kev ua tiav tag nrho lub neej voj voog ntawm cov ntim khoom (chaw disk chaw, rub tawm cov duab, ua haujlwm nrog lub network, tso tawm, txhim kho thiab saib xyuas lub xeev ntim) thiab runC, lub thawv ua haujlwm ib puag ncig, raws li kev siv cgroups thiab lwm yam nta ntawm Linux kernel. Qhov kev pabcuam docker nws tus kheej tseem nyob, tab sis tam sim no nws tsuas yog ua haujlwm rau cov txheej txheem API thov txhais rau hauv ntim.
Teeb thiab kev teeb tsa
Kuv txoj kev nyiam rau nruab docker yog docker-machine, uas, ntxiv rau kev txhim kho ncaj qha thiab teeb tsa docker ntawm cov chaw taws teeb servers (xws li huab cua ntau), ua rau nws muaj peev xwm ua haujlwm nrog cov ntaub ntawv ntawm cov chaw taws teeb servers thiab tuaj yeem khiav ntau yam lus txib.
Txawm li cas los xij, txij li xyoo 2018, qhov project tsis tshua tau tsim, yog li peb yuav nruab nws raws li tus qauv rau feem ntau Linux faib - ntxiv cov chaw cia khoom thiab txhim kho cov pob tsim nyog.
Txoj kev no kuj tseem siv rau kev teeb tsa automated, piv txwv li siv Ansible lossis lwm lub tshuab zoo sib xws, tab sis kuv yuav tsis xav txog nws hauv tsab xov xwm no.
Kev teeb tsa yuav ua tiav ntawm Centos 7, Kuv yuav siv lub tshuab virtual ua lub server, txhawm rau txhim kho tsuas yog khiav cov lus txib hauv qab no:
# yum install -y yum-utils
# yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
# yum install docker-ce docker-ce-cli containerd.io
Tom qab kev teeb tsa, koj yuav tsum pib qhov kev pabcuam thiab muab tso rau hauv kev pib:
# systemctl enable docker
# systemctl start docker
# firewall-cmd --zone=public --add-port=2377/tcp --permanent
Tsis tas li ntawd, koj tuaj yeem tsim ib pawg docker, uas cov neeg siv yuav tuaj yeem ua haujlwm nrog docker yam tsis muaj sudo, teeb tsa kev nkag, qhib kev nkag mus rau API los ntawm sab nraud, thiab tsis txhob hnov ββββqab teeb tsa lub firewall kom meej dua (txhua yam uas tsis tso cai. yog txwv tsis pub nyob rau hauv cov piv txwv saum toj no thiab hauv qab no - Kuv tshem tawm qhov no rau simplicity thiab clarity), tab sis kuv yuav tsis mus rau hauv ntau nthuav dav ntawm no.
Lwm yam nta
Ntxiv rau lub tshuab docker uas tau hais los saum toj no, kuj tseem muaj cov npe docker, cov cuab yeej khaws cia cov duab rau cov thawv, nrog rau docker compose, lub cuab yeej rau kev siv lub tshuab xa tawm ntawm cov ntawv thov hauv ntim, YAML cov ntaub ntawv siv los tsim thiab teeb tsa cov thawv. thiab lwm yam ntsig txog (piv txwv li, tes hauj lwm, cov ntaub ntawv tsis tu ncua rau cov ntaub ntawv khaws cia).
Nws kuj tseem siv tau los npaj cov khoom siv rau CICD. Lwm qhov nthuav dav yog ua haujlwm hauv pawg hom, lub npe hu ua swarm hom (ua ntej version 1.12 nws tau hu ua docker swarm), uas tso cai rau koj los sib sau ua ke ib qho kev tsim kho los ntawm ntau lub servers rau cov thawv khiav. Muaj kev txhawb nqa rau lub network virtual nyob rau sab saum toj ntawm tag nrho cov servers, muaj cov khoom sib npaug ua ke, nrog rau kev txhawb nqa rau cov zais cia rau ntim.
YAML cov ntaub ntawv los ntawm docker compose, nrog rau kev hloov kho me me, tuaj yeem siv rau cov pawg no, ua tiav kev saib xyuas ntawm pawg me thiab nruab nrab rau ntau lub hom phiaj. Rau cov pawg loj, Kubernetes yog qhov zoo dua vim tias tus nqi saib xyuas ntawm hom swarm tuaj yeem dhau ntawm Kubernetes. Ntxiv nrog rau runC, koj tuaj yeem nruab, piv txwv li, raws li lub thawv ua haujlwm ib puag ncig
Ua haujlwm nrog Docker
Tom qab kev teeb tsa thiab teeb tsa, peb yuav sim sib sau ua ke ib pawg uas peb yuav xa GitLab thiab Docker Registry rau pab pawg txhim kho. Kuv yuav siv peb lub tshuab virtual ua cov servers, uas kuv yuav ntxiv rau kev xa tawm FS GlusterFS; Kuv yuav siv nws li docker ntim ntim cia, piv txwv li, los khiav qhov txhaum-tho rau ntawm docker npe. Cov Cheebtsam tseem ceeb los khiav: Docker Registry, Postgresql, Redis, GitLab nrog kev txhawb nqa rau GitLab Runner saum Swarm. Peb yuav tso Postgresql nrog pawg
Txhawm rau xa GlusterFS ntawm txhua lub servers (lawv hu ua node1, node2, node3), koj yuav tsum tau nruab cov pob khoom, qhib lub firewall, thiab tsim cov npe tsim nyog:
# yum -y install centos-release-gluster7
# yum -y install glusterfs-server
# systemctl enable glusterd
# systemctl start glusterd
# firewall-cmd --add-service=glusterfs --permanent
# firewall-cmd --reload
# mkdir -p /srv/gluster
# mkdir -p /srv/docker
# echo "$(hostname):/docker /srv/docker glusterfs defaults,_netdev 0 0" >> /etc/fstab
Tom qab kev teeb tsa, ua haujlwm ntawm kev teeb tsa GlusterFS yuav tsum txuas ntxiv los ntawm ib qho, piv txwv li node1:
# gluster peer probe node2
# gluster peer probe node3
# gluster volume create docker replica 3 node1:/srv/gluster node2:/srv/gluster node3:/srv/gluster force
# gluster volume start docker
Tom qab ntawd koj yuav tsum tau mount lub resulting ntim (cov lus txib yuav tsum tau ua rau tag nrho cov servers):
# mount /srv/docker
Hom swarm yog teeb tsa ntawm ib qho ntawm cov servers, uas yuav yog Tus Thawj Coj, tus so yuav tsum tau koom nrog pawg, yog li qhov tshwm sim ntawm kev ua tiav cov lus txib ntawm thawj tus neeg rau zaub mov yuav tsum tau theej thiab ua rau lwm tus.
Thawj pawg teeb tsa, Kuv khiav cov lus txib ntawm node1:
# docker swarm init
Swarm initialized: current node (a5jpfrh5uvo7svzz1ajduokyq) is now a manager.
To add a worker to this swarm, run the following command:
docker swarm join --token SWMTKN-1-0c5mf7mvzc7o7vjk0wngno2dy70xs95tovfxbv4tqt9280toku-863hyosdlzvd76trfptd4xnzd xx.xx.xx.xx:2377
To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.
# docker swarm join-token manager
Peb theej qhov tshwm sim ntawm cov lus txib thib ob thiab ua nws ntawm node2 thiab node3:
# docker swarm join --token SWMTKN-x-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx-xxxxxxxxx xx.xx.xx.xx:2377
This node joined a swarm as a manager.
Txij ntawm no mus, qhov kev teeb tsa ua ntej ntawm cov servers tiav, cia peb mus teeb tsa cov kev pabcuam; cov lus txib kom ua tiav yuav raug tso tawm los ntawm node1, tshwj tsis yog tias tau teev tseg.
Ua ntej tshaj plaws, cia peb tsim cov network rau cov thawv:
# docker network create --driver=overlay etcd
# docker network create --driver=overlay pgsql
# docker network create --driver=overlay redis
# docker network create --driver=overlay traefik
# docker network create --driver=overlay gitlab
Tom qab ntawd peb kos cov servers, qhov no yog qhov tsim nyog los khi qee cov kev pabcuam rau cov servers:
# docker node update --label-add nodename=node1 node1
# docker node update --label-add nodename=node2 node2
# docker node update --label-add nodename=node3 node3
Tom ntej no, peb tsim cov ntaub ntawv khaws cia thiab lwm yam ntaub ntawv, KV cia, uas xav tau rau Traefik thiab Stolon. Zoo ib yam li Postgresql, cov no yuav ntim khi rau cov servers, yog li peb khiav cov lus txib no ntawm txhua lub servers:
# mkdir -p /srv/etcd
Tom ntej no, tsim ib cov ntaub ntawv rau configure etcd thiab siv nws:
00 ymx
version: '3.7'
services:
etcd1:
image: quay.io/coreos/etcd:latest
hostname: etcd1
command:
- etcd
- --name=etcd1
- --data-dir=/data.etcd
- --advertise-client-urls=http://etcd1:2379
- --listen-client-urls=http://0.0.0.0:2379
- --initial-advertise-peer-urls=http://etcd1:2380
- --listen-peer-urls=http://0.0.0.0:2380
- --initial-cluster=etcd1=http://etcd1:2380,etcd2=http://etcd2:2380,etcd3=http://etcd3:2380
- --initial-cluster-state=new
- --initial-cluster-token=etcd-cluster
networks:
- etcd
volumes:
- etcd1vol:/data.etcd
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node1]
etcd2:
image: quay.io/coreos/etcd:latest
hostname: etcd2
command:
- etcd
- --name=etcd2
- --data-dir=/data.etcd
- --advertise-client-urls=http://etcd2:2379
- --listen-client-urls=http://0.0.0.0:2379
- --initial-advertise-peer-urls=http://etcd2:2380
- --listen-peer-urls=http://0.0.0.0:2380
- --initial-cluster=etcd1=http://etcd1:2380,etcd2=http://etcd2:2380,etcd3=http://etcd3:2380
- --initial-cluster-state=new
- --initial-cluster-token=etcd-cluster
networks:
- etcd
volumes:
- etcd2vol:/data.etcd
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node2]
etcd3:
image: quay.io/coreos/etcd:latest
hostname: etcd3
command:
- etcd
- --name=etcd3
- --data-dir=/data.etcd
- --advertise-client-urls=http://etcd3:2379
- --listen-client-urls=http://0.0.0.0:2379
- --initial-advertise-peer-urls=http://etcd3:2380
- --listen-peer-urls=http://0.0.0.0:2380
- --initial-cluster=etcd1=http://etcd1:2380,etcd2=http://etcd2:2380,etcd3=http://etcd3:2380
- --initial-cluster-state=new
- --initial-cluster-token=etcd-cluster
networks:
- etcd
volumes:
- etcd3vol:/data.etcd
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node3]
volumes:
etcd1vol:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/etcd"
etcd2vol:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/etcd"
etcd3vol:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/etcd"
networks:
etcd:
external: true
# docker stack deploy --compose-file 00etcd.yml etcd
Tom qab qee lub sijhawm, peb tshawb xyuas tias pawg etcd tau nce:
# docker exec $(docker ps | awk '/etcd/ {print $1}') etcdctl member list
ade526d28b1f92f7: name=etcd1 peerURLs=http://etcd1:2380 clientURLs=http://etcd1:2379 isLeader=false
bd388e7810915853: name=etcd3 peerURLs=http://etcd3:2380 clientURLs=http://etcd3:2379 isLeader=false
d282ac2ce600c1ce: name=etcd2 peerURLs=http://etcd2:2380 clientURLs=http://etcd2:2379 isLeader=true
# docker exec $(docker ps | awk '/etcd/ {print $1}') etcdctl cluster-health
member ade526d28b1f92f7 is healthy: got healthy result from http://etcd1:2379
member bd388e7810915853 is healthy: got healthy result from http://etcd3:2379
member d282ac2ce600c1ce is healthy: got healthy result from http://etcd2:2379
cluster is healthy
Peb tsim cov npe rau Postgresql, ua cov lus txib ntawm txhua lub servers:
# mkdir -p /srv/pgsql
Tom ntej no, tsim cov ntaub ntawv los teeb tsa Postgresql:
01 pgsql wb
version: '3.7'
services:
pgsentinel:
image: sorintlab/stolon:master-pg10
command:
- gosu
- stolon
- stolon-sentinel
- --cluster-name=stolon-cluster
- --store-backend=etcdv3
- --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379
- --log-level=debug
networks:
- etcd
- pgsql
deploy:
replicas: 3
update_config:
parallelism: 1
delay: 30s
order: stop-first
failure_action: pause
pgkeeper1:
image: sorintlab/stolon:master-pg10
hostname: pgkeeper1
command:
- gosu
- stolon
- stolon-keeper
- --pg-listen-address=pgkeeper1
- --pg-repl-username=replica
- --uid=pgkeeper1
- --pg-su-username=postgres
- --pg-su-passwordfile=/run/secrets/pgsql
- --pg-repl-passwordfile=/run/secrets/pgsql_repl
- --data-dir=/var/lib/postgresql/data
- --cluster-name=stolon-cluster
- --store-backend=etcdv3
- --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379
networks:
- etcd
- pgsql
environment:
- PGDATA=/var/lib/postgresql/data
volumes:
- pgkeeper1:/var/lib/postgresql/data
secrets:
- pgsql
- pgsql_repl
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node1]
pgkeeper2:
image: sorintlab/stolon:master-pg10
hostname: pgkeeper2
command:
- gosu
- stolon
- stolon-keeper
- --pg-listen-address=pgkeeper2
- --pg-repl-username=replica
- --uid=pgkeeper2
- --pg-su-username=postgres
- --pg-su-passwordfile=/run/secrets/pgsql
- --pg-repl-passwordfile=/run/secrets/pgsql_repl
- --data-dir=/var/lib/postgresql/data
- --cluster-name=stolon-cluster
- --store-backend=etcdv3
- --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379
networks:
- etcd
- pgsql
environment:
- PGDATA=/var/lib/postgresql/data
volumes:
- pgkeeper2:/var/lib/postgresql/data
secrets:
- pgsql
- pgsql_repl
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node2]
pgkeeper3:
image: sorintlab/stolon:master-pg10
hostname: pgkeeper3
command:
- gosu
- stolon
- stolon-keeper
- --pg-listen-address=pgkeeper3
- --pg-repl-username=replica
- --uid=pgkeeper3
- --pg-su-username=postgres
- --pg-su-passwordfile=/run/secrets/pgsql
- --pg-repl-passwordfile=/run/secrets/pgsql_repl
- --data-dir=/var/lib/postgresql/data
- --cluster-name=stolon-cluster
- --store-backend=etcdv3
- --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379
networks:
- etcd
- pgsql
environment:
- PGDATA=/var/lib/postgresql/data
volumes:
- pgkeeper3:/var/lib/postgresql/data
secrets:
- pgsql
- pgsql_repl
deploy:
replicas: 1
placement:
constraints: [node.labels.nodename == node3]
postgresql:
image: sorintlab/stolon:master-pg10
command: gosu stolon stolon-proxy --listen-address 0.0.0.0 --cluster-name stolon-cluster --store-backend=etcdv3 --store-endpoints http://etcd1:2379,http://etcd2:2379,http://etcd3:2379
networks:
- etcd
- pgsql
deploy:
replicas: 3
update_config:
parallelism: 1
delay: 30s
order: stop-first
failure_action: rollback
volumes:
pgkeeper1:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/pgsql"
pgkeeper2:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/pgsql"
pgkeeper3:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/pgsql"
secrets:
pgsql:
file: "/srv/docker/postgres"
pgsql_repl:
file: "/srv/docker/replica"
networks:
etcd:
external: true
pgsql:
external: true
Peb tsim secrets thiab siv cov ntaub ntawv:
# </dev/urandom tr -dc 234567890qwertyuopasdfghjkzxcvbnmQWERTYUPASDFGHKLZXCVBNM | head -c $(((RANDOM%3)+15)) > /srv/docker/replica
# </dev/urandom tr -dc 234567890qwertyuopasdfghjkzxcvbnmQWERTYUPASDFGHKLZXCVBNM | head -c $(((RANDOM%3)+15)) > /srv/docker/postgres
# docker stack deploy --compose-file 01pgsql.yml pgsql
Tom qab qee lub sijhawm (saib cov zis ntawm cov lus txib docker kev pabcuam lstias tag nrho cov kev pabcuam tau nce) peb pib tsim Postgresql pawg:
# docker exec $(docker ps | awk '/pgkeeper/ {print $1}') stolonctl --cluster-name=stolon-cluster --store-backend=etcdv3 --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379 init
Tshawb xyuas qhov kev npaj ntawm Postgresql pawg:
# docker exec $(docker ps | awk '/pgkeeper/ {print $1}') stolonctl --cluster-name=stolon-cluster --store-backend=etcdv3 --store-endpoints=http://etcd1:2379,http://etcd2:2379,http://etcd3:2379 status
=== Active sentinels ===
ID LEADER
26baa11d false
74e98768 false
a8cb002b true
=== Active proxies ===
ID
4d233826
9f562f3b
b0c79ff1
=== Keepers ===
UID HEALTHY PG LISTENADDRESS PG HEALTHY PG WANTEDGENERATION PG CURRENTGENERATION
pgkeeper1 true pgkeeper1:5432 true 2 2
pgkeeper2 true pgkeeper2:5432 true 2 2
pgkeeper3 true pgkeeper3:5432 true 3 3
=== Cluster Info ===
Master Keeper: pgkeeper3
===== Keepers/DB tree =====
pgkeeper3 (master)
ββpgkeeper2
ββpgkeeper1
Peb teeb tsa traefik qhib kev nkag mus rau cov thawv los ntawm sab nraud:
03 ib.yml
version: '3.7'
services:
traefik:
image: traefik:latest
command: >
--log.level=INFO
--providers.docker=true
--entryPoints.web.address=:80
--providers.providersThrottleDuration=2
--providers.docker.watch=true
--providers.docker.swarmMode=true
--providers.docker.swarmModeRefreshSeconds=15s
--providers.docker.exposedbydefault=false
--accessLog.bufferingSize=0
--api=true
--api.dashboard=true
--api.insecure=true
networks:
- traefik
ports:
- 80:80
volumes:
- /var/run/docker.sock:/var/run/docker.sock
deploy:
replicas: 3
placement:
constraints:
- node.role == manager
preferences:
- spread: node.id
labels:
- traefik.enable=true
- traefik.http.routers.traefik.rule=Host(`traefik.example.com`)
- traefik.http.services.traefik.loadbalancer.server.port=8080
- traefik.docker.network=traefik
networks:
traefik:
external: true
# docker stack deploy --compose-file 03traefik.yml traefik
Peb tso Redis Cluster, ua qhov no peb tsim cov npe khaws cia ntawm txhua qhov nodes:
# mkdir -p /srv/redis
05 ib.yml
version: '3.7'
services:
redis-master:
image: 'bitnami/redis:latest'
networks:
- redis
ports:
- '6379:6379'
environment:
- REDIS_REPLICATION_MODE=master
- REDIS_PASSWORD=xxxxxxxxxxx
deploy:
mode: global
restart_policy:
condition: any
volumes:
- 'redis:/opt/bitnami/redis/etc/'
redis-replica:
image: 'bitnami/redis:latest'
networks:
- redis
ports:
- '6379'
depends_on:
- redis-master
environment:
- REDIS_REPLICATION_MODE=slave
- REDIS_MASTER_HOST=redis-master
- REDIS_MASTER_PORT_NUMBER=6379
- REDIS_MASTER_PASSWORD=xxxxxxxxxxx
- REDIS_PASSWORD=xxxxxxxxxxx
deploy:
mode: replicated
replicas: 3
update_config:
parallelism: 1
delay: 10s
restart_policy:
condition: any
redis-sentinel:
image: 'bitnami/redis:latest'
networks:
- redis
ports:
- '16379'
depends_on:
- redis-master
- redis-replica
entrypoint: |
bash -c 'bash -s <<EOF
"/bin/bash" -c "cat <<EOF > /opt/bitnami/redis/etc/sentinel.conf
port 16379
dir /tmp
sentinel monitor master-node redis-master 6379 2
sentinel down-after-milliseconds master-node 5000
sentinel parallel-syncs master-node 1
sentinel failover-timeout master-node 5000
sentinel auth-pass master-node xxxxxxxxxxx
sentinel announce-ip redis-sentinel
sentinel announce-port 16379
EOF"
"/bin/bash" -c "redis-sentinel /opt/bitnami/redis/etc/sentinel.conf"
EOF'
deploy:
mode: global
restart_policy:
condition: any
volumes:
redis:
driver: local
driver_opts:
type: 'none'
o: 'bind'
device: "/srv/redis"
networks:
redis:
external: true
# docker stack deploy --compose-file 05redis.yml redis
Ntxiv Docker Registry:
06 npe.yml
version: '3.7'
services:
registry:
image: registry:2.6
networks:
- traefik
volumes:
- registry_data:/var/lib/registry
deploy:
replicas: 1
placement:
constraints: [node.role == manager]
restart_policy:
condition: on-failure
labels:
- traefik.enable=true
- traefik.http.routers.registry.rule=Host(`registry.example.com`)
- traefik.http.services.registry.loadbalancer.server.port=5000
- traefik.docker.network=traefik
volumes:
registry_data:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/docker/registry"
networks:
traefik:
external: true
# mkdir /srv/docker/registry
# docker stack deploy --compose-file 06registry.yml registry
Thiab thaum kawg - GitLab:
08 gitlab-runner.yml
version: '3.7'
services:
gitlab:
image: gitlab/gitlab-ce:latest
networks:
- pgsql
- redis
- traefik
- gitlab
ports:
- 22222:22
environment:
GITLAB_OMNIBUS_CONFIG: |
postgresql['enable'] = false
redis['enable'] = false
gitlab_rails['registry_enabled'] = false
gitlab_rails['db_username'] = "gitlab"
gitlab_rails['db_password'] = "XXXXXXXXXXX"
gitlab_rails['db_host'] = "postgresql"
gitlab_rails['db_port'] = "5432"
gitlab_rails['db_database'] = "gitlab"
gitlab_rails['db_adapter'] = 'postgresql'
gitlab_rails['db_encoding'] = 'utf8'
gitlab_rails['redis_host'] = 'redis-master'
gitlab_rails['redis_port'] = '6379'
gitlab_rails['redis_password'] = 'xxxxxxxxxxx'
gitlab_rails['smtp_enable'] = true
gitlab_rails['smtp_address'] = "smtp.yandex.ru"
gitlab_rails['smtp_port'] = 465
gitlab_rails['smtp_user_name'] = "[email protected]"
gitlab_rails['smtp_password'] = "xxxxxxxxx"
gitlab_rails['smtp_domain'] = "example.com"
gitlab_rails['gitlab_email_from'] = '[email protected]'
gitlab_rails['smtp_authentication'] = "login"
gitlab_rails['smtp_tls'] = true
gitlab_rails['smtp_enable_starttls_auto'] = true
gitlab_rails['smtp_openssl_verify_mode'] = 'peer'
external_url 'http://gitlab.example.com/'
gitlab_rails['gitlab_shell_ssh_port'] = 22222
volumes:
- gitlab_conf:/etc/gitlab
- gitlab_logs:/var/log/gitlab
- gitlab_data:/var/opt/gitlab
deploy:
mode: replicated
replicas: 1
placement:
constraints:
- node.role == manager
labels:
- traefik.enable=true
- traefik.http.routers.gitlab.rule=Host(`gitlab.example.com`)
- traefik.http.services.gitlab.loadbalancer.server.port=80
- traefik.docker.network=traefik
gitlab-runner:
image: gitlab/gitlab-runner:latest
networks:
- gitlab
volumes:
- gitlab_runner_conf:/etc/gitlab
- /var/run/docker.sock:/var/run/docker.sock
deploy:
mode: replicated
replicas: 1
placement:
constraints:
- node.role == manager
volumes:
gitlab_conf:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/docker/gitlab/conf"
gitlab_logs:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/docker/gitlab/logs"
gitlab_data:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/docker/gitlab/data"
gitlab_runner_conf:
driver: local
driver_opts:
type: none
o: bind
device: "/srv/docker/gitlab/runner"
networks:
pgsql:
external: true
redis:
external: true
traefik:
external: true
gitlab:
external: true
# mkdir -p /srv/docker/gitlab/conf
# mkdir -p /srv/docker/gitlab/logs
# mkdir -p /srv/docker/gitlab/data
# mkdir -p /srv/docker/gitlab/runner
# docker stack deploy --compose-file 08gitlab-runner.yml gitlab
Lub xeev kawg ntawm pawg thiab cov kev pabcuam:
# docker service ls
ID NAME MODE REPLICAS IMAGE PORTS
lef9n3m92buq etcd_etcd1 replicated 1/1 quay.io/coreos/etcd:latest
ij6uyyo792x5 etcd_etcd2 replicated 1/1 quay.io/coreos/etcd:latest
fqttqpjgp6pp etcd_etcd3 replicated 1/1 quay.io/coreos/etcd:latest
hq5iyga28w33 gitlab_gitlab replicated 1/1 gitlab/gitlab-ce:latest *:22222->22/tcp
dt7s6vs0q4qc gitlab_gitlab-runner replicated 1/1 gitlab/gitlab-runner:latest
k7uoezno0h9n pgsql_pgkeeper1 replicated 1/1 sorintlab/stolon:master-pg10
cnrwul4r4nse pgsql_pgkeeper2 replicated 1/1 sorintlab/stolon:master-pg10
frflfnpty7tr pgsql_pgkeeper3 replicated 1/1 sorintlab/stolon:master-pg10
x7pqqchi52kq pgsql_pgsentinel replicated 3/3 sorintlab/stolon:master-pg10
mwu2wl8fti4r pgsql_postgresql replicated 3/3 sorintlab/stolon:master-pg10
9hkbe2vksbzb redis_redis-master global 3/3 bitnami/redis:latest *:6379->6379/tcp
l88zn8cla7dc redis_redis-replica replicated 3/3 bitnami/redis:latest *:30003->6379/tcp
1utp309xfmsy redis_redis-sentinel global 3/3 bitnami/redis:latest *:30002->16379/tcp
oteb824ylhyp registry_registry replicated 1/1 registry:2.6
qovrah8nzzu8 traefik_traefik replicated 3/3 traefik:latest *:80->80/tcp, *:443->443/tcp
Dab tsi ntxiv tuaj yeem txhim kho? Nco ntsoov teeb tsa Traefik kom khiav cov thawv hla https, ntxiv tls encryption rau Postgresql thiab Redis. Tab sis feem ntau, nws tuaj yeem muab rau cov neeg tsim khoom ua PoC. Tam sim no cia peb saib lwm txoj hauv kev rau Docker.
podman
Lwm lub cav muaj npe nrov rau kev khiav cov ntim khoom sib koom ua ke los ntawm cov pods (pods, pawg ntawm cov thawv xa tawm ua ke). Tsis zoo li Docker, nws tsis tas yuav muaj kev pabcuam los khiav cov thawv; txhua txoj haujlwm yog ua tiav los ntawm lub tsev qiv ntawv libpod. Kuj sau rau hauv Go, yuav tsum muaj OCI-compatible runtime los khiav ntim, xws li runC.
Ua haujlwm nrog Podman feem ntau nco txog qhov ntawd rau Docker, mus txog qhov uas koj tuaj yeem ua tau zoo li no (raws li tau hais los ntawm ntau tus neeg uas tau sim nws, suav nrog tus sau tsab xov xwm no):
$ alias docker=podman
thiab koj tuaj yeem ua haujlwm ntxiv. Feem ntau, qhov xwm txheej nrog Podman yog qhov nthuav heev, vim hais tias yog thaum ntxov versions ntawm Kubernetes ua hauj lwm nrog Docker, ces nyob rau hauv 2015, tom qab lub standardization ntawm lub ntiaj teb ntim ntim (OCI - Qhib Thawv Initiative) thiab faib Docker rau hauv ntim thiab runC, Lwm txoj hauv kev rau Docker rau kev khiav hauv Kubernetes tau tsim: CRI-O. Podman hauv qhov no yog lwm txoj hauv kev rau Docker, ua raws li cov hauv paus ntsiab lus ntawm Kubernetes, suav nrog pawg ntim ntim, tab sis lub hom phiaj tseem ceeb ntawm txoj haujlwm yog tsim cov thawv ntim Docker-style yam tsis muaj kev pabcuam ntxiv. Rau qhov laj thawj pom tseeb, tsis muaj hom swarm, txij li cov neeg tsim khoom tau hais meej tias yog tias koj xav tau pawg, coj Kubernetes.
chaw
Txhawm rau nruab rau ntawm Centos 7, tsuas yog qhib lub chaw cia khoom ntxiv, thiab tom qab ntawd nruab txhua yam nrog cov lus txib:
# yum -y install podman
Lwm yam nta
Podman tuaj yeem tsim cov units rau systemd, yog li daws qhov teeb meem ntawm kev pib ntim tom qab lub server reboot. Tsis tas li ntawd, systemd tau tshaj tawm tias ua haujlwm kom raug raws li pid 1 hauv lub thawv. Muaj cov cuab yeej buildah cais rau lub tsev ntim khoom, kuj tseem muaj cov cuab yeej thib peb - ββanalogues ntawm docker-compose, uas kuj tsim cov ntaub ntawv teeb tsa tau sib xws nrog Kubernetes, yog li kev hloov ntawm Podman mus rau Kubernetes yog yooj yim npaum li ua tau.
Ua haujlwm nrog Podman
Txij li thaum tsis muaj hom swarm (peb yuav tsum hloov mus rau Kubernetes yog tias xav tau ib pawg), peb yuav sau rau hauv cov thawv cais.
Nruab podman-compose:
# yum -y install python3-pip
# pip3 install podman-compose
Cov ntaub ntawv teeb tsa tshwm sim rau podman yog qhov sib txawv me ntsis, yog li piv txwv li peb yuav tsum tau txav ib ntu cais ncaj qha mus rau ntu nrog cov kev pabcuam.
gitlab-podman.yml
version: '3.7'
services:
gitlab:
image: gitlab/gitlab-ce:latest
hostname: gitlab.example.com
restart: unless-stopped
environment:
GITLAB_OMNIBUS_CONFIG: |
gitlab_rails['gitlab_shell_ssh_port'] = 22222
ports:
- "80:80"
- "22222:22"
volumes:
- /srv/podman/gitlab/conf:/etc/gitlab
- /srv/podman/gitlab/data:/var/opt/gitlab
- /srv/podman/gitlab/logs:/var/log/gitlab
networks:
- gitlab
gitlab-runner:
image: gitlab/gitlab-runner:alpine
restart: unless-stopped
depends_on:
- gitlab
volumes:
- /srv/podman/gitlab/runner:/etc/gitlab-runner
- /var/run/docker.sock:/var/run/docker.sock
networks:
- gitlab
networks:
gitlab:
# podman-compose -f gitlab-runner.yml -d up
Qhov tshwm sim:
# podman ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
da53da946c01 docker.io/gitlab/gitlab-runner:alpine run --user=gitlab... About a minute ago Up About a minute ago 0.0.0.0:22222->22/tcp, 0.0.0.0:80->80/tcp root_gitlab-runner_1
781c0103c94a docker.io/gitlab/gitlab-ce:latest /assets/wrapper About a minute ago Up About a minute ago 0.0.0.0:22222->22/tcp, 0.0.0.0:80->80/tcp root_gitlab_1
Cia peb pom dab tsi nws tsim rau systemd thiab kubernetes, rau qhov no peb yuav tsum paub txog lub npe lossis tus lej ntawm cov pod:
# podman pod ls
POD ID NAME STATUS CREATED # OF CONTAINERS INFRA ID
71fc2b2a5c63 root Running 11 minutes ago 3 db40ab8bf84b
Kubernetes:
# podman generate kube 71fc2b2a5c63
# Generation of Kubernetes YAML is still under development!
#
# Save the output of this file and use kubectl create -f to import
# it into Kubernetes.
#
# Created with podman-1.6.4
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: "2020-07-29T19:22:40Z"
labels:
app: root
name: root
spec:
containers:
- command:
- /assets/wrapper
env:
- name: PATH
value: /opt/gitlab/embedded/bin:/opt/gitlab/bin:/assets:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- name: TERM
value: xterm
- name: HOSTNAME
value: gitlab.example.com
- name: container
value: podman
- name: GITLAB_OMNIBUS_CONFIG
value: |
gitlab_rails['gitlab_shell_ssh_port'] = 22222
- name: LANG
value: C.UTF-8
image: docker.io/gitlab/gitlab-ce:latest
name: rootgitlab1
ports:
- containerPort: 22
hostPort: 22222
protocol: TCP
- containerPort: 80
hostPort: 80
protocol: TCP
resources: {}
securityContext:
allowPrivilegeEscalation: true
capabilities: {}
privileged: false
readOnlyRootFilesystem: false
volumeMounts:
- mountPath: /var/opt/gitlab
name: srv-podman-gitlab-data
- mountPath: /var/log/gitlab
name: srv-podman-gitlab-logs
- mountPath: /etc/gitlab
name: srv-podman-gitlab-conf
workingDir: /
- command:
- run
- --user=gitlab-runner
- --working-directory=/home/gitlab-runner
env:
- name: PATH
value: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
- name: TERM
value: xterm
- name: HOSTNAME
- name: container
value: podman
image: docker.io/gitlab/gitlab-runner:alpine
name: rootgitlab-runner1
resources: {}
securityContext:
allowPrivilegeEscalation: true
capabilities: {}
privileged: false
readOnlyRootFilesystem: false
volumeMounts:
- mountPath: /etc/gitlab-runner
name: srv-podman-gitlab-runner
- mountPath: /var/run/docker.sock
name: var-run-docker.sock
workingDir: /
volumes:
- hostPath:
path: /srv/podman/gitlab/runner
type: Directory
name: srv-podman-gitlab-runner
- hostPath:
path: /var/run/docker.sock
type: File
name: var-run-docker.sock
- hostPath:
path: /srv/podman/gitlab/data
type: Directory
name: srv-podman-gitlab-data
- hostPath:
path: /srv/podman/gitlab/logs
type: Directory
name: srv-podman-gitlab-logs
- hostPath:
path: /srv/podman/gitlab/conf
type: Directory
name: srv-podman-gitlab-conf
status: {}
Systemd:
# podman generate systemd 71fc2b2a5c63
# pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
# autogenerated by Podman 1.6.4
# Thu Jul 29 15:23:28 EDT 2020
[Unit]
Description=Podman pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
Documentation=man:podman-generate-systemd(1)
Requires=container-781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3.service container-da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864.service
Before=container-781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3.service container-da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864.service
[Service]
Restart=on-failure
ExecStart=/usr/bin/podman start db40ab8bf84bf35141159c26cb6e256b889c7a98c0418eee3c4aa683c14fccaa
ExecStop=/usr/bin/podman stop -t 10 db40ab8bf84bf35141159c26cb6e256b889c7a98c0418eee3c4aa683c14fccaa
KillMode=none
Type=forking
PIDFile=/var/run/containers/storage/overlay-containers/db40ab8bf84bf35141159c26cb6e256b889c7a98c0418eee3c4aa683c14fccaa/userdata/conmon.pid
[Install]
WantedBy=multi-user.target
# container-da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864.service
# autogenerated by Podman 1.6.4
# Thu Jul 29 15:23:28 EDT 2020
[Unit]
Description=Podman container-da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864.service
Documentation=man:podman-generate-systemd(1)
RefuseManualStart=yes
RefuseManualStop=yes
BindsTo=pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
After=pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
[Service]
Restart=on-failure
ExecStart=/usr/bin/podman start da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864
ExecStop=/usr/bin/podman stop -t 10 da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864
KillMode=none
Type=forking
PIDFile=/var/run/containers/storage/overlay-containers/da53da946c01449f500aa5296d9ea6376f751948b17ca164df438b7df6607864/userdata/conmon.pid
[Install]
WantedBy=multi-user.target
# container-781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3.service
# autogenerated by Podman 1.6.4
# Thu Jul 29 15:23:28 EDT 2020
[Unit]
Description=Podman container-781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3.service
Documentation=man:podman-generate-systemd(1)
RefuseManualStart=yes
RefuseManualStop=yes
BindsTo=pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
After=pod-71fc2b2a5c6346f0c1c86a2dc45dbe78fa192ea02aac001eb8347ccb8c043c26.service
[Service]
Restart=on-failure
ExecStart=/usr/bin/podman start 781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3
ExecStop=/usr/bin/podman stop -t 10 781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3
KillMode=none
Type=forking
PIDFile=/var/run/containers/storage/overlay-containers/781c0103c94aaa113c17c58d05ddabf8df4bf39707b664abcf17ed2ceff467d3/userdata/conmon.pid
[Install]
WantedBy=multi-user.target
Hmoov tsis zoo, sib nrug los ntawm kev tso cov thawv ntim khoom, lub tsev tsim khoom rau systemd tsis muaj dab tsi ntxiv (piv txwv li, ntxuav cov thawv qub thaum qhov kev pabcuam no rov pib dua), yog li koj yuav tsum tau sau tej yam koj tus kheej.
Raws li txoj cai, Podman txaus los sim cov ntim dab tsi, hloov cov txheej txheem qub rau docker-compose, thiab tom qab ntawd txav mus rau Kubernetes, yog tias koj xav tau pawg, lossis tau txais lwm txoj hauv kev yooj yim rau Docker.
rkt
Qhov project
Plush
Ntau ntxiv
tshawb pom
Qhov xwm txheej nrog Kubernetes yog qhov nthuav heev: ntawm ib sab, nrog Docker koj tuaj yeem tsim ib pawg (hauv hom swarm), uas koj tuaj yeem khiav cov khoom lag luam ib puag ncig rau cov neeg siv khoom, qhov no yog qhov tseeb tshwj xeeb rau pawg me (3-5 tus neeg) , los yog nrog ib tug me me tag nrho load, los yog tsis muaj lub siab xav to taub intricacies ntawm kev teeb tsa Kubernetes, nrog rau cov loads siab.
Podman tsis muab kev sib raug zoo tag nrho, tab sis nws muaj ib qho txiaj ntsig tseem ceeb - kev sib raug zoo nrog Kubernetes, suav nrog cov cuab yeej ntxiv (buildah thiab lwm yam). Yog li ntawd, kuv yuav mus rau qhov kev xaiv ntawm cov cuab yeej rau kev ua haujlwm raws li hauv qab no: rau cov pab pawg me, lossis nrog kev siv nyiaj tsawg - Docker (nrog rau kev ua tau zoo), rau kev tsim kho rau kuv tus kheej ntawm tus kheej hauv zos - Podman comrades, thiab rau txhua tus neeg. - Kubernetes.
Kuv tsis paub meej tias qhov xwm txheej nrog Docker yuav tsis hloov mus rau yav tom ntej, tom qab tag nrho, lawv yog cov pioneers, thiab tseem maj mam ua tus txheej txheem los ntawm kauj ruam, tab sis Podman, rau tag nrho nws qhov tsis txaus (ua haujlwm tsuas yog hauv Linux, tsis muaj pawg, kev sib sau ua ke thiab lwm yam kev ua yog kev daws teeb meem thib peb) yav tom ntej yog qhov tseeb dua, yog li kuv caw txhua tus los tham txog cov kev tshawb pom no hauv cov lus.
PS Thaum Lub Yim Hli 3 peb tso tawm "
Pre-order nqi ua ntej tso tawm: RUB 5000. Koj tuaj yeem saib Docker Video Course program
Tau qhov twg los: www.hab.com