ProHoster > Blog > Tsamaiso > GitLab Shell Semathi. Ho qala ka tlholisano ea lits'ebeletso tse lekiloeng ho sebelisa Docker Compose
GitLab Shell Semathi. Ho qala ka tlholisano ea lits'ebeletso tse lekiloeng ho sebelisa Docker Compose
Sengoliloeng sena se tla khahla bahlahlobi le bahlahisi, empa se reretsoe haholo litsebi tsa boiketsetso tse tobaneng le bothata ba ho theha GitLab CI/CD bakeng sa tlhahlobo ea kopanyo maemong a ho haella ha lisebelisoa tsa meaho le / kapa ho ba sieo ha setshelo. sethala sa orchestration. Ke tla u joetsa mokhoa oa ho theha phepelo ea tikoloho ea liteko u sebelisa docker compose ho semathi se le seng sa khetla ea GitLab le hore ha u tsamaisa libaka tse 'maloa, lits'ebeletso tse qalileng li se ke tsa kena-kenana.
Ts'ebetsong ea ka, hangata ho ne ho etsahala hore tlhahlobo ea ho kopanya e "tšoaroe" mererong. 'Me hangata bothata ba pele le ba bohlokoa ka ho fetisisa ke phaephe ea CI, eo ho eona tlhahlobo ea ho kopanya ho ntlafatsoa litšebeletso li etsoa sebakeng sa dev/stage. Sena se ile sa baka mathata a mangata haholo:
Ka lebaka la bofokoli tšebeletsong e itseng nakong ea tlhahlobo ea ho kopanya, potoloho ea teko e ka senyeha ke data e robehileng. Ho bile le linyeoe ha ho romela kopo ka mokhoa o robehileng oa JSON ho ile ha senya ts'ebeletso, e leng se ileng sa etsa hore boemo bo se ke ba sebetsa ka ho feletseng.
Ho fokotseha ha potoloho ea liteko ha lintlha tsa tlhahlobo li ntse li eketseha. Ke nahana hore ha ho utloahale ho hlalosa mohlala ka ho hloekisa / ho khutlisa database. Ts'ebetsong ea ka, ha ke so kopane le morero moo mokhoa ona o tsamaileng hantle.
Kotsi ea ho sitisa ts'ebetso ea potoloho ea teko ha ho lekoa litlhophiso tsa sistimi e akaretsang. Ka mohlala, leano la mosebedisi/sehlopha/phasewete/tshebediso.
Lintlha tsa liteko ho tsoa litekong tse iketsang li thatafatsa bophelo ho bahlahlobi ba matsoho.
Ba bang ba tla re li-autotes tse ntle li lokela ho hloekisa data ka mor'a tsona. Ke na le likhang khahlanong le:
Li-Dynamic stands li bonolo haholo ho li sebelisa.
Ha se ntho e 'ngoe le e' ngoe e ka tlosoang tsamaisong ka API. Mohlala, mohala oa ho hlakola ntho ha oa kengoa tšebetsong hobane o hanana le mohopolo oa khoebo.
Ha ho etsoa ntho ka API, ho ka etsoa palo e kholo ea metadata, e leng bothata ba ho e hlakola.
Haeba liteko li na le ho its'etleha har'a tsona, mokhoa oa ho hloekisa data ka mor'a ho etsa liteko o fetoha hlooho.
Keketseho (mme, ka maikutlo a ka, ha e na mabaka) mehala ho API.
Le khang ea mantlha: ha data ea liteko e qala ho hlakoloa ka kotloloho ho database. Sena se fetoha liserekisi tsa 'nete tsa PK/FK! Re utloa ho tsoa ho batho ba ntlafatsang: "Ke sa tsoa kenya / ke tlositse / ke rehile lets'oao hape, hobaneng liteko tse 100500 tsa kopanyo li ile tsa tšoaroa?"
Ka maikutlo a ka, tharollo e nepahetseng ka ho fetisisa ke tikoloho e matla.
Batho ba bangata ba sebelisa docker-compose ho tsamaisa tikoloho ea liteko, empa ke batho ba fokolang ba sebelisang docker-compose ha ba etsa liteko tsa ho kopanya ho CI/CD. Mme mona ha ke nahane ka kubernetes, swarm le li-platform tse ling tsa 'mino oa lijana. Ha se lik'hamphani tsohle tse nang le tsona. Ho ka ba monate haeba docker-compose.yml e ne e le bokahohle.
Leha re na le semathi sa rona sa QA, re ka etsa bonnete ba hore lits'ebeletso tse qalisoang ka docker-compose ha li kena-kenane?
Mokhoa oa ho bokella lits'ebeletso tse lekiloeng?
Joang ho hloekisa semathi?
Ke na le semathi sa ka sa GitLab bakeng sa merero ea ka mme ke kopane le lipotso tsena nakong ea nts'etsopele Moreki oa Java etsoe TestRail. Ka nepo, ha o etsa liteko tsa ho kopanya. Ka tlase re tla rarolla mathata ana re sebelisa mehlala ea morero ona.
Bakeng sa semathi, ke khothaletsa mochini o sebetsang oa Linux o nang le 4 vCPU, 4 GB RAM, 50 GB HDD.
Ho na le tlhaiso-leseling e ngata mabapi le ho theha gitlab-runner Marang-rang, ka bokhutšoane:
Kena mochining ka SSH
Haeba u na le tlase ho 8 GB ea RAM, ke khothaletsa etsa phapanyetsano 10 GBe le hore 'molai oa OOM a se ke a tla ho tla bolaea mesebetsi ea rona ka lebaka la khaello ea RAM. Sena se ka etsahala ha mesebetsi e fetang 5 e qalisoa ka nako e le 'ngoe. Mesebetsi e tla tsoela pele butle, empa butle-butle.
Mohlala ka 'molai oa OOM
Haeba u bona ka har'a li-logs tsa mosebetsi bash: line 82: 26474 Killed, ebe o phetha feela ho semathi sudo dmesg | grep 26474
[26474] 1002 26474 1061935 123806 339 0 0 java
Out of memory: Kill process 26474 (java) score 127 or sacrifice child
Killed process 26474 (java) total-vm:4247740kB, anon-rss:495224kB, file-rss:0kB, shmem-rss:0kB
Sena se tla u lumella ho tsamaisa mesebetsi e tšoanang ho semathi se le seng. Bala haholoanyane mona.
Haeba u na le mochine o matla haholoanyane, mohlala 8 vCPU, 16 GB RAM, joale linomoro tsena li ka etsoa bonyane ka makhetlo a 2 ho feta. Empa tsohle li ipapisitse le hore na hantle-ntle ho tla hlahisoa eng ho semathi sena le ka bongata bofe.
Mosebetsi o ka sehloohong ke universal docker-compose.yml, eo bahlahisi/bahlahlobi ba ka e sebelisang sebakeng sa heno le liphaepheng tsa CI.
Pele ho tsohle, re etsa mabitso a ikhethileng a litšebeletso bakeng sa CI. E 'ngoe ea mefuta e ikhethang ho GitLab CI ke phapang CI_JOB_ID. Haeba o boletse container_name e nang le moelelo "service-${CI_JOB_ID:-local}", joale tabeng:
haeba CI_JOB_ID ha e hlalosoe ka mefuta e fapaneng ea tikoloho,
joale lebitso la tšebeletso le tla ba service-local
haeba CI_JOB_ID e hlalosoa ka mefuta-futa ea tikoloho (mohlala 123),
joale lebitso la tšebeletso le tla ba service-123
Taba ea bobeli, re theha marang-rang a tloaelehileng bakeng sa lits'ebeletso tse qalileng. Sena se re fa boikhethelo ba marang-rang ha re etsa liteko tse ngata.
Mohlala oa docker-compose.yml ea ka e nang le maikutlo
version: "3"
# Для корректной работы web (php) и fmt нужно,
# чтобы контейнеры имели общий исполняемый контент.
# В нашем случае, это директория /var/www/testrail
volumes:
static-content:
# Изолируем окружение на сетевом уровне
networks:
default:
external:
name: testrail-network-${CI_JOB_ID:-local}
services:
db:
image: mysql:5.7.22
# Каждый container_name содержит ${CI_JOB_ID:-local}
container_name: "testrail-mysql-${CI_JOB_ID:-local}"
environment:
MYSQL_HOST: db
MYSQL_DATABASE: mydb
MYSQL_ROOT_PASSWORD: 1234
SKIP_GRANT_TABLES: 1
SKIP_NETWORKING: 1
SERVICE_TAGS: dev
SERVICE_NAME: mysql
networks:
- default
migration:
image: registry.gitlab.com/touchbit/image/testrail/migration:latest
container_name: "testrail-migration-${CI_JOB_ID:-local}"
links:
- db
depends_on:
- db
networks:
- default
fpm:
image: registry.gitlab.com/touchbit/image/testrail/fpm:latest
container_name: "testrail-fpm-${CI_JOB_ID:-local}"
volumes:
- static-content:/var/www/testrail
links:
- db
networks:
- default
web:
image: registry.gitlab.com/touchbit/image/testrail/web:latest
container_name: "testrail-web-${CI_JOB_ID:-local}"
# Если переменные TR_HTTP_PORT или TR_HTTPS_PORTS не определены,
# то сервис поднимается на 80 и 443 порту соответственно.
ports:
- ${TR_HTTP_PORT:-80}:80
- ${TR_HTTPS_PORT:-443}:443
volumes:
- static-content:/var/www/testrail
links:
- db
- fpm
networks:
- default
Integration:
stage: test
tags:
- my-shell-runner
before_script:
# Аутентифицируемся в registry
- docker login -u gitlab-ci-token -p ${CI_JOB_TOKEN} ${CI_REGISTRY}
# Генерируем псевдоуникальные TR_HTTP_PORT и TR_HTTPS_PORT
- export TR_HTTP_PORT=$(shuf -i10000-60000 -n1)
- export TR_HTTPS_PORT=$(shuf -i10000-60000 -n1)
# создаем директорию с идентификатором задачи
- mkdir ${CI_JOB_ID}
# копируем в созданную директорию наш docker-compose.yml
# чтобы контекст был разный для каждой задачи
- cp .indirect/docker-compose.yml ${CI_JOB_ID}/docker-compose.yml
script:
# поднимаем наше окружение
- make docker-up
# запускаем тесты исполняемым jar (у меня так)
- java -jar itest.jar --http-port ${TR_HTTP_PORT} --https-port ${TR_HTTPS_PORT}
# или в контейнере
- docker run --network=testrail-network-${CI_JOB_ID:-local} --rm itest
after_script:
# собираем логи
- make docker-logs
# останавливаем окружение
- make docker-kill
artifacts:
# сохраняем логи
when: always
paths:
- logs
expire_in: 30 days
Ka lebaka la ho etsa mosebetsi o joalo, bukana ea li-log tse ka har'a lintho tsa khale e tla ba le lits'ebeletso le lits'oants'o tsa liteko. E leng ho loketseng haholo tabeng ea liphoso. Teko e 'ngoe le e' ngoe ka ho lekana e ngola lethathamo la eona, empa ke tla bua ka sena ka thoko.
$ docker login -u gitlab-ci-token -p ${CI_JOB_TOKEN} ${CI_REGISTRY}
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
WARNING! Your password will be stored unencrypted in /home/gitlab-runner/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credentials-store
Login Succeeded
$ export TR_HTTP_PORT=$(shuf -i10000-60000 -n1)
$ export TR_HTTPS_PORT=$(shuf -i10000-60000 -n1)
$ mkdir ${CI_JOB_ID}
$ cp .indirect/docker-compose.yml ${CI_JOB_ID}/docker-compose.yml
$ make docker-up
docker-compose -f ${CI_JOB_ID:-.indirect}/docker-compose.yml kill
docker network rm testrail-network-${CI_JOB_ID:-local} || true
Error: No such network: testrail-network-204645172
docker network create testrail-network-${CI_JOB_ID:-local}
0a59552b4464b8ab484de6ae5054f3d5752902910bacb0a7b5eca698766d0331
docker-compose -f ${CI_JOB_ID:-.indirect}/docker-compose.yml pull
Pulling web ... done
Pulling fpm ... done
Pulling migration ... done
Pulling db ... done
docker-compose -f ${CI_JOB_ID:-.indirect}/docker-compose.yml up --force-recreate --renew-anon-volumes -d
Creating volume "204645172_static-content" with default driver
Creating testrail-mysql-204645172 ...
Creating testrail-mysql-204645172 ... done
Creating testrail-migration-204645172 ... done
Creating testrail-fpm-204645172 ... done
Creating testrail-web-204645172 ... done
docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
c6b76f9135ed registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" 13 seconds ago Up 1 second 0.0.0.0:51148->80/tcp, 0.0.0.0:25426->443/tcp testrail-web-204645172
01d303262d8e registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" 16 seconds ago Up 13 seconds 9000/tcp testrail-fpm-204645172
2cdab1edbf6a registry.gitlab.com/touchbit/image/testrail/migration:latest "docker-entrypoint.s…" 16 seconds ago Up 13 seconds 3306/tcp, 33060/tcp testrail-migration-204645172
826aaf7c0a29 mysql:5.7.22 "docker-entrypoint.s…" 18 seconds ago Up 16 seconds 3306/tcp testrail-mysql-204645172
6dbb3fae0322 registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" 36 seconds ago Up 22 seconds 0.0.0.0:44202->80/tcp, 0.0.0.0:20151->443/tcp testrail-web-204645084
3540f8d448ce registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" 38 seconds ago Up 35 seconds 9000/tcp testrail-fpm-204645084
70fea72aa10d mysql:5.7.22 "docker-entrypoint.s…" 40 seconds ago Up 37 seconds 3306/tcp testrail-mysql-204645084
d8aa24b2892d registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" About a minute ago Up 53 seconds 0.0.0.0:31103->80/tcp, 0.0.0.0:43872->443/tcp testrail-web-204644881
6d4ccd910fad registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" About a minute ago Up About a minute 9000/tcp testrail-fpm-204644881
685d8023a3ec mysql:5.7.22 "docker-entrypoint.s…" About a minute ago Up About a minute 3306/tcp testrail-mysql-204644881
1cdfc692003a registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" About a minute ago Up About a minute 0.0.0.0:44752->80/tcp, 0.0.0.0:23540->443/tcp testrail-web-204644793
6f26dfb2683e registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" About a minute ago Up About a minute 9000/tcp testrail-fpm-204644793
029e16b26201 mysql:5.7.22 "docker-entrypoint.s…" About a minute ago Up About a minute 3306/tcp testrail-mysql-204644793
c10443222ac6 registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" 5 hours ago Up 5 hours 0.0.0.0:57123->80/tcp, 0.0.0.0:31657->443/tcp testrail-web-204567103
04339229397e registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" 5 hours ago Up 5 hours 9000/tcp testrail-fpm-204567103
6ae0accab28d mysql:5.7.22 "docker-entrypoint.s…" 5 hours ago Up 5 hours 3306/tcp testrail-mysql-204567103
b66b60d79e43 registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" 5 hours ago Up 5 hours 0.0.0.0:56321->80/tcp, 0.0.0.0:58749->443/tcp testrail-web-204553690
033b1f46afa9 registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" 5 hours ago Up 5 hours 9000/tcp testrail-fpm-204553690
a8879c5ef941 mysql:5.7.22 "docker-entrypoint.s…" 5 hours ago Up 5 hours 3306/tcp testrail-mysql-204553690
069954ba6010 registry.gitlab.com/touchbit/image/testrail/web:latest "nginx -g 'daemon of…" 5 hours ago Up 5 hours 0.0.0.0:32869->80/tcp, 0.0.0.0:16066->443/tcp testrail-web-204553539
ed6b17d911a5 registry.gitlab.com/touchbit/image/testrail/fpm:latest "docker-php-entrypoi…" 5 hours ago Up 5 hours 9000/tcp testrail-fpm-204553539
1a1eed057ea0 mysql:5.7.22 "docker-entrypoint.s…" 5 hours ago Up 5 hours 3306/tcp testrail-mysql-204553539
Mesebetsi eohle e phethiloe ka katleho
Lintho tsa khale tsa mosebetsi li na le lits'ebeletso le lintlha tsa tlhahlobo
Ntho e 'ngoe le e' ngoe e bonahala e le ntle, empa ho na le nuance. Pipeline e ka hlakoloa ka matla ha liteko tsa ho kopanya li ntse li sebetsa, moo linkho tse sebetsang li ke keng tsa emisoa. Nako le nako o hloka ho hloekisa semathi. Ka bomalimabe, mosebetsi oa ntlafatso ho GitLab CE o ntse o le maemong Open
Empa re ekelitse ho thakholoa ha mosebetsi ho latela kemiso, ’me ha ho motho ea re thibelang ho o tsamaisa ka letsoho.
E-ea morerong oa rona -> CI / CD -> Kemiso 'me u tsamaise mosebetsi Clean runner
Kakaretso:
Re na le semathi se le seng sa likhetla.
Ha ho likhohlano lipakeng tsa mesebetsi le tikoloho.
Re etsa mesebetsi ka liteko tsa ho kopanya ka ho bapa.
U ka etsa liteko tsa khokahano sebakeng sa heno kapa ka har'a setshelo.
Li-logs tsa lits'ebeletso le liteko li bokelloa ebe li hokelloa mosebetsing oa lipeipi.
Hoa khoneha ho hloekisa semathi ho tloha litšoantšong tsa khale tsa Docker.
Nako ea ho seta ke ~ lihora tse 2.
Ke phetho, hantle-ntle. Ke tla thabela ho amohela maikutlo.