Buildbot ໃນຕົວຢ່າງ

ຂ້ອຍຈໍາເປັນຕ້ອງຕັ້ງຄ່າຂະບວນການປະກອບແລະສົ່ງຊຸດຊອບແວຈາກບ່ອນເກັບ Git ໄປຫາເວັບໄຊທ໌. ແລະໃນເວລາທີ່ຂ້າພະເຈົ້າໄດ້ເຫັນ, ບໍ່ດົນກ່ອນຫນ້ານີ້, ທີ່ນີ້ກ່ຽວກັບ Habre ບົດຄວາມກ່ຽວກັບ buildbot (ການເຊື່ອມຕໍ່ໃນຕອນທ້າຍຂອງ), ຂ້າພະເຈົ້າໄດ້ຕັດສິນໃຈທີ່ຈະພະຍາຍາມມັນແລະນໍາໃຊ້ມັນ.

ເນື່ອງຈາກ buildbot ເປັນລະບົບການແຈກຢາຍ, ມັນຈະເປັນການສົມເຫດສົມຜົນທີ່ຈະສ້າງເຈົ້າພາບສ້າງແຍກຕ່າງຫາກສໍາລັບແຕ່ລະສະຖາປັດຕະຍະກໍາແລະລະບົບປະຕິບັດການ. ໃນກໍລະນີຂອງພວກເຮົາ, ເຫຼົ່ານີ້ແມ່ນບັນຈຸ LXC (ໃນກໍລະນີຂອງ Linux) ແລະ qemu (ໃນກໍລະນີຂອງ Windows):

• vm-srv-build1 - centos 7, ຈະມີ buildbot master ແລະຫນຶ່ງໃນພະນັກງານ.
• vm-srv-build2 - debian 10, ສໍາລັບການສ້າງແພັກເກັດ DEB
• vm-srv-build3 - windows 10, ສໍາລັບການປະກອບ, ທ່ານຮູ້ວ່າສໍາລັບຫຍັງ

ພວກເຮົາຈະເກັບກໍາ Rac GUI — ການໂຕ້ຕອບຮູບພາບສໍາລັບ 1C rac ສໍາລັບການຄຸ້ມຄອງກຸ່ມຂອງເຄື່ອງແມ່ຂ່າຍ. ສໍາລັບ Linux, ເຄື່ອງມືມາດຕະຖານສໍາລັບແຕ່ລະ OS ຈະຖືກນໍາໃຊ້; freewrap.

ການຕັ້ງຄ່າ

GNU / Linux

ມີເອກະສານພຽງພໍໃນອິນເຕີເນັດສໍາລັບການຕິດຕັ້ງ 1,2. ແມ່ນແລ້ວ, ແລະມັນບໍ່ໄດ້ເຮັດໃຫ້ເກີດບັນຫາພິເສດໃດໆ:
ສໍາລັບແມ່ບົດ:

pip3 install buildbot
pip3 install twisted
pip3 install autobahn
pip3 install pysqlite3
pip3 install sqlalchemy sqlalchemy-migrate
pip3 install buildbot-www buildbot-grid-view buildbot-console-view buildbot-waterfall-view
pip3 install python-dateutil

ສໍາລັບ "ຄົນງານ", ນີ້ແມ່ນພຽງພໍ:

pip3 install buildbot-worker

ແນ່ນອນ, ມັນຈະຖືກຕ້ອງກວ່າທີ່ຈະລວບລວມແພັກເກັດສໍາລັບແຕ່ລະ OS, ແຕ່ນີ້ແມ່ນເກີນຂອບເຂດຂອງບົດຄວາມ. ພວກເຮົາຍັງຈະຍົກເວັ້ນຄໍາອະທິບາຍກ່ຽວກັບການຕັ້ງຄ່າຕູ້ຄອນເທນເນີສໍາລັບການເຮັດວຽກ, ຂ້າພະເຈົ້າພຽງແຕ່ຈະສັງເກດວ່າຂ້ອຍໃຊ້ ProxMox VE. ແລະທ່ານຍັງຈະຕ້ອງຕິດຕັ້ງຊຸດສໍາລັບແຕ່ລະແກນທີ່ຕ້ອງການສໍາລັບການປະກອບ (centos: rpmdevtools, ແລະອື່ນໆ; debian: build-essential, dh-make, pbuilder, ແລະອື່ນໆ.)

ໂຄງການກໍ່ສ້າງແລະບໍລິການ buildbot ຈະຖືກເປີດຕົວເປັນຜູ້ໃຊ້ທີ່ບໍ່ມີສິດທິພິເສດ, ດັ່ງນັ້ນທ່ານຈໍາເປັນຕ້ອງສ້າງຫນຶ່ງໃນທຸກເຈົ້າພາບທີ່ເຂົ້າຮ່ວມໃນຂະບວນການ:

adduser buildbot

ຕໍ່ໄປ, ພວກເຮົາຈະຕັ້ງຄ່າການເປີດຕົວອັດຕະໂນມັດຂອງການບໍລິການ, ຕາມລໍາດັບ, ໃນແຕ່ລະເຈົ້າພາບ (ບັນຈຸ):

ຫນ່ວຍງານລະບົບເພື່ອແລ່ນຕົວຊ່ວຍສ້າງ:

touch /etc/systemd/buildbot-master.service 

[Unit]
Description=BuildBot master service
After=network.target

[Service]
User=buildbot
Group=buildbot
WorkingDirectory=/home/buildbot/master
ExecStart=/usr/local/bin/buildbot start --nodaemon
ExecReload=/bin/kill -HUP $MAINPID

[Install]
WantedBy=multi-user.target

ແລະ "ພະນັກງານ"

touch /etc/systemd/buildbot-worker.service 

[Unit]
Description=BuildBot worker service
After=network.target

[Service]master
User=buildbot
Group=buildbot
WorkingDirectory=/home/buildbot/worker
ExecStart=/usr/local/bin/buildbot-worker start --nodaemon

[Install]
WantedBy=buildbot-master.service

ເນື່ອງຈາກສະຄຣິບທັງໝົດ (ໃນກໍລະນີຂອງພວກເຮົາ) ຢູ່ໃນ /usr/local/, ທ່ານຄວນຕັ້ງເສັ້ນທາງໄປຫາພວກມັນຢູ່ໃນຕົວແປສະພາບແວດລ້ອມ:

nano /root/.bash_profile

PATH=$PATH:$HOME/.local/bin:$HOME/bin:/usr/local/bin

ຫຼັງຈາກນັ້ນ, ທ່ານສາມາດສ້າງໂຄງສ້າງພື້ນຖານຂອງໄດເລກະທໍລີສໍາລັບ "ພະນັກງານ" (ໃນທຸກໂຮດ), ເພື່ອເຮັດສິ່ງນີ້, ລົງທະບຽນພາຍໃຕ້ຜູ້ໃຊ້ buildbot ແລະດໍາເນີນການຄໍາສັ່ງຕໍ່ໄປນີ້:

ໃນ host ທໍາອິດ vm-srv-build1:

su - buildbot
mkdir /home/buildbot/worker
cd ~
buildbot-worker create-worker --umask=0o22 --keepalive=60 worker vm-srv-build1:4000 CentOS 123456

ໃນເຈົ້າພາບທີສອງ vm-srv-build2:

su - buildbot
mkdir /home/buildbot/worker
cd ~
buildbot-worker create-worker --umask=0o22 --keepalive=60 worker vm-srv-build1:4000 Debian-10 123456

ໃນ hosts ພະນັກງານ, ການບໍລິການ buildbot-worker ສາມາດເລີ່ມຕົ້ນໄດ້

systemctl start buildbot-worker

MS Windows

ໃນຖານະເປັນ "ຜູ້ເຮັດວຽກ" ສໍາລັບການປະກອບພາຍໃຕ້ Windows, ເຄື່ອງ virtual ທີ່ມີການປ່ອຍຫລ້າສຸດຂອງ Win10 ຈະຖືກນໍາໃຊ້.
ເພື່ອ​ເຮັດ​ວຽກ​ທ່ານ​ຈະ​ຕ້ອງ​ການ​:

• Python
• PyWIN
• Git
• ເພື່ອຕິດຕັ້ງສິ່ງທີ່ແຕກຕ່າງກັນໃນ Python, ທ່ານຈໍາເປັນຕ້ອງດາວໂຫລດ ສ້າງເຄື່ອງມືສຳລັບ Visual Studio 2019
• 7Zip

ຫຼັງຈາກທີ່ທັງຫມົດຂ້າງເທິງໄດ້ຖືກຕິດຕັ້ງ, ທ່ານສາມາດຕິດຕັ້ງ buildbot ຕົວຂອງມັນເອງ:

pip install buildbot-worker

ໃຫ້ສ້າງໄດເລກະທໍລີທີ່ເຮັດວຽກ

md c:worker

ແລະໃຫ້ເປີດຕົວ

buildbot-worker start c:worker

ຖ້າທຸກສິ່ງທຸກຢ່າງເຮັດວຽກ (ເບິ່ງບັນທຶກ c:workertwistd.log), ຫຼັງຈາກນັ້ນທ່ານສາມາດລົງທະບຽນ "ພະນັກງານ" ຂອງພວກເຮົາເປັນການບໍລິການໂດຍການເພີ່ມລາຍການທີ່ມີໄດເລກະທໍລີທີ່ເຮັດວຽກຢູ່ໃນທະບຽນ (ຄໍາສັ່ງຖືກປະຕິບັດໃນ powershell ແລ່ນເປັນຜູ້ເບິ່ງແຍງ):

buildbot_worker_windows_service.exe --user VM-SRV-BUILD3buildbot --password 123456 --startup auto install
New-ItemProperty -path Registry::HKEY_LOCAL_MACHINESYSTEMCurrentControlSetservicesBuildBotParameters -Name directories -PropertyType String -Value c:worker

ແລະທ່ານສາມາດເລີ່ມຕົ້ນການບໍລິການ

Start-Service buildbot

ນັ້ນແມ່ນທັງຫມົດກັບ "ພະນັກງານ", ທ່ານບໍ່ຈໍາເປັນຕ້ອງແຕະຕ້ອງພວກເຂົາອີກຕໍ່ໄປ, ການຄວບຄຸມທັງຫມົດແມ່ນມາຈາກແມ່ບົດ.

ການຕັ້ງຄ່າຕົວຊ່ວຍສ້າງ

ເພື່ອເລີ່ມຕົ້ນດ້ວຍ, ໃຫ້ສ້າງໂຄງສ້າງພື້ນຖານສໍາລັບແມ່ບົດ (ຢູ່ໃນເຈົ້າພາບຕົ້ນຕໍ), ເພື່ອເຮັດສິ່ງນີ້, ລົງທະບຽນພາຍໃຕ້ຜູ້ໃຊ້ buildbot ແລະດໍາເນີນການຄໍາສັ່ງຕໍ່ໄປນີ້:

su - buildbot
mkdir /home/buildbot/master
cd ~
buildbot create-master master

ສໍາລັບຊຸດທີ່ກຽມພ້ອມ, ສ້າງໄດເລກະທໍລີ builds

mkdir /home/buildbot/builds

ໄຟລ໌ master.cfg ຖືກສ້າງຂື້ນຢູ່ໃນລະບົບ /home/buildbot/master/. ໄຟລ໌ນີ້ແມ່ນລະຫັດ python ແລະມີຄໍາອະທິບາຍກ່ຽວກັບກົນໄກທັງຫມົດຂອງລະບົບທີ່ພວກເຮົາຈະເຮັດວຽກກັບມັນໃນອະນາຄົດ.

nano /home/buildbot/master/master.cfg

import os, re
from buildbot.plugins import steps, util, schedulers, worker, changes, reporters

c= BuildmasterConfig ={}

# Описание наших рабочих.
c['workers'] = [ worker.Worker('CentOS', '123456'), worker.Worker('Debian-10', '123456'), worker.Worker('Windows-10', '123456')]
c['protocols'] = {'pb': {'port': 4000}} 

# Указание мастеру какой репозиторий отслеживать
c['change_source'] = []
c['change_source'].append(changes.GitPoller(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       project = 'Rac-GUI',
       branches = True,
       pollInterval = 60
      )
)

# служба запуска сборки
c['schedulers'] = []
c['schedulers'].append(schedulers.SingleBranchScheduler(
       name="Rac-GUI-schedulers",
       change_filter=util.ChangeFilter(branch='master'),
       builderNames=["Rac-GUI-RPM-builder", "Rac-GUI-DEB-builder", "Rac-GUI-WIN-builder"],
       properties = {'owner': 'admin'}
       )
)
@util.renderer

######################################3
# Сборка RPM-пакета
 rac_gui_build_RPM = util.BuildFactory()

rac_gui_build_RPM.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       workdir = 'rac-gui',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       progress = True)
)

ເພື່ອອັດຕະໂນມັດການປະກອບການຫຸ້ມຫໍ່ຂອງສະບັບທີ່ແຕກຕ່າງກັນ, ເພື່ອບໍ່ໃຫ້ມີການເຈາະເລິກເຂົ້າໄປໃນລະຫັດຂອງໄຟລ໌ master.cfg, ໃນສະຄິບຕົ້ນຕໍຂອງໂຄງການ rac_gui.tcl, ສາຍທີ່ມີສະບັບປະຈຸບັນແລະການປ່ອຍໄດ້ຖືກເພີ່ມເຂົ້າໃນ header. :

######################################################
#        Rac GUI
...
# version: 1.0.3
# release: 1

ແລະອີງໃສ່ສາຍເຫຼົ່ານີ້, buildbot ຈະເລກຊຸດ. ເພື່ອສະກັດຂໍ້ມູນ, ໃຫ້ໃຊ້ console grep call. ໃນ buildbot ທ່ານພຽງແຕ່ບໍ່ສາມາດກໍານົດຕົວແປສໍາລັບ "ພະນັກງານ" (ຢ່າງຫນ້ອຍ, ຂ້ອຍບໍ່ພົບວິທີ). ນີ້ແມ່ນສິ່ງທີ່ຄຸນສົມບັດຖືກນໍາໃຊ້ສໍາລັບ. ເຫຼົ່ານັ້ນ. ໃນຂະບວນການປະກອບ, ພວກເຮົາເພີ່ມຂັ້ນຕອນເພື່ອກໍານົດສະບັບແລະການປ່ອຍແລະ, ຕາມຄວາມເຫມາະສົມ, ກໍານົດສະບັບແລະຄຸນສົມບັດການປ່ອຍ. ຄຸນສົມບັດສາມາດຖືກກໍານົດດ້ວຍວິທີຕ່າງໆ, ໃນກໍລະນີນີ້ໂດຍການໂທຫາຄໍາສັ່ງ console:

# Добавим определение версии из основного файла
rac_gui_build_RPM.addStep(
       steps.SetPropertyFromCommand(
       command="grep version ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
       )
)
# Добавим определение релиза из основного файла
rac_gui_build_RPM.addStep(
       steps.SetPropertyFromCommand(
       command="grep release ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
       )
)

ທ່ານສາມາດທົດແທນຄ່າທີ່ໄດ້ຮັບໂດຍການໂທຫາ util.Interpolate().

# Запакуем исходники
rac_gui_build_RPM.addStep(
       steps.ShellCommand(
          command=["tar", "czf", util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"), "../rac-gui"]
       )
)

ມັນຄວນຈະສັງເກດເຫັນຢູ່ທີ່ນີ້ວ່ານັບຕັ້ງແຕ່ເຈົ້າພາບຍັງຖືກນໍາໃຊ້ສໍາລັບການປະກອບຄູ່ມືຂອງຊຸດ, ການຊຸມນຸມຈະຈັດຂຶ້ນຕາມເສັ້ນທາງມາດຕະຖານ.

# Копируем spec
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["cp", "../rac-gui/rac_gui.spec", "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))

ເພື່ອກໍານົດການປ່ອຍແລະຕົວເລກທີ່ຖືກຕ້ອງ, ໃຫ້ໃຊ້ sed call ມາດຕະຖານ, i.e. ຄໍາສັ່ງທົດແທນຄ່າພາຍໃນໄຟລ໌ spec ກັບສິ່ງທີ່ຕ້ອງການ

# меняем версию
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["sed", "-i", util.Interpolate("s/.*Version:.*/Version:t%(prop:version)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
# меняем релиз
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["sed", "-i", util.Interpolate("s/.*Release:.*/Release:t%(prop:release)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))

# запускаем процесс сборки
rac_gui_build_RPM.addStep(steps.RpmBuild(
       specfile="/home/buildbot/rpmbuild/SPECS/rac_gui.spec",
       dist='.el5',
       topdir='/home/buildbot/rpmbuild',
       builddir='/home/buildbot/rpmbuild/build',
       rpmdir='/home/buildbot/rpmbuild/RPMS',
       sourcedir='/home/buildbot/rpmbuild/SOURCES'
      )
)

ພວກເຮົາຄັດລອກຊຸດທີ່ປະກອບສໍາເລັດແລ້ວແລະແຟ້ມຈັດເກັບທີ່ມີແຫຼ່ງໄປຫາແມ່ບົດ. ແຕ່ທ່ານສາມາດຄັດລອກໄຟລ໌ຈາກໄຟລ໌ບ່ອນເຮັດວຽກຂອງທ່ານໄປຫາບ່ອນເກັບມ້ຽນຫຼືເວັບໄຊທ໌ຂອງທ່ານທັນທີ.

# Скопируем файл на мастер
rac_gui_build_RPM.addStep(
       steps.FileUpload(
          workersrc=util.Interpolate("/home/buildbot/rpmbuild/RPMS/noarch/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
          masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")
      )
)

rac_gui_build_RPM.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
          masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")
       )
)

ໃຫ້ເລີ່ມຕົ້ນຂະບວນການຂອງການຄັດລອກຊຸດທີ່ເກັບກໍາໄປ hosting ຜ່ານ FTP ໃນແມ່ບົດ. ສໍາລັບຈຸດປະສົງນີ້, ມັນຖືກນໍາໃຊ້ ສະຄຣິບ ສຸດ tcl.

rac_gui_build_RPM.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
                util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
                util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")]
        )
)

rac_gui_build_RPM.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
                util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
                util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")]
        )
)

ນັ້ນແມ່ນກັບ RPM. ຕອນນີ້ໃຫ້ເລີ່ມຕົ້ນການອະທິບາຍ algorithm ສໍາລັບການກໍ່ສ້າງຊຸດ DEB. ເນື່ອງຈາກຂະບວນການສ້າງຊຸດສໍາລັບລະບົບທີ່ແຕກຕ່າງກັນແມ່ນເປັນເອກະລາດຂອງກັນແລະກັນ, ຫຼາຍຂັ້ນຕອນຈະຖືກຊ້ໍາ.

rac_gui_build_DEB = util.BuildFactory()

rac_gui_build_DEB.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       workdir='build',
       progress = True)
)

# Добавим определение версии из основного файла
rac_gui_build_DEB.addStep(
       steps.SetPropertyFromCommand(
       command="grep version rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
       )
)

# Добавим определение релиза из основного файла
rac_gui_build_DEB.addStep(
       steps.SetPropertyFromCommand(
       command="grep release rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
       )
)

# Переименуем запускаемый файл
    rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["mv", "rac_gui.tcl", "racgui"]))

ສໍາລັບຊຸດ RPM, ບາງຂັ້ນຕອນຕໍ່ໄປນີ້ແມ່ນເຮັດໂດຍ rpm ຕົວມັນເອງໃນລະຫວ່າງການປະກອບແລະຖືກອະທິບາຍຢູ່ໃນ spec ສໍາລັບ Debian, ທ່ານຕ້ອງເຮັດມັນຢູ່ທີ່ນີ້:

# Поменяем пути к библиотекам
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["sed", "-i", "s+^set dir(lib)+set dir(lib) /usr/share/rac-gui/lib ;#+g", "racgui"]))

# Поменяем пути к файлам
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["sed", "-i", "s+[pwd]+/usr/share/rac-gui+g", "racgui"]))

# заархивируем исходники
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["tar", "czf", util.Interpolate("../rac-gui_%(prop:version)s.orig.tar.gz"), "."]))

# Соберём пакет
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["dpkg-buildpackage"]))

# Скопируем файл на мастер
rac_gui_build_DEB.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("../rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
           masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")
       )
)
rac_gui_build_DEB.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
             util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
             util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")]
        )
)

ແລະເຮັດແລ້ວກັບ DEB, ດຽວນີ້ windows!

rac_gui_build_WIN = util.BuildFactory()

rac_gui_build_WIN.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       workdir='build',
       progress = True)
)

ເນື່ອງຈາກ grep ແລະ sed ບໍ່ແມ່ນມາດຕະຖານໃນ Windows (ຫຼືມີ?), ພວກເຮົາຈະໃຊ້ powershell

# Добавим определение версии из основного файла
rac_gui_build_WIN.addStep(
       steps.SetPropertyFromCommand(
       command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'version:') -split 's')[2]",
       property="version"
       )
    )

# Добавим определение релиза из основного файла
rac_gui_build_WIN.addStep(
       steps.SetPropertyFromCommand(
       command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'release:') -split 's')[2]",
       property="release"
       )
)

# Создадим запускаемый файл
rac_gui_build_WIN.addStep(steps.ShellCommand(
       command=["c:binfreewrap.exe", "rac_gui.tcl"]))

# запакуем то, что получилось
rac_gui_build_WIN.addStep(steps.ShellCommand(
       command=["c:Program Files7-zip7z.exe", "a", "-r", util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"), "..build"]))

# скопируем на мастер
rac_gui_build_WIN.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
           masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")
       )
)
# Скопируем файл на хостинг
rac_gui_build_WIN.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
            util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
            util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")]
       )
)

# Тут определяем какие сборщики у нас есть
c['builders'] = [
        util.BuilderConfig(name="Rac-GUI-RPM-builder", workername='CentOS', factory=rac_gui_build_RPM),
        util.BuilderConfig(name="Rac-GUI-DEB-builder", workername='Debian-10', factory=rac_gui_build_DEB),
        util.BuilderConfig(name="Rac-GUI-WIN-builder", workername='Windows-10', factory=rac_gui_build_WIN),
]

ພວກເຮົາຈະໃຊ້ອີເມວເພື່ອແຈ້ງບອກທ່ານກ່ຽວກັບສະຖານະຂອງຂະບວນການສ້າງ.

c['services'] = []

template=u'''
    <h4>Build status: {{ summary }}</h4>
    <p> Worker used: {{ workername }}</p>
    {% for step in build['steps'] %}
    <p> {{ step['name'] }}: {{ step['result'] }}</p>
    {% endfor %}
    <p><b> -- The Buildbot</b></p>
    '''

mailNotifier = reporters.MailNotifier(fromaddr="[email protected]",
             sendToInterestedUsers=False,
             mode=('all'),
             extraRecipients=["[email protected]"],
             relayhost="mail.domain.ru",
             smtpPort=587,
             smtpUser="[email protected]",
             smtpPassword="******",
             messageFormatter=reporters.MessageFormatter(
                                 template=template, template_type='html',
                                 wantProperties=True, wantSteps=True))

c['services'].append(mailNotifier)

# Основные настройки мастера
c['title'] = "The process of bulding"
c['titleURL'] = "http://vm-srv-build1:80/"
c['buildbotURL'] = "http://vm-srv-build1/"
c['www'] = dict(port=80,
                plugins=dict(waterfall_view={}, console_view={}, grid_view={}))
c['db'] = {
       'db_url' : "sqlite:///state.sqlite"
}

ບັນທຶກໄຟລ໌ແລະທ່ານສາມາດພະຍາຍາມເລີ່ມຕົ້ນການບໍລິການຂອງຄວາມຍາວປາ:

systemctl restart buildbot-master

ໃນບັນທຶກພວກເຮົາຈະກວດເບິ່ງວ່າທຸກສິ່ງທຸກຢ່າງຢູ່ໃນຄໍາສັ່ງກັບ config ແລະທຸກສິ່ງທຸກຢ່າງເຮັດວຽກເປັນປົກກະຕິ. ດຽວນີ້ພະນັກງານຂອງພວກເຮົາທຸກຄົນຄວນເຊື່ອມຕໍ່, ເຊິ່ງຈະຖືກລາຍງານຢ່າງມີຄວາມສຸກໃນບັນທຶກ »»'/home/buildbot/master/twistd.log»»':

 2019-07-24 16:50:35+0300 [-] Loading buildbot.tac...
 2019-07-24 16:50:35+0300 [-] Loaded.
 2019-07-24 16:50:35+0300 [-] twistd 19.2.1 (/usr/bin/python3.6 3.6.8) starting up.
 2019-07-24 16:50:35+0300 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
 2019-07-24 16:50:35+0300 [-] Starting BuildMaster -- buildbot.version: 2.3.1
 2019-07-24 16:50:35+0300 [-] Loading configuration from '/home/buildbot/master/master.cfg'
 2019-07-24 16:50:36+0300 [-] /usr/local/lib/python3.6/site-packages/buildbot/config.py:90: buildbot.config.ConfigWarning: [0.9.0 and later] `buildbotNetUsageData` is not configured and defaults to basic.
        This parameter helps the buildbot development team to understand the installation base.
        No personal information is collected.
        Only installation software version info and plugin usage is sent.
        You can `opt-out` by setting this variable to None.
        Or `opt-in` for more information by setting it to "full".

 2019-07-24 16:50:36+0300 [-] Setting up database with URL 'sqlite:/state.sqlite'
 2019-07-24 16:50:36+0300 [-] setting database journal mode to 'wal'
 2019-07-24 16:50:36+0300 [-] adding 1 new services, removing 0
 2019-07-24 16:50:36+0300 [-] adding 1 new change_sources, removing 0
 2019-07-24 16:50:36+0300 [-] gitpoller: using workdir '/home/buildbot/master/gitpoller-work'
 2019-07-24 16:50:36+0300 [-] adding 3 new builders, removing 0
 2019-07-24 16:50:36+0300 [-] adding 1 new schedulers, removing 0
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'waterfall_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'console_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'grid_view'
 2019-07-24 16:50:36+0300 [-] NOTE: www plugin 'sitenav' is installed but not configured
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'waterfall_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'console_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'grid_view'
 2019-07-24 16:50:36+0300 [-] NOTE: www plugin 'sitenav' is installed but not configured
 2019-07-24 16:50:36+0300 [-] BuildbotSite starting on 80
 2019-07-24 16:50:36+0300 [-] Starting factory <buildbot.www.service.BuildbotSite object at 0x7fe31c2657b8>
 2019-07-24 16:50:36+0300 [-] adding 3 new workers, removing 0
 2019-07-24 16:50:36+0300 [-] PBServerFactory starting on 4000
 2019-07-24 16:50:36+0300 [-] Starting factory <twisted.spread.pb.PBServerFactory object at 0x7fe31c147470>
 2019-07-24 16:50:37+0300 [-] BuildMaster is running
 2019-07-24 16:50:37+0300 [-] buildbotNetUsageData: sending {'installid': 'b6193b126b96689351d2fe95787c5a03fc0879f9', 'versions': {'Python': '3.6.8', 'Buildbot': '2.3.1', 'Twisted': '19.2.1'}, 'platform': {'platform': 'Linux-4.15.18-10- pve-x86_64-with-centos-7.6.1810-Core', 'system': 'Linux', 'machine': 'x86_64', 'processor': 'x86_64', 'python_implementation': 'CPython', 'version': '#1 SMP PVE 4.15.18-32', 'distro': 'centos:7'}, 'plugins': {'buildbot/worker/base/Worker': 3, 'buildbot/config/BuilderConfig': 3, 'buildbot/schedulers/basic/SingleBranchScheduler': 1, 'buildbot/reporters/mail/MailNotifier': 1, 'buildbot/changes/gitpoller/GitPoller': 1, 'buildbot/steps/worker/MakeDirectory': 1, 'buildbot/steps/source/git/Git': 3, 'buildbot/steps/shell/ShellCommand': 9, 'buildbot/steps/package/rpm/rpmbuild/RpmBuild': 1}, 'db': 'sqlite', 'mq': 'simple', 'www_plugins': ['waterfall_view', 'console_view', 'grid_view']}
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] worker 'CentOS' attaching from IPv4Address(type='TCP', host='127.0.0.1', port=37332)
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] Got workerinfo from 'CentOS'
 2019-07-24 16:50:37+0300 [-] bot attached
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] Worker CentOS attached to Rac-GUI-RPM-builder
 2019-07-24 16:50:37+0300 [-] buildbotNetUsageData: buildbot.net said: ok
 2019-07-24 16:50:39+0300 [Broker,1,192.168.55.15] worker 'Windows-10' attaching from IPv4Address(type='TCP', host='192.168.5.145', port=49831)
 2019-07-24 16:50:39+0300 [Broker,1,192.168.55.15] Got workerinfo from 'Windows-10'
 2019-07-24 16:50:40+0300 [-] bot attached
 2019-07-24 16:50:40+0300 [Broker,1,192.168.55.15] Worker Windows-10 attached to Rac-GUI-WIN-builder
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] worker 'Debian-10' attaching from IPv4Address(type='TCP', host='192.168.5.9', port=44430)
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] Got workerinfo from 'Debian-10'
 2019-07-24 16:50:41+0300 [-] bot attached
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] Worker Debian-10 attached to Rac-GUI-DEB-builder

ນີ້ເຮັດສໍາເລັດຂະບວນການຕິດຕັ້ງ. ທ່ານສາມາດເບິ່ງສະຖານະປະຈຸບັນໄດ້ໂດຍຜ່ານການໂຕ້ຕອບເວັບໄຊຕ໌. ບ່ອນ​ທີ່​ທ່ານ​ຍັງ​ສາ​ມາດ​ເບິ່ງ​ຄວາມ​ຜິດ​ພາດ​ການ​ກໍ່​ສ້າງ​, ເຕະ​ຂະ​ບວນ​ການ frozen ຖ້າ​ຫາກ​ວ່າ​ບາງ​ສິ່ງ​ບາງ​ຢ່າງ​ຜິດ​ພາດ​, ແລະ​ອື່ນໆ​.

ທັນທີຫຼັງຈາກການເປີດຕົວ, ຄົນງານຫນັກຂອງພວກເຮົາສາມາດເບິ່ງໄດ້ຜ່ານເມນູ "ສ້າງ" -> "ຄົນງານ"

ຫຼັງຈາກຂະບວນການສ້າງທໍາອິດສໍາເລັດ (i. e. ການປ່ຽນແປງກັບ Git repository), ສະຖານະພາບຂອງຂະບວນການຈະປາກົດຢູ່ໃນຫນ້າທໍາອິດ.

ຖ້າທ່ານຄລິກໃສ່ເສັ້ນທີ່ຕ້ອງການດ້ວຍຫນູ, ຫນ້າໃດຫນຶ່ງຈະເປີດດ້ວຍສະຖານະປະຈຸບັນຂອງຂະບວນການນີ້, ບ່ອນທີ່ທ່ານສາມາດເບິ່ງສິ່ງທີ່ເກີດຂຶ້ນ, ຂໍ້ຜິດພາດຫຍັງ, ແລະອື່ນໆ.

ການຕັ້ງຄ່າຕົວຊ່ວຍສ້າງທັງໝົດສາມາດພົບໄດ້ທີ່ນີ້

import os, re
from buildbot.plugins import steps, util, schedulers, worker, changes, reporters
c= BuildmasterConfig ={}
c['workers'] = [ worker.Worker('CentOS', '123456'), worker.Worker('Debian-10', '123456'), worker.Worker('Windows-10', '123456')]
c['protocols'] = {'pb': {'port': 4000}} 
c['change_source'] = []
c['change_source'].append(changes.GitPoller(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
project = 'Rac-GUI',
branches = True,
pollInterval = 600
))
# служба запуска сборки
c['schedulers'] = []
c['schedulers'].append(schedulers.SingleBranchScheduler(
name="Rac-GUI-schedulers",
change_filter=util.ChangeFilter(branch='master'),
builderNames=["Rac-GUI-RPM-builder", "Rac-GUI-DEB-builder", "Rac-GUI-WIN-builder"],
properties = {'owner': 'admin'}
))
@util.renderer
def get_name_version_release(props):
prog_name = "rac-gui"
prog_version = "1.0.3"
prog_release = "3"
return {
"prog_name": prog_name
#"prog_version": prog_version,
#"prog_release": prog_release
}
rac_gui_build_RPM = util.BuildFactory()
rac_gui_build_RPM.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
workdir = 'rac-gui',
haltOnFailure = True,
submodules = True,
mode='full',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_RPM.addStep(
steps.SetPropertyFromCommand(
command="grep version ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_RPM.addStep(
steps.SetPropertyFromCommand(
command="grep release ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
)
)
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["tar", "czf", util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"), "../rac-gui"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["cp", "../rac-gui/rac_gui.spec", "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["sed", "-i", util.Interpolate("s/.*Version:.*/Version:t%(prop:version)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["sed", "-i", util.Interpolate("s/.*Release:.*/Release:t%(prop:release)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.RpmBuild(
specfile="/home/buildbot/rpmbuild/SPECS/rac_gui.spec",
dist='.el5',
topdir='/home/buildbot/rpmbuild',
builddir='/home/buildbot/rpmbuild/build',
rpmdir='/home/buildbot/rpmbuild/RPMS',
sourcedir='/home/buildbot/rpmbuild/SOURCES'
))
# Скопируем файл на мастер
rac_gui_build_RPM.addStep(
steps.FileUpload(
workersrc=util.Interpolate("/home/buildbot/rpmbuild/RPMS/noarch/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")
)
)
rac_gui_build_RPM.addStep(
steps.FileUpload(
workersrc=util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")
)
)
rac_gui_build_RPM.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")]
)
)
rac_gui_build_RPM.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")]
)
)
####################################
##      DEB 
####################################
rac_gui_build_DEB = util.BuildFactory()
rac_gui_build_DEB.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
haltOnFailure = True,
submodules = True,
mode='full',
workdir='build',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_DEB.addStep(
steps.SetPropertyFromCommand(
command="grep version rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_DEB.addStep(
steps.SetPropertyFromCommand(
command="grep release rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
)
)
# Переименуем запускаемый файл
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["mv", "rac_gui.tcl", "racgui"]))
# Поменяем пути к библиотекам
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["sed", "-i", "s+^set dir(lib)+set dir(lib) /usr/share/rac-gui/lib ;#+g", "racgui"]))
# Поменяем пути к файлам
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["sed", "-i", "s+[pwd]+/usr/share/rac-gui+g", "racgui"]))
# заархивируем исходники
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["tar", "czf", util.Interpolate("../rac-gui_%(prop:version)s.orig.tar.gz"), "."]))
# Соберём пакет
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["dpkg-buildpackage"]))
# Скопируем файл на мастер
rac_gui_build_DEB.addStep(
steps.FileUpload(
workersrc=util.Interpolate("../rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")
)
)
rac_gui_build_DEB.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")]
)
)
############################################
#       WIN
############################################
rac_gui_build_WIN = util.BuildFactory()
rac_gui_build_WIN.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
haltOnFailure = True,
submodules = True,
mode='full',
workdir='build',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_WIN.addStep(
steps.SetPropertyFromCommand(
command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'version:') -split 's')[2]",
property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_WIN.addStep(
steps.SetPropertyFromCommand(
command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'release:') -split 's')[2]",
property="release"
)
)
# Создадим запускаемый файл
rac_gui_build_WIN.addStep(steps.ShellCommand(
command=["c:binfreewrap.exe", "rac_gui.tcl"]))
# запакуем то, что получилось
rac_gui_build_WIN.addStep(steps.ShellCommand(
command=["c:Program Files7-zip7z.exe", "a", "-r", util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"), "..build"]))
# скопируем на мастер
rac_gui_build_WIN.addStep(
steps.FileUpload(
workersrc=util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")
)
)
# Скопируем файл на хостинг
rac_gui_build_WIN.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")]
)
)
c['builders'] = [
util.BuilderConfig(name="Rac-GUI-RPM-builder", workername='CentOS', factory=rac_gui_build_RPM),
util.BuilderConfig(name="Rac-GUI-DEB-builder", workername='Debian-10', factory=rac_gui_build_DEB),
util.BuilderConfig(name="Rac-GUI-WIN-builder", workername='Windows-10', factory=rac_gui_build_WIN),
]
c['services'] = []
template=u'''
<h4>Build status: {{ summary }}</h4>
<p> Worker used: {{ workername }}</p>
{% for step in build['steps'] %}
<p> {{ step['name'] }}: {{ step['result'] }}</p>
{% endfor %}
<p><b> -- The Buildbot</b></p>
'''
mailNotifier = reporters.MailNotifier(fromaddr="[email protected]",
sendToInterestedUsers=False,
mode=('all'),
extraRecipients=["[email protected]"],
relayhost="mail.domain.local",
smtpPort=587,
smtpUser="[email protected]",
smtpPassword="**********",
messageFormatter=reporters.MessageFormatter(
template=template, template_type='html',
wantProperties=True, wantSteps=True))
c['services'].append(mailNotifier)
c['title'] = "The process of bulding"
c['titleURL'] = "http://vm-srv-build1:80/"
c['buildbotURL'] = "http://vm-srv-build1/"
c['www'] = dict(port=80,
plugins=dict(waterfall_view={}, console_view={}, grid_view={}))
c['db'] = {
'db_url' : "sqlite:///state.sqlite"
}

ເຄື່ອງແຕ່ງກາຍ

ອຸປະກອນຕໍ່ໄປນີ້ໄດ້ຖືກນໍາໃຊ້ໃນການກະກຽມບົດຄວາມ:

• ຕົວຢ່າງຂອງການປະຕິບັດການເຊື່ອມໂຍງຢ່າງຕໍ່ເນື່ອງໂດຍໃຊ້ BuildBot
• Buildbot: ນິທານທີ່ມີຕົວຢ່າງກ່ຽວກັບລະບົບການເຊື່ອມໂຍງຢ່າງຕໍ່ເນື່ອງອື່ນ
• ການຕັ້ງຄ່າການເຊື່ອມໂຍງຢ່າງຕໍ່ເນື່ອງໃນ Buildbot ໃນ Ubuntu 16.04
• ດີ, ເອກະສານຜະລິດຕະພັນ Buildbot Tutorial

ແຫຼ່ງຂໍ້ມູນ: www.habr.com