በምሳሌዎች ውስጥ Buildbot

የሶፍትዌር ፓኬጆችን ከጂት ማከማቻ ወደ ጣቢያው የመገንባት እና የማድረስ ሂደቱን ማዋቀር ነበረብኝ። እና ብዙም ሳይቆይ፣ እዚህ ሃበሬ ላይ በ buildbot (በመጨረሻ ማገናኛ) ላይ አንድ መጣጥፍ ባየሁ ጊዜ ልሞክረው እና ለዚህ ልጠቀምበት ወሰንኩ።

Buildbot የተከፋፈለ ስርዓት ስለሆነ ለእያንዳንዱ አርክቴክቸር እና ኦፕሬቲንግ ሲስተም የተለየ የግንባታ አስተናጋጅ ማድረግ ምክንያታዊ ይሆናል። በእኛ ሁኔታ፣ እነዚህ የኤልኤክስሲ ኮንቴይነሮች (በሊኑክስ ሁኔታ) እና qemu (በመስኮቶች ሁኔታ) ይሆናሉ።

• vm-srv-build1 - ሴንቶስ 7፣ የBuildbot ማስተር (ማስተር) እና ከሠራተኞቹ አንዱ (ሠራተኛ) ይኖራል።
• vm-srv-build2 - ዴቢያን 10፣ የDEB ፓኬጆችን ለመገንባት
• vm-srv-build3 - ዊንዶውስ 10, ለስብሰባ, እርስዎ እራስዎ ምን እንደሆነ ይገባዎታል

እንሰበስባለን ራክ GUI - የአገልጋዮችን ዘለላ ለማስተዳደር ግራፊክ ፊት ወደ 1ሲ ውድድር። በሊኑክስ ስር ለእያንዳንዱ የስርዓተ ክወና መደበኛ መሳሪያዎች ጥቅም ላይ ይውላሉ፣ የ exe ፋይልን ከ tcl ስክሪፕት ስር በዊንዶውስ ለመስራት ይጠቀሙ። ነፃ ጥቅል.

ቅንብር

ጂኤንዩ / ሊኑክስ

ለመጫን, በአውታረ መረቡ ላይ በቂ ሰነዶች አሉ 1,2. አዎ, እና ምንም ልዩ ችግር አያስከትልም:
ለመምህር፡

pip3 install buildbot
pip3 install twisted
pip3 install autobahn
pip3 install pysqlite3
pip3 install sqlalchemy sqlalchemy-migrate
pip3 install buildbot-www buildbot-grid-view buildbot-console-view buildbot-waterfall-view
pip3 install python-dateutil

ለ "ሰራተኞች" ይህ በቂ ነው:

pip3 install buildbot-worker

በእርግጥ ለእያንዳንዱ ስርዓተ ክወና ፓኬጆችን መገንባት የበለጠ ትክክል ይሆናል ፣ ግን ይህ በአንቀጹ ወሰን ውስጥ አይደለም። ኮንቴይነሮችን ለስራ የማዘጋጀት መግለጫን እናስወግዳለን, እኔ ProxMox VE መጠቀሜን ብቻ እናስተውላለን. እና ለግንባታ ለሚፈለገው ለእያንዳንዱ ዘንግ (ሴንቶስ፡ rpmdevtools፣ ወዘተ፣ ዲቢያን፡ ግንባታ-አስፈላጊ፣ dh-make፣ pbuilder፣ ወዘተ) ጥቅሎችን መጫን ያስፈልግዎታል።

የፕሮጀክት ግንባታዎች እና የBuildbot አገልግሎቶች እንደ ልዩ ተጠቃሚነት ይሰራሉ፣ ስለዚህ በሂደቱ ውስጥ በተሳተፉ ሁሉም አስተናጋጆች ላይ መፍጠር አለብዎት።

adduser buildbot

በመቀጠል በእያንዳንዱ አስተናጋጆች (ኮንቴይነሮች) ላይ የአገልግሎቶች አውቶማቲክ ጅምርን እናዋቅራለን፡-

ጠንቋዩን ለመጀመር systemd unit:

touch /etc/systemd/buildbot-master.service 

[Unit]
Description=BuildBot master service
After=network.target

[Service]
User=buildbot
Group=buildbot
WorkingDirectory=/home/buildbot/master
ExecStart=/usr/local/bin/buildbot start --nodaemon
ExecReload=/bin/kill -HUP $MAINPID

[Install]
WantedBy=multi-user.target

እና "ሰራተኛ"

touch /etc/systemd/buildbot-worker.service 

[Unit]
Description=BuildBot worker service
After=network.target

[Service]master
User=buildbot
Group=buildbot
WorkingDirectory=/home/buildbot/worker
ExecStart=/usr/local/bin/buildbot-worker start --nodaemon

[Install]
WantedBy=buildbot-master.service

ሁሉም ስክሪፕቶች (በእኛ ሁኔታ) በ/usr/local/ ውስጥ ስለሆኑ በአካባቢ ተለዋዋጮች ውስጥ ለእነሱ መንገዱን ማዘጋጀት አለብዎት።

nano /root/.bash_profile

PATH=$PATH:$HOME/.local/bin:$HOME/bin:/usr/local/bin

ከዚያ በኋላ ለ "ሰራተኞች" ማውጫ መሠረተ ልማት መፍጠር ይችላሉ (በሁሉም አስተናጋጆች ላይ) ፣ ለዚህም በ buildbot ተጠቃሚ ስር መመዝገብ እና የሚከተሉትን ትዕዛዞችን ያስፈጽማሉ።

በመጀመሪያው አስተናጋጅ vm-srv-build1 ላይ፡-

su - buildbot
mkdir /home/buildbot/worker
cd ~
buildbot-worker create-worker --umask=0o22 --keepalive=60 worker vm-srv-build1:4000 CentOS 123456

በሁለተኛው አስተናጋጅ vm-srv-build2 ላይ፡-

su - buildbot
mkdir /home/buildbot/worker
cd ~
buildbot-worker create-worker --umask=0o22 --keepalive=60 worker vm-srv-build1:4000 Debian-10 123456

በሠራተኛ አስተናጋጆች ላይ የBuildbot-ሠራተኛ አገልግሎት መጀመር ይቻላል

systemctl start buildbot-worker

ኤምኤስ ዊንዶውስ

በመስኮቶች ስር ለመገንባት እንደ "ሰራተኛ" ፣ የቅርብ ጊዜ የዊን10 ልቀት ያለው ምናባዊ ማሽን ጥቅም ላይ ይውላል።
ለስራ የሚከተሉትን ያስፈልግዎታል

• ዘንዶ
• ፒዊን
• Git
• ሁሉንም አይነት ነገሮች በpython ውስጥ ለመጫን ማውረድ ያስፈልግዎታል ለእይታ ስቱዲዮ 2019 መሣሪያዎችን ይገንቡ
• 7Zip

ከላይ ያሉት ሁሉም ከተጫነ በኋላ, buildbot እራሱን መጫን ይችላሉ:

pip install buildbot-worker

የስራ ማውጫ ይፍጠሩ

md c:worker

እና እንሩጥ

buildbot-worker start c:worker

ሁሉም ነገር የሚሰራ ከሆነ (የ c: workertwistd.log ሎግ ይመልከቱ)፣ ከዚያም የእኛን "ሰራተኛ" እንደ አገልግሎት በመመዝገብ ከስራ ማውጫው ጋር አንድ ንጥል በመዝገቡ ላይ መመዝገብ ይችላሉ (ትእዛዞች የሚፈጸሙት በpowershell እንደ አስተዳዳሪ ሆኖ ነው)

buildbot_worker_windows_service.exe --user VM-SRV-BUILD3buildbot --password 123456 --startup auto install
New-ItemProperty -path Registry::HKEY_LOCAL_MACHINESYSTEMCurrentControlSetservicesBuildBotParameters -Name directories -PropertyType String -Value c:worker

እና አገልግሎቱን መጀመር ይችላሉ

Start-Service buildbot

በ "ሰራተኞች" ያ ብቻ ነው, እነሱን የበለጠ መንካት አይችሉም, ሁሉም ቁጥጥር የሚመጣው ከጌታው ነው.

ጠንቋይ ማዋቀር

ለመጀመር ፣ ለጌታው መሠረተ ልማት እንፍጠር (በዋናው አስተናጋጅ ላይ) ፣ ለዚህም በBuildbot ተጠቃሚ ስር ተመዝግበን የሚከተሉትን ትዕዛዞችን እንፈጽማለን ።

su - buildbot
mkdir /home/buildbot/master
cd ~
buildbot create-master master

ለተዘጋጁ ጥቅሎች የግንባታ ማውጫ ይፍጠሩ

mkdir /home/buildbot/builds

master.cfg ፋይል በ /home/buildbot/master/ directory ውስጥ ተፈጥሯል። ይህ ፋይል የፓይቶን ኮድ ነው እና የስርዓቱን ሁሉንም ስልቶች መግለጫ ይይዛል እና ለወደፊቱ ከእሱ ጋር እንሰራለን።

nano /home/buildbot/master/master.cfg

import os, re
from buildbot.plugins import steps, util, schedulers, worker, changes, reporters

c= BuildmasterConfig ={}

# Описание наших рабочих.
c['workers'] = [ worker.Worker('CentOS', '123456'), worker.Worker('Debian-10', '123456'), worker.Worker('Windows-10', '123456')]
c['protocols'] = {'pb': {'port': 4000}} 

# Указание мастеру какой репозиторий отслеживать
c['change_source'] = []
c['change_source'].append(changes.GitPoller(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       project = 'Rac-GUI',
       branches = True,
       pollInterval = 60
      )
)

# служба запуска сборки
c['schedulers'] = []
c['schedulers'].append(schedulers.SingleBranchScheduler(
       name="Rac-GUI-schedulers",
       change_filter=util.ChangeFilter(branch='master'),
       builderNames=["Rac-GUI-RPM-builder", "Rac-GUI-DEB-builder", "Rac-GUI-WIN-builder"],
       properties = {'owner': 'admin'}
       )
)
@util.renderer

######################################3
# Сборка RPM-пакета
 rac_gui_build_RPM = util.BuildFactory()

rac_gui_build_RPM.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       workdir = 'rac-gui',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       progress = True)
)

ወደ master.cfg ፋይል ኮድ መውጣት እንዳይኖርባቸው የተለያዩ ስሪቶች ፓኬጆችን በራስ-ሰር ለማገናኘት ፣ በርዕሱ ውስጥ ባለው የ rac_gui.tcl ፕሮግራም ዋና ስክሪፕት ውስጥ ፣ የአሁኑ ስሪት እና ልቀት ያላቸው መስመሮች ተደርገዋል ። ታክሏል፡

######################################################
#        Rac GUI
...
# version: 1.0.3
# release: 1

እና በእነዚህ መስመሮች ላይ በመመስረት, buildbot እሽጎችን ይቆጥራል. ውሂቡን ለማውጣት፣ ወደ ኮንሶል grep ጥሪ ጥቅም ላይ ይውላል። በ buildbot ውስጥ ፣ ለ “ሠራተኞች” ተለዋዋጮችን ብቻ መግለፅ አይችሉም (በማንኛውም ሁኔታ ፣ እንዴት እንደሆነ አላገኘሁም)። ንብረቶች ለዚህ ነው. እነዚያ። በግንባታው ሂደት ውስጥ ስሪቱን ለመወሰን እና ለመልቀቅ ደረጃዎቹን ይጨምሩ እና በዚህ መሠረት የስሪት እና የመልቀቂያ ባህሪያትን ያዘጋጁ። ንብረቶች በተለያዩ መንገዶች ሊዘጋጁ ይችላሉ, በዚህ አጋጣሚ ወደ ኮንሶል ትዕዛዝ ጥሪ ነው.

# Добавим определение версии из основного файла
rac_gui_build_RPM.addStep(
       steps.SetPropertyFromCommand(
       command="grep version ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
       )
)
# Добавим определение релиза из основного файла
rac_gui_build_RPM.addStep(
       steps.SetPropertyFromCommand(
       command="grep release ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
       )
)

ወደ util.Interpolate() በመደወል የተቀበሉትን እሴቶች መተካት ይችላሉ።

# Запакуем исходники
rac_gui_build_RPM.addStep(
       steps.ShellCommand(
          command=["tar", "czf", util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"), "../rac-gui"]
       )
)

እዚህ ላይ ልብ ሊባል የሚገባው, አስተናጋጁ እሽጎችን በእጅ ለመገጣጠም ጥቅም ላይ ስለሚውል, ስብሰባው በመደበኛ መንገዶች ላይ ይከናወናል.

# Копируем spec
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["cp", "../rac-gui/rac_gui.spec", "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))

ትክክለኛውን የመልቀቂያ እና የስሪት ቁጥሮችን ለማዘጋጀት, መደበኛ የ sed ጥሪ ጥቅም ላይ ይውላል, ማለትም. ትዕዛዙ በፋይሉ ውስጥ ያሉትን እሴቶች በአስፈላጊዎቹ ይተካል።

# меняем версию
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["sed", "-i", util.Interpolate("s/.*Version:.*/Version:t%(prop:version)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
# меняем релиз
rac_gui_build_RPM.addStep(steps.ShellCommand(
       command=["sed", "-i", util.Interpolate("s/.*Release:.*/Release:t%(prop:release)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))

# запускаем процесс сборки
rac_gui_build_RPM.addStep(steps.RpmBuild(
       specfile="/home/buildbot/rpmbuild/SPECS/rac_gui.spec",
       dist='.el5',
       topdir='/home/buildbot/rpmbuild',
       builddir='/home/buildbot/rpmbuild/build',
       rpmdir='/home/buildbot/rpmbuild/RPMS',
       sourcedir='/home/buildbot/rpmbuild/SOURCES'
      )
)

የተጠናቀቀውን ጥቅል እና ማህደሩን ከምንጭ ኮዶች ጋር ወደ ጌታው እንገለበጣለን። ነገር ግን ወዲያውኑ ፋይሎችን ከስራው ወደ ማከማቻዎ ወይም ወደ ጣቢያው መቅዳት ይችላሉ.

# Скопируем файл на мастер
rac_gui_build_RPM.addStep(
       steps.FileUpload(
          workersrc=util.Interpolate("/home/buildbot/rpmbuild/RPMS/noarch/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
          masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")
      )
)

rac_gui_build_RPM.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
          masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")
       )
)

የተሰበሰቡትን ፓኬጆች በመቅዳት በዋናው ላይ በኤፍቲፒ በኩል ወደ ማስተናገጃ ሂደት እንጀምር። ለዚህም, ጥቅም ላይ ይውላል ስክሪፕት በ tcl.

rac_gui_build_RPM.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
                util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
                util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")]
        )
)

rac_gui_build_RPM.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
                util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
                util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")]
        )
)

ይህ የ RPM መጨረሻ ነው። አሁን የDEB ጥቅልን ለመገንባት አልጎሪዝምን መግለጽ እንጀምር። ለተለያዩ ስርዓቶች ፓኬጆችን የመገንባት ሂደቶች አንዳቸው ከሌላው ነፃ ስለሆኑ ብዙ እርምጃዎች ይደጋገማሉ።

rac_gui_build_DEB = util.BuildFactory()

rac_gui_build_DEB.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       workdir='build',
       progress = True)
)

# Добавим определение версии из основного файла
rac_gui_build_DEB.addStep(
       steps.SetPropertyFromCommand(
       command="grep version rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
       )
)

# Добавим определение релиза из основного файла
rac_gui_build_DEB.addStep(
       steps.SetPropertyFromCommand(
       command="grep release rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
       )
)

# Переименуем запускаемый файл
    rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["mv", "rac_gui.tcl", "racgui"]))

ለ RPM ጥቅል፣ ከሚከተሉት ሂደቶች ውስጥ አንዳንዶቹ በሚገነቡበት ጊዜ በራሱ rpm ይከናወናሉ እና በዝርዝሩ ውስጥ ይገለፃሉ፣ ለዴቢያን እዚህ ማድረግ አለብዎት።

# Поменяем пути к библиотекам
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["sed", "-i", "s+^set dir(lib)+set dir(lib) /usr/share/rac-gui/lib ;#+g", "racgui"]))

# Поменяем пути к файлам
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["sed", "-i", "s+[pwd]+/usr/share/rac-gui+g", "racgui"]))

# заархивируем исходники
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["tar", "czf", util.Interpolate("../rac-gui_%(prop:version)s.orig.tar.gz"), "."]))

# Соберём пакет
rac_gui_build_DEB.addStep(steps.ShellCommand(
       command=["dpkg-buildpackage"]))

# Скопируем файл на мастер
rac_gui_build_DEB.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("../rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
           masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")
       )
)
rac_gui_build_DEB.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
             util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
             util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")]
        )
)

እና DEB አብቅቷል፣ አሁን መስኮቶች!

rac_gui_build_WIN = util.BuildFactory()

rac_gui_build_WIN.addStep(steps.Git(
       repourl = 'https://bitbucket.org/svk28/rac-gui.git',
       haltOnFailure = True,
       submodules = True,
       mode='full',
       workdir='build',
       progress = True)
)

በመስኮቶች ውስጥ ግሬፕ እና ሴድ (ወይንም አለ?) ስለሌለ የኃይል ሼልን እንጠቀማለን።

# Добавим определение версии из основного файла
rac_gui_build_WIN.addStep(
       steps.SetPropertyFromCommand(
       command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'version:') -split 's')[2]",
       property="version"
       )
    )

# Добавим определение релиза из основного файла
rac_gui_build_WIN.addStep(
       steps.SetPropertyFromCommand(
       command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'release:') -split 's')[2]",
       property="release"
       )
)

# Создадим запускаемый файл
rac_gui_build_WIN.addStep(steps.ShellCommand(
       command=["c:binfreewrap.exe", "rac_gui.tcl"]))

# запакуем то, что получилось
rac_gui_build_WIN.addStep(steps.ShellCommand(
       command=["c:Program Files7-zip7z.exe", "a", "-r", util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"), "..build"]))

# скопируем на мастер
rac_gui_build_WIN.addStep(
       steps.FileUpload(
       workersrc=util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
           masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")
       )
)
# Скопируем файл на хостинг
rac_gui_build_WIN.addStep(
        steps.MasterShellCommand(
            command=["/usr/local/bin/deploy-ftp.tcl",
            util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
            util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")]
       )
)

# Тут определяем какие сборщики у нас есть
c['builders'] = [
        util.BuilderConfig(name="Rac-GUI-RPM-builder", workername='CentOS', factory=rac_gui_build_RPM),
        util.BuilderConfig(name="Rac-GUI-DEB-builder", workername='Debian-10', factory=rac_gui_build_DEB),
        util.BuilderConfig(name="Rac-GUI-WIN-builder", workername='Windows-10', factory=rac_gui_build_WIN),
]

የግንባታ ሂደቱን ያለበትን ሁኔታ ለማሳወቅ ኢሜል እንጠቀማለን።

c['services'] = []

template=u'''
    <h4>Build status: {{ summary }}</h4>
    <p> Worker used: {{ workername }}</p>
    {% for step in build['steps'] %}
    <p> {{ step['name'] }}: {{ step['result'] }}</p>
    {% endfor %}
    <p><b> -- The Buildbot</b></p>
    '''

mailNotifier = reporters.MailNotifier(fromaddr="[email protected]",
             sendToInterestedUsers=False,
             mode=('all'),
             extraRecipients=["[email protected]"],
             relayhost="mail.domain.ru",
             smtpPort=587,
             smtpUser="[email protected]",
             smtpPassword="******",
             messageFormatter=reporters.MessageFormatter(
                                 template=template, template_type='html',
                                 wantProperties=True, wantSteps=True))

c['services'].append(mailNotifier)

# Основные настройки мастера
c['title'] = "The process of bulding"
c['titleURL'] = "http://vm-srv-build1:80/"
c['buildbotURL'] = "http://vm-srv-build1/"
c['www'] = dict(port=80,
                plugins=dict(waterfall_view={}, console_view={}, grid_view={}))
c['db'] = {
       'db_url' : "sqlite:///state.sqlite"
}

ፋይሉን እናስቀምጠዋለን እና የአዋቂ አገልግሎቱን ለመጀመር መሞከር ይችላሉ-

systemctl restart buildbot-master

በምዝግብ ማስታወሻው ውስጥ ሁሉም ነገር በቅንጅቱ እንደተስተካከለ እና ሁሉም ነገር በመደበኛነት እየሰራ መሆኑን እናረጋግጣለን። ሁሉም ሰራተኞቻችን አሁን መገናኘት አለባቸው፣ ይህም በ »»'/home/buildbot/master/twistd.log»» ምዝግብ ማስታወሻ ውስጥ በደስታ ሪፖርት ይደረጋል፡

 2019-07-24 16:50:35+0300 [-] Loading buildbot.tac...
 2019-07-24 16:50:35+0300 [-] Loaded.
 2019-07-24 16:50:35+0300 [-] twistd 19.2.1 (/usr/bin/python3.6 3.6.8) starting up.
 2019-07-24 16:50:35+0300 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
 2019-07-24 16:50:35+0300 [-] Starting BuildMaster -- buildbot.version: 2.3.1
 2019-07-24 16:50:35+0300 [-] Loading configuration from '/home/buildbot/master/master.cfg'
 2019-07-24 16:50:36+0300 [-] /usr/local/lib/python3.6/site-packages/buildbot/config.py:90: buildbot.config.ConfigWarning: [0.9.0 and later] `buildbotNetUsageData` is not configured and defaults to basic.
        This parameter helps the buildbot development team to understand the installation base.
        No personal information is collected.
        Only installation software version info and plugin usage is sent.
        You can `opt-out` by setting this variable to None.
        Or `opt-in` for more information by setting it to "full".

 2019-07-24 16:50:36+0300 [-] Setting up database with URL 'sqlite:/state.sqlite'
 2019-07-24 16:50:36+0300 [-] setting database journal mode to 'wal'
 2019-07-24 16:50:36+0300 [-] adding 1 new services, removing 0
 2019-07-24 16:50:36+0300 [-] adding 1 new change_sources, removing 0
 2019-07-24 16:50:36+0300 [-] gitpoller: using workdir '/home/buildbot/master/gitpoller-work'
 2019-07-24 16:50:36+0300 [-] adding 3 new builders, removing 0
 2019-07-24 16:50:36+0300 [-] adding 1 new schedulers, removing 0
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'waterfall_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'console_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'grid_view'
 2019-07-24 16:50:36+0300 [-] NOTE: www plugin 'sitenav' is installed but not configured
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'waterfall_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'console_view'
 2019-07-24 16:50:36+0300 [-] initializing www plugin 'grid_view'
 2019-07-24 16:50:36+0300 [-] NOTE: www plugin 'sitenav' is installed but not configured
 2019-07-24 16:50:36+0300 [-] BuildbotSite starting on 80
 2019-07-24 16:50:36+0300 [-] Starting factory <buildbot.www.service.BuildbotSite object at 0x7fe31c2657b8>
 2019-07-24 16:50:36+0300 [-] adding 3 new workers, removing 0
 2019-07-24 16:50:36+0300 [-] PBServerFactory starting on 4000
 2019-07-24 16:50:36+0300 [-] Starting factory <twisted.spread.pb.PBServerFactory object at 0x7fe31c147470>
 2019-07-24 16:50:37+0300 [-] BuildMaster is running
 2019-07-24 16:50:37+0300 [-] buildbotNetUsageData: sending {'installid': 'b6193b126b96689351d2fe95787c5a03fc0879f9', 'versions': {'Python': '3.6.8', 'Buildbot': '2.3.1', 'Twisted': '19.2.1'}, 'platform': {'platform': 'Linux-4.15.18-10- pve-x86_64-with-centos-7.6.1810-Core', 'system': 'Linux', 'machine': 'x86_64', 'processor': 'x86_64', 'python_implementation': 'CPython', 'version': '#1 SMP PVE 4.15.18-32', 'distro': 'centos:7'}, 'plugins': {'buildbot/worker/base/Worker': 3, 'buildbot/config/BuilderConfig': 3, 'buildbot/schedulers/basic/SingleBranchScheduler': 1, 'buildbot/reporters/mail/MailNotifier': 1, 'buildbot/changes/gitpoller/GitPoller': 1, 'buildbot/steps/worker/MakeDirectory': 1, 'buildbot/steps/source/git/Git': 3, 'buildbot/steps/shell/ShellCommand': 9, 'buildbot/steps/package/rpm/rpmbuild/RpmBuild': 1}, 'db': 'sqlite', 'mq': 'simple', 'www_plugins': ['waterfall_view', 'console_view', 'grid_view']}
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] worker 'CentOS' attaching from IPv4Address(type='TCP', host='127.0.0.1', port=37332)
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] Got workerinfo from 'CentOS'
 2019-07-24 16:50:37+0300 [-] bot attached
 2019-07-24 16:50:37+0300 [Broker,0,127.0.0.1] Worker CentOS attached to Rac-GUI-RPM-builder
 2019-07-24 16:50:37+0300 [-] buildbotNetUsageData: buildbot.net said: ok
 2019-07-24 16:50:39+0300 [Broker,1,192.168.55.15] worker 'Windows-10' attaching from IPv4Address(type='TCP', host='192.168.5.145', port=49831)
 2019-07-24 16:50:39+0300 [Broker,1,192.168.55.15] Got workerinfo from 'Windows-10'
 2019-07-24 16:50:40+0300 [-] bot attached
 2019-07-24 16:50:40+0300 [Broker,1,192.168.55.15] Worker Windows-10 attached to Rac-GUI-WIN-builder
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] worker 'Debian-10' attaching from IPv4Address(type='TCP', host='192.168.5.9', port=44430)
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] Got workerinfo from 'Debian-10'
 2019-07-24 16:50:41+0300 [-] bot attached
 2019-07-24 16:50:41+0300 [Broker,2,192.168.55.99] Worker Debian-10 attached to Rac-GUI-DEB-builder

ይህ የማዋቀር ሂደቱን ያጠናቅቃል. አሁን ያለውን ሁኔታ በድር ሞርዴ በኩል ማየት ይችላሉ። እንዲሁም የግንባታ ስህተቶችን ማየት የሚችሉበት፣ የሆነ ችግር ከተፈጠረ የቀዘቀዘ ሂደትን ያስጀምሩ፣ ወዘተ.

ታታሪ ሰራተኞቻችን ከጀመሩ በኋላ ወዲያውኑ በምናሌው ውስጥ ማየት ይችላሉ "ይገነባል" -> "ሰራተኞች"

የመጀመሪያው የግንባታ ሂደት ከተጠናቀቀ በኋላ (ማለትም በ Git ማከማቻ ውስጥ ለውጦች), የሂደቶቹ ሁኔታ በመጀመሪያው ገጽ ላይ ይታያል.

የተፈለገውን መስመር በመዳፊት ጠቅ ካደረጉ, በዚህ ሂደት ወቅታዊ ሁኔታ ላይ አንድ ገጽ ይከፈታል, ምን እየተፈጠረ እንዳለ, ምን ስህተቶች, ወዘተ.

አጠቃላይ ማስተር ውቅረት እዚህ ይገኛል።

import os, re
from buildbot.plugins import steps, util, schedulers, worker, changes, reporters
c= BuildmasterConfig ={}
c['workers'] = [ worker.Worker('CentOS', '123456'), worker.Worker('Debian-10', '123456'), worker.Worker('Windows-10', '123456')]
c['protocols'] = {'pb': {'port': 4000}} 
c['change_source'] = []
c['change_source'].append(changes.GitPoller(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
project = 'Rac-GUI',
branches = True,
pollInterval = 600
))
# служба запуска сборки
c['schedulers'] = []
c['schedulers'].append(schedulers.SingleBranchScheduler(
name="Rac-GUI-schedulers",
change_filter=util.ChangeFilter(branch='master'),
builderNames=["Rac-GUI-RPM-builder", "Rac-GUI-DEB-builder", "Rac-GUI-WIN-builder"],
properties = {'owner': 'admin'}
))
@util.renderer
def get_name_version_release(props):
prog_name = "rac-gui"
prog_version = "1.0.3"
prog_release = "3"
return {
"prog_name": prog_name
#"prog_version": prog_version,
#"prog_release": prog_release
}
rac_gui_build_RPM = util.BuildFactory()
rac_gui_build_RPM.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
workdir = 'rac-gui',
haltOnFailure = True,
submodules = True,
mode='full',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_RPM.addStep(
steps.SetPropertyFromCommand(
command="grep version ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_RPM.addStep(
steps.SetPropertyFromCommand(
command="grep release ../rac-gui/rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
)
)
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["tar", "czf", util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"), "../rac-gui"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["cp", "../rac-gui/rac_gui.spec", "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["sed", "-i", util.Interpolate("s/.*Version:.*/Version:t%(prop:version)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.ShellCommand(
command=["sed", "-i", util.Interpolate("s/.*Release:.*/Release:t%(prop:release)s/"), "/home/buildbot/rpmbuild/SPECS/rac_gui.spec"]))
rac_gui_build_RPM.addStep(steps.RpmBuild(
specfile="/home/buildbot/rpmbuild/SPECS/rac_gui.spec",
dist='.el5',
topdir='/home/buildbot/rpmbuild',
builddir='/home/buildbot/rpmbuild/build',
rpmdir='/home/buildbot/rpmbuild/RPMS',
sourcedir='/home/buildbot/rpmbuild/SOURCES'
))
# Скопируем файл на мастер
rac_gui_build_RPM.addStep(
steps.FileUpload(
workersrc=util.Interpolate("/home/buildbot/rpmbuild/RPMS/noarch/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")
)
)
rac_gui_build_RPM.addStep(
steps.FileUpload(
workersrc=util.Interpolate("/home/buildbot/rpmbuild/SOURCES/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")
)
)
rac_gui_build_RPM.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.noarch.rpm")]
)
)
rac_gui_build_RPM.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui-%(prop:version)s-%(prop:release)s.tar.gz")]
)
)
####################################
##      DEB 
####################################
rac_gui_build_DEB = util.BuildFactory()
rac_gui_build_DEB.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
haltOnFailure = True,
submodules = True,
mode='full',
workdir='build',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_DEB.addStep(
steps.SetPropertyFromCommand(
command="grep version rac_gui.tcl | grep -oE 'b[0-9]{1,2}.[0-9]{1,2}.[0-9]{1,2}b'", property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_DEB.addStep(
steps.SetPropertyFromCommand(
command="grep release rac_gui.tcl | grep -oE 'b[0-9]{1,3}b'", property="release"
)
)
# Переименуем запускаемый файл
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["mv", "rac_gui.tcl", "racgui"]))
# Поменяем пути к библиотекам
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["sed", "-i", "s+^set dir(lib)+set dir(lib) /usr/share/rac-gui/lib ;#+g", "racgui"]))
# Поменяем пути к файлам
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["sed", "-i", "s+[pwd]+/usr/share/rac-gui+g", "racgui"]))
# заархивируем исходники
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["tar", "czf", util.Interpolate("../rac-gui_%(prop:version)s.orig.tar.gz"), "."]))
# Соберём пакет
rac_gui_build_DEB.addStep(steps.ShellCommand(
command=["dpkg-buildpackage"]))
# Скопируем файл на мастер
rac_gui_build_DEB.addStep(
steps.FileUpload(
workersrc=util.Interpolate("../rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")
)
)
rac_gui_build_DEB.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s_amd64.deb")]
)
)
############################################
#       WIN
############################################
rac_gui_build_WIN = util.BuildFactory()
rac_gui_build_WIN.addStep(steps.Git(
repourl = 'https://bitbucket.org/svk28/rac-gui.git',
haltOnFailure = True,
submodules = True,
mode='full',
workdir='build',
progress = True)
)
# Добавим определение версии из основного файла
rac_gui_build_WIN.addStep(
steps.SetPropertyFromCommand(
command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'version:') -split 's')[2]",
property="version"
)
)
# Добавим определение релиза из основного файла
rac_gui_build_WIN.addStep(
steps.SetPropertyFromCommand(
command="powershell -command "((Get-Content .rac_gui.tcl | Select-String -Pattern 'release:') -split 's')[2]",
property="release"
)
)
# Создадим запускаемый файл
rac_gui_build_WIN.addStep(steps.ShellCommand(
command=["c:binfreewrap.exe", "rac_gui.tcl"]))
# запакуем то, что получилось
rac_gui_build_WIN.addStep(steps.ShellCommand(
command=["c:Program Files7-zip7z.exe", "a", "-r", util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"), "..build"]))
# скопируем на мастер
rac_gui_build_WIN.addStep(
steps.FileUpload(
workersrc=util.Interpolate("..rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
masterdest=util.Interpolate("/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")
)
)
# Скопируем файл на хостинг
rac_gui_build_WIN.addStep(
steps.MasterShellCommand(
command=["/usr/local/bin/deploy-ftp.tcl",
util.Interpolate("--local-file=/home/buildbot/builds/rac-gui_%(prop:version)s-%(prop:release)s.win.zip"),
util.Interpolate("--remote-file=uploads/rac-gui/rac-gui_%(prop:version)s-%(prop:release)s.win.zip")]
)
)
c['builders'] = [
util.BuilderConfig(name="Rac-GUI-RPM-builder", workername='CentOS', factory=rac_gui_build_RPM),
util.BuilderConfig(name="Rac-GUI-DEB-builder", workername='Debian-10', factory=rac_gui_build_DEB),
util.BuilderConfig(name="Rac-GUI-WIN-builder", workername='Windows-10', factory=rac_gui_build_WIN),
]
c['services'] = []
template=u'''
<h4>Build status: {{ summary }}</h4>
<p> Worker used: {{ workername }}</p>
{% for step in build['steps'] %}
<p> {{ step['name'] }}: {{ step['result'] }}</p>
{% endfor %}
<p><b> -- The Buildbot</b></p>
'''
mailNotifier = reporters.MailNotifier(fromaddr="[email protected]",
sendToInterestedUsers=False,
mode=('all'),
extraRecipients=["[email protected]"],
relayhost="mail.domain.local",
smtpPort=587,
smtpUser="[email protected]",
smtpPassword="**********",
messageFormatter=reporters.MessageFormatter(
template=template, template_type='html',
wantProperties=True, wantSteps=True))
c['services'].append(mailNotifier)
c['title'] = "The process of bulding"
c['titleURL'] = "http://vm-srv-build1:80/"
c['buildbotURL'] = "http://vm-srv-build1/"
c['www'] = dict(port=80,
plugins=dict(waterfall_view={}, console_view={}, grid_view={}))
c['db'] = {
'db_url' : "sqlite:///state.sqlite"
}

ቁሶች

ጽሑፉን ለማዘጋጀት የሚከተሉት ቁሳቁሶች ጥቅም ላይ ውለዋል.

• ከBuildBot ጋር ቀጣይነት ያለው ውህደት ምሳሌ ትግበራ
• Buildbot፡ ስለሌላ ተከታታይ የውህደት ስርዓት ምሳሌዎች ያለው ታሪክ
• በኡቡንቱ 16.04 ላይ በBuildbot ውስጥ ቀጣይነት ያለው ውህደትን በማዘጋጀት ላይ
• ኦህ፣ እና የምርት ሰነዱ። Buildbot አጋዥ ስልጠና

ምንጭ: hab.com