Pulogalamu ya ProHoster > Blog > Ulamuliro > Kuyesa mayeso a JMeter mu OpenShift pogwiritsa ntchito Jenkins Pipeline

Kuyesa mayeso a JMeter mu OpenShift pogwiritsa ntchito Jenkins Pipeline

Hello aliyense!

M'nkhaniyi ndikufuna kugawana nawo njira imodzi yoyendetsera mayeso a JMeter mu OpenShift pogwiritsa ntchito Jenkins ngati makina. Choyamba tidzachita zonse zofunika (kupanga ImageStreams, BuildConfig, Job etc.) mu mode manual. Pambuyo pake, tiyeni tilembe Jenkins Pipeline.

Choyamba tiyenera kukhala:

  1. kuthamanga gulu la OpenShift (v3.11).
  2. Seva ya Jenkins yokhala ndi zidziwitso zokhazikitsidwa kuti zigwire ntchito ku OpenShift
  3. fayilo apache-jmeter-5.2.tgz

Monga mayesero zidzakhala zosavuta HTTP Request pa ya.ru mu mtsinje umodzi.

Kupanga projekiti mu OpenShift

Tiyeni tiyambe ndi kupanga malo atsopano. Tiyeni tipange perftest wazunguliridwa ndi gulu:

$ oc new-project perftest --display-name="Performance Tests" --description="Performance Tests - JMeter"

Tidzasamutsidwa zokha kumalo opangidwa kumene perftest, tiyeni tiwone ngati izi zili choncho:

$ oc project
Using project "perftest" on server "https://127.0.0.1:8443".

Kupanga Kusungirako

Malipoti oyesa adzasungidwa mofanana ndi seva yapaintaneti ndi jmeter-meter'malo - /jmeter/reports.

Ndibwino kupanga Storajs tsopano, chifukwa ma POD adzamangidwa kwa iwo jmeter-web ΠΈ jmeter-master.

Mudzapeza zambiri za kusungirako muzolemba zovomerezeka Kusunga kosalekeza.

Tiyeni tipange mafayilo a yaml PV ΠΈ PVC.

pv.yaml

$ tee pv.yaml<<EOF
apiVersion: v1
kind: PersistentVolume
metadata:
  name: jmeter-reports
spec:
  capacity:
    storage: 10Gi
  accessModes:
    - ReadWriteMany
  glusterfs:
    endpoints: glusterfs-cluster
    path: /jmeter/reports
    readOnly: false
  persistentVolumeReclaimPolicy: Retain
EOF

pvc.yaml

$ tee pvc.yaml<<EOF
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: jmeter-reports
spec:
  accessModes:
    - ReadWriteMany
  resources:
    requests:
      storage: 10Gi
EOF

Tiyeni tipange PV ΠΈ PVC kuzunguliridwa ndi OpenShift:

$ oc create -f pv.yaml -n perftest
$ oc create -f pvc.yaml -n perftest

Kuyang'ana mawonekedwe a PVC:

$ oc get pvc -n perftest
NAME             STATUS    VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS        AGE
jmeter-reports   Bound     pvc-b0e5f152-db4b-11ea-a497-566f75280024   10Gi       RWX            glusterfs-storage   8m

Izi ndi zomwe zidzawonekere mu GUI:

Kuyesa mayeso a JMeter mu OpenShift pogwiritsa ntchito Jenkins Pipeline

Kupanga Chithunzi cha JMeter Base

Tiyeni tipitirire kulenga ImageStream ΠΈ BuildConfig.

Mutha kupeza zonse zofunika pazolembedwa - Amamanga ndi Image Mitsinje.

Njira yopangira chithunzi ndi Docker kuchokera kwa komweko.

Tiyeni tipange chithunzi choyambira jmeter-base, amene adzakhala maziko jmeter-master.

Dockerfile

FROM openjdk:8u212-jdk

ARG JMETER_VER="5.2"
ENV JMETER_HOME /jmeter/apache-jmeter-$JMETER_VER
ENV PATH $JMETER_HOME/bin:$PATH

RUN mkdir -p /jmeter/results 
    && mkdir /jmeter/tests

WORKDIR /jmeter

COPY apache-jmeter-$JMETER_VER.tgz .

RUN tar -xzf $JMETER_HOME.tgz 
    && rm $JMETER_HOME.tgz 
    && ls -la

RUN sed -i s/#server.rmi.ssl.disable=false/server.rmi.ssl.disable=true/ $JMETER_HOME/bin/jmeter.properties

EXPOSE 60000

ndi.yaml

$ tee is.yaml<<EOF
apiVersion: v1
kind: ImageStream
metadata:
  labels:
    build: jmeter-base
  name: jmeter-base
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: v1
kind: BuildConfig
metadata:
  name: jmeter-base
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-base:latest'
  postCommit: {}
  resources: {}
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'openjdk:8u212-jdk'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Tiyeni tipange zinthu IS ΠΈ BC:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Tsopano tiyeni tisonkhanitse chithunzi choyambira jmeter-base:

$ oc start-build jmeter-base -n perftest --from-dir=. --follow

JMeter WEB

jmeter-web Iyi ndi seva yapaintaneti ya Apache. Ntchito yake ndikupereka chikwatu chokhala ndi zotsatira zoyesa kuti muwonere.

Zokonzekera Dockerfile ndi configuration file httpd.conf. Kwa malangizo DocumentRoot mtengo wamtengo /jmeter/reports,ndi. chikwatu chomwe zotsatira za mayeso zimasungidwa.

Dockerfile

$ tee Dockerfile<<EOF
FROM httpd:2.4

COPY httpd.conf /usr/local/apache2/conf/httpd.conf
RUN chmod -R 777 /usr/local/apache2/logs

EXPOSE 8080

CMD ["httpd", "-D", "FOREGROUND"]
EOF

ndi.yaml

$ tee is.yaml<<EOF
apiVersion: v1
kind: ImageStream
metadata:
  generation: 1
  labels:
    build: jmeter-web
  name: jmeter-web
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: v1
kind: BuildConfig
metadata:
  name: jmeter-web
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-web:latest'
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'httpd:2.4'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Tiyeni tipange ImageStream ΠΈ BuildConfig zinthu:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Kusonkhanitsa chithunzi kuchokera Dockerfile:

$ oc start-build jmeter-web -n perftest --from-dir=. --follow

dc.yaml

$ tee dc.yaml<<EOF
apiVersion: apps.openshift.io/v1
kind: DeploymentConfig
metadata:
  name: jmeter-web
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: jmeter-web
    spec:
      containers:
        - image: 172.30.1.1:5000/perftest/jmeter-web
          name: jmeter-web
          volumeMounts:
            - mountPath: /jmeter/reports
              name: jmeter-reports
          ports:
            - containerPort: 80
              protocol: TCP
            - containerPort: 8080
              protocol: TCP
      volumes:
        - name: jmeter-reports
          persistentVolumeClaim:
            claimName: jmeter-reports
EOF

sc.yaml

$ tee sc.yaml<<EOF
apiVersion: v1
kind: Service
metadata:
  labels:
    app: jmeter-web
  name: jmeter-web
spec:
  ports:
    - name: 8080-tcp
      port: 8080
      protocol: TCP
      targetPort: 8080
  selector:
    deploymentconfig: jmeter-web
  sessionAffinity: None
  type: ClusterIP
EOF

Tiyeni tipange zinthu Service ΠΈ DeploymentConfig:

$ oc create -f sc.yaml -n perftest
$ oc create -f dc.yaml -n perftest

Jmeter-bwana

Tiyeni tiyambe kutumiza Apache web server.

Ichi ndiye Dockerfile jmeter-master'a, kutengera jmeter-base, yomwe idzayesa mayesero ndikusunga zotsatira kusungirako.

Dockerfile

Dockerfile chifukwa jmeter-master, kutengera jmeter-base.

FROM jmeter-base

ARG JMETER_VER="5.2"
ENV JMETER_HOME /jmeter/apache-jmeter-$JMETER_VER
ENV PATH $JMETER_HOME/bin:$PATH

WORKDIR /jmeter
COPY run.sh /jmeter/
COPY tests/*.jmx /jmeter/tests/
RUN chmod +x /jmeter/run.sh

ENTRYPOINT ["/bin/bash"]
CMD ["/jmeter/run.sh"]

thamanga.sh

run.sh Ichi ndi script yomwe imayendetsa JMeter ndikusunga zotsatira ku chikwatu files.

Nthawi iliyonse script ikatsegulidwa, imachotsa mayesero am'mbuyomu, kotero mutha kugwira ntchito ndi data yaposachedwa. Koma ili si vuto, chifukwa mukhoza kusintha izo kuti zigwirizane ndi zosowa zanu.

#!/bin/bash

set -e

if [ -d "/jmeter/reports/files" ]
then
    echo "Directory /jmeter/reports/files exist - OK"
else
    echo "Creating /jmeter/reports/files directory"
    mkdir /jmeter/reports/files
fi

if [ -d "/jmeter/reports/dashboards" ]
then
    echo "Directory /jmeter/reports/dashboards exist"
else
    echo "Creating /jmeter/reports/dashboards directory"
    mkdir /jmeter/reports/dashboards
fi

echo "*** JMeter START Tests ***"

for item in $(ls -1 /jmeter/tests | grep jmx)
do
    echo "*** Removing dashboard directory for $item"
    rm -rdf /jmeter/reports/dashboards/${item}*

    echo "*** Removing tests directory for $item"
    rm -rdf /jmeter/reports/files/${item}*

    echo "*** Testing a $item file ***"
    jmeter -n -t /jmeter/tests/${item} -l /jmeter/reports/files/${item}-report.jtl -e -o /jmeter/reports/dashboards/${item}-dash
done

ndi.yaml

$ tee is.yaml<<EOF
apiVersion: image.openshift.io/v1
kind: ImageStream
metadata:
  generation: 1
  labels:
    build: jmeter-master
  name: jmeter-master
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: build.openshift.io/v1
kind: BuildConfig
metadata:
  name: jmeter-master
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-master:latest'
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'jmeter-base:latest'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Tiyeni tipange IS ΠΈ BC zinthu:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Tisonkhanitsa jmeter-master chithunzi:

$ oc start-build jmeter-master -n perftest --from-dir=. --follow

Job

Jobamagwiritsidwa ntchito mu OpenShift'e kuti muthamange chimodzi kapena zingapo POD's ndikutsimikizira kuti amamaliza bwino atamaliza lamulo/script.

$ tee job.yaml<<EOF
apiVersion: batch/v1
kind: Job
metadata:
  name: jmeter-master
  labels:
    jobName: jmeter-master
spec:
  completions: 1
  parallelism: 1
  template:
    metadata:
      name: jmeter-master
      labels:
        jobName: jmeter-master
    spec:
      containers:
        - name: jmeter-master
          image: 172.30.1.1:5000/perftest/jmeter-master:latest
          volumeMounts:
            - mountPath: /jmeter/reports
              name: jmeter-reports
          imagePullPolicy: Always
      volumes:
        - name: jmeter-reports
          persistentVolumeClaim:
            claimName: jmeter-reports
      restartPolicy: Never
      terminationGracePeriodSeconds: 30
EOF

Pangani chinthu Job:

$ oc create -f job.yaml -n perftest

Tiyeni tiwone momwe ntchitoyo ilili:

$ oc get jobs -n perftest
NAME            DESIRED   SUCCESSFUL   AGE
jmeter-master   1         1            5m

Kuti muchotse Job tiyeni tigwiritse ntchito lamulo:

$ oc delete jobs/jmeter-master -n perftest --ignore-not-found=true

Jenkins Pipeline

Tsopano automation. Tiyeni tidutsenso masitepe:

  1. git clone
  2. oc whoami -t
  3. oc start-build ...
  4. oc delete jobs/jmeter-master
  5. oc create -f job.yaml -n perftest

Pansipa pali payipi momwe kukopera kosungirako, kuchotsa ndi kulenga kwa OpenShift kumachitika Job's. 

#!groovy

pipeline {

    agent any

    stages {

        stage('Start Notifications') {
            steps {
                echo "Sending Email Notification"
            }
            post {
                always {
                    echo "STARTED - Performance Tests"
                    mail(to: '[email protected]', from: "[email protected]", subject: "START - Performance Tests",mimeType: "text/html", body: "<strong>START - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL:   ${env.BUILD_URL}"
                }
            }
        }

        stage('Git checkout') {
            steps {
                ...
            }
        }

        stage('Perf Tests') {
            steps {
                script {
                    sh '''
                        OC_CMD1="oc login -u=username -p=PASS -n=perftest 
                        --server=https://...:8443"

                        $OC_CMD1

                        OC_TOKEN=`oc whoami -t`

                        OC_CMD2="oc --token=$OC_TOKEN --server=https://...:8443 
                        start-build jmeter-master -n=perftest --from-dir=./master 
                        --follow=true"

                        OC_CMD3="oc --token=$OC_TOKEN --server=https://...:8443 
                        delete jobs/jmeter-master -n=perftest --ignore-not-found=true"

                        OC_CMD4="oc--token=$OC_TOKEN --server=https://...:8443 
                        create -f ./master/job.yaml -n=perftest"

                        $OC_CMD2
                        $OC_CMD3
                        $OC_CMD4
                    '''
                }
            }
        }

        post {
            failure {
                echo "FAILED - Performance Tests"
                mail(to: '[email protected]', from: "[email protected]", subject: "FAILED - Performance Tests",mimeType: "text/html", body: "<strong>FAILED - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL: ${env.BUILD_URL}"
                }

            success {
                echo "SUCCESSED - Performance Tests"
                mail(to: '[email protected]', from: "[email protected]", subject: "SUCCESSED - Performance Tests",mimeType: "text/html", body: "<strong>SUCCESSED - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL:   ${env.BUILD_URL}"
            }
        }

    }
}

Pipeline ikamaliza kugwira ntchito, tilandila zidziwitso kudzera pa imelo '[email protected] ΠΎΡ‚ [email protected].

Podina ulalo http://jmeter-web.127.0.0.1.nip.io/ tiwona chikwatu files, yomwe imasunga malipoti a mayeso:

Kuyesa mayeso a JMeter mu OpenShift pogwiritsa ntchito Jenkins Pipeline

Zomwe zili mufayilo ya.HTTP.Request.jmx-report.jtk:

timeStamp,elapsed,label,responseCode,responseMessage,threadName,dataType,success,failureMessage,bytes,sentBytes,grpThreads,allThreads,URL,Latency,IdleTime,Connect
1597311456443,569,Yandex - HTTP Request,200,Ok,Thread Group 1-1,text,true,,59449,220,1,1,https://ya.ru/,145,0,57
1597311456443,147,Yandex - HTTP Request-0,302,Found,Thread Group 1-1,,true,,478,110,1,1,http://ya.ru/,145,0,57
1597311456592,420,Yandex - HTTP Request-1,200,Ok,Thread Group 1-1,text,true,,58971,110,1,1,https://ya.ru/,370,0,259

Pomaliza

Nkhaniyi ikuwonetsa imodzi mwazosankha pakuyesa mayeso a JMeter pamalo a OpenShift. Tidamaliza masitepe onse pamanja, kenako tidapanga Jenkins Pipeline kuti azitha kuyesa mayeso.

Magwero ndi zolemba

Source: www.habr.com

Kuwonjezera ndemanga