Mandeha fitsapana JMeter amin'ny OpenShift mampiasa Jenkins Pipeline

Miarahaba ny rehetra!

Ato amin'ity lahatsoratra ity dia te hizara ny iray amin'ireo fomba fampandehanana ny fitsapana fampisehoana JMeter amin'ny OpenShift mampiasa Jenkins ho automation aho. Voalohany dia hanao ny dingana rehetra ilaina isika (mamorona ImageStreams, BuildConfig, Job sns) amin'ny fomba manual. Aorian'izay, andao hanoratra Jenkins Pipeline.

Ho fanombohana dia tokony hanana:

  1. mihazakazaka OpenShift (v3.11) cluster
  2. Jenkins mpizara miaraka amin'ny fahazoan-dΓ lana voarindra hiasa amin'ny OpenShift
  3. rakitra apache-jmeter-5.2.tgz

Toy ny fitsapana dia ho tsotra HTTP Request amin'ny ya.ru amin'ny renirano iray.

Mamorona tetikasa amin'ny OpenShift

Andao hanomboka amin'ny famoronana tontolo vaovao. Andao hamorona perftest voahodidin'ny ekipa iray:

$ oc new-project perftest --display-name="Performance Tests" --description="Performance Tests - JMeter"

Hafindra ho azy amin'ny tontolo vao noforonina isika perftest, andeha hojerentsika fa izany no izy:

$ oc project
Using project "perftest" on server "https://127.0.0.1:8443".

Famoronana fitahirizana

Ny tatitra fitsapana dia hotehirizina mitovy amin'ny mpizara tranonkala sy jmeter-meter'toerana - /jmeter/reports.

Tsara kokoa ny mamorona Storajs izao, satria ny POD dia hifamatotra amin'izy ireo jmeter-web ΠΈ jmeter-master.

Hahita fampahalalana misimisy kokoa momba ny fitahirizana ianao ao amin'ny antontan-taratasy ofisialy Fitehirizana maharitra.

Andao hamorona rakitra yaml ho an'ny PV ΠΈ PVC.

pv.yaml

$ tee pv.yaml<<EOF
apiVersion: v1
kind: PersistentVolume
metadata:
  name: jmeter-reports
spec:
  capacity:
    storage: 10Gi
  accessModes:
    - ReadWriteMany
  glusterfs:
    endpoints: glusterfs-cluster
    path: /jmeter/reports
    readOnly: false
  persistentVolumeReclaimPolicy: Retain
EOF

pvc.yaml

$ tee pvc.yaml<<EOF
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: jmeter-reports
spec:
  accessModes:
    - ReadWriteMany
  resources:
    requests:
      storage: 10Gi
EOF

Andao hamorona PV ΠΈ PVC voahodidin'ny OpenShift:

$ oc create -f pv.yaml -n perftest
$ oc create -f pvc.yaml -n perftest

Fanamarinana ny sata momba ny PVC:

$ oc get pvc -n perftest
NAME             STATUS    VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS        AGE
jmeter-reports   Bound     pvc-b0e5f152-db4b-11ea-a497-566f75280024   10Gi       RWX            glusterfs-storage   8m

Toy izao ny endriny amin'ny GUI:

Mandeha fitsapana JMeter amin'ny OpenShift mampiasa Jenkins Pipeline

Mamorona sary fototra JMeter

Andao hiroso amin’ny famoronana ImageStream ΠΈ BuildConfig.

Azonao atao ny mahita ny fampahalalana ilaina rehetra ao amin'ny antontan-taratasy - Builds sy sary Stream.

Ny paikady fananganana sary dia Docker avy any an-toerana.

Andao hamorona sary fototra jmeter-base, izay ho fototry ny jmeter-master.

dockerfile

FROM openjdk:8u212-jdk

ARG JMETER_VER="5.2"
ENV JMETER_HOME /jmeter/apache-jmeter-$JMETER_VER
ENV PATH $JMETER_HOME/bin:$PATH

RUN mkdir -p /jmeter/results 
    && mkdir /jmeter/tests

WORKDIR /jmeter

COPY apache-jmeter-$JMETER_VER.tgz .

RUN tar -xzf $JMETER_HOME.tgz 
    && rm $JMETER_HOME.tgz 
    && ls -la

RUN sed -i s/#server.rmi.ssl.disable=false/server.rmi.ssl.disable=true/ $JMETER_HOME/bin/jmeter.properties

EXPOSE 60000

is.yaml

$ tee is.yaml<<EOF
apiVersion: v1
kind: ImageStream
metadata:
  labels:
    build: jmeter-base
  name: jmeter-base
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: v1
kind: BuildConfig
metadata:
  name: jmeter-base
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-base:latest'
  postCommit: {}
  resources: {}
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'openjdk:8u212-jdk'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Andao hamorona zavatra IS ΠΈ BC:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Andao izao hanangona ny sary fototra jmeter-base:

$ oc start-build jmeter-base -n perftest --from-dir=. --follow

JMeter WEB

jmeter-web Ity dia mpizara tranonkala Apache. Ny asany dia ny manome lahatahiry misy valim-panadinana hojerena.

vonona Dockerfile ary ny fichier configuration httpd.conf. Ho an'ny torolΓ lana DocumentRoot sanda napetraka /jmeter/reports, i.e. ny lahatahiry misy ny valin'ny fitsapana voatahiry.

dockerfile

$ tee Dockerfile<<EOF
FROM httpd:2.4

COPY httpd.conf /usr/local/apache2/conf/httpd.conf
RUN chmod -R 777 /usr/local/apache2/logs

EXPOSE 8080

CMD ["httpd", "-D", "FOREGROUND"]
EOF

is.yaml

$ tee is.yaml<<EOF
apiVersion: v1
kind: ImageStream
metadata:
  generation: 1
  labels:
    build: jmeter-web
  name: jmeter-web
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: v1
kind: BuildConfig
metadata:
  name: jmeter-web
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-web:latest'
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'httpd:2.4'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Andao hamorona ImageStream ΠΈ BuildConfig zavatra:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Manangona sary avy amin'ny Dockerfile:

$ oc start-build jmeter-web -n perftest --from-dir=. --follow

dc.yaml

$ tee dc.yaml<<EOF
apiVersion: apps.openshift.io/v1
kind: DeploymentConfig
metadata:
  name: jmeter-web
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: jmeter-web
    spec:
      containers:
        - image: 172.30.1.1:5000/perftest/jmeter-web
          name: jmeter-web
          volumeMounts:
            - mountPath: /jmeter/reports
              name: jmeter-reports
          ports:
            - containerPort: 80
              protocol: TCP
            - containerPort: 8080
              protocol: TCP
      volumes:
        - name: jmeter-reports
          persistentVolumeClaim:
            claimName: jmeter-reports
EOF

sc.yaml

$ tee sc.yaml<<EOF
apiVersion: v1
kind: Service
metadata:
  labels:
    app: jmeter-web
  name: jmeter-web
spec:
  ports:
    - name: 8080-tcp
      port: 8080
      protocol: TCP
      targetPort: 8080
  selector:
    deploymentconfig: jmeter-web
  sessionAffinity: None
  type: ClusterIP
EOF

Andao hamorona zavatra Service ΠΈ DeploymentConfig:

$ oc create -f sc.yaml -n perftest
$ oc create -f dc.yaml -n perftest

Jmeter-master

Andao hanomboka hametraka ny mpizara tranonkala Apache.

Ity no Dockerfile jmeter-master'a, mifototra amin'ny jmeter-base, izay hanao fitsapana ary hitahiry ny valiny ao anaty fitahirizana.

dockerfile

Dockerfile ho an'ny jmeter-master, miankina amin'ny jmeter-base.

FROM jmeter-base

ARG JMETER_VER="5.2"
ENV JMETER_HOME /jmeter/apache-jmeter-$JMETER_VER
ENV PATH $JMETER_HOME/bin:$PATH

WORKDIR /jmeter
COPY run.sh /jmeter/
COPY tests/*.jmx /jmeter/tests/
RUN chmod +x /jmeter/run.sh

ENTRYPOINT ["/bin/bash"]
CMD ["/jmeter/run.sh"]

run.sh

run.sh Ity dia script iray izay mihazakazaka JMeter ary mitahiry ny valiny ao anaty lahatahiry files.

Isaky ny atomboka ny script, dia mamafa ny fitsapana teo aloha, ka tsy afaka miasa afa-tsy amin'ny angona farany ianao. Tsy olana anefa izany, satria azonao atao ny manova azy hifanaraka amin'ny filanao.

#!/bin/bash

set -e

if [ -d "/jmeter/reports/files" ]
then
    echo "Directory /jmeter/reports/files exist - OK"
else
    echo "Creating /jmeter/reports/files directory"
    mkdir /jmeter/reports/files
fi

if [ -d "/jmeter/reports/dashboards" ]
then
    echo "Directory /jmeter/reports/dashboards exist"
else
    echo "Creating /jmeter/reports/dashboards directory"
    mkdir /jmeter/reports/dashboards
fi

echo "*** JMeter START Tests ***"

for item in $(ls -1 /jmeter/tests | grep jmx)
do
    echo "*** Removing dashboard directory for $item"
    rm -rdf /jmeter/reports/dashboards/${item}*

    echo "*** Removing tests directory for $item"
    rm -rdf /jmeter/reports/files/${item}*

    echo "*** Testing a $item file ***"
    jmeter -n -t /jmeter/tests/${item} -l /jmeter/reports/files/${item}-report.jtl -e -o /jmeter/reports/dashboards/${item}-dash
done

is.yaml

$ tee is.yaml<<EOF
apiVersion: image.openshift.io/v1
kind: ImageStream
metadata:
  generation: 1
  labels:
    build: jmeter-master
  name: jmeter-master
EOF

bc.yaml

$ tee bc.yaml<<EOF
apiVersion: build.openshift.io/v1
kind: BuildConfig
metadata:
  name: jmeter-master
spec:
  failedBuildsHistoryLimit: 5
  nodeSelector: null
  output:
    to:
      kind: ImageStreamTag
      name: 'jmeter-master:latest'
  runPolicy: Serial
  source:
    binary: {}
    type: Binary
  strategy:
    dockerStrategy:
      from:
        kind: ImageStreamTag
        name: 'jmeter-base:latest'
    type: Docker
  successfulBuildsHistoryLimit: 5
EOF

Andao hamorona IS ΠΈ BC zavatra:

$ oc create -f is.yaml -n perftest
$ oc create -f bc.yaml -n perftest

Manangona izahay jmeter-master sary:

$ oc start-build jmeter-master -n perftest --from-dir=. --follow

Job

Job's dia ampiasaina amin'ny OpenShift'e mba hampandehanana iray na maromaro POD's ary miantoka ny fahavitan'izy ireo amim-pahombiazana rehefa avy nanatanteraka ny baiko/script.

$ tee job.yaml<<EOF
apiVersion: batch/v1
kind: Job
metadata:
  name: jmeter-master
  labels:
    jobName: jmeter-master
spec:
  completions: 1
  parallelism: 1
  template:
    metadata:
      name: jmeter-master
      labels:
        jobName: jmeter-master
    spec:
      containers:
        - name: jmeter-master
          image: 172.30.1.1:5000/perftest/jmeter-master:latest
          volumeMounts:
            - mountPath: /jmeter/reports
              name: jmeter-reports
          imagePullPolicy: Always
      volumes:
        - name: jmeter-reports
          persistentVolumeClaim:
            claimName: jmeter-reports
      restartPolicy: Never
      terminationGracePeriodSeconds: 30
EOF

Mamorona zavatra Job:

$ oc create -f job.yaml -n perftest

Andeha hojerentsika ny toetry ny asa:

$ oc get jobs -n perftest
NAME            DESIRED   SUCCESSFUL   AGE
jmeter-master   1         1            5m

Fafao Job andao hampiasa ny baiko:

$ oc delete jobs/jmeter-master -n perftest --ignore-not-found=true

Jenkins Pipeline

Automation izao. Andeha hojerentsika indray ny dingana:

  1. git clone
  2. oc whoami -t
  3. oc start-build ...
  4. oc delete jobs/jmeter-master
  5. oc create -f job.yaml -n perftest

Ity ambany ity ny fantsona iray izay anaovana ny cloning repository, ny famafana ary ny famoronana OpenShift Job's.

#!groovy

pipeline {

    agent any

    stages {

        stage('Start Notifications') {
            steps {
                echo "Sending Email Notification"
            }
            post {
                always {
                    echo "STARTED - Performance Tests"
                    mail(to: '[email protected]', from: "[email protected]", subject: "START - Performance Tests",mimeType: "text/html", body: "<strong>START - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL:   ${env.BUILD_URL}"
                }
            }
        }

        stage('Git checkout') {
            steps {
                ...
            }
        }

        stage('Perf Tests') {
            steps {
                script {
                    sh '''
                        OC_CMD1="oc login -u=username -p=PASS -n=perftest 
                        --server=https://...:8443"

                        $OC_CMD1

                        OC_TOKEN=`oc whoami -t`

                        OC_CMD2="oc --token=$OC_TOKEN --server=https://...:8443 
                        start-build jmeter-master -n=perftest --from-dir=./master 
                        --follow=true"

                        OC_CMD3="oc --token=$OC_TOKEN --server=https://...:8443 
                        delete jobs/jmeter-master -n=perftest --ignore-not-found=true"

                        OC_CMD4="oc--token=$OC_TOKEN --server=https://...:8443 
                        create -f ./master/job.yaml -n=perftest"

                        $OC_CMD2
                        $OC_CMD3
                        $OC_CMD4
                    '''
                }
            }
        }

        post {
            failure {
                echo "FAILED - Performance Tests"
                mail(to: '[email protected]', from: "[email protected]", subject: "FAILED - Performance Tests",mimeType: "text/html", body: "<strong>FAILED - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL: ${env.BUILD_URL}"
                }

            success {
                echo "SUCCESSED - Performance Tests"
                mail(to: '[email protected]', from: "[email protected]", subject: "SUCCESSED - Performance Tests",mimeType: "text/html", body: "<strong>SUCCESSED - Performance Tests</strong><br /><br />Project: Name of Project<br />Environment: PerfTest<br />Build number: ${env.BUILD_NUMBER}<br />Build URL:   ${env.BUILD_URL}"
            }
        }

    }
}

Rehefa nahavita ny asany ny Pipeline dia hahazo fampahafantarana amin'ny alΓ lan'ny mailaka izahay '[email protected] ΠΎΡ‚ [email protected].

Amin'ny fipihana ny rohy http://jmeter-web.127.0.0.1.nip.io/ ho hitantsika ny lahatahiry files, izay mitahiry tatitra fitsapana:

Mandeha fitsapana JMeter amin'ny OpenShift mampiasa Jenkins Pipeline

Ny votoatin'ny rakitra ya.HTTP.Request.jmx-report.jtk:

timeStamp,elapsed,label,responseCode,responseMessage,threadName,dataType,success,failureMessage,bytes,sentBytes,grpThreads,allThreads,URL,Latency,IdleTime,Connect
1597311456443,569,Yandex - HTTP Request,200,Ok,Thread Group 1-1,text,true,,59449,220,1,1,https://ya.ru/,145,0,57
1597311456443,147,Yandex - HTTP Request-0,302,Found,Thread Group 1-1,,true,,478,110,1,1,http://ya.ru/,145,0,57
1597311456592,420,Yandex - HTTP Request-1,200,Ok,Thread Group 1-1,text,true,,58971,110,1,1,https://ya.ru/,370,0,259

famaranana

Ity lahatsoratra ity dia naneho ny iray amin'ireo safidy amin'ny fanaovana fitiliana JMeter amin'ny tontolo OpenShift. Vitanay tamin'ny tanana ny dingana rehetra, ary avy eo dia namorona Jenkins Pipeline izahay mba hanamafisana ny fizotran'ny fitsapana.

Loharano sy antontan-taratasy

Source: www.habr.com

Add a comment