Kugadzira otomatiki uye kuzadza kwetiweki mudziyo kugadzirisa zvinhu uchishandisa Nornir

Kugadzira otomatiki uye kuzadza kwetiweki mudziyo kugadzirisa zvinhu uchishandisa Nornir

Hei Habr!

Munguva ichangopfuura imwe nyaya yakabuda pano Mikrotik uye Linux. Routine uye otomatiki apo dambudziko rakafanana rakagadziriswa pachishandiswa zvisaririra. Uye kunyangwe basa iri rakajairika, hapana chakafanana nezvaro paHabré. Ini ndinoshinga kupa bhasikoro rangu kune inoremekedzwa IT nharaunda.

Iyi haisi bhasikoro rekutanga rebasa rakadaro. Sarudzo yekutanga yakaitwa makore akati wandei apfuura kumashure anable shanduro 1.x.x. Bhasikoro racho rakanga risinganyanyi kushandiswa saka raigara richiita ngura. Mupfungwa yekuti basa racho pacharo harisimuke kakawanda sezvo shanduro dzinovandudzwa anable. Uye pese paunoda kutyaira, cheni inodonha kana vhiri rinodonha. Nekudaro, chikamu chekutanga, kugadzira configs, chinogara chichishanda zvakajeka, nerufaro jinja2 Injini yakasimbiswa kwenguva refu. Asi chikamu chechipiri - kuburitsa configs - kazhinji kwakaunza zvinoshamisa. Uye sezvo ini ndichifanira kuburitsa iyo config kure kure kusvika kuhafu yezana zvishandiso, zvimwe zvacho zviri zviuru zvemakiromita kure, kushandisa chishandiso ichi kwaive kufinha zvishoma.

Apa ndinofanira kubvuma kuti kusava nechokwadi kwangu kungangove kuri mukusaziva kwangu anablekupfuura mukukanganisa kwayo. Uye izvi, nenzira, ipfungwa inokosha. anable yakaparadzana zvachose, nzvimbo yayo yeruzivo ine yayo DSL (Domain Specific Mutauro), iyo inofanirwa kuchengetedzwa padanho rekuvimba. Zvakanaka, nguva iyoyo anable Iri kukura nekukurumidza, uye pasina kukoshesa kuenderana kwekudzokera kumashure, haiwedzere chivimbo.

Nokudaro, kwete kare kare shanduro yechipiri yebhasikoro yakashandiswa. Panguva ino python, kana kuti pane chimiro chakanyorwa mukati python uye python pasi pezita Nornir

Saka- Nornir iri microframework yakanyorwa mukati python uye python uye yakagadzirirwa otomatiki. Zvakafanana nezviri muchiitiko ne anable, kugadzirisa matambudziko pano, kugadzirira data kwakakodzera kunodiwa, i.e. inventory of hosts and their parameters, asi zvinyorwa hazvina kunyorwa muDSL yakasiyana, asi mune imwechete kwete yekare, asi yakanaka kwazvo p[i|i] toni.

Ngatitarisei kuti chii chiri kushandisa inotevera mhenyu muenzaniso.

Ndine bazi rine mahofisi akawanda munyika yose. Hofisi yega yega ine WAN router inomisa akati wandei nzira dzekutaurirana kubva kune akasiyana maoperator. Iyo routing protocol ndeye BGP. WAN ma routers anouya mumhando mbiri: Cisco ISG kana Juniper SRX.

Iye zvino basa: iwe unofanirwa kugadzirisa yakatsaurirwa subnet yeVhidhiyo Kuongorora pane imwe chiteshi pane ese WAN routers yebazi network - shambadza iyi subnet muBGP - gadzira iyo yekumhanyisa muganhu wechiteshi chakatsaurirwa.

Kutanga, isu tinofanirwa kugadzirira akati wandei matemplate, pahwaro hwekuti zvigadziriso zvichagadzirwa zvakasiyana zveCisco neJuniper. Izvo zvinodiwawo kugadzirira data kune imwe neimwe poindi uye yekubatanidza paramita, i.e. unganidza zvinyorwa zvakafanana

Yakagadzirira template yeCisco:

$ cat templates/ios/base.j2 
class-map match-all VIDEO_SURV
 match access-group 111

policy-map VIDEO_SURV
 class VIDEO_SURV
    police 1500000 conform-action transmit  exceed-action drop

interface {{ host.task_data.ifname }}
  description VIDEOSURV
  ip address 10.10.{{ host.task_data.ipsuffix }}.254 255.255.255.0
  service-policy input VIDEO_SURV

router bgp {{ host.task_data.asn }}
  network 10.40.{{ host.task_data.ipsuffix }}.0 mask 255.255.255.0

access-list 11 permit 10.10.{{ host.task_data.ipsuffix }}.0 0.0.0.255
access-list 111 permit ip 10.10.{{ host.task_data.ipsuffix }}.0 0.0.0.255 any

Template yeJuniper:

$ cat templates/junos/base.j2 
set interfaces {{ host.task_data.ifname }} unit 0 description "Video surveillance"
set interfaces {{ host.task_data.ifname }} unit 0 family inet filter input limit-in
set interfaces {{ host.task_data.ifname }} unit 0 family inet address 10.10.{{ host.task_data.ipsuffix }}.254/24
set policy-options policy-statement export2bgp term 1 from route-filter 10.10.{{ host.task_data.ipsuffix }}.0/24 exact
set security zones security-zone WAN interfaces {{ host.task_data.ifname }}
set firewall policer policer-1m if-exceeding bandwidth-limit 1m
set firewall policer policer-1m if-exceeding burst-size-limit 187k
set firewall policer policer-1m then discard
set firewall policer policer-1.5m if-exceeding bandwidth-limit 1500000
set firewall policer policer-1.5m if-exceeding burst-size-limit 280k
set firewall policer policer-1.5m then discard
set firewall filter limit-in term 1 then policer policer-1.5m
set firewall filter limit-in term 1 then count limiter

Matemplate, hongu, haabude mumhepo yakatetepa. Izvi zvinonyanya kusiyana pakati pemagadzirirwo ekushanda aive uye aive mushure mekugadzirisa basa pane maviri chaiwo ma routers emhando dzakasiyana.

Kubva pamatemplate edu tinoona kuti kugadzirisa dambudziko, isu tinongoda maparamita maviri eJuniper uye 3 paramita yeCisco. ndezvizvi:

  • ifname
  • ipsuffix
  • asn

Iye zvino tinoda kuseta aya maparameter kune imwe neimwe mudziyo, i.e. ita zvimwe chetezvo Inventory.

nokuti Inventory Tichanyatsotevera zvinyorwa Kutanga Nornir

ndiko kuti, ngatigadzire iyo yakafanana faira skeleton:

.
├── config.yaml
├── inventory
│   ├── defaults.yaml
│   ├── groups.yaml
│   └── hosts.yaml

Iyo config.yaml faira ndiyo yakajairwa nornir configuration file

$ cat config.yaml 
---
core:
    num_workers: 10

inventory:
    plugin: nornir.plugins.inventory.simple.SimpleInventory
    options:
        host_file: "inventory/hosts.yaml"
        group_file: "inventory/groups.yaml"
        defaults_file: "inventory/defaults.yaml"

Isu ticharatidza iwo main parameters mufaira hosts.yaml, boka (munyaya yangu aya ma logins/password) mukati mapoka.yaml, uye mukati defaults.yaml Isu hatiratidze chero chinhu, asi iwe unofanirwa kuisa maminusi matatu ipapo - zvichiratidza kuti ndizvo yaml iyo faira haina chinhu zvakadaro.

Izvi ndizvo zvinoita hosts.yaml:

---
srx-test:
    hostname: srx-test
    groups: 
        - juniper
    data:
        task_data:
            ifname: fe-0/0/2
            ipsuffix: 111

cisco-test:
    hostname: cisco-test
    groups: 
        - cisco
    data:
        task_data:
            ifname: GigabitEthernet0/1/1
            ipsuffix: 222
            asn: 65111

Uye heano mapoka.yaml:

---
cisco:
    platform: ios
    username: admin1
    password: cisco1

juniper:
    platform: junos
    username: admin2
    password: juniper2

Izvi ndizvo zvakaitika Inventory nokuda kwebasa redu. Panguva yekutanga, ma parameters kubva kumafaira ezvinyorwa anoiswa mepu kune iyo chinhu modhi InventoryElement.

Pazasi pemuparadzi pane dhayagiramu yeInventoryElement modhi

print(json.dumps(InventoryElement.schema(), indent=4))
{
    "title": "InventoryElement",
    "type": "object",
    "properties": {
        "hostname": {
            "title": "Hostname",
            "type": "string"
        },
        "port": {
            "title": "Port",
            "type": "integer"
        },
        "username": {
            "title": "Username",
            "type": "string"
        },
        "password": {
            "title": "Password",
            "type": "string"
        },
        "platform": {
            "title": "Platform",
            "type": "string"
        },
        "groups": {
            "title": "Groups",
            "default": [],
            "type": "array",
            "items": {
                "type": "string"
            }
        },
        "data": {
            "title": "Data",
            "default": {},
            "type": "object"
        },
        "connection_options": {
            "title": "Connection_Options",
            "default": {},
            "type": "object",
            "additionalProperties": {
                "$ref": "#/definitions/ConnectionOptions"
            }
        }
    },
    "definitions": {
        "ConnectionOptions": {
            "title": "ConnectionOptions",
            "type": "object",
            "properties": {
                "hostname": {
                    "title": "Hostname",
                    "type": "string"
                },
                "port": {
                    "title": "Port",
                    "type": "integer"
                },
                "username": {
                    "title": "Username",
                    "type": "string"
                },
                "password": {
                    "title": "Password",
                    "type": "string"
                },
                "platform": {
                    "title": "Platform",
                    "type": "string"
                },
                "extras": {
                    "title": "Extras",
                    "type": "object"
                }
            }
        }
    }
}

Iyi modhi inogona kutarisa zvishoma kuvhiringidza, kunyanya pakutanga. Kuti uzvione, iyo interactive mode mukati ipython.

 $ ipython3
Python 3.6.9 (default, Nov  7 2019, 10:44:02) 
Type 'copyright', 'credits' or 'license' for more information
IPython 7.1.1 -- An enhanced Interactive Python. Type '?' for help.

In [1]: from nornir import InitNornir                                                                           

In [2]: nr = InitNornir(config_file="config.yaml", dry_run=True)                                                

In [3]: nr.inventory.hosts                                                                                      
Out[3]: 
{'srx-test': Host: srx-test, 'cisco-test': Host: cisco-test}

In [4]: nr.inventory.hosts['srx-test'].data                                                                                    
Out[4]: {'task_data': {'ifname': 'fe-0/0/2', 'ipsuffix': 111}}

In [5]: nr.inventory.hosts['srx-test']['task_data']                                                     
Out[5]: {'ifname': 'fe-0/0/2', 'ipsuffix': 111}

In [6]: nr.inventory.hosts['srx-test'].platform                                                                                
Out[6]: 'junos'

Uye pakupedzisira, ngatiendererei kune iyo script pachayo. Ini handina chekunyanya kudada nacho pano. Ini ndangotora yakagadzirira-yakagadzirwa muenzaniso kubva tutorial uye akarishandisa anenge asina kuchinja. Izvi ndizvo zvinoita script yapera kushanda:

from nornir import InitNornir
from nornir.plugins.tasks import networking, text
from nornir.plugins.functions.text import print_title, print_result

def config_and_deploy(task):
    # Transform inventory data to configuration via a template file
    r = task.run(task=text.template_file,
                 name="Base Configuration",
                 template="base.j2",
                 path=f"templates/{task.host.platform}")

    # Save the compiled configuration into a host variable
    task.host["config"] = r.result

    # Save the compiled configuration into a file
    with open(f"configs/{task.host.hostname}", "w") as f:
        f.write(r.result)

    # Deploy that configuration to the device using NAPALM
    task.run(task=networking.napalm_configure,
             name="Loading Configuration on the device",
             replace=False,
             configuration=task.host["config"])

nr = InitNornir(config_file="config.yaml", dry_run=True) # set dry_run=False, cross your fingers and run again

# run tasks
result = nr.run(task=config_and_deploy)
print_result(result)

Teerera kune parameter dry_run=Chokwadi mumutsara chinhu kutanga nr.
Pano zvakafanana nein anable bvunzo yekumhanya yakaitwa umo chinongedzo kune router chinogadzirwa, chigadziriso chitsva chakagadziridzwa, icho chinobva chasimbiswa nemudziyo (asi izvi hazvina chokwadi; zvinoenderana nerutsigiro rwechishandiso uye kuitiswa kwemutyairi muNAPALM) , asi iyo nyowani yekumisikidza haina kushandiswa zvakananga. Kuti ushandise kurwa, unofanira kubvisa parameter dry_run kana kuchinja kukosha kwayo kuti venhema.

Kana iyo script yaitwa, Nornir anoburitsa akadzama matanda kune iyo console.

Pazasi pemuparadzi pane kubuda kwehondo inomhanya pane maviri bvunzo ma routers:

config_and_deploy***************************************************************
* cisco-test ** changed : True *******************************************
vvvv config_and_deploy ** changed : True vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv INFO
---- Base Configuration ** changed : True ------------------------------------- INFO
class-map match-all VIDEO_SURV
 match access-group 111

policy-map VIDEO_SURV
 class VIDEO_SURV
    police 1500000 conform-action transmit  exceed-action drop

interface GigabitEthernet0/1/1
  description VIDEOSURV
  ip address 10.10.222.254 255.255.255.0
  service-policy input VIDEO_SURV

router bgp 65001
  network 10.10.222.0 mask 255.255.255.0

access-list 11 permit 10.10.222.0 0.0.0.255
access-list 111 permit ip 10.10.222.0 0.0.0.255 any
---- Loading Configuration on the device ** changed : True --------------------- INFO
+class-map match-all VIDEO_SURV
+ match access-group 111
+policy-map VIDEO_SURV
+ class VIDEO_SURV
+interface GigabitEthernet0/1/1
+  description VIDEOSURV
+  ip address 10.10.222.254 255.255.255.0
+  service-policy input VIDEO_SURV
+router bgp 65001
+  network 10.10.222.0 mask 255.255.255.0
+access-list 11 permit 10.10.222.0 0.0.0.255
+access-list 111 permit ip 10.10.222.0 0.0.0.255 any
^^^^ END config_and_deploy ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
* srx-test ** changed : True *******************************************
vvvv config_and_deploy ** changed : True vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv INFO
---- Base Configuration ** changed : True ------------------------------------- INFO
set interfaces fe-0/0/2 unit 0 description "Video surveillance"
set interfaces fe-0/0/2 unit 0 family inet filter input limit-in
set interfaces fe-0/0/2 unit 0 family inet address 10.10.111.254/24
set policy-options policy-statement export2bgp term 1 from route-filter 10.10.111.0/24 exact
set security zones security-zone WAN interfaces fe-0/0/2
set firewall policer policer-1m if-exceeding bandwidth-limit 1m
set firewall policer policer-1m if-exceeding burst-size-limit 187k
set firewall policer policer-1m then discard
set firewall policer policer-1.5m if-exceeding bandwidth-limit 1500000
set firewall policer policer-1.5m if-exceeding burst-size-limit 280k
set firewall policer policer-1.5m then discard
set firewall filter limit-in term 1 then policer policer-1.5m
set firewall filter limit-in term 1 then count limiter
---- Loading Configuration on the device ** changed : True --------------------- INFO
[edit interfaces]
+   fe-0/0/2 {
+       unit 0 {
+           description "Video surveillance";
+           family inet {
+               filter {
+                   input limit-in;
+               }
+               address 10.10.111.254/24;
+           }
+       }
+   }
[edit]
+  policy-options {
+      policy-statement export2bgp {
+          term 1 {
+              from {
+                  route-filter 10.10.111.0/24 exact;
+              }
+          }
+      }
+  }
[edit security zones]
     security-zone test-vpn { ... }
+    security-zone WAN {
+        interfaces {
+            fe-0/0/2.0;
+        }
+    }
[edit]
+  firewall {
+      policer policer-1m {
+          if-exceeding {
+              bandwidth-limit 1m;
+              burst-size-limit 187k;
+          }
+          then discard;
+      }
+      policer policer-1.5m {
+          if-exceeding {
+              bandwidth-limit 1500000;
+              burst-size-limit 280k;
+          }
+          then discard;
+      }
+      filter limit-in {
+          term 1 {
+              then {
+                  policer policer-1.5m;
+                  count limiter;
+              }
+          }
+      }
+  }
^^^^ END config_and_deploy ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Kuviga mapassword mu ansible_vault

Pakutanga kwechinyorwa ndakaenda zvishoma anable, asi hazvina kushata. Ndinovada chaizvo vault kufanana, iyo yakagadzirirwa kuvanza ruzivo rwakadzama kuti usaonekwe. Uye pamwe vazhinji vaona kuti isu tine ese ma logins / mapassword eese ekurwisa ma router anopenya ari akavhurika fomu mufaira. gorups.yaml. Hazvina kunaka, hongu. Ngatidzivirirei data iri ne vault.

Ngatitamise maparamendi kubva kugroups.yaml kuenda kucreds.yaml, toivharira neAES256 ine makumi maviri-digit password:

$ cd inventory
$ cat creds.yaml
---
cisco:
    username: admin1
    password: cisco1

juniper:
    username: admin2
    password: juniper2

$ pwgen 20 -N 1 > vault.passwd
ansible-vault encrypt creds.yaml --vault-password-file vault.passwd  
Encryption successful
$ cat creds.yaml 
$ANSIBLE_VAULT;1.1;AES256
39656463353437333337356361633737383464383231366233386636333965306662323534626131
3964396534396333363939373539393662623164373539620a346565373439646436356438653965
39643266333639356564663961303535353364383163633232366138643132313530346661316533
6236306435613132610a656163653065633866626639613537326233653765353661613337393839
62376662303061353963383330323164633162386336643832376263343634356230613562643533
30363436343465306638653932366166306562393061323636636163373164613630643965636361
34343936323066393763323633336366366566393236613737326530346234393735306261363239
35663430623934323632616161636330353134393435396632663530373932383532316161353963
31393434653165613432326636616636383665316465623036376631313162646435

Zviri nyore. Chasara kudzidzisa zvedu Nornir-script kutora uye kushandisa iyi data.
Kuti tiite izvi, mune yedu script mushure mekutanga mutsara nr = InitNornir(config_file=... wedzera kodhi inotevera:

...
nr = InitNornir(config_file="config.yaml", dry_run=True) # set dry_run=False, cross your fingers and run again

# enrich Inventory with the encrypted vault data
from ansible_vault import Vault
vault_password_file="inventory/vault.passwd"
vault_file="inventory/creds.yaml"
with open(vault_password_file, "r") as fp:
    password = fp.readline().strip()   
    vault = Vault(password)
    vaultdata = vault.load(open(vault_file).read())

for a in nr.inventory.hosts.keys():
    item = nr.inventory.hosts[a]
    item.username = vaultdata[item.groups[0]]['username']
    item.password = vaultdata[item.groups[0]]['password']
    #print("hostname={}, username={}, password={}n".format(item.hostname, item.username, item.password))

# run tasks
...

Ehe, vault.passwd haifanirwe kunge iri padivi pecreds.yaml semumuenzaniso wangu. Asi zvakanaka zvekutamba.

Ndizvo zvose ikozvino. Kune akati wandei zvimwe zvinyorwa nezve Cisco + Zabbix iri kuuya, asi izvi hazvisi zvishoma nezve otomatiki. Uye munguva pfupi iri kutevera ndinoronga kunyora nezve RESTCONF muCisco.

Source: www.habr.com

Voeg