Otometi faʻatupuina ma faʻatumu elemene fesoʻotaʻiga masini fesoʻotaʻiga e faʻaaoga ai Nornir

Otometi faʻatupuina ma faʻatumu elemene fesoʻotaʻiga masini fesoʻotaʻiga e faʻaaoga ai Nornir

Ei Habr!

Talu ai nei na sau ai se tala iinei Mikrotik ma Linux. Faiga masani ma masini lea na fo'ia ai se fa'afitauli fa'apenei i le fa'aogaina o auala fa'aola. Ma e ui lava o le galuega e masani lava, e leai se mea e tutusa i luga o Habré. Ou te lototele e ofo atu laʻu uila i le faʻalapotopotoga faʻapitoa IT.

E le o le uila muamua lea mo se galuega faapena. O le filifiliga muamua na faʻatinoina i ni nai tausaga talu ai i tua mafai lomiga 1.x.x. O le uila na seasea faaaogaina ma o lea e elea ai pea. I le uiga o le galuega lava ia e le tulaʻi mai i taimi uma pe a faʻafouina lomiga mafai. Ma o taimi uma e te manaʻomia ai le taʻavale, e paʻu le filifili pe paʻu le uili. Ae ui i lea, o le vaega muamua, fatuina o configs, e galue manino lava, manuia jinja2 Ua leva ona faatuina le afi. Ae o le vaega lona lua, o le taʻavaleina o configs, e masani ona aumaia ai ni mea e ofo ai. Ma talu ai e tatau ona ou taʻavale mamao atu le config i le afa selau masini, o nisi o loʻo tu i le afe o kilomita le mamao, o le faʻaaogaina o lenei meafaigaluega sa fai si le manaia.

O iinei e tatau ona ou taʻutino atu o loʻu le mautonu e foliga mai o loʻo taoto i loʻu le masani i mafainai lo ona faaletonu. Ma o lenei, i le ala, o se mea taua. mafai e matua'i ese lava, lona lava vaega o le poto ma lana lava DSL (Domain Specific Language), lea e tatau ona tausia i se tulaga mautinoa. Ia, o le taimi lena mafai O loʻo faʻatupulaia vave, ma e aunoa ma se manatu faʻapitoa mo le fetaui i tua, e le faʻaopoopoina le mautinoa.

O le mea lea, e leʻi leva talu ai na faʻatinoina ai se faʻataʻitaʻiga lona lua o le uila. O le taimi lenei python, pe sili atu i luga o se auivi ua tusia i totonu python ma mo python i lalo o le igoa Nornir

O lea- Nornir o se microframework ua tusia i totonu python ma mo python ma fuafuaina mo masini. E tutusa ma le tulaga i mafai, e foia ai faʻafitauli iinei, e manaʻomia sauniuniga faʻamaumauga agavaa, i.e. inventory of hosts and their parameters, ae o tusitusiga e le o tusia i se DSL ese, ae i le tutusa e le matua tuai, ae lelei tele p[i|i]ton.

Se'i o tatou va'ai po'o le a le mea o lo'o fa'aaogaina ai le fa'ata'ita'iga ola nei.

E iai laʻu fesoʻotaʻiga lala ma le tele o ofisa i le atunuʻu atoa. O ofisa taʻitasi e iai le WAN router e faʻamutaina le tele o fesoʻotaʻiga mai faʻalapotopotoga eseese. Ole fa'asologa ole auala ole BGP. WAN routers e sau i ituaiga e lua: Cisco ISG poʻo Juniper SRX.

Ole galuega nei: e tatau ona e faʻapipiʻi se subnet tuʻufaʻatasia mo le Mataʻituina Vitio i luga o se isi taulaga i luga o WAN routers uma o le paranesi fesoʻotaʻiga - faʻasalalau lenei subnet ile BGP - faʻapipiʻi le saoasaoa faatapulaaina o le taulaga tuuto.

Muamua, tatou te manaʻomia le saunia o ni faʻataʻitaʻiga se lua, i luga o le faʻavae o faʻasalalauga o le a faʻavae ese mo Cisco ma Juniper. E tatau foi ona saunia faʻamatalaga mo vaega taʻitasi ma fesoʻotaʻiga faʻamau, i.e. aoina le lisi tutusa

Fa'ata'ita'iga sauni mo Cisco:

$ cat templates/ios/base.j2 
class-map match-all VIDEO_SURV
 match access-group 111

policy-map VIDEO_SURV
 class VIDEO_SURV
    police 1500000 conform-action transmit  exceed-action drop

interface {{ host.task_data.ifname }}
  description VIDEOSURV
  ip address 10.10.{{ host.task_data.ipsuffix }}.254 255.255.255.0
  service-policy input VIDEO_SURV

router bgp {{ host.task_data.asn }}
  network 10.40.{{ host.task_data.ipsuffix }}.0 mask 255.255.255.0

access-list 11 permit 10.10.{{ host.task_data.ipsuffix }}.0 0.0.0.255
access-list 111 permit ip 10.10.{{ host.task_data.ipsuffix }}.0 0.0.0.255 any

Fa'ata'ita'iga mo Juniper:

$ cat templates/junos/base.j2 
set interfaces {{ host.task_data.ifname }} unit 0 description "Video surveillance"
set interfaces {{ host.task_data.ifname }} unit 0 family inet filter input limit-in
set interfaces {{ host.task_data.ifname }} unit 0 family inet address 10.10.{{ host.task_data.ipsuffix }}.254/24
set policy-options policy-statement export2bgp term 1 from route-filter 10.10.{{ host.task_data.ipsuffix }}.0/24 exact
set security zones security-zone WAN interfaces {{ host.task_data.ifname }}
set firewall policer policer-1m if-exceeding bandwidth-limit 1m
set firewall policer policer-1m if-exceeding burst-size-limit 187k
set firewall policer policer-1m then discard
set firewall policer policer-1.5m if-exceeding bandwidth-limit 1500000
set firewall policer policer-1.5m if-exceeding burst-size-limit 280k
set firewall policer policer-1.5m then discard
set firewall filter limit-in term 1 then policer policer-1.5m
set firewall filter limit-in term 1 then count limiter

O mamanu, ioe, e le sau mai le ea manifinifi. O nei mea e matua'i 'ese'ese i le va o fa'atonuga faigaluega sa i ai ma sa mae'a fo'ia le galuega i luga o auala fa'apitoa e lua o fa'ata'ita'iga eseese.

Mai a matou faʻataʻitaʻiga matou te vaʻai ai e foia le faʻafitauli, matou te manaʻomia naʻo le lua faʻasologa mo Juniper ma 3 faʻasologa mo Cisco. o i latou nei:

  • ifname
  • ipsuffix
  • asn

Ole taimi nei e tatau ona tatou setiina nei taʻiala mo masini taʻitasi, i.e. fai le mea lava e tasi faamaumauga.

mo faamaumauga O le a matou mulimulitaʻia faʻamaumauga Amataina Nornir

o lona uiga, tatou faia le auivi faila tutusa:

.
├── config.yaml
├── inventory
│   ├── defaults.yaml
│   ├── groups.yaml
│   └── hosts.yaml

O le faila config.yaml o le faila faatulagaina masani nornir

$ cat config.yaml 
---
core:
    num_workers: 10

inventory:
    plugin: nornir.plugins.inventory.simple.SimpleInventory
    options:
        host_file: "inventory/hosts.yaml"
        group_file: "inventory/groups.yaml"
        defaults_file: "inventory/defaults.yaml"

O le a matou faʻaalia vaega autu i le faila hosts.yaml, vaega (i lo'u tulaga o logins/passwords) i totonu vaega.yaml, ma i totonu defaults.yaml Matou te le faʻaalia se mea, ae e tatau ona e ulufale i ni faʻaletonu se tolu iina - e faʻaalia ai o lea yaml e gaogao le faila e ui lava.

O foliga lea o hosts.yaml:

---
srx-test:
    hostname: srx-test
    groups: 
        - juniper
    data:
        task_data:
            ifname: fe-0/0/2
            ipsuffix: 111

cisco-test:
    hostname: cisco-test
    groups: 
        - cisco
    data:
        task_data:
            ifname: GigabitEthernet0/1/1
            ipsuffix: 222
            asn: 65111

Ma o vaega nei.yaml:

---
cisco:
    platform: ios
    username: admin1
    password: cisco1

juniper:
    platform: junos
    username: admin2
    password: juniper2

O le mea lea na tupu faamaumauga mo la tatou galuega. A'o amataina, o fa'amaufa'ailoga mai faila fa'amaumauga e fa'afanua i le fa'ata'ita'iga mea InventoryElement.

I lalo ifo o le spoiler o loʻo i ai se ata o le InventoryElement model

print(json.dumps(InventoryElement.schema(), indent=4))
{
    "title": "InventoryElement",
    "type": "object",
    "properties": {
        "hostname": {
            "title": "Hostname",
            "type": "string"
        },
        "port": {
            "title": "Port",
            "type": "integer"
        },
        "username": {
            "title": "Username",
            "type": "string"
        },
        "password": {
            "title": "Password",
            "type": "string"
        },
        "platform": {
            "title": "Platform",
            "type": "string"
        },
        "groups": {
            "title": "Groups",
            "default": [],
            "type": "array",
            "items": {
                "type": "string"
            }
        },
        "data": {
            "title": "Data",
            "default": {},
            "type": "object"
        },
        "connection_options": {
            "title": "Connection_Options",
            "default": {},
            "type": "object",
            "additionalProperties": {
                "$ref": "#/definitions/ConnectionOptions"
            }
        }
    },
    "definitions": {
        "ConnectionOptions": {
            "title": "ConnectionOptions",
            "type": "object",
            "properties": {
                "hostname": {
                    "title": "Hostname",
                    "type": "string"
                },
                "port": {
                    "title": "Port",
                    "type": "integer"
                },
                "username": {
                    "title": "Username",
                    "type": "string"
                },
                "password": {
                    "title": "Password",
                    "type": "string"
                },
                "platform": {
                    "title": "Platform",
                    "type": "string"
                },
                "extras": {
                    "title": "Extras",
                    "type": "object"
                }
            }
        }
    }
}

O lenei faʻataʻitaʻiga e mafai ona foliga le mautonu, aemaise i le taimi muamua. Ina ia mafai ona iloa, o le auala fegalegaleai i totonu ipython.

 $ ipython3
Python 3.6.9 (default, Nov  7 2019, 10:44:02) 
Type 'copyright', 'credits' or 'license' for more information
IPython 7.1.1 -- An enhanced Interactive Python. Type '?' for help.

In [1]: from nornir import InitNornir                                                                           

In [2]: nr = InitNornir(config_file="config.yaml", dry_run=True)                                                

In [3]: nr.inventory.hosts                                                                                      
Out[3]: 
{'srx-test': Host: srx-test, 'cisco-test': Host: cisco-test}

In [4]: nr.inventory.hosts['srx-test'].data                                                                                    
Out[4]: {'task_data': {'ifname': 'fe-0/0/2', 'ipsuffix': 111}}

In [5]: nr.inventory.hosts['srx-test']['task_data']                                                     
Out[5]: {'ifname': 'fe-0/0/2', 'ipsuffix': 111}

In [6]: nr.inventory.hosts['srx-test'].platform                                                                                
Out[6]: 'junos'

Ma le mea mulimuli, seʻi o tatou agai atu i le tusitusiga lava ia. E leai se mea ou te mitamita ai iinei. Na ona ou aveina se faataitaiga ua saunia mai a'oa'oga ma faʻaaogaina toetoe lava a le suia. O le mea lenei e foliga mai o le tusitusiga galue ua maeʻa:

from nornir import InitNornir
from nornir.plugins.tasks import networking, text
from nornir.plugins.functions.text import print_title, print_result

def config_and_deploy(task):
    # Transform inventory data to configuration via a template file
    r = task.run(task=text.template_file,
                 name="Base Configuration",
                 template="base.j2",
                 path=f"templates/{task.host.platform}")

    # Save the compiled configuration into a host variable
    task.host["config"] = r.result

    # Save the compiled configuration into a file
    with open(f"configs/{task.host.hostname}", "w") as f:
        f.write(r.result)

    # Deploy that configuration to the device using NAPALM
    task.run(task=networking.napalm_configure,
             name="Loading Configuration on the device",
             replace=False,
             configuration=task.host["config"])

nr = InitNornir(config_file="config.yaml", dry_run=True) # set dry_run=False, cross your fingers and run again

# run tasks
result = nr.run(task=config_and_deploy)
print_result(result)

Faʻalogo i le parakalafa dry_run=Sa'o i le laina mea amata nr.
O iinei e tutusa ma totonu mafai ua faʻatinoina se suʻega suʻega lea e faia ai se fesoʻotaʻiga i le router, ua saunia se fetuutuunaiga fou fou, lea e faʻamaonia e le masini (ae le o mautinoa, e faʻalagolago i le masini lagolago ma le faʻatinoina o le avetaʻavale ile NAPALM) , ae o le faatulagaga fou e leʻo faʻaogaina saʻo. Mo le faʻaaogaina o le taua, e tatau ona e aveese le parakalafa dry_run pe suia lona tau i sesē.

A maeʻa le faʻamaumauga, e tuʻuina atu e Nornir faʻamatalaga auiliili i le faʻamafanafanaga.

I lalo ifo o le spoiler o loʻo i ai le gaioiga o se faʻataʻitaʻiga tau i luga o auala e lua suʻega:

config_and_deploy***************************************************************
* cisco-test ** changed : True *******************************************
vvvv config_and_deploy ** changed : True vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv INFO
---- Base Configuration ** changed : True ------------------------------------- INFO
class-map match-all VIDEO_SURV
 match access-group 111

policy-map VIDEO_SURV
 class VIDEO_SURV
    police 1500000 conform-action transmit  exceed-action drop

interface GigabitEthernet0/1/1
  description VIDEOSURV
  ip address 10.10.222.254 255.255.255.0
  service-policy input VIDEO_SURV

router bgp 65001
  network 10.10.222.0 mask 255.255.255.0

access-list 11 permit 10.10.222.0 0.0.0.255
access-list 111 permit ip 10.10.222.0 0.0.0.255 any
---- Loading Configuration on the device ** changed : True --------------------- INFO
+class-map match-all VIDEO_SURV
+ match access-group 111
+policy-map VIDEO_SURV
+ class VIDEO_SURV
+interface GigabitEthernet0/1/1
+  description VIDEOSURV
+  ip address 10.10.222.254 255.255.255.0
+  service-policy input VIDEO_SURV
+router bgp 65001
+  network 10.10.222.0 mask 255.255.255.0
+access-list 11 permit 10.10.222.0 0.0.0.255
+access-list 111 permit ip 10.10.222.0 0.0.0.255 any
^^^^ END config_and_deploy ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
* srx-test ** changed : True *******************************************
vvvv config_and_deploy ** changed : True vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv INFO
---- Base Configuration ** changed : True ------------------------------------- INFO
set interfaces fe-0/0/2 unit 0 description "Video surveillance"
set interfaces fe-0/0/2 unit 0 family inet filter input limit-in
set interfaces fe-0/0/2 unit 0 family inet address 10.10.111.254/24
set policy-options policy-statement export2bgp term 1 from route-filter 10.10.111.0/24 exact
set security zones security-zone WAN interfaces fe-0/0/2
set firewall policer policer-1m if-exceeding bandwidth-limit 1m
set firewall policer policer-1m if-exceeding burst-size-limit 187k
set firewall policer policer-1m then discard
set firewall policer policer-1.5m if-exceeding bandwidth-limit 1500000
set firewall policer policer-1.5m if-exceeding burst-size-limit 280k
set firewall policer policer-1.5m then discard
set firewall filter limit-in term 1 then policer policer-1.5m
set firewall filter limit-in term 1 then count limiter
---- Loading Configuration on the device ** changed : True --------------------- INFO
[edit interfaces]
+   fe-0/0/2 {
+       unit 0 {
+           description "Video surveillance";
+           family inet {
+               filter {
+                   input limit-in;
+               }
+               address 10.10.111.254/24;
+           }
+       }
+   }
[edit]
+  policy-options {
+      policy-statement export2bgp {
+          term 1 {
+              from {
+                  route-filter 10.10.111.0/24 exact;
+              }
+          }
+      }
+  }
[edit security zones]
     security-zone test-vpn { ... }
+    security-zone WAN {
+        interfaces {
+            fe-0/0/2.0;
+        }
+    }
[edit]
+  firewall {
+      policer policer-1m {
+          if-exceeding {
+              bandwidth-limit 1m;
+              burst-size-limit 187k;
+          }
+          then discard;
+      }
+      policer policer-1.5m {
+          if-exceeding {
+              bandwidth-limit 1500000;
+              burst-size-limit 280k;
+          }
+          then discard;
+      }
+      filter limit-in {
+          term 1 {
+              then {
+                  policer policer-1.5m;
+                  count limiter;
+              }
+          }
+      }
+  }
^^^^ END config_and_deploy ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Natia upu faataga i le ansible_vault

I le amataga o le tusiga sa ou alu teisi atu i luga mafai, ae e le o se mea leaga tele. Ou te matua fiafia lava ia i latou vailaau pei, lea ua mamanuina e nana ai faamatalaga maaleale mai le vaai. Ma masalo ua matauina e le to'atele o lo'o i ai uma a matou logins/passwords mo ta'avale taua uma e feilafi i foliga matala i se faila. gorups.yaml. E le aulelei, ioe. Sei o tatou puipuia lenei faamatalaga ma vailaau.

Seʻi o tatou faʻafeiloaʻi faʻamaufaʻailoga mai groups.yaml i creds.yaml, ma faʻapipiʻi i le AES256 ma se faʻaupuga 20-numera:

$ cd inventory
$ cat creds.yaml
---
cisco:
    username: admin1
    password: cisco1

juniper:
    username: admin2
    password: juniper2

$ pwgen 20 -N 1 > vault.passwd
ansible-vault encrypt creds.yaml --vault-password-file vault.passwd  
Encryption successful
$ cat creds.yaml 
$ANSIBLE_VAULT;1.1;AES256
39656463353437333337356361633737383464383231366233386636333965306662323534626131
3964396534396333363939373539393662623164373539620a346565373439646436356438653965
39643266333639356564663961303535353364383163633232366138643132313530346661316533
6236306435613132610a656163653065633866626639613537326233653765353661613337393839
62376662303061353963383330323164633162386336643832376263343634356230613562643533
30363436343465306638653932366166306562393061323636636163373164613630643965636361
34343936323066393763323633336366366566393236613737326530346234393735306261363239
35663430623934323632616161636330353134393435396632663530373932383532316161353963
31393434653165613432326636616636383665316465623036376631313162646435

E faigofie lava. O loo tumau pea le aoaoina o tatou Nornir-script e toe aumai ma faʻaoga nei faʻamatalaga.
Ina ia faia lenei mea, i la matou tusitusiga pe a uma le laina amata nr = InitNornir(config_file=… fa'aopoopo le code lea:

...
nr = InitNornir(config_file="config.yaml", dry_run=True) # set dry_run=False, cross your fingers and run again

# enrich Inventory with the encrypted vault data
from ansible_vault import Vault
vault_password_file="inventory/vault.passwd"
vault_file="inventory/creds.yaml"
with open(vault_password_file, "r") as fp:
    password = fp.readline().strip()   
    vault = Vault(password)
    vaultdata = vault.load(open(vault_file).read())

for a in nr.inventory.hosts.keys():
    item = nr.inventory.hosts[a]
    item.username = vaultdata[item.groups[0]]['username']
    item.password = vaultdata[item.groups[0]]['password']
    #print("hostname={}, username={}, password={}n".format(item.hostname, item.username, item.password))

# run tasks
...

Ioe, vault.passwd e le tatau ona tu i tafatafa o creds.yaml pei o laʻu faʻataʻitaʻiga. Ae e lelei mo le taalo.

Na'o le pau lena mo le taimi nei. O loʻo i ai ni nai tala e uiga i Cisco + Zabbix o loʻo sau, ae e leʻo se mea e uiga i le masini. Ma i se taimi lata mai ou te fuafua e tusi e uiga i RESTCONF i Cisco.

puna: www.habr.com

Faaopoopo i ai se faamatalaga