{"id":91646,"date":"2020-08-16T07:42:09","date_gmt":"2020-08-16T05:42:09","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/kak-trablshutit-otechestvennyj-ipsec-vpn-chast-1"},"modified":"2020-08-16T07:42:09","modified_gmt":"2020-08-16T05:42:09","slug":"kak-trablshutit-otechestvennyj-ipsec-vpn-chast-1","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-trablshutit-otechestvennyj-ipsec-vpn-chast-1","title":{"rendered":"How to troubleshoot a domestic IPsec VPN. Part 1","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

\"How
\n<\/p>\n

Situation<\/h3>\n

\nI'm out. Drinking coffee. The student set up a VPN connection between two points and disappeared. Checking: there is indeed a tunnel, but there is no traffic in the tunnel. The student is not answering calls.<\/p>\n

I'm boiling the kettle and diving into troubleshooting the C-TERRA Gateway. Sharing my experience and methodology.
\n<\/a><\/noindex><\/p>\n

Source Data<\/h3>\n

\nTwo geographically separated sites are connected by a GRE tunnel. GRE needs to be encrypted:<\/p>\n

\"How
\n
\nI'm checking the functionality of the GRE tunnel. To do this, I'm pinging from device R1 to the GRE interface of device R2. This is the target traffic for encryption. No response:<\/p>\n

root@R1:~# ping 1.1.1.2 -c 4\nPING 1.1.1.2 (1.1.1.2) 56(84) bytes of data.\n\n--- 1.1.1.2 ping statistics ---\n4 packets transmitted, 0 received, 100% packet loss, time 3057ms<\/code><\/pre>\n
\nI'm looking at the logs on Gate1 and Gate2. The log happily reports that the IPsec tunnel has been successfully established, no issues:<\/p>\n
root@Gate1:~# cat \/var\/log\/cspvpngate.log\nAug  5 16:14:23 localhost  vpnsvc: 00100119  IPSec connection 5 established, traffic selector 172.17.0.1->172.16.0.1, proto 47, peer 10.10.10.251, id \"10.10.10.251\", Filter\nIPsec:Protect:CMAP:1:LIST, IPsecAction IPsecAction:CMAP:1, IKERule IKERule:CMAP:1<\/code><\/pre>\n
\nIn the statistics of the IPsec tunnel on Gate1, I see that the tunnel is indeed there, but the Rcvd counter is reset:<\/p>\n
root@Gate1:~# sa_mgr show\nISAKMP sessions: 0 initiated, 0 responded\n\nISAKMP connections:\nNum Conn-id (Local Addr,Port)-(Remote Addr,Port) State Sent Rcvd\n1 3 (10.10.10.251,500)-(10.10.10.252,500) active 1070 1014\n\nIPsec connections:\nNum Conn-id (Local Addr,Port)-(Remote Addr,Port) Protocol Action Type Sent Rcvd\n1 3 (172.16.0.1,*)-(172.17.0.1,*) 47 ESP tunn 480 0<\/code><\/pre>\n
\nI'm troubleshooting C-TERRA this way: I'm looking for where the target packets are being lost on the way from R1 to R2. In the process (spoiler), I will find an error.<\/p>\n
Troubleshooting<\/h3>\n
\nStep 1. What Gate1 receives from R1<\/b><\/p>\n
I'm using the built-in packet sniffer \u2013 tcpdump. I start the sniffer on the internal (Gi0\/1 in Cisco-like notation or eth1 in Debian OS notation) interface:<\/p>\n
root@Gate1:~# tcpdump -i eth1\n\ntcpdump: verbose output suppressed, use -v or -vv for full protocol decode\nlistening on eth1, link-type EN10MB (Ethernet), capture size 262144 bytes\n14:53:38.879525 IP 172.16.0.1 > 172.17.0.1: GREv0, key=0x1, length 92: IP 1.1.1.1 > 1.1.1.2: ICMP echo request, id 2083, seq 1, length 64\n14:53:39.896869 IP 172.16.0.1 > 172.17.0.1: GREv0, key=0x1, length 92: IP 1.1.1.1 > 1.1.1.2: ICMP echo request, id 2083, seq 2, length 64\n14:53:40.921121 IP 172.16.0.1 > 172.17.0.1: GREv0, key=0x1, length 92: IP 1.1.1.1 > 1.1.1.2: ICMP echo request, id 2083, seq 3, length 64\n14:53:41.944958 IP 172.16.0.1 > 172.17.0.1: GREv0, key=0x1, length 92: IP 1.1.1.1 > 1.1.1.2: ICMP echo request, id 2083, seq 4, length 64<\/code><\/pre>\n
\nI see that Gate1 is receiving GRE packets from R1. Moving on.<\/p>\n
Step 2. What Gate1 does with the GRE packets<\/b><\/p>\n
Using the klogview utility, I check what's happening with the GRE packets inside VPN<\/a> the C-TERRA driver:<\/p>\n
root@Gate1:~# klogview -f 0xffffffff\n\nFiltration result for out packet 172.16.0.1->172.17.0.1, proto 47, len 112, if eth0: chain 4 \"IPsecPolicy:CMAP\", filter 8, event id IPsec:Protect:CMAP:1:LIST, status PASS\nEncapsulating with SA 31: 172.16.0.1->172.17.0.1, proto 47, len 112, if eth0\nPassed out packet 10.10.10.251->10.10.10.252, proto 50, len 160, if eth0: encapsulated\n<\/code><\/pre>\n
\nI see that the target GRE traffic (proto 47) 172.16.0.1 -> 172.17.0.1 passed (PASS) under the encryption rule LIST in the crypto map CMAP and was encapsulated. The packet was then routed (passed out). There is no incoming traffic in the klogview output.<\/p>\n
Checking the access lists on the device Gate1. I see one access list LIST that defines the target traffic for encryption, meaning that the ME rules are not configured:<\/p>\n
Gate1#show access-lists\nExtended IP access list LIST\n    10 permit gre host 172.16.0.1 host 172.17.0.1<\/code><\/pre>\n
\nConclusion: the problem is not on the device Gate1.<\/p>\n
Additional information about klogview<\/b><\/p>\n
The VPN driver processes all network traffic, not just the traffic that should be encrypted. Such messages are visible in klogview if the VPN driver has processed the network traffic and sent it unencrypted:<\/p>\n
root@R1:~# ping 172.17.0.1 -c 4<\/code><\/pre>\n
<\/p>\n
root@Gate1:~# klogview -f 0xffffffff\n\nFiltration result for out packet 172.16.0.1->172.17.0.1, proto 1, len 84, if eth0: chain 4 \"IPsecPolicy:CMAP\": no match\nPassed out packet 172.16.0.1->172.17.0.1, proto 1, len 84, if eth0: filtered<\/code><\/pre>\n
\nI see that the ICMP traffic (proto 1) 172.16.0.1->172.17.0.1 did not match (no match) the encryption rules in the crypto map CMAP. The packet was routed (passed out) in plain form.<\/p>\n
Step 3. What Gate2 receives from Gate1<\/b><\/p>\n
Starting a sniffer on the WAN (eth0) interface of Gate2:<\/p>\n
root@Gate2:~# tcpdump -i eth0\ntcpdump: verbose output suppressed, use -v or -vv for full protocol decode\nlistening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes\n16:05:45.104195 IP 10.10.10.251 > 10.10.10.252: ESP(spi=0x30088112,seq=0x1), length 140\n16:05:46.093918 IP 10.10.10.251 > 10.10.10.252: ESP(spi=0x30088112,seq=0x2), length 140\n16:05:47.117078 IP 10.10.10.251 > 10.10.10.252: ESP(spi=0x30088112,seq=0x3), length 140\n16:05:48.141785 IP 10.10.10.251 > 10.10.10.252: ESP(spi=0x30088112,seq=0x4), length 140<\/code><\/pre>\n
\nI see that Gate2 is receiving ESP packets from Gate1.<\/p>\n
Step 4. What Gate2 does with the ESP packets<\/b><\/p>\n
Running the klogview utility on Gate2:<\/p>\n
root@Gate2:~# klogview -f 0xffffffff\nFiltration result for in packet 10.10.10.251->10.10.10.252, proto 50, len 160, if eth0: chain 17 \"FilterChain:L3VPN\", filter 21, status DROP\ndropped in packet 10.10.10.251->10.10.10.252, proto 50, len 160, if eth0: firewall\n<\/code><\/pre>\n
\nI see that the ESP packets (proto 50) were dropped (DROP) by the rule (L3VPN) of the firewall. I verify that the access list L3VPN is indeed attached to Gi0\/0:<\/p>\n
Gate2#show ip interface gi0\/0\nGigabitEthernet0\/0 is up, line protocol is up\n  Internet address is 10.10.10.252\/24\n  MTU is 1500 bytes\n  Outgoing access list is not set\n  Inbound  access list is L3VPN<\/code><\/pre>\n
\nIdentified the problem.<\/p>\n
Step 5. What is wrong with the access list
\n<\/b>
\nI look at what the access list L3VPN consists of:<\/p>\n
Gate2#show access-list L3VPN\nExtended IP access list L3VPN\n    10 permit udp host 10.10.10.251 any eq isakmp\n    20 permit udp host 10.10.10.251 any eq non500-isakmp\n    30 permit icmp host 10.10.10.251 any<\/code><\/pre>\n
\nI see that ISAKMP packets are allowed, so an IPsec tunnel is being established. However, there\u2019s no permit rule for ESP. Apparently, the student mixed up icmp and esp.<\/p>\n
I'll edit the access list:<\/p>\n
Gate2(config)#\nip access-list extended L3VPN\nno 30\n30 permit esp host 10.10.10.251 any<\/code><\/pre>\n
\nStep 6. Checking functionality<\/b><\/p>\n
First, I ensure that the L3VPN access list is correct:<\/p>\n
Gate2#show access-list L3VPN\nExtended IP access list L3VPN\n    10 permit udp host 10.10.10.251 any eq isakmp\n    20 permit udp host 10.10.10.251 any eq non500-isakmp\n    30 permit esp host 10.10.10.251 any<\/code><\/pre>\n
\nNow I'm generating target traffic from device R1:<\/p>\n
root@R1:~# ping 1.1.1.2 -c 4\nPING 1.1.1.2 (1.1.1.2) 56(84) bytes of data.\n64 bytes from 1.1.1.2: icmp_seq=1 ttl=64 time=35.3 ms\n64 bytes from 1.1.1.2: icmp_seq=2 ttl=64 time=3.01 ms\n64 bytes from 1.1.1.2: icmp_seq=3 ttl=64 time=2.65 ms\n64 bytes from 1.1.1.2: icmp_seq=4 ttl=64 time=2.87 ms\n\n--- 1.1.1.2 ping statistics ---\n4 packets transmitted, 4 received, 0% packet loss, time 3006ms\nrtt min\/avg\/max\/mdev = 2.650\/10.970\/35.338\/14.069 ms<\/code><\/pre>\n
\nVictory. The GRE tunnel has been established. The incoming traffic counter in the IPsec statistics is not zero:<\/p>\n
root@Gate1:~# sa_mgr show\nISAKMP sessions: 0 initiated, 0 responded\n\nISAKMP connections:\nNum Conn-id (Local Addr,Port)-(Remote Addr,Port) State Sent Rcvd\n1 3 (10.10.10.251,500)-(10.10.10.252,500) active 1474 1350\n\nIPsec connections:\nNum Conn-id (Local Addr,Port)-(Remote Addr,Port) Protocol Action Type Sent Rcvd\n1 4 (172.16.0.1,*)-(172.17.0.1,*) 47 ESP tunn 1920 480<\/code><\/pre>\n
\nOn the Gate2 gateway, messages appeared in the klogview indicating that the target traffic 172.16.0.1->172.17.0.1 has been successfully (PASS) decrypted (decapsulated) by the LIST rule in the cryptographic map CMAP:<\/p>\n
root@Gate2:~# klogview -f 0xffffffff\nFiltration result for in packet 172.16.0.1->172.17.0.1, proto 47, len 112, if eth0: chain 18 \"IPsecPolicy:CMAP\", filter 25, event id IPsec:Protect:CMAP:1:LIST, status PASS\nPassed in packet 172.16.0.1->172.17.0.1, proto 47, len 112, if eth0: decapsulated<\/code><\/pre>\n
\nSummary<\/b><\/p>\n
The student messed up the output. 
\nBe careful with the M\u042d rules.<\/p>\n
Anonymous Engineer
\nt.me\/anonimous_engineer<\/i>
\n
Source: habr.com<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u0421\u0438\u0442\u0443\u0430\u0446\u0438\u044f \u0412\u044b\u0445\u043e\u0434\u043d\u043e\u0439. \u041f\u044c\u044e \u043a\u043e\u0444\u0435. \u0421\u0442\u0443\u0434\u0435\u043d\u0442 \u043d\u0430\u0441\u0442\u0440\u043e\u0438\u043b VPN \u0441\u043e\u0435\u0434\u0438\u043d\u0435\u043d\u0438\u0435 \u043c\u0435\u0436\u0434\u0443 \u0434\u0432\u0443\u043c\u044f \u0442\u043e\u0447\u043a\u0430\u043c\u0438 \u0438 \u0438\u0441\u0447\u0435\u0437. \u041f\u0440\u043e\u0432\u0435\u0440\u044f\u044e: \u0442\u0443\u043d\u043d\u0435\u043b\u044c \u0434\u0435\u0439\u0441\u0442\u0432\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0435\u0441\u0442\u044c, \u043d\u043e \u0442\u0440\u0430\u0444\u0438\u043a\u0430 \u0432 \u0442\u0443\u043d\u043d\u0435\u043b\u0435 \u043d\u0435\u0442. \u041d\u0430 \u0437\u0432\u043e\u043d\u043a\u0438 \u0441\u0442\u0443\u0434\u0435\u043d\u0442 \u043d\u0435 \u043e\u0442\u0432\u0435\u0447\u0430\u0435\u0442. \u0421\u0442\u0430\u0432\u043b\u044e \u0447\u0430\u0439\u043d\u0438\u043a \u0438 \u043f\u043e\u0433\u0440\u0443\u0436\u0430\u044e\u0441\u044c \u0432 \u0442\u0440\u0430\u0431\u043b\u0448\u0443\u0442\u0438\u043d\u0433 \u0421-\u0422\u0435\u0440\u0440\u0430 \u0428\u043b\u044e\u0437. \u0414\u0435\u043b\u044e\u0441\u044c \u0441\u0432\u043e\u0438\u043c \u043e\u043f\u044b\u0442\u043e\u043c \u0438 \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0435\u0439. \u0418\u0441\u0445\u043e\u0434\u043d\u044b\u0435 \u0434\u0430\u043d\u043d\u044b\u0435 \u0414\u0432\u0435 \u0442\u0435\u0440\u0440\u0438\u0442\u043e\u0440\u0438\u0430\u043b\u044c\u043d\u043e \u0440\u0430\u0437\u0434\u0435\u043b\u0435\u043d\u043d\u044b\u0435 \u043f\u043b\u043e\u0449\u0430\u0434\u043a\u0438 \u0441\u0432\u044f\u0437\u0430\u043d\u044b GRE \u0442\u0443\u043d\u043d\u0435\u043b\u0435\u043c. GRE \u043d\u0443\u0436\u043d\u043e \u0437\u0430\u0448\u0438\u0444\u0440\u043e\u0432\u0430\u0442\u044c: \u041f\u0440\u043e\u0432\u0435\u0440\u044f\u044e \u0440\u0430\u0431\u043e\u0442\u043e\u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c GRE […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":91647,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-91646","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47How to troubleshoot domestic IPsec VPN. Part 1 | ProHoster","description":"Situation Output.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-trablshutit-otechestvennyj-ipsec-vpn-chast-1","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u0430\u043a \u0442\u0440\u0430\u0431\u043b\u0448\u0443\u0442\u0438\u0442\u044c \u043e\u0442\u0435\u0447\u0435\u0441\u0442\u0432\u0435\u043d\u043d\u044b\u0439 IPsec VPN. \u0427\u0430\u0441\u0442\u044c 1 | ProHoster","og:description":"\u0421\u0438\u0442\u0443\u0430\u0446\u0438\u044f \u0412\u044b\u0445\u043e\u0434\u043d\u043e\u0439.","og:url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/kak-trablshutit-otechestvennyj-ipsec-vpn-chast-1","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-08-16T05:42:09+00:00","article:modified_time":"2020-08-16T05:42:09+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"91646","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 12:23:24","updated":"2026-02-04 14:42:05","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/91646","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=91646"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/91646\/revisions"}],"predecessor-version":[{"id":156750,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/91646\/revisions\/156750"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media\/91647"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=91646"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=91646"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=91646"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}