{"id":55884,"date":"2020-01-31T00:00:00","date_gmt":"2020-01-30T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql"},"modified":"2020-02-18T14:04:03","modified_gmt":"2020-02-18T11:04:03","slug":"znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","title":{"rendered":"Ismerked\u00e9s a wal-g PostgreSQL biztons\u00e1gi ment\u00e9si rendszer\u00e9vel","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">WAL-G<\/a><\/noindex> \u2014 egyszer\u0171 \u00e9s hat\u00e9kony eszk\u00f6z PostgreSQL biztons\u00e1gi ment\u00e9sek k\u00e9sz\u00edt\u00e9s\u00e9re felh\u0151ben. Alapfunkcionalit\u00e1sa alapj\u00e1n a n\u00e9pszer\u0171 <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-e\/wal-e\">WAL-E<\/a><\/noindex>, de Go nyelvre \u00e1t\u00edrt v\u00e1ltozata. Az WAL-G-ban van egy fontos \u00faj funkci\u00f3 \u2014 delta m\u00e1solatok. A delta m\u00e1solatok <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">WAL-G<\/a><\/noindex> meg\u0151rzik a f\u00e1jlok azon lapjait, amelyek a legut\u00f3bbi biztons\u00e1gi ment\u00e9s \u00f3ta megv\u00e1ltoztak. Az WAL-G rengeteg p\u00e1rhuzamos\u00edt\u00e1si technol\u00f3gi\u00e1t alkalmaz a biztons\u00e1gi ment\u00e9sek sor\u00e1n. Az WAL-G sokkal gyorsabban m\u0171k\u00f6dik, mint az WAL-E.<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p>A wal-g m\u0171k\u00f6d\u00e9s\u00e9r\u0151l r\u00e9szletesebben olvashat a k\u00f6vetkez\u0151 cikkben: <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/yandex\/blog\/415817\/\">A biztons\u00e1gi ment\u00e9s gyors\u00edt\u00e1sa. Yandex el\u0151ad\u00e1s<\/a><\/noindex> <\/p>\n<p><\/p>\n<p>Az S3 t\u00e1rol\u00e1si protokoll n\u00e9pszer\u0171v\u00e9 v\u00e1lt az adatok t\u00e1rol\u00e1s\u00e1ban. Az S3 egyik el\u0151nye az API-n kereszt\u00fcli hozz\u00e1f\u00e9r\u00e9s lehet\u0151s\u00e9ge, ami rugalmas interakci\u00f3t tesz lehet\u0151v\u00e9 a t\u00e1rol\u00f3ban, bele\u00e9rtve a nyilv\u00e1nos olvas\u00e1shoz val\u00f3 hozz\u00e1f\u00e9r\u00e9st, mik\u00f6zben az inform\u00e1ci\u00f3 friss\u00edt\u00e9se csak jogosult szem\u00e9lyek \u00e1ltal t\u00f6rt\u00e9nik.<\/p>\n<p><\/p>\n<p>T\u00f6bb ny\u00edlt \u00e9s priv\u00e1t megval\u00f3s\u00edt\u00e1sa l\u00e9tezik az S3 protokollt haszn\u00e1l\u00f3 t\u00e1rol\u00f3knak. Ma egy n\u00e9pszer\u0171 megold\u00e1st vizsg\u00e1lunk kis t\u00e1rol\u00f3k l\u00e9trehoz\u00e1s\u00e1ra \u2014 a Minio-t.<\/p>\n<p><\/p>\n<p>A wal-g tesztel\u00e9s\u00e9hez elegend\u0151 egy PostgreSQL szerver, m\u00edg az S3 helyettes\u00edt\u00e9s\u00e9re a Minio-t haszn\u00e1ljuk.<\/p>\n<p><\/p>\n<h2 id=\"server-minio\">Minio szerver<\/h2>\n<p><\/p>\n<p>Minio telep\u00edt\u00e9se<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum -y install yum-plugin-copr\nyum copr enable -y lkiesow\/minio\nyum install -y minio<\/code><\/pre>\n<p><\/p>\n<p>M\u00f3dos\u00edtjuk az AccessKey-t \u00e9s a SecretKey-t az \/etc\/minio\/minio.conf f\u00e1jlban<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">vi \/etc\/minio\/minio.conf<\/code><\/pre>\n<p><\/p>\n<p>Ha nem haszn\u00e1l nginx-et a Minio el\u0151tt, m\u00f3dos\u00edtani kell<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">--address 127.0.0.1:9000<\/code><\/pre>\n<p><\/p>\n<pre><code class=\"plaintext\">--address 0.0.0.0:9000<\/code><\/pre>\n<p><\/p>\n<p>Elind\u00edtjuk a Minio-t<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start minio<\/code><\/pre>\n<p><\/p>\n<p>Bel\u00e9p\u00fcnk a Minio webes fel\u00fclet\u00e9re <noindex><a rel=\"nofollow\" href=\"http:\/\/ip-c\u00edm-szerver-minio:9000\">http:\/\/ip-c\u00edm-minio-szerver:9000<\/a><\/noindex> \u00e9s l\u00e9trehozunk egy t\u00e1rol\u00f3t (p\u00e9ld\u00e1ul pg-backups).<\/p>\n<p><\/p>\n<h2 id=\"server-bd\">Adatb\u00e1zis szerver<\/h2>\n<p><\/p>\n<p>A WAL-G-t rpm-ben \u00e9n (Anton Patsev) gy\u0171jt\u00f6m. <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/patsevanton\/wal-g-rpm\">Githubot<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/copr.fedorainfracloud.org\/coprs\/antonpatsev\/wal-g\/\">Fedora COPR<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Akinek nem RPM-alap\u00fa rendszere van, haszn\u00e1lja a hivatalos <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g#installation\">telep\u00edt\u00e9si<\/a><\/noindex> utas\u00edt\u00e1st.<\/p>\n<p><\/p>\n<p>A wal-g bin\u00e1ris\u00e1val egy\u00fctt az rpm-ben olyan szkriptek tal\u00e1lhat\u00f3k, amelyek v\u00e1ltoz\u00f3kat import\u00e1lnak az \/etc\/wal-g.d\/server-s3.conf f\u00e1jlb\u00f3l.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">backup-fetch.sh\nbackup-list.sh\nbackup-push.sh\nwal-fetch.sh\nwal-g-run.sh\nwal-push.sh<\/code><\/pre>\n<p><\/p>\n<p>Telep\u00edtj\u00fck a wal-g-t.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum -y install yum-plugin-copr\nyum copr enable -y antonpatsev\/wal-g\nyum install -y wal-g<\/code><\/pre>\n<p><\/p>\n<p>Ellen\u0151rizz\u00fck a wal-g verzi\u00f3j\u00e1t.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">wal-g --version\nwal-g version v0.2.14<\/code><\/pre>\n<p><\/p>\n<p>M\u00f3dos\u00edtjuk az \/etc\/wal-g.d\/server-s3.conf f\u00e1jlt a lehet\u0151s\u00e9geink szerint.<\/p>\n<p><\/p>\n<p>A konfigur\u00e1ci\u00f3s f\u00e1jlokat \u00e9s az adatb\u00e1zis klaszter \u00e1ltal haszn\u00e1lt adatf\u00e1jlokat hagyom\u00e1nyosan egy\u00fcttesen t\u00e1rolj\u00e1k a klaszter adatk\u00f6nyvt\u00e1r\u00e1ban, amelyet \u00e1ltal\u00e1ban <code>PGDATA<\/code><\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">#!\/bin\/bash\n\nexport PG_VER=&quot;9.6&quot;\n\nexport WALE_S3_PREFIX=&quot;s3:\/\/pg-backups&quot; # \u0431\u0430\u043a\u0435\u0442, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043c\u044b \u0441\u043e\u0437\u0434\u0430\u043b\u0438 \u0432 S3\nexport AWS_ACCESS_KEY_ID=&quot;xxxx&quot; # AccessKey \u0438\u0437 \/etc\/minio\/minio.conf \nexport AWS_ENDPOINT=&quot;http:\/\/ip-\u0430\u0434\u0440\u0435\u0441-\u0441\u0435\u0440\u0432\u0435\u0440\u0430-minio:9000&quot;\nexport AWS_S3_FORCE_PATH_STYLE=&quot;true&quot;\nexport AWS_SECRET_ACCESS_KEY=&quot;yyyy&quot; # SecretKey \u0438\u0437 \/etc\/minio\/minio.conf\n\nexport PGDATA=\/var\/lib\/pgsql\/$PG_VER\/data\/\nexport PGHOST=\/var\/run\/postgresql\/.s.PGSQL.5432 # \u0421\u043e\u043a\u0435\u0442 \u0434\u043b\u044f \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0435\u043d\u0438\u044f \u043a PostgreSQL\n\nexport WALG_UPLOAD_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u0434\u043b\u044f \u0437\u0430\u043a\u0430\u0447\u043a\u0438 \nexport WALG_DOWNLOAD_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f\nexport WALG_UPLOAD_DISK_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u043d\u0430 \u0434\u0438\u0441\u043a\u0435 \u0434\u043b\u044f \u0437\u0430\u043a\u0430\u0447\u043a\u0438\nexport WALG_DELTA_MAX_STEPS=7\nexport WALG_COMPRESSION_METHOD=brotli # \u041a\u0430\u043a\u043e\u0439 \u043c\u0435\u0442\u043e\u0434 \u0441\u0436\u0430\u0442\u0438\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c.\n<\/code><\/pre>\n<p><\/p>\n<p>A WAL-G be\u00e1ll\u00edt\u00e1sakor megadja a WALG_DELTA_MAX_STEPS \u00e9rt\u00e9ket, amely a base-bakapt\u00f3l maxim\u00e1lisan elt\u00e9r\u0151 delta-bakup l\u00e9p\u00e9sek sz\u00e1m\u00e1t jel\u00f6li, \u00e9s meghat\u00e1roz egy delta-kop\u00edroz\u00e1si politik\u00e1t. Vagy a legut\u00f3bbi megl\u00e9v\u0151 delta-b\u00f3l k\u00e9sz\u00edt m\u00e1solatot, vagy az eredeti teljes backupb\u00f3l k\u00e9sz\u00edt delt\u00e1t. Ezt arra az esetre kell, amikor az adatb\u00e1zis\u00e1ban folyamatosan azonos adatokat m\u00f3dos\u00edtanak.<\/p>\n<p><\/p>\n<p>Adatb\u00e1zis telep\u00edt\u00e9se.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum install -y https:\/\/download.postgresql.org\/pub\/repos\/yum\/reporpms\/EL-7-x86_64\/pgdg-redhat-repo-latest.noarch.rpm\nyum install -y postgresql96 postgresql96-server mc<\/code><\/pre>\n<p><\/p>\n<p>Adatb\u00e1zis inicializ\u00e1l\u00e1sa.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">\/usr\/pgsql-9.6\/bin\/postgresql96-setup initdb\nInitializing database ... OK<\/code><\/pre>\n<p><\/p>\n<p>Ha egy szerveren tesztel, a wal_level param\u00e9tert archive \u00e9rt\u00e9kre kell \u00e1ll\u00edtania PostgreSQL 10 el\u0151tti verzi\u00f3kn\u00e1l, \u00e9s replica \u00e9rt\u00e9kre a PostgreSQL 10 \u00e9s \u00fajabb verzi\u00f3kn\u00e1l.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">wal_level = archive<\/code><\/pre>\n<p><\/p>\n<p>60 m\u00e1sodpercenk\u00e9nt k\u00e9sz\u00edt\u00fcnk WAL arch\u00edvumok biztons\u00e1gi ment\u00e9s\u00e9t a PostgreSQL seg\u00edts\u00e9g\u00e9vel. A termel\u00e9si k\u00f6rnyezetben m\u00e1s archive_timeout \u00e9rt\u00e9ket kell be\u00e1ll\u00edtania.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">archive_mode = on\narchive_command = '\/usr\/local\/bin\/wal-push.sh %p'\narchive_timeout = 60 # Minden 60 m\u00e1sodpercben v\u00e9grehajt\u00f3dik az archive_command.<\/code><\/pre>\n<p><\/p>\n<p>PostgreSQL ind\u00edt\u00e1sa<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6<\/code><\/pre>\n<p><\/p>\n<p>Egy k\u00fcl\u00f6n konzolban n\u00e9zze meg a PostgreSQL logokat hib\u00e1k keres\u00e9s\u00e9hez: (a postgresql-Wed.log f\u00e1jlt cser\u00e9lje ki a jelenlegire).<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">tail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<p>Bel\u00e9p\u00e9s a psql-be.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\npsql<\/code><\/pre>\n<p><\/p>\n<p>Adatb\u00e1zis l\u00e9trehoz\u00e1sa psql-ben.<\/p>\n<p><\/p>\n<p>T\u00e1bla l\u00e9trehoz\u00e1sa a test1 adatb\u00e1zisban.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">create database test1;<\/code><\/pre>\n<p><\/p>\n<p>\u00c1tv\u00e1lt\u00e1s a test adatb\u00e1zisra.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">postgres=# c test1;<\/code><\/pre>\n<p><\/p>\n<p>indexing_table t\u00e1bla l\u00e9trehoz\u00e1sa.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">test1=# CREATE TABLE indexing_table(created_at TIMESTAMP WITH TIME ZONE DEFAULT NOW());<\/code><\/pre>\n<p><\/p>\n<p>Adatok hozz\u00e1ad\u00e1sa.<\/p>\n<p><\/p>\n<p>Az adatok besz\u00far\u00e1s\u00e1nak elind\u00edt\u00e1sa. V\u00e1rjon 10-20 percet.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">#!\/bin\/bash\n# postgres\nwhile true; do\npsql -U postgres -d test1 -c &quot;INSERT INTO indexing_table(created_at) VALUES (CURRENT_TIMESTAMP);&quot;\nsleep 60;\ndone<\/code><\/pre>\n<p><\/p>\n<p>Mindig k\u00e9sz\u00edtsen teljes biztons\u00e1gi ment\u00e9st.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\n\/usr\/local\/bin\/backup-push.sh<\/code><\/pre>\n<p><\/p>\n<p>Records megtekint\u00e9se a test1 adatb\u00e1zisban l\u00e9v\u0151 t\u00e1bl\u00e1ban.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">select * from indexing_table;\n2020-01-29 09:41:25.226198+\n2020-01-29 09:42:25.336989+\n2020-01-29 09:43:25.356069+\n2020-01-29 09:44:25.37381+\n2020-01-29 09:45:25.392944+\n2020-01-29 09:46:25.412327+\n2020-01-29 09:47:25.432564+\n2020-01-29 09:48:25.451985+\n2020-01-29 09:49:25.472653+\n2020-01-29 09:50:25.491974+\n2020-01-29 09:51:25.510178+<\/code><\/pre>\n<p><\/p>\n<p>A sor az aktu\u00e1lis id\u0151t jelzi.<\/p>\n<p><\/p>\n<h3 id=\"smotrim-spisok-polnyh-bekapov\">Teljes biztons\u00e1gi ment\u00e9sek list\u00e1j\u00e1nak megtekint\u00e9se.<\/h3>\n<p><\/p>\n<pre><code class=\"plaintext\">\/usr\/local\/bin\/backup-list.sh<\/code><\/pre>\n<p><\/p>\n<h3 id=\"testirovanie-vosstanovleniya\">Vissza\u00e1ll\u00edt\u00e1s tesztel\u00e9se.<\/h3>\n<p><\/p>\n<h4 id=\"polnoe-vosstanovlenie-s-nakatyvaem-vseh-dostupnyh-wal\">Teljes vissza\u00e1ll\u00edt\u00e1s az el\u00e9rhet\u0151 WAL-ok \u00fajraalkot\u00e1s\u00e1val.<\/h4>\n<p><\/p>\n<p>A PostgreSQL le\u00e1ll\u00edt\u00e1sa.<\/p>\n<p><\/p>\n<p>Mindent t\u00f6r\u00f6lni a \/var\/lib\/pgsql\/9.6\/data mapp\u00e1b\u00f3l.<\/p>\n<p><\/p>\n<p>A \/usr\/local\/bin\/backup-fetch.sh script ind\u00edt\u00e1sa postgres felhaszn\u00e1l\u00f3k\u00e9nt.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\n\/usr\/local\/bin\/backup-fetch.sh<\/code><\/pre>\n<p><\/p>\n<p>A biztons\u00e1gi ment\u00e9s kinyer\u00e9se befejez\u0151d\u00f6tt.<\/p>\n<p><\/p>\n<p>A recovery.conf f\u00e1jl hozz\u00e1ad\u00e1sa a \/var\/lib\/pgsql\/9.6\/data mapp\u00e1ba a k\u00f6vetkez\u0151 tartalommal.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">restore_command = '\/usr\/local\/bin\/wal-fetch.sh \"%f\" \"%p\"'<\/code><\/pre>\n<p><\/p>\n<p>A PostgreSQL ind\u00edt\u00e1sa. A PostgreSQL az arch\u00edv WAL-b\u00f3l fogja v\u00e9grehajtani a vissza\u00e1ll\u00edt\u00e1st, \u00e9s csak ut\u00e1na ny\u00edlik meg az adatb\u00e1zis. <\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6\ntail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<h4 id=\"vosstanovlenie-na-opredelennoe-vremya\">Vissza\u00e1ll\u00edt\u00e1s meghat\u00e1rozott id\u0151re.<\/h4>\n<p><\/p>\n<p>Ha vissza akarjuk \u00e1ll\u00edtani az adatb\u00e1zist egy adott percre, akkor a recovery.conf f\u00e1jlba hozz\u00e1 kell adnunk a recovery_target_time param\u00e9tert \u2014 megadjuk, hogy mikorra \u00e1ll\u00edtsuk vissza az adatb\u00e1zist.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">restore_command = '\/usr\/local\/bin\/wal-fetch.sh \"%f\" \"%p\"'\nrecovery_target_time = '2020-01-29 09:46:25'<\/code><\/pre>\n<p><\/p>\n<p>A helyre\u00e1ll\u00edt\u00e1s ut\u00e1n n\u00e9zz\u00fck meg az indexing_table t\u00e1bl\u00e1t.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\"> 2020-01-29 09:41:25.226198+00\n 2020-01-29 09:42:25.336989+00\n 2020-01-29 09:43:25.356069+00\n 2020-01-29 09:44:25.37381+00\n 2020-01-29 09:45:25.392944+00<\/code><\/pre>\n<p><\/p>\n<p>A PostgreSQL ind\u00edt\u00e1sa. A PostgreSQL az arch\u00edv WAL-b\u00f3l fogja v\u00e9grehajtani a vissza\u00e1ll\u00edt\u00e1st, \u00e9s csak ut\u00e1na ny\u00edlik meg az adatb\u00e1zis. <\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6\ntail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<h3 id=\"testirovanie\">Tesztel\u00e9s<\/h3>\n<p><\/p>\n<p>Gener\u00e1ljunk egy 1GB-os adatb\u00e1zist, ahogy itt le van \u00edrva. <noindex><a rel=\"nofollow\" href=\"https:\/\/gist.github.com\/ololobus\/5b25c432f208d7eb31051a5f238dffff\">https:\/\/gist.github.com\/ololobus\/5b25c432f208d7eb31051a5f238dffff<\/a><\/noindex><\/p>\n<p><\/p>\n<p>K\u00e9rj\u00fck le a bucket m\u00e9ret\u00e9t az 1GB adatok gener\u00e1l\u00e1sa ut\u00e1n.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">postgres=# SELECT pg_size_pretty(pg_database_size('test1'));\npg_size_pretty\n----------------\n1003 MB<\/code><\/pre>\n<p><\/p>\n<p>s4cmd \u2014 ingyenes parancssori eszk\u00f6z az Amazon S3 t\u00e1rol\u00f3ban l\u00e9v\u0151 adatokkal val\u00f3 munk\u00e1hoz. A seg\u00e9dprogram Python nyelven \u00edr\u00f3dott, ez\u00e9rt mind Windows, mind Linux oper\u00e1ci\u00f3s rendszerekben haszn\u00e1lhat\u00f3.<\/p>\n<p><\/p>\n<p>Telep\u00edts\u00fck az s4cmd-t.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">pip install s4cmd<\/code><\/pre>\n<p><\/p>\n<h4 id=\"lz4\">LZ4<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">s4cmd --endpoint-url=http:\/\/ip-c\u00edm-szerver-minio:9000 --access-key=xxxx --secret-key=yyyy du -r s3:\/\/pg-backups\n840540822       s3:\/\/pg-backups\/wal_005\/\n840 MB lz4 form\u00e1tumban csak a WAL napl\u00f3khoz.\n\nTeljes ment\u00e9s lz4 - 1GB adatokra\ntime backup_push.sh\nreal 0m18.582s\n\nAz S3 bucket m\u00e9rete a teljes ment\u00e9s ut\u00e1n\n\n581480085       s3:\/\/pg-backups\/basebackups_005\/\n842374424   s3:\/\/pg-backups\/wal_005\n581 MB-ot foglal el a teljes ment\u00e9s.<\/code><\/pre>\n<p><\/p>\n<h4 id=\"lzma\">LZMA<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">Az 1GB adatok gener\u00e1l\u00e1sa ut\u00e1n\n338413694       s3:\/\/pg-backups\/wal_005\/\n338 MB napl\u00f3k lzma form\u00e1tumban.\n\nA teljes ment\u00e9s gener\u00e1l\u00e1s\u00e1nak ideje\ntime backup_push.sh\nreal    5m25.054s\n\nA bucket m\u00e9rete az S3-ban\n270310495       s3:\/\/pg-backups\/basebackups_005\/\n433485092   s3:\/\/pg-backups\/wal_005\/\n\n270 MB-ot foglal el a teljes ment\u00e9s lzma form\u00e1tumban.<\/code><\/pre>\n<p><\/p>\n<h4 id=\"brotli\">Brotli<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">Az 1GB adatok gener\u00e1l\u00e1sa ut\u00e1n\n459229886       s3:\/\/pg-backups\/wal_005\/\n459 MB napl\u00f3k brotli form\u00e1tumban.\n\nA teljes ment\u00e9s gener\u00e1l\u00e1s\u00e1nak ideje\nreal    0m23.408s\n\nA bucket m\u00e9rete az S3-ban\n312960942       s3:\/\/pg-backups\/basebackups_005\/\n459309262   s3:\/\/pg-backups\/wal_005\/\n\n312 MB-ot foglal el a teljes ment\u00e9s brotli form\u00e1tumban.\n<\/code><\/pre>\n<p><\/p>\n<p>\u00d6sszehasonl\u00edt\u00e1s a grafikonon.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Ismerked\u00e9s a wal-g PostgreSQL biztons\u00e1gi ment\u00e9si rendszer\u00e9vel\" src=\"\/wp-content\/uploads\/2020\/01\/eeb4f6ae485f086cba126de323f900db.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Ahogy l\u00e1tjuk, a Brotli m\u00e9retileg \u00f6sszehasonl\u00edthat\u00f3 az LZMA-val, de a ment\u00e9s a LZ4 idej\u00e9vel v\u00e9gz\u0151dik.<\/p>\n<p><\/p>\n<p>PostgreSQL orosz nyelv\u0171 k\u00f6z\u00f6ss\u00e9gi chat: <noindex><a rel=\"nofollow\" href=\"https:\/\/t.me\/pgsql\">https:\/\/t.me\/pgsql<\/a><\/noindex><\/p>\n<p><\/p>\n<p>K\u00e9rj\u00fck, adj egy csillagot a Github-on, ha haszn\u00e1lod. <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">wal-g<\/a><\/noindex><\/p>\n<p>Forr\u00e1s: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/486188\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430. \u041f\u043e \u0441\u0432\u043e\u0435\u0439 \u043e\u0441\u043d\u043e\u0432\u043d\u043e\u0439 \u0444\u0443\u043d\u043a\u0446\u0438\u043e\u043d\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043e\u043d \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043d\u0430\u0441\u043b\u0435\u0434\u043d\u0438\u043a\u043e\u043c \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0433\u043e \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430 WAL-E, \u043d\u043e \u043f\u0435\u0440\u0435\u043f\u0438\u0441\u0430\u043d\u043d\u044b\u043c \u043d\u0430 Go. \u041d\u043e \u0432 WAL-G \u0435\u0441\u0442\u044c \u043e\u0434\u043d\u0430 \u0432\u0430\u0436\u043d\u0430\u044f \u043d\u043e\u0432\u0430\u044f \u043e\u0441\u043e\u0431\u0435\u043d\u043d\u043e\u0441\u0442\u044c \u2014 \u0434\u0435\u043b\u044c\u0442\u0430-\u043a\u043e\u043f\u0438\u0438. \u0414\u0435\u043b\u044c\u0442\u0430-\u043a\u043e\u043f\u0438\u0438 WAL-G \u0445\u0440\u0430\u043d\u044f\u0442 \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u044b \u0444\u0430\u0439\u043b\u043e\u0432, \u0438\u0437\u043c\u0435\u043d\u0438\u0432\u0448\u0438\u0435\u0441\u044f \u0441 \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0435\u0439 \u0432\u0435\u0440\u0441\u0438\u0438 \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0439 \u043a\u043e\u043f\u0438\u0438. \u0412 WAL-G \u0440\u0435\u0430\u043b\u0438\u0437\u043e\u0432\u0430\u043d\u043e \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043c\u043d\u043e\u0433\u043e \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u043f\u043e \u0440\u0430\u0441\u043f\u0430\u0440\u0430\u043b\u043b\u0435\u043b\u0438\u0432\u0430\u043d\u0438\u044e [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":55885,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55884","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.3 - aioseo.com -->\n\t<meta name=\"description\" content=\"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.3\" \/>\n\t\t<meta property=\"og:locale\" content=\"hu_HU\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0417\u043d\u0430\u043a\u043e\u043c\u0441\u0442\u0432\u043e \u0441 wal-g \u0441\u0438\u0441\u0442\u0435\u043c\u043e\u0439 \u0431\u0435\u043a\u0430\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-30T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:04:03+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Ismerked\u00e9s a wal-g PostgreSQL biztons\u00e1gi ment\u00e9si rendszerrel | ProHoster","description":"WAL-G \u2014 egyszer\u0171 \u00e9s hat\u00e9kony eszk\u00f6z a PostgreSQL felh\u0151be t\u00f6rt\u00e9n\u0151 biztons\u00e1gi ment\u00e9s\u00e9re.","canonical_url":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hu_HU","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0417\u043d\u0430\u043a\u043e\u043c\u0441\u0442\u0432\u043e \u0441 wal-g \u0441\u0438\u0441\u0442\u0435\u043c\u043e\u0439 \u0431\u0435\u043a\u0430\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL | ProHoster","og:description":"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.","og:url":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-30T21:00:00+00:00","article:modified_time":"2020-02-18T11:04:03+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55884","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 19:35:40","updated":"2022-09-28 13:58:06","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/55884","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/comments?post=55884"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/55884\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media\/55885"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media?parent=55884"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/categories?post=55884"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/tags?post=55884"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}