{"id":55884,"date":"2020-01-31T00:00:00","date_gmt":"2020-01-30T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql"},"modified":"2020-02-18T14:04:03","modified_gmt":"2020-02-18T11:04:03","slug":"znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","status":"publish","type":"post","link":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","title":{"rendered":"Sezn\u00e1men\u00ed se se syst\u00e9mem z\u00e1lohov\u00e1n\u00ed PostgreSQL wal-g","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">WAL-G<\/a><\/noindex> \u2014 jednoduch\u00fd a efektivn\u00ed n\u00e1stroj pro z\u00e1lohov\u00e1n\u00ed PostgreSQL do cloudu. V z\u00e1sad\u011b navazuje na popul\u00e1rn\u00ed n\u00e1stroj <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-e\/wal-e\">WAL-E<\/a><\/noindex>, ale je p\u0159eps\u00e1n v Go. V WAL-G je v\u0161ak jedna d\u016fle\u017eit\u00e1 nov\u00e1 funkce \u2014 delta z\u00e1lohy. Delta z\u00e1lohy <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">WAL-G<\/a><\/noindex> uchov\u00e1vaj\u00ed str\u00e1nky soubor\u016f, kter\u00e9 se od p\u0159edchoz\u00ed verze z\u00e1lohy zm\u011bnily. WAL-G implementuje \u0159adu technologi\u00ed pro paralelizaci z\u00e1loh. WAL-G funguje mnohem rychleji ne\u017e WAL-E.<\/p>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p>Podrobnosti o fungov\u00e1n\u00ed wal-g si m\u016f\u017eete p\u0159e\u010d\u00edst v \u010dl\u00e1nku: <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/yandex\/blog\/415817\/\">Zrychlen\u00ed z\u00e1lohy. P\u0159edn\u00e1\u0161ka od Yandexu<\/a><\/noindex> <\/p>\n<p><\/p>\n<p>Protokol S3 se stal popul\u00e1rn\u00edm pro ukl\u00e1d\u00e1n\u00ed dat. Jednou z v\u00fdhod S3 je mo\u017enost p\u0159\u00edstupu p\u0159es API, co\u017e umo\u017e\u0148uje flexibiln\u00ed interakci se storage, v\u010detn\u011b ve\u0159ejn\u00e9ho p\u0159\u00edstupu pro \u010dten\u00ed, zat\u00edmco aktualizace informac\u00ed ve storage prob\u00edh\u00e1 pouze autorizovan\u00fdmi osobami.<\/p>\n<p><\/p>\n<p>Existuje n\u011bkolik otev\u0159en\u00fdch i soukrom\u00fdch implementac\u00ed storage, kter\u00e9 funguj\u00ed podle protokolu S3. Dnes se pod\u00edv\u00e1me na popul\u00e1rn\u00ed \u0159e\u0161en\u00ed pro organizaci mal\u00fdch storage \u2014 Minio.<\/p>\n<p><\/p>\n<p>Pro testov\u00e1n\u00ed wal-g posta\u010d\u00ed jeden server PostgreSQL, p\u0159i\u010dem\u017e jako n\u00e1hrada za S3 pou\u017e\u00edv\u00e1me Minio.<\/p>\n<p><\/p>\n<h2 id=\"server-minio\">Server Minio<\/h2>\n<p><\/p>\n<p>Instalace Minio<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum -y install yum-plugin-copr\nyum copr enable -y lkiesow\/minio\nyum install -y minio<\/code><\/pre>\n<p><\/p>\n<p>Upravujeme AccessKey a SecretKey v \/etc\/minio\/minio.conf<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">vi \/etc\/minio\/minio.conf<\/code><\/pre>\n<p><\/p>\n<p>Pokud nebudete pou\u017e\u00edvat nginx p\u0159ed Minio, je pot\u0159eba zm\u011bnit<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">--address 127.0.0.1:9000<\/code><\/pre>\n<p><\/p>\n<pre><code class=\"plaintext\">--address 0.0.0.0:9000<\/code><\/pre>\n<p><\/p>\n<p>Spou\u0161t\u00edme Minio<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start minio<\/code><\/pre>\n<p><\/p>\n<p>P\u0159ejdeme do webov\u00e9ho rozhran\u00ed Minio <noindex><a rel=\"nofollow\" href=\"http:\/\/ip-adresa-serveru-minio:9000\">http:\/\/ip-adresa-serveru-minio:9000<\/a><\/noindex> a vytvo\u0159\u00edme bucket (nap\u0159\u00edklad pg-backups).<\/p>\n<p><\/p>\n<h2 id=\"server-bd\">Server DB<\/h2>\n<p><\/p>\n<p>WAL-G v rpm sestavuji j\u00e1 (Anton Pacev). <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/patsevanton\/wal-g-rpm\">Github<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/copr.fedorainfracloud.org\/coprs\/antonpatsev\/wal-g\/\">Fedora COPR<\/a><\/noindex>.<\/p>\n<p><\/p>\n<p>Pro ty, kte\u0159\u00ed nemaj\u00ed syst\u00e9m zalo\u017een\u00fd na RPM, pou\u017eijte ofici\u00e1ln\u00ed <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g#installation\">n\u00e1vod<\/a><\/noindex> na instalaci.<\/p>\n<p><\/p>\n<p>Spolu s bin\u00e1rn\u00edm souborem wal-g v rpm jsou p\u0159\u00edtomny skripty, kter\u00e9 importuj\u00ed prom\u011bnn\u00e9 ze souboru \/etc\/wal-g.d\/server-s3.conf.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">backup-fetch.sh\nbackup-list.sh\nbackup-push.sh\nwal-fetch.sh\nwal-g-run.sh\nwal-push.sh<\/code><\/pre>\n<p><\/p>\n<p>Instalujeme wal-g.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum -y install yum-plugin-copr\nyum copr enable -y antonpatsev\/wal-g\nyum install -y wal-g<\/code><\/pre>\n<p><\/p>\n<p>Kontrolujeme verzi wal-g.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">wal-g --version\nwal-g version v0.2.14<\/code><\/pre>\n<p><\/p>\n<p>Upravujeme \/etc\/wal-g.d\/server-s3.conf podle vlastn\u00edch pot\u0159eb.<\/p>\n<p><\/p>\n<p>Konfigura\u010dn\u00ed soubory a datov\u00e9 soubory, kter\u00e9 pou\u017e\u00edv\u00e1 cluster datab\u00e1ze, se tradi\u010dn\u011b ukl\u00e1daj\u00ed spolu v adres\u00e1\u0159i dat clusteru, co\u017e je obvykle naz\u00fdv\u00e1no <code>PGDATA<\/code><\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">#!\/bin\/bash\n\nexport PG_VER=&quot;9.6&quot;\n\nexport WALE_S3_PREFIX=&quot;s3:\/\/pg-backups&quot; # \u0431\u0430\u043a\u0435\u0442, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043c\u044b \u0441\u043e\u0437\u0434\u0430\u043b\u0438 \u0432 S3\nexport AWS_ACCESS_KEY_ID=&quot;xxxx&quot; # AccessKey \u0438\u0437 \/etc\/minio\/minio.conf \nexport AWS_ENDPOINT=&quot;http:\/\/ip-\u0430\u0434\u0440\u0435\u0441-\u0441\u0435\u0440\u0432\u0435\u0440\u0430-minio:9000&quot;\nexport AWS_S3_FORCE_PATH_STYLE=&quot;true&quot;\nexport AWS_SECRET_ACCESS_KEY=&quot;yyyy&quot; # SecretKey \u0438\u0437 \/etc\/minio\/minio.conf\n\nexport PGDATA=\/var\/lib\/pgsql\/$PG_VER\/data\/\nexport PGHOST=\/var\/run\/postgresql\/.s.PGSQL.5432 # \u0421\u043e\u043a\u0435\u0442 \u0434\u043b\u044f \u043f\u043e\u0434\u043a\u043b\u044e\u0447\u0435\u043d\u0438\u044f \u043a PostgreSQL\n\nexport WALG_UPLOAD_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u0434\u043b\u044f \u0437\u0430\u043a\u0430\u0447\u043a\u0438 \nexport WALG_DOWNLOAD_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f\nexport WALG_UPLOAD_DISK_CONCURRENCY=2 # \u041a\u043e\u043b-\u0432\u043e \u043f\u043e\u0442\u043e\u043a\u043e\u0432 \u043d\u0430 \u0434\u0438\u0441\u043a\u0435 \u0434\u043b\u044f \u0437\u0430\u043a\u0430\u0447\u043a\u0438\nexport WALG_DELTA_MAX_STEPS=7\nexport WALG_COMPRESSION_METHOD=brotli # \u041a\u0430\u043a\u043e\u0439 \u043c\u0435\u0442\u043e\u0434 \u0441\u0436\u0430\u0442\u0438\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c.\n<\/code><\/pre>\n<p><\/p>\n<p>P\u0159i konfiguraci WAL-G nastav\u00edte WALG_DELTA_MAX_STEPS \u2014 maxim\u00e1ln\u00ed po\u010det krok\u016f, o kter\u00e9 se delta z\u00e1loha m\u016f\u017ee odch\u00fdlit od z\u00e1kladn\u00ed z\u00e1lohy, a tak\u00e9 ur\u010d\u00edte politiku delta kopie. Bu\u010f vytv\u00e1\u0159\u00edte kopii z posledn\u00ed existuj\u00edc\u00ed delty, nebo vytv\u00e1\u0159\u00edte deltovou z\u00e1lohu z p\u016fvodn\u00ed \u00fapln\u00e9 z\u00e1lohy. To je d\u016fle\u017eit\u00e9 v p\u0159\u00edpad\u011b, kdy se ve va\u0161\u00ed datab\u00e1zi neust\u00e1le m\u011bn\u00ed stejn\u00e1 \u010d\u00e1st datab\u00e1ze, kter\u00e9 se neust\u00e1le m\u011bn\u00ed stejn\u00e1 data.<\/p>\n<p><\/p>\n<p>Instalujeme datab\u00e1zi.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">yum install -y https:\/\/download.postgresql.org\/pub\/repos\/yum\/reporpms\/EL-7-x86_64\/pgdg-redhat-repo-latest.noarch.rpm\nyum install -y postgresql96 postgresql96-server mc<\/code><\/pre>\n<p><\/p>\n<p>Inicializujeme datab\u00e1zi.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">\/usr\/pgsql-9.6\/bin\/postgresql96-setup initdb\nInitializing database ... OK<\/code><\/pre>\n<p><\/p>\n<p>Pokud testujete na 1 serveru, mus\u00edte zm\u011bnit parametr wal_level na archive pro PostgreSQL verzi ni\u017e\u0161\u00ed ne\u017e 10, a na replica pro PostgreSQL verzi 10 a vy\u0161\u0161\u00ed.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">wal_level = archive<\/code><\/pre>\n<p><\/p>\n<p>Zaji\u0161\u0165ujeme z\u00e1lohov\u00e1n\u00ed WAL archiv\u016f ka\u017ed\u00fdch 60 sekund pomoc\u00ed samotn\u00e9ho PostgreSQL. Na produk\u010dn\u00edm prost\u0159ed\u00ed budete m\u00edt jinou hodnotu archive_timeout.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">archive_mode = on\narchive_command = '\/usr\/local\/bin\/wal-push.sh %p'\narchive_timeout = 60 # Ka\u017ed\u00fdch 60 sekund bude vykon\u00e1na p\u0159\u00edkaz archive_command.<\/code><\/pre>\n<p><\/p>\n<p>Spou\u0161t\u00edme PostgreSQL<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6<\/code><\/pre>\n<p><\/p>\n<p>V samostatn\u00e9 konzoli sledujeme logy PostgreSQL na chyby: (postgresql-Wed.log zm\u011b\u0148te na aktu\u00e1ln\u00ed).<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">tail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<p>P\u0159ihla\u0161ujeme se do psql.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\npsql<\/code><\/pre>\n<p><\/p>\n<p>V psql vytv\u00e1\u0159\u00edme datab\u00e1zi.<\/p>\n<p><\/p>\n<p>Vytv\u00e1\u0159\u00edme tabulku v datab\u00e1zi test1.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">create database test1;<\/code><\/pre>\n<p><\/p>\n<p>P\u0159ep\u00edn\u00e1me se na datab\u00e1zi test.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">postgres=# c test1;<\/code><\/pre>\n<p><\/p>\n<p>Vytv\u00e1\u0159\u00edme tabulku indexing_table.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">test1=# CREATE TABLE indexing_table(created_at TIMESTAMP WITH TIME ZONE DEFAULT NOW());<\/code><\/pre>\n<p><\/p>\n<p>P\u0159id\u00e1n\u00ed dat.<\/p>\n<p><\/p>\n<p>Spou\u0161t\u00edme vkl\u00e1d\u00e1n\u00ed dat. \u010cek\u00e1me 10-20 minut.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">#!\/bin\/bash\n# postgres\nwhile true; do\npsql -U postgres -d test1 -c &quot;INSERT INTO indexing_table(created_at) VALUES (CURRENT_TIMESTAMP);&quot;\nsleep 60;\ndone<\/code><\/pre>\n<p><\/p>\n<p>Rozhodn\u011b d\u011bl\u00e1me \u00faplnou z\u00e1lohu.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\n\/usr\/local\/bin\/backup-push.sh<\/code><\/pre>\n<p><\/p>\n<p>Sledujeme z\u00e1znamy v tabulce v datab\u00e1zi test1<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">select * from indexing_table;\n2020-01-29 09:41:25.226198+\n2020-01-29 09:42:25.336989+\n2020-01-29 09:43:25.356069+\n2020-01-29 09:44:25.37381+\n2020-01-29 09:45:25.392944+\n2020-01-29 09:46:25.412327+\n2020-01-29 09:47:25.432564+\n2020-01-29 09:48:25.451985+\n2020-01-29 09:49:25.472653+\n2020-01-29 09:50:25.491974+\n2020-01-29 09:51:25.510178+<\/code><\/pre>\n<p><\/p>\n<p>\u0158\u00e1dek to je aktu\u00e1ln\u00ed \u010das.<\/p>\n<p><\/p>\n<h3 id=\"smotrim-spisok-polnyh-bekapov\">Sledujeme seznam \u00fapln\u00fdch z\u00e1loh<\/h3>\n<p><\/p>\n<pre><code class=\"plaintext\">\/usr\/local\/bin\/backup-list.sh<\/code><\/pre>\n<p><\/p>\n<h3 id=\"testirovanie-vosstanovleniya\">Testov\u00e1n\u00ed obnovy<\/h3>\n<p><\/p>\n<h4 id=\"polnoe-vosstanovlenie-s-nakatyvaem-vseh-dostupnyh-wal\">\u00dapln\u00e1 obnova s aplikov\u00e1n\u00edm v\u0161ech dostupn\u00fdch WAL.<\/h4>\n<p><\/p>\n<p>Zastavujeme Postgresql.<\/p>\n<p><\/p>\n<p>Odstra\u0148ujeme v\u0161echno z adres\u00e1\u0159e \/var\/lib\/pgsql\/9.6\/data.<\/p>\n<p><\/p>\n<p>Spou\u0161t\u00edme skript \/usr\/local\/bin\/backup-fetch.sh od u\u017eivatele postgres.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">su - postgres\n\/usr\/local\/bin\/backup-fetch.sh<\/code><\/pre>\n<p><\/p>\n<p>Extrakce z\u00e1lohy dokon\u010dena.<\/p>\n<p><\/p>\n<p>P\u0159id\u00e1v\u00e1me recovery.conf do adres\u00e1\u0159e \/var\/lib\/pgsql\/9.6\/data s n\u00e1sleduj\u00edc\u00edm obsahem.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">restore_command = '\/usr\/local\/bin\/wal-fetch.sh \"%f\" \"%p\"'<\/code><\/pre>\n<p><\/p>\n<p>Spou\u0161t\u00edme PostgreSQL. PostgreSQL spust\u00ed proces obnovy z archivovan\u00fdch WAL a teprve pot\u00e9 se datab\u00e1ze otev\u0159e. <\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6\ntail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<h4 id=\"vosstanovlenie-na-opredelennoe-vremya\">Obnova na ur\u010ditou dobu.<\/h4>\n<p><\/p>\n<p>Pokud chceme obnovit datab\u00e1zi do ur\u010dit\u00e9 minuty, p\u0159id\u00e1me do recovery.conf parametr recovery_target_time \u2014 uvedeme p\u0159esn\u011b, na jakou dobu chceme datab\u00e1zi obnovit.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">restore_command = '\/usr\/local\/bin\/wal-fetch.sh \"%f\" \"%p\"'\nrecovery_target_time = '2020-01-29 09:46:25'<\/code><\/pre>\n<p><\/p>\n<p>Po obnov\u011b se pod\u00edv\u00e1me na tabulku indexing_table.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\"> 2020-01-29 09:41:25.226198+00\n 2020-01-29 09:42:25.336989+00\n 2020-01-29 09:43:25.356069+00\n 2020-01-29 09:44:25.37381+00\n 2020-01-29 09:45:25.392944+00<\/code><\/pre>\n<p><\/p>\n<p>Spou\u0161t\u00edme PostgreSQL. PostgreSQL spust\u00ed proces obnovy z archivovan\u00fdch WAL a teprve pot\u00e9 se datab\u00e1ze otev\u0159e. <\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">systemctl start postgresql-9.6\ntail -fn100 \/var\/lib\/pgsql\/9.6\/data\/pg_log\/postgresql-Wed.log<\/code><\/pre>\n<p><\/p>\n<h3 id=\"testirovanie\">Testov\u00e1n\u00ed<\/h3>\n<p><\/p>\n<p>Generujeme datab\u00e1zi o velikosti 1 GB, jak je pops\u00e1no zde. <noindex><a rel=\"nofollow\" href=\"https:\/\/gist.github.com\/ololobus\/5b25c432f208d7eb31051a5f238dffff\">https:\/\/gist.github.com\/ololobus\/5b25c432f208d7eb31051a5f238dffff<\/a><\/noindex><\/p>\n<p><\/p>\n<p>\u017d\u00e1d\u00e1me o velikost bucketu po vygenerov\u00e1n\u00ed 1 GB dat.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">postgres=# SELECT pg_size_pretty(pg_database_size('test1'));\npg_size_pretty\n----------------\n1003 MB<\/code><\/pre>\n<p><\/p>\n<p>s4cmd \u2014 bezplatn\u00fd n\u00e1stroj p\u0159\u00edkazov\u00e9ho \u0159\u00e1dku pro pr\u00e1ci s daty ulo\u017een\u00fdmi v \u00falo\u017ei\u0161ti Amazon S3. Tento n\u00e1stroj je naps\u00e1n v programovac\u00edm jazyce Python, a d\u00edky tomu m\u016f\u017ee b\u00fdt pou\u017eit v opera\u010dn\u00edch syst\u00e9mech Windows i Linux.<\/p>\n<p><\/p>\n<p>Nainstalujeme s4cmd.<\/p>\n<p><\/p>\n<pre><code class=\"plaintext\">pip install s4cmd<\/code><\/pre>\n<p><\/p>\n<h4 id=\"lz4\">LZ4<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">s4cmd --endpoint-url=http:\/\/ip-adresa-serveru-minio:9000 --access-key=xxxx --secret-key=yyyy du -r s3:\/\/pg-backups\n840540822       s3:\/\/pg-backups\/wal_005\/\n840 MB ve form\u00e1tu lz4 pouze WAL logy\n\n\u00dapln\u00fd backup s lz4 - 1 GB dat\ntime backup_push.sh\nreal 0m18.582s\n\nVelikost S3 bucketu po \u00fapln\u00e9m backupu\n\n581480085       s3:\/\/pg-backups\/basebackups_005\/\n842374424   s3:\/\/pg-backups\/wal_005\n581 MB zab\u00edr\u00e1 \u00fapln\u00fd backup<\/code><\/pre>\n<p><\/p>\n<h4 id=\"lzma\">LZMA<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">Po vygenerov\u00e1n\u00ed 1 GB dat\n338413694       s3:\/\/pg-backups\/wal_005\/\n338 MB log\u016f ve form\u00e1tu lzma\n\n\u010cas generov\u00e1n\u00ed \u00fapln\u00e9ho backupu\ntime backup_push.sh\nreal    5m25.054s\n\nVelikost bucketu v S3\n270310495       s3:\/\/pg-backups\/basebackups_005\/\n433485092   s3:\/\/pg-backups\/wal_005\/\n\n270 MB zab\u00edr\u00e1 \u00fapln\u00fd backup ve form\u00e1tu lzma<\/code><\/pre>\n<p><\/p>\n<h4 id=\"brotli\">Brotli<\/h4>\n<p><\/p>\n<pre><code class=\"plaintext\">Po vygenerov\u00e1n\u00ed 1 GB dat\n459229886       s3:\/\/pg-backups\/wal_005\/\n459 MB log\u016f ve form\u00e1tu brotli\n\n\u010cas generov\u00e1n\u00ed \u00fapln\u00e9ho backupu\nreal    0m23.408s\n\nVelikost bucketu v S3\n312960942       s3:\/\/pg-backups\/basebackups_005\/\n459309262   s3:\/\/pg-backups\/wal_005\/\n\n312 MB zab\u00edr\u00e1 \u00fapln\u00fd backup ve form\u00e1tu brotli\n<\/code><\/pre>\n<p><\/p>\n<p>Srovn\u00e1n\u00ed v\u00fdsledk\u016f na grafu.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Sezn\u00e1men\u00ed se se syst\u00e9mem z\u00e1lohov\u00e1n\u00ed PostgreSQL wal-g\" src=\"\/wp-content\/uploads\/2020\/01\/eeb4f6ae485f086cba126de323f900db.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Jak vid\u00edme, Brotli je velikostn\u011b srovnateln\u00fd s LZMA, ale backup prob\u00edh\u00e1 za \u010das LZ4.<\/p>\n<p><\/p>\n<p>Chat rusky mluv\u00edc\u00ed komunity PostgreSQL: <noindex><a rel=\"nofollow\" href=\"https:\/\/t.me\/pgsql\">https:\/\/t.me\/pgsql<\/a><\/noindex><\/p>\n<p><\/p>\n<p>Pros\u00edm, dejte hv\u011bzdi\u010dku na Githubu, pokud pou\u017e\u00edv\u00e1te <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wal-g\/wal-g\">wal-g<\/a><\/noindex><\/p>\n<p>Zdroj: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/486188\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430. \u041f\u043e \u0441\u0432\u043e\u0435\u0439 \u043e\u0441\u043d\u043e\u0432\u043d\u043e\u0439 \u0444\u0443\u043d\u043a\u0446\u0438\u043e\u043d\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043e\u043d \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043d\u0430\u0441\u043b\u0435\u0434\u043d\u0438\u043a\u043e\u043c \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0433\u043e \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430 WAL-E, \u043d\u043e \u043f\u0435\u0440\u0435\u043f\u0438\u0441\u0430\u043d\u043d\u044b\u043c \u043d\u0430 Go. \u041d\u043e \u0432 WAL-G \u0435\u0441\u0442\u044c \u043e\u0434\u043d\u0430 \u0432\u0430\u0436\u043d\u0430\u044f \u043d\u043e\u0432\u0430\u044f \u043e\u0441\u043e\u0431\u0435\u043d\u043d\u043e\u0441\u0442\u044c \u2014 \u0434\u0435\u043b\u044c\u0442\u0430-\u043a\u043e\u043f\u0438\u0438. \u0414\u0435\u043b\u044c\u0442\u0430-\u043a\u043e\u043f\u0438\u0438 WAL-G \u0445\u0440\u0430\u043d\u044f\u0442 \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u044b \u0444\u0430\u0439\u043b\u043e\u0432, \u0438\u0437\u043c\u0435\u043d\u0438\u0432\u0448\u0438\u0435\u0441\u044f \u0441 \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0435\u0439 \u0432\u0435\u0440\u0441\u0438\u0438 \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0439 \u043a\u043e\u043f\u0438\u0438. \u0412 WAL-G \u0440\u0435\u0430\u043b\u0438\u0437\u043e\u0432\u0430\u043d\u043e \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043c\u043d\u043e\u0433\u043e \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u043f\u043e \u0440\u0430\u0441\u043f\u0430\u0440\u0430\u043b\u043b\u0435\u043b\u0438\u0432\u0430\u043d\u0438\u044e [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":55885,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55884","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.3 - aioseo.com -->\n\t<meta name=\"description\" content=\"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.3\" \/>\n\t\t<meta property=\"og:locale\" content=\"cs_CZ\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0417\u043d\u0430\u043a\u043e\u043c\u0441\u0442\u0432\u043e \u0441 wal-g \u0441\u0438\u0441\u0442\u0435\u043c\u043e\u0439 \u0431\u0435\u043a\u0430\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-30T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:04:03+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Sezn\u00e1men\u00ed se syst\u00e9mem z\u00e1lohov\u00e1n\u00ed wal-g pro PostgreSQL | ProHoster","description":"WAL-G \u2014 jednoduch\u00fd a efektivn\u00ed n\u00e1stroj pro z\u00e1lohov\u00e1n\u00ed PostgreSQL do cloudu.","canonical_url":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"cs_CZ","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0417\u043d\u0430\u043a\u043e\u043c\u0441\u0442\u0432\u043e \u0441 wal-g \u0441\u0438\u0441\u0442\u0435\u043c\u043e\u0439 \u0431\u0435\u043a\u0430\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL | ProHoster","og:description":"WAL-G \u2014 \u043f\u0440\u043e\u0441\u0442\u043e\u0439 \u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u0439 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442 \u0434\u043b\u044f \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0433\u043e \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f PostgreSQL \u0432 \u043e\u0431\u043b\u0430\u043a\u0430.","og:url":"https:\/\/prohoster.info\/cs\/blog\/administrirovanie\/znakomstvo-s-wal-g-sistemoj-bekapirovaniya-postgresql","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-30T21:00:00+00:00","article:modified_time":"2020-02-18T11:04:03+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55884","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 19:35:40","updated":"2022-09-28 13:58:06","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/55884","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/comments?post=55884"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/55884\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media\/55885"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media?parent=55884"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/categories?post=55884"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/tags?post=55884"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}