kordhinta pgsentinel :
Β«Dhammaan macluumaadka la ururiyey waxa lagu kaydiyaa RAM oo keliya, iyo xaddiga xusuusta la isticmaalo waxaa lagu nidaamiyaa tirada diiwaannada kaydsan ee ugu dambeeya.
Goobta su'aalaha ayaa lagu daray - isla su'aal ka timid pg_stat_statements kordhinta (ku-rakici hore ayaa loo baahan yahay).Β«
Tani, dabcan, wax badan ayay caawin doontaa, laakiin waxa ugu dhibka badan ayaa ah qodobka koowaad. "Dhammaan macluumaadka la ururiyey waxa lagu kaydiyaa RAM kaliya β, i.e. waxaa saameyn ku leh saldhigga la beegsanayo. Intaa waxaa dheer, ma jiraan taariikhda quful iyo tirakoobka miiska. Kuwaas. Xalku wuxuu guud ahaan ku hadlayaa mid aan dhammaystirnayn: "Weli ma jirto xirmo diyaarsan oo la rakibay Waxaa lagu talinayaa inaad soo dejiso ilaha oo aad adigu ururiso maktabadda. Marka hore waxaad u baahan tahay inaad ku rakibto xirmada "devel" ee serverkaaga oo aad dejiso dariiqa pg_config ee doorsoomiyaha PATH.".
Guud ahaan, waxaa jira buuq badan, iyo haddii ay dhacdo xog-ururin wax-soo-saar halis ah, waxaa laga yaabaa inaysan suurtagal ahayn in wax lagu sameeyo server-ka. Waxaan u baahanahay inaan la nimaadno wax noo gaar ah mar kale.
Digniin
Sababo la xiriira mugga oo aad u weyn iyo xilliga imtixaan la'aanta awgeed, maqaalku wuxuu inta badan ka mid yahay dabeecadda macluumaadka, halkii uu ahaan lahaa qoraallo iyo natiijooyin dhexdhexaad ah.
Wax badan oo faahfaahsan ayaa la diyaarin doonaa mar dambe, qaybo
Shuruudaha qabyada ah ee xalka
Waa lagama maarmaan in la horumariyo qalab kuu ogolaanaya inaad kaydiso:
Shardiga xalinta-Yaree saamaynta ay ku leedahay xogta xogta la beegsanayo.
Fikrad guud- Wakiilka xog ururinta laguma daah-furin kaydka bartilmaameedka, laakiin waxa la dhexgeliyaa kaydinta xogta sida adeeg habaysan. Haa, lumitaanka xogta qaarkood waa suurtagal, laakiin tani maaha mid muhiim u ah warbixinta, laakiin ma jirto wax saameyn ah oo ku saabsan xogta bartilmaameedka marka la eego xusuusta iyo booska diskka. Iyo kiiska isticmaalka barkada isku xirka, saameynta hababka isticmaaluhu waa mid aad u yar.
Heerarka fulinta
1.Miisaska adeegga
Nidaam gaar ah ayaa loo isticmaalaa in lagu kaydiyo miisaska, si aan loo adkeyn falanqaynta miisaska muhiimka ah ee la isticmaalo.
DROP SCHEMA IF EXISTS activity_hist ;
CREATE SCHEMA activity_hist AUTHORIZATION monitor ;
Muhiim: Qorshaha laguma abuurin kaydka bartilmaameedka, laakiin waxa lagu dhex abuuray kaydka la socodka.
pg_stat_activity aragtida taariikhda
Shaxda waxa loo isticmaalaa in lagu kaydiyo sawir-qaadista hadda ee pg_stat_activity view
waxqabadka_hist.history_pg_stat_firfircoon:
--ACTIVITY_HIST.HISTORY_PG_STAT_ACTIVITY
DROP TABLE IF EXISTS activity_hist.history_pg_stat_activity;
CREATE TABLE activity_hist.history_pg_stat_activity
(
timepoint timestamp without time zone ,
datid oid ,
datname name ,
pid integer,
usesysid oid ,
usename name ,
application_name text ,
client_addr inet ,
client_hostname text ,
client_port integer,
backend_start timestamp with time zone ,
xact_start timestamp with time zone ,
query_start timestamp with time zone ,
state_change timestamp with time zone ,
wait_event_type text ,
wait_event text ,
state text ,
backend_xid xid ,
backend_xmin xid ,
query text ,
backend_type text ,
queryid bigint
);
Si aad u dedejiso gelinta - ma jiro tusmooyin ama xaddidaadyo.
Si loo kaydiyo taariikhda lafteeda, miis qaybsan ayaa la isticmaalaa:
hawl_hist.archive_pg_stat_firfircooni:
DROP TABLE IF EXISTS activity_hist.archive_pg_stat_activity;
CREATE TABLE activity_hist.archive_pg_stat_activity
(
timepoint timestamp without time zone ,
datid oid ,
datname name ,
pid integer,
usesysid oid ,
usename name ,
application_name text ,
client_addr inet ,
client_hostname text ,
client_port integer,
backend_start timestamp with time zone ,
xact_start timestamp with time zone ,
query_start timestamp with time zone ,
state_change timestamp with time zone ,
wait_event_type text ,
wait_event text ,
state text ,
backend_xid xid ,
backend_xmin xid ,
query text ,
backend_type text ,
queryid bigint
)
PARTITION BY RANGE (timepoint);
Maadaama kiiskan aysan jirin wax shuruud ah oo loogu talagalay xawaaraha gelinta, qaar ka mid ah tusmooyinka ayaa la sameeyay si loo dedejiyo abuurista warbixinnada.
Kulanka xannibaya taariikhda
Miis ayaa loo isticmaalaa in lagu kaydiyo sawir-qaadashada hadda ee qufulka fadhiga:
waxqabadka_hist.taariikhda quful:
--ACTIVITY_HIST.HISTORY_LOCKING
DROP TABLE IF EXISTS activity_hist.history_locking;
CREATE TABLE activity_hist.history_locking
(
timepoint timestamp without time zone ,
locktype text ,
relation oid ,
mode text ,
tid xid ,
vtid text ,
pid integer ,
blocking_pids integer[] ,
granted boolean
);
Sidoo kale, si loo dedejiyo gelinta, ma jiraan tusmooyin ama xaddidaadyo.
Si loo kaydiyo taariikhda lafteeda, miis qaybsan ayaa la isticmaalaa:
dhaqdhaqaaqa_hist.archive_locking:
DROP TABLE IF EXISTS activity_hist.archive_locking;
CREATE TABLE activity_hist.archive_locking
(
timepoint timestamp without time zone ,
locktype text ,
relation oid ,
mode text ,
tid xid ,
vtid text ,
pid integer ,
blocking_pids integer[] ,
granted boolean
)
PARTITION BY RANGE (timepoint);
Maadaama kiiskan aysan jirin wax shuruud ah oo loogu talagalay xawaaraha gelinta, qaar ka mid ah tusmooyinka ayaa la sameeyay si loo dedejiyo abuurista warbixinnada.
2. Buuxinta taariikhda hadda jirta
Si toos ah loo ururiyo sawir-qaadista muuqaalka, qoraalka bash ayaa la adeegsadaa kaasoo socodsiiya shaqada plpgsql.
plgsql Shaqada dblink waxa ay gashaa aragtiyaha ku jira kaydka bartilmaameedka oo waxa ay gelisaa safafka miisaska adeegga ee kaydka la socodka.
hel_hawlaha_current.sql
CREATE OR REPLACE FUNCTION activity_hist.get_current_activity( current_host text , current_s_name text , current_s_pass text ) RETURNS BOOLEAN AS $$
DECLARE
database_rec record;
dblink_str text ;
BEGIN
EXECUTE 'SELECT dblink_connect(''LINK1'',''host='||current_host||' port=5432 dbname=postgres'||
' user='||current_s_name||' password='||current_s_pass|| ' '')';
--------------------------------------------------------------------
--GET pg_stat_activity stats
INSERT INTO activity_hist.history_pg_stat_activity
(
SELECT * FROM dblink('LINK1',
'SELECT
now() ,
datid ,
datname ,
pid ,
usesysid ,
usename ,
application_name ,
client_addr ,
client_hostname ,
client_port ,
backend_start ,
xact_start ,
query_start ,
state_change ,
wait_event_type ,
wait_event ,
state ,
backend_xid ,
backend_xmin ,
query ,
backend_type
FROM pg_stat_activity
')
AS t (
timepoint timestamp without time zone ,
datid oid ,
datname name ,
pid integer,
usesysid oid ,
usename name ,
application_name text ,
client_addr inet ,
client_hostname text ,
client_port integer,
backend_start timestamp with time zone ,
xact_start timestamp with time zone ,
query_start timestamp with time zone ,
state_change timestamp with time zone ,
wait_event_type text ,
wait_event text ,
state text ,
backend_xid xid ,
backend_xmin xid ,
query text ,
backend_type text
)
);
---------------------------------------
--ACTIVITY_HIST.HISTORY_LOCKING
INSERT INTO activity_hist.history_locking
(
SELECT * FROM dblink('LINK1',
'SELECT
now() ,
lock.locktype,
lock.relation,
lock.mode,
lock.transactionid as tid,
lock.virtualtransaction as vtid,
lock.pid,
pg_blocking_pids(lock.pid),
lock.granted
FROM pg_catalog.pg_locks lock LEFT JOIN pg_catalog.pg_database db ON db.oid = lock.database
WHERE NOT lock.pid = pg_backend_pid()
')
AS t (
timepoint timestamp without time zone ,
locktype text ,
relation oid ,
mode text ,
tid xid ,
vtid text ,
pid integer ,
blocking_pids integer[] ,
granted boolean
)
);
PERFORM dblink_disconnect('LINK1');
RETURN TRUE ;
END
$$ LANGUAGE plpgsql;
Si loo ururiyo sawirada sawirada, adeegga nidaamka iyo laba qoraal ayaa la isticmaalaa:
pg_current_activity.adeegga
# /etc/systemd/system/pg_current_activity.service
[Unit]
Description=Collect history of pg_stat_activity , pg_locks
Wants=pg_current_activity.timer
[Service]
Type=forking
StartLimitIntervalSec=0
ExecStart=/home/postgres/pgutils/demon/get_current_activity.sh 10.124.70.40 postgres postgres
[Install]
WantedBy=multi-user.target
pg_current_activity.timer
# /etc/systemd/system/pg_current_activity.timer
[Unit]
Description=Run pg_current_activity.sh every 1 second
Requires=pg_current_activity.service
[Timer]
Unit=pg_current_activity.service
OnCalendar=*:*:0/1
AccuracySec=1
[Install]
WantedBy=timers.target
Aan bilowno adeega:
# nidaam-dib-u-cusbooneysiin
# systemctl bilow pg_current_activity.adeeg
Sidaa darteed, taariikhda aragtida waxaa lagu soo ururiyaa qaab sawir-qaade-labaad-labaad ah. Dabcan, haddii wax walba loo daayo sida ay yihiin, miisaska ayaa si dhakhso ah u kordhin doona xajmiga iyo wax badan ama ka yar oo wax soo saar leh ayaa noqon doona mid aan macquul ahayn.
Waa lagama maarmaan in la habeeyo kaydinta xogta.
3. Taariikhda kaydinta
Kaydinta, kaydka miisaska qaybsan* ayaa la isticmaalaa.
Qaybo cusub ayaa la abuuraa saacad kasta, halka xogtii hore laga saaro miisaska taariikhda *, markaa cabbirka miisaska taariikhda * wax badan isma beddelo xawaaraha gelintaduna ma hoos u dhaco muddo ka dib.
Abuuritaanka qaybo cusub waxaa sameeya plpgsql function function_hist.archive_current_activity. Algorithm-ka shaqadu waa mid aad u fudud (iyadoo la adeegsanayo tusaalaha qaybta shaxda_pg_stat_activity).
Abuur oo buuxi qayb cusub
EXECUTE format(
'CREATE TABLE ' || partition_name ||
' PARTITION OF activity_hist.archive_pg_stat_activity FOR VALUES FROM ( %L ) TO ( %L ) ' ,
to_char(date_trunc('year', partition_min_range ),'YYYY')||'-'||
to_char(date_trunc('month', partition_min_range ),'MM')||'-'||
to_char(date_trunc('day', partition_min_range ),'DD')||' '||
to_char(date_trunc('hour', partition_min_range ),'HH24')||':00',
to_char(date_trunc('year', partition_max_range ),'YYYY')||'-'||
to_char(date_trunc('month', partition_max_range ),'MM')||'-'||
to_char(date_trunc('day', partition_max_range ),'DD')||' '||
to_char(date_trunc('hour', partition_max_range ),'HH24')||':00'
);
INSERT INTO activity_hist.archive_pg_stat_activity
(
SELECT *
FROM activity_hist.history_pg_stat_activity
WHERE timepoint BETWEEN partition_min_range AND partition_max_range
);
Abuuritaanka tusmooyinka
EXECUTE format (
'CREATE INDEX '||index_name||
' ON '||partition_name||' ( wait_event_type , backend_type , timepoint )'
);
EXECUTE format ('CREATE INDEX '||index_name||
' ON '||partition_name||' ( wait_event_type , backend_type , timepoint , queryid )'
);
Kasaarida xogta hore shaxda history_pg_stat_activity
DELETE
FROM activity_hist.history_pg_stat_activity
WHERE timepoint < partition_max_range;
Dabcan, waqti ka waqti, qaybaha hore waa la tirtiraa sida aan loo baahnayn.
Warbixinada aasaasiga ah
Dhab ahaantii, maxaa waxaas oo dhan loo sameeyay? Si aad u hesho warbixino si aan qarsoodi lahayn u xasuusiya Oracle's AWR.
Waa muhiim in lagu daro si loo helo warbixinnada, waxaad u baahan tahay inaad dhisto xiriir ka dhexeeya pg_stat_activity iyo pg_stat_statements views. Jadwalka waxaa lagu xiray iyadoo lagu darayo tiir 'queryid' shaxda 'history_pg_stat_activity', 'archive_pg_stat_activity' miisaska. Habka lagu daro qiimaha tiirka ayaa ka baxsan baaxadda maqaalkan waxaana lagu sifeeyay halkan - pg_stat_statements + pg_stat_activity + loq_query = pg_ash? .
Wadarta wakhtiga CPU ee su'aalaha
Codsi:
WITH hist AS
(
SELECT
aa.query ,aa.queryid ,
count(*) * interval '1 second' AS duration
FROM activity_hist.archive_pg_stat_activity aa
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND backend_type = 'client backend' AND datname != 'postgres' AND ( aa.wait_event_type IS NULL ) ANDaa.state = 'active'
GROUP BY aa.wait_event_type , aa.wait_event , aa.query ,aa.queryid
UNION
SELECT
ha.query ,ha.queryid,
count(*) * interval '1 second' AS duration
FROM activity_hist.history_pg_stat_activity_for_reports ha
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND backend_type = 'client backend' AND datname != 'postgres' AND ( ha.wait_event_type IS NULL )AND ha.state = 'active'
GROUP BY ha.wait_event_type , ha.wait_event , ha.query ,ha.queryid
)
SELECT query , queryid , SUM( duration ) as duration
FROM hist
GROUP BY query , queryid
ORDER BY 3 DESC
WITH hist AS
(
SELECT
aa.query ,aa.queryid ,
count(*) * interval '1 second' AS duration
FROM activity_hist.archive_pg_stat_activity aa
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
( aa.wait_event_type IS NOT NULL )
GROUP BY aa.wait_event_type , aa.wait_event , aa.query ,aa.queryid
UNION
SELECT
ha.query ,ha.queryid,
count(*) * interval '1 second' AS duration
FROM activity_hist.history_pg_stat_activity_for_reports ha
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
( ha.wait_event_type IS NOT NULL )
GROUP BY ha.wait_event_type , ha.wait_event , ha.query ,ha.queryid
)
SELECT query , queryid , SUM( duration ) as duration
FROM hist
GROUP BY query , queryid
ORDER BY 3 DESC
WITH hist AS
(
SELECT
aa.wait_event_type , aa.wait_event
FROM activity_hist.archive_pg_stat_activity aa
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
aa.wait_event IS NOT NULL
GROUP BY aa.wait_event_type , aa.wait_event
UNION
SELECT
ha.wait_event_type , ha.wait_event
FROM activity_hist.history_pg_stat_activity_for_reports ha
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
ha.wait_event IS NOT NULL
GROUP BY ha.wait_event_type , ha.wait_event
)
SELECT wait_event_type , wait_event
FROM hist
GROUP BY wait_event_type , wait_event
ORDER BY 1 ASC,2 ASC
----------------------------------------------------------------------
WITH hist AS
(
SELECT
aa.wait_event_type , aa.wait_event , aa.query ,aa.queryid ,
count(*) * interval '1 second' AS duration
FROM activity_hist.archive_pg_stat_activity aa
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
( aa.wait_event_type = waitings_stat_rec.wait_event_type AND aa.wait_event = waitings_stat_rec.wait_event )
GROUP BY aa.wait_event_type , aa.wait_event , aa.query ,aa.queryid
UNION
SELECT
ha.wait_event_type , ha.wait_event , ha.query ,ha.queryid,
count(*) * interval '1 second' AS duration
FROM activity_hist.history_pg_stat_activity_for_reports ha
WHERE timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
backend_type = 'client backend' AND datname != 'postgres' AND
( ha.wait_event_type = waitings_stat_rec.wait_event_type AND ha.wait_event = waitings_stat_rec.wait_event )
GROUP BY ha.wait_event_type , ha.wait_event , ha.query ,ha.queryid
)
SELECT query , queryid , SUM( duration ) as duration
FROM hist
GROUP BY query , queryid
ORDER BY 3 DESC
SELECT
MIN(date_trunc('second',timepoint)) AS started ,
count(*) * interval '1 second' as duration ,
pid , blocking_pids , relation , mode , locktype
FROM
activity_hist.archive_locking al
WHERE
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
NOT granted AND
locktype = 'relation'
GROUP BY pid , blocking_pids , relation , mode , locktype
UNION
SELECT
MIN(date_trunc('second',timepoint)) AS started ,
count(*) * interval '1 second' as duration ,
pid , blocking_pids , relation , mode , locktype
FROM
activity_hist.history_locking
WHERE
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
NOT granted AND
locktype = 'relation'
GROUP BY pid , blocking_pids , relation , mode , locktype
ORDER BY 1
SELECT
blocking_pids
FROM
activity_hist.archive_locking al
WHERE
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
NOT granted AND
locktype = 'relation'
GROUP BY blocking_pids
UNION
SELECT
blocking_pids
FROM
activity_hist.history_locking
WHERE
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour') AND
NOT granted AND
locktype = 'relation'
GROUP BY blocking_pids
ORDER BY 1
---------------------------------------------------------------
SELECT
pid , usename , application_name , datname ,
MIN(date_trunc('second',timepoint)) as started ,
count(*) * interval '1 second' as duration ,
state ,
query
FROM activity_hist.archive_pg_stat_activity
WHERE pid= current_pid AND
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour')
GROUP BY pid , usename , application_name ,
datname ,
state_change,
state ,
query
UNION
SELECT
pid , usename , application_name , datname ,
MIN(date_trunc('second',timepoint)) as started ,
count(*) * interval '1 second' as duration ,
state ,
query
FROM activity_hist.history_pg_stat_activity_for_reports
WHERE pid= current_pid AND
timepoint BETWEEN pg_stat_history_begin+(current_hour_diff * interval '1 hour') AND pg_stat_history_end+(current_hour_diff * interval '1 hour')
GROUP BY pid , usename , application_name ,
datname ,
state_change,
state ,
query
ORDER BY 5 , 1
Weydiimaha aasaasiga ah ee la muujiyey iyo warbixinnada ka soo baxay ayaa durba nolosha ka dhigaya mid aad u fudud marka la falanqeynayo dhacdooyinka waxqabadka.
Iyada oo ku saleysan su'aalaha aasaasiga ah, waxaad heli kartaa warbixin si aan caddayn u eeg Oracle's AWR. Tusaalaha warbixinta oo kooban
------------------------------------------------ ---------------------------------- | WARBIXINTA LAGU DUWAN EE HABKA IYO SUGAYSIGA.
In la sii wado. Safka ku xiga waa abuurista taariikhda qufulka (pg_stat_locks), sharraxaad aad u faahfaahsan oo ku saabsan habka buuxinta miisaska.