Daraasad ku saabsan hirgelinta macquulka ganacsiga ee heerka PostgreSQL ee hawlaha kaydsan

Dhiirigelinta qoritaanka sawirkan ayaa ahayd maqaalka "Intii lagu jiray karantiil, culeyska shaqadu wuxuu kordhay 5 jeer, laakiin diyaar ayaan ahayn." Sida Lingualeo ugu guuray PostgreSQL oo leh 23 milyan isticmaale. Waxaan sidoo kale ka helay maqaalkii la daabacay 4 sano ka hor mid xiiso leh - Hirgelinta macquulka ganacsiga ee MySQL.

Waxay u muuqatay mid xiiso leh in isla fikirka - "hirgalinta macquulka ganacsiga ee database-ka".

Daraasad ku saabsan hirgelinta macquulka ganacsiga ee heerka PostgreSQL ee hawlaha kaydsan

Aniga kaliya ma ahan kan maskaxda ku soo dhacay.

Sidoo kale, mustaqbalka, waxaan rabay in aan ilaaliyo, ugu horreyntii, nafteyda, horumarinta xiisaha leh ee kacday intii lagu jiray hirgelinta. Gaar ahaan iyadoo la tixgelinayo in dhowaan go'aan istiraatijiyadeed la sameeyay si loo beddelo qaab-dhismeedka iyo u wareejinta macquulka ganacsiga ee heerka dambe. Si wax kasta oo la horumariyay ay mar dhow cidna faa’iido ugu yeelan oo aanay cidna dani ugu jirin.

Hababka lagu tilmaamay ma aha nooc ka mid ah daah-furka ama wax gaar ah. ogoow sida, Wax walba waa classic oo dhowr jeer la fuliyay (tusaale ahaan, waxaan isticmaalay hab la mid ah 20 sano ka hor on Oracle). Haddii ay dhacdo in ay u timaado qof anfacaya. Sida dhaqanku muujiyay, inta badan fikrad la mid ah waxay u timaadaa dad kala duwan si madaxbannaan. Waxayna faa'iido u leedahay inaad naftaada u haysato xusuus ahaan.

Dabcan, ma jiraan wax adduunkan ka mid ah oo qumman, khaladaadka iyo khaladaadka waa nasiib darro suurtagal. Dhaliilaha iyo faallooyinka si adag ayaa loo soo dhaweeyay oo la filayaa.iyo mid kale oo tafaasiil yar - tafaasiisha fulinta gaarka ah waa la dhaafay. Weli, wax walba weli waxaa loo isticmaalaa mashruuc shaqo oo dhab ah. Markaa, maqaalku waa uun sawir-gacmeed iyo sharraxaad fikradda guud, wax kale maaha. Waxaan rajeynayaa inay jiraan faahfaahin ku filan si loo fahmo sawirka guud.

Fikradda guud waa "qaybi oo guulaysta, qari oo yeel"

Fikradda waa mid caadi ah - qorshe gaar ah oo loogu talagalay miisaska, qorshe gaar ah oo loogu talagalay hawlaha kaydsan.
Macmiilku si toos ah uma heli karo xogta. Dhammaan macmiilku wuxuu samayn karaa waa inuu waco shaqada kaydsan oo uu habeeyo jawaabta la helay.

Doorarka

CREATE ROLE store;

CREATE ROLE sys_functions;

CREATE ROLE loc_audit_functions;

CREATE ROLE service_functions;

CREATE ROLE business_functions;

Qorshe

Qorshaha kaydinta miiska

Shaxda bartilmaameedka ah ee fuliya maadooyinka.

CREATE SCHEMA store AUTHORIZATION store ;

jaantuska shaqada nidaamka

Hawlaha nidaamka, gaar ahaan qorista isbeddellada miiska.

CREATE SCHEMA sys_functions AUTHORIZATION sys_functions ;

Nidaamka hantidhawrka maxaliga ah

Hawlaha iyo miisaska si loo hirgeliyo xisaabinta maxalliga ah ee fulinta hawlaha kaydsan iyo isbeddelka miisaska bartilmaameedka.

CREATE SCHEMA loc_audit_functions AUTHORIZATION loc_audit_functions;

jaantuska shaqada adeegga

Hawlaha adeegga iyo hawlaha DML.

CREATE SCHEMA service_functions AUTHORIZATION service_functions;

jaantuska shaqada ganacsiga

Hawlaha hawlaha ganacsi ee ugu dambeeya ee loo yaqaan macmiilku.

CREATE SCHEMA business_functions AUTHORIZATION business_functions;

Xuquuqda galitaanka

Doorka - DBA waxay si buuxda u heli kartaa dhammaan qorshayaasha (oo ka soocan doorka Mulkiilaha DB).

CREATE ROLE dba_role;
GRANT store TO dba_role;
GRANT sys_functions TO dba_role;
GRANT loc_audit_functions TO dba_role;
GRANT service_functions TO dba_role;
GRANT business_functions TO dba_role;

Doorka - USER ayaa mudnaanta leh SAXIIX shaxda hawlaha_ganacsiga.

CREATE ROLE user_role;

Mudnaanta u dhaxaysa qorshayaasha

BILAASH
Maadaama dhammaan hawlaha la abuuray sifada QEEXA AMNIGA tilmaamaha loo baahan yahay KA NOQO FULINTA HAWLAHA OO DHAN…

REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA sys_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  loc_audit_functions  FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  service_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  business_functions FROM public ; 

GRANT USAGE ON SCHEMA sys_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA sys_functions TO dba_role ;
GRANT USAGE ON SCHEMA loc_audit_functions  TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA loc_audit_functions  TO dba_role ;
GRANT USAGE ON SCHEMA service_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA service_functions TO dba_role ;
GRANT USAGE ON SCHEMA business_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO dba_role ;
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO user_role ;

GRANT ALL PRIVILEGES ON SCHEMA store TO GROUP business_functions ;
GRANT ALL PRIVILEGES ON ALL TABLES IN SCHEMA store TO business_functions ;
GRANT USAGE ON ALL SEQUENCES IN SCHEMA store TO business_functions ;

Markaa schema database waa diyaar. Waxaad bilaabi kartaa buuxinta xogta.

Miisaska bartilmaameedka

Samaynta miisaska waa wax yar. Ma jiraan astaamo gaar ah, marka laga reebo in la go'aamiyay inaan la isticmaalin Taxane oo si cad u soo saar taxane. Waxaa dheer, dabcan, isticmaalka ugu badan ee tilmaamaha

COMMENT ON ...

Faallooyinka loogu talagalay всСх walxaha, iyada oo aan laga reebo.

Hantidhawrka maxaliga ah

Si aad u gasho fulinta hawlaha kaydsan iyo isbeddelada miisaska bartilmaameedka ah, miiska xisaabinta maxalliga ah ayaa la isticmaalaa, oo ay ku jiraan, waxyaabo kale, faahfaahinta xiriirka macmiilka, calaamadda moduleka loo yaqaan, iyo qiyamka dhabta ah ee gelinta iyo xuduudaha wax soo saarka ee qaabka JSON.

Hawlaha nidaamka

Naqshadeynta isbeddelka qorista ee jaantusyada bartilmaameedka. Waa hawlo kiciya.

Template - shaqada nidaamka

---------------------------------------------------------
-- INSERT
CREATE OR REPLACE FUNCTION sys_functions.table_insert_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'insert' , json_build_object('id', NEW.id)  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_insert AFTER INSERT ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_insert_log();

---------------------------------------------------------
-- UPDATE
CREATE OR REPLACE FUNCTION sys_functions.table_update_log ()
RETURNS TRIGGER AS $$
BEGIN
  IF OLD.column != NEW.column
  THEN
    PERFORM loc_audit_functions.make_log( ' '||'table' , 'update' , json_build_object('OLD.column', OLD.column , 'NEW.column' , NEW.column )  );
  END IF ;
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_update AFTER UPDATE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_update_log ();

---------------------------------------------------------
-- DELETE
CREATE OR REPLACE FUNCTION sys_functions.table_delete_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'delete' , json_build_object('id', OLD.id )  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_delete AFTER DELETE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_delete_log ();

Hawlaha adeegga

Loogu talagalay in lagu fuliyo adeegyada iyo hawlgallada DML ee miisaska bartilmaameedka ah.

Template - shaqada adeegga

--INSERT
--RETURN id OF NEW ROW
CREATE OR REPLACE FUNCTION service_functions.table_insert ( new_column store.table.column%TYPE )
RETURNS integer AS $$
DECLARE
  new_id integer ;
BEGIN
  -- Generate new id
  new_id = nextval('store.table.seq');

  -- Insert into table
  INSERT INTO store.table
  ( 
    id ,
    column
   )
  VALUES
  (
   new_id ,
   new_column
   );

RETURN new_id ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

--DELETE
--RETURN ROW NUMBERS DELETED
CREATE OR REPLACE FUNCTION service_functions.table_delete ( current_id integer ) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ;    
BEGIN
  DELETE FROM store.table WHERE id = current_id; 

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;
 
-- UPDATE DETAILS
-- RETURN ROW NUMBERS UPDATED
CREATE OR REPLACE FUNCTION service_functions.table_update_column 
(
  current_id integer 
  ,new_column store.table.column%TYPE
) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ; 
BEGIN
  UPDATE  store.table
  SET
    column = new_column
  WHERE id = current_id;

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Hawlaha ganacsiga

Loogu talagalay hawlaha ganacsi ee ugu dambeeya ee loo yaqaan macmiilka. Had iyo jeer way soo noqdaan - JSON. Si aad u dhexgasho oo aad u gasho khaladaadka fulinta, isticmaal block MARKA LAGA REEBO.

Template - shaqada ganacsiga

CREATE OR REPLACE FUNCTION business_functions.business_function_template(
--Input parameters        
 )
RETURNS JSON AS $$
DECLARE
  ------------------------
  --for exception catching
  error_message text ;
  error_json json ;
  result json ;
  ------------------------ 
BEGIN
--LOGGING
  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'STARTED',
    json_build_object
    (
	--IN Parameters
    ) 
   );

  PERFORM business_functions.notice('business_function_template');            

  --START BUSINESS PART
  --END BUSINESS PART

  -- SUCCESFULLY RESULT
  PERFORM business_functions.notice('result');
  PERFORM business_functions.notice(result);

  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'FINISHED', 
    json_build_object( 'result',result )
  );

  RETURN result ;
----------------------------------------------------------------------------------------------------------
-- EXCEPTION CATCHING
EXCEPTION                        
  WHEN OTHERS THEN    
    PERFORM loc_audit_functions.make_log
    (
      'business_function_template',
      'STARTED',
      json_build_object
      (
	--IN Parameters	
      ) , TRUE );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLSTATE',SQLSTATE ), TRUE 
     );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLERRM',SQLERRM  ), TRUE 
      );

     GET STACKED DIAGNOSTICS error_message = RETURNED_SQLSTATE ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-RETURNED_SQLSTATE',json_build_object('RETURNED_SQLSTATE',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = COLUMN_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-COLUMN_NAME',
       json_build_object('COLUMN_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = CONSTRAINT_NAME ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-CONSTRAINT_NAME',
      json_build_object('CONSTRAINT_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_DATATYPE_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_DATATYPE_NAME',
       json_build_object('PG_DATATYPE_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = MESSAGE_TEXT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-MESSAGE_TEXT',json_build_object('MESSAGE_TEXT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = SCHEMA_NAME ;
     PERFORM loc_audit_functions.make_log
     (s
       'business_function_template',
       ' ERROR-SCHEMA_NAME',json_build_object('SCHEMA_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_DETAIL ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_DETAIL',
      json_build_object('PG_EXCEPTION_DETAIL',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_HINT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_EXCEPTION_HINT',json_build_object('PG_EXCEPTION_HINT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_CONTEXT ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_CONTEXT',json_build_object('PG_EXCEPTION_CONTEXT',error_message  ), TRUE );                                      

    RAISE WARNING 'ALARM: %' , SQLERRM ;

    SELECT json_build_object
    (
      'isError' , TRUE ,
      'errorMsg' , SQLERRM
     ) INTO error_json ;

  RETURN  error_json ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Natiijada

Si loo qeexo sawirka guud, waxaan filayaa inay ku filan tahay. Haddii qof uu xiiseynayo faahfaahinta iyo natiijooyinka, qor faallooyinka, waxaan ku farxi doonaa inaan ku daro taabasho dheeraad ah sawirka.

PS

Gelitaanka khalad fudud - nooca cabbirka gelinta

-[ RECORD 1 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1072
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          | STARTED
jsonb_pretty    | {
                |     "dko": {
                |         "id": 4,
                |         "type": "Type1",                                                                                                                                                                                            
                |         "title": "CREATED BY addKD",
                |         "Weight": 10,
                |         "Tr": "300",
                |         "reduction": 10,
                |         "isTrud": "TRUE",
                |         "description": "decription",
                |         "lowerTr": "100",
                |         "measurement": "measurement1",
                |         "methodology": "m1",                                                                                                                                                                                           
                |         "passportUrl": "files",
                |         "upperTr": "200",
                |         "weightingFactor": 100.123,
                |         "actualTrValue": null,
                |         "upperTrCalcNumber": "120"
                |     },
                |     "CardId": 3
                | }
-[ RECORD 2 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1073
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLSTATE": "22P02"
                | }
-[ RECORD 3 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1074
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLERRM": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 4 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1075
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-RETURNED_SQLSTATE
jsonb_pretty    | {
                |     "RETURNED_SQLSTATE": "22P02"
                | }
-[ RECORD 5 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1076
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-COLUMN_NAME
jsonb_pretty    | {
                |     "COLUMN_NAME": ""
                | }

-[ RECORD 6 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1077
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-CONSTRAINT_NAME
jsonb_pretty    | {
                |     "CONSTRAINT_NAME": ""
                | }
-[ RECORD 7 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1078
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_DATATYPE_NAME
jsonb_pretty    | {
                |     "PG_DATATYPE_NAME": ""
                | }
-[ RECORD 8 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1079
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 9 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1080
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-SCHEMA_NAME
jsonb_pretty    | {
                |     "SCHEMA_NAME": ""
                | }
-[ RECORD 10 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1081
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_DETAIL
jsonb_pretty    | {
                |     "PG_EXCEPTION_DETAIL": ""
                | }
-[ RECORD 11 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1082
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_HINT
jsonb_pretty    | {
                |     "PG_EXCEPTION_HINT": ""
                | }
-[ RECORD 12 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1083
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_CONTEXT
jsonb_pretty    | {
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }

Source: www.habr.com

Add a comment