Kafukufuku wogwiritsa ntchito malingaliro abizinesi pamlingo wa PostgreSQL ntchito zosungidwa

Chilimbikitso cholemba chojambulachi chinali nkhaniyo "Panthawi yokhala kwaokha, ntchito zidakwera kasanu, koma tinali okonzeka." Momwe Lingualeo idasamukira ku PostgreSQL yokhala ndi ogwiritsa ntchito 5 miliyoni. Ndapezanso nkhani yomwe idasindikizidwa zaka 4 zapitazo kukhala yosangalatsa - Kukhazikitsa malingaliro abizinesi mu MySQL.

Zinkawoneka zosangalatsa kuti lingaliro lomwelo - "khazikitsani malingaliro abizinesi mu database".

Kafukufuku wogwiritsa ntchito malingaliro abizinesi pamlingo wa PostgreSQL ntchito zosungidwa

Siine ndekha amene ndinabwera m’maganizo.

Komanso, m'tsogolomu, ndinkafuna kusunga, choyamba, kwa ine ndekha, zochitika zosangalatsa zomwe zidachitika panthawi yokhazikitsidwa. Makamaka poganizira kuti posachedwapa lingaliro lachidziwitso lidapangidwa kuti lisinthe zomangamanga ndikusintha malingaliro abizinesi kupita ku gawo lakumbuyo. Kotero kuti chirichonse chomwe chapangidwa posachedwapa sichidzakhala chothandiza kwa aliyense ndipo sichidzakhala ndi chidwi ndi aliyense.

Njira zomwe zafotokozedwazo si zamtundu wina wotulukira kapena zapadera. mukudziwa momwe, Chilichonse ndi chapamwamba ndipo chakhala chikugwiritsidwa ntchito kangapo (mwachitsanzo, ndinagwiritsa ntchito njira yofananira zaka 20 zapitazo pa Oracle) Ndinangoganiza zosonkhanitsa chirichonse pamalo amodzi. Zikafika pothandiza munthu. Monga momwe zasonyezera, nthawi zambiri lingaliro lomwelo limabwera kwa anthu osiyanasiyana paokha. Ndipo ndizothandiza kuzisungira nokha ngati chikumbutso.

Zoonadi, palibe chilichonse m'dziko lino chomwe chili changwiro, zolakwa ndi typos mwatsoka ndizotheka. Kudzudzula ndi ndemanga zimalandiridwa kwambiri ndikuyembekezeredwa.Ndiponso mfundo ina yaying'ono - tsatanetsatane wokhudza kukhazikitsa sikunatchulidwe. Komabe, chilichonse chikugwiritsidwabe ntchito muntchito yeniyeni yogwira ntchito. Chifukwa chake, nkhaniyi ndi chithunzi chabe komanso kufotokozera za lingaliro lonse, palibenso china. Ndikukhulupirira kuti pali zambiri zokwanira kuti mumvetsetse chithunzi chonse.

Lingaliro lalikulu ndi "gawikana ndikugonjetsa, bisala ndi kukhala"

Lingaliro ndi lachikale - schema yosiyana ya matebulo, schema yosiyana ya ntchito zosungidwa.
Wofuna chithandizo alibe mwayi wopeza deta mwachindunji. Zonse zomwe kasitomala angachite ndikuyimbira ntchito yosungidwa ndikukonza yankho lomwe walandira.

Ntchito

CREATE ROLE store;

CREATE ROLE sys_functions;

CREATE ROLE loc_audit_functions;

CREATE ROLE service_functions;

CREATE ROLE business_functions;

Zolinga

Table yosungirako ndondomeko

Matebulo omwe amatsata mitu yankhani.

CREATE SCHEMA store AUTHORIZATION store ;

Chiwonetsero cha ntchito ya kachitidwe

Ntchito zamakina, makamaka zosintha ma tebulo odula mitengo.

CREATE SCHEMA sys_functions AUTHORIZATION sys_functions ;

Dongosolo la ma Audit a m'deralo

Ntchito ndi matebulo kuti akhazikitse kuwunika kwapafupipafupi kwa magwiridwe antchito osungidwa ndikusintha kwamatebulo omwe mukufuna.

CREATE SCHEMA loc_audit_functions AUTHORIZATION loc_audit_functions;

Chiwonetsero cha ntchito yautumiki

Ntchito za ntchito ndi ntchito za DML.

CREATE SCHEMA service_functions AUTHORIZATION service_functions;

Chiwonetsero cha ntchito ya bizinesi

Ntchito zamabizinesi omaliza otchedwa ndi kasitomala.

CREATE SCHEMA business_functions AUTHORIZATION business_functions;

Ufulu wopeza

Udindo - DBA ali ndi mwayi wofikira kuzinthu zonse (zosiyana ndi udindo wa DB Owner).

CREATE ROLE dba_role;
GRANT store TO dba_role;
GRANT sys_functions TO dba_role;
GRANT loc_audit_functions TO dba_role;
GRANT service_functions TO dba_role;
GRANT business_functions TO dba_role;

Udindo - USER ali ndi mwayi WERENGANI mu chithunzi bizinesi_ntchito.

CREATE ROLE user_role;

Mwayi pakati pa ziwembu

ZOPEREKA
Popeza ntchito zonse zimapangidwa ndi chikhalidwe KUSINTHA KWA CHITENDERO malangizo ofunikira THETSANI NTCHITO PA NTCHITO ZONSE… KUCHOKERA pagulu;

REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA sys_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  loc_audit_functions  FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  service_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  business_functions FROM public ; 

GRANT USAGE ON SCHEMA sys_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA sys_functions TO dba_role ;
GRANT USAGE ON SCHEMA loc_audit_functions  TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA loc_audit_functions  TO dba_role ;
GRANT USAGE ON SCHEMA service_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA service_functions TO dba_role ;
GRANT USAGE ON SCHEMA business_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO dba_role ;
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO user_role ;

GRANT ALL PRIVILEGES ON SCHEMA store TO GROUP business_functions ;
GRANT ALL PRIVILEGES ON ALL TABLES IN SCHEMA store TO business_functions ;
GRANT USAGE ON ALL SEQUENCES IN SCHEMA store TO business_functions ;

Chifukwa chake schema ya database yakonzeka. Mukhoza kuyamba kudzaza deta.

Matebulo omwe mukufuna

Kupanga matebulo ndikosavuta. Palibe mawonekedwe apadera, kupatula kuti adaganiza kuti asagwiritse ntchito ZOTHANDIZA ndi kupanga zotsatizana momveka bwino. Komanso, ndithudi, ntchito pazipita malangizo

COMMENT ON ...

Ndemanga za всСх zinthu, popanda kupatula.

Audit m'deralo

Kuti mulembetse ntchito zosungidwa ndikusintha pamatebulo omwe mukufuna, tebulo lowerengera lamba limagwiritsidwa ntchito, lomwe limaphatikizapo, mwa zina, tsatanetsatane wa kulumikizana kwamakasitomala, chizindikiro cha gawo lotchedwa, ndi zowona zenizeni za zomwe alowetsa ndi zotuluka mu mawonekedwe a JSON.

Ntchito zadongosolo

Zapangidwa kuti zisinthe zodula pamatebulo omwe mukufuna. Ndi ntchito zoyambitsa.

Template - ntchito ya dongosolo

---------------------------------------------------------
-- INSERT
CREATE OR REPLACE FUNCTION sys_functions.table_insert_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'insert' , json_build_object('id', NEW.id)  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_insert AFTER INSERT ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_insert_log();

---------------------------------------------------------
-- UPDATE
CREATE OR REPLACE FUNCTION sys_functions.table_update_log ()
RETURNS TRIGGER AS $$
BEGIN
  IF OLD.column != NEW.column
  THEN
    PERFORM loc_audit_functions.make_log( ' '||'table' , 'update' , json_build_object('OLD.column', OLD.column , 'NEW.column' , NEW.column )  );
  END IF ;
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_update AFTER UPDATE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_update_log ();

---------------------------------------------------------
-- DELETE
CREATE OR REPLACE FUNCTION sys_functions.table_delete_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'delete' , json_build_object('id', OLD.id )  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_delete AFTER DELETE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_delete_log ();

Ntchito zautumiki

Zapangidwa kuti zigwiritse ntchito ntchito ndi DML pamatebulo omwe mukufuna.

Template - ntchito ya utumiki

--INSERT
--RETURN id OF NEW ROW
CREATE OR REPLACE FUNCTION service_functions.table_insert ( new_column store.table.column%TYPE )
RETURNS integer AS $$
DECLARE
  new_id integer ;
BEGIN
  -- Generate new id
  new_id = nextval('store.table.seq');

  -- Insert into table
  INSERT INTO store.table
  ( 
    id ,
    column
   )
  VALUES
  (
   new_id ,
   new_column
   );

RETURN new_id ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

--DELETE
--RETURN ROW NUMBERS DELETED
CREATE OR REPLACE FUNCTION service_functions.table_delete ( current_id integer ) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ;    
BEGIN
  DELETE FROM store.table WHERE id = current_id; 

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;
 
-- UPDATE DETAILS
-- RETURN ROW NUMBERS UPDATED
CREATE OR REPLACE FUNCTION service_functions.table_update_column 
(
  current_id integer 
  ,new_column store.table.column%TYPE
) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ; 
BEGIN
  UPDATE  store.table
  SET
    column = new_column
  WHERE id = current_id;

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Ntchito zamabizinesi

Zapangidwira ntchito zomaliza zamabizinesi zomwe zimatchedwa ndi kasitomala. Amabwerera nthawi zonse - JSON. Kuti muchepetse ndikulowetsa zolakwika, gwiritsani ntchito block KUKHALA.

Template - ntchito ya bizinesi

CREATE OR REPLACE FUNCTION business_functions.business_function_template(
--Input parameters        
 )
RETURNS JSON AS $$
DECLARE
  ------------------------
  --for exception catching
  error_message text ;
  error_json json ;
  result json ;
  ------------------------ 
BEGIN
--LOGGING
  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'STARTED',
    json_build_object
    (
	--IN Parameters
    ) 
   );

  PERFORM business_functions.notice('business_function_template');            

  --START BUSINESS PART
  --END BUSINESS PART

  -- SUCCESFULLY RESULT
  PERFORM business_functions.notice('result');
  PERFORM business_functions.notice(result);

  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'FINISHED', 
    json_build_object( 'result',result )
  );

  RETURN result ;
----------------------------------------------------------------------------------------------------------
-- EXCEPTION CATCHING
EXCEPTION                        
  WHEN OTHERS THEN    
    PERFORM loc_audit_functions.make_log
    (
      'business_function_template',
      'STARTED',
      json_build_object
      (
	--IN Parameters	
      ) , TRUE );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLSTATE',SQLSTATE ), TRUE 
     );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLERRM',SQLERRM  ), TRUE 
      );

     GET STACKED DIAGNOSTICS error_message = RETURNED_SQLSTATE ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-RETURNED_SQLSTATE',json_build_object('RETURNED_SQLSTATE',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = COLUMN_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-COLUMN_NAME',
       json_build_object('COLUMN_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = CONSTRAINT_NAME ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-CONSTRAINT_NAME',
      json_build_object('CONSTRAINT_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_DATATYPE_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_DATATYPE_NAME',
       json_build_object('PG_DATATYPE_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = MESSAGE_TEXT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-MESSAGE_TEXT',json_build_object('MESSAGE_TEXT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = SCHEMA_NAME ;
     PERFORM loc_audit_functions.make_log
     (s
       'business_function_template',
       ' ERROR-SCHEMA_NAME',json_build_object('SCHEMA_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_DETAIL ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_DETAIL',
      json_build_object('PG_EXCEPTION_DETAIL',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_HINT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_EXCEPTION_HINT',json_build_object('PG_EXCEPTION_HINT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_CONTEXT ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_CONTEXT',json_build_object('PG_EXCEPTION_CONTEXT',error_message  ), TRUE );                                      

    RAISE WARNING 'ALARM: %' , SQLERRM ;

    SELECT json_build_object
    (
      'isError' , TRUE ,
      'errorMsg' , SQLERRM
     ) INTO error_json ;

  RETURN  error_json ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Zotsatira

Kufotokozera chithunzi chonse, ndikuganiza kuti ndizokwanira. Ngati wina ali ndi chidwi ndi tsatanetsatane ndi zotsatira, lembani ndemanga, ndidzakhala wokondwa kuwonjezera zina pa chithunzicho.

PS

Kulowetsa cholakwika chosavuta - mtundu wa parameter yolowetsa

-[ RECORD 1 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1072
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          | STARTED
jsonb_pretty    | {
                |     "dko": {
                |         "id": 4,
                |         "type": "Type1",                                                                                                                                                                                            
                |         "title": "CREATED BY addKD",
                |         "Weight": 10,
                |         "Tr": "300",
                |         "reduction": 10,
                |         "isTrud": "TRUE",
                |         "description": "decription",
                |         "lowerTr": "100",
                |         "measurement": "measurement1",
                |         "methodology": "m1",                                                                                                                                                                                           
                |         "passportUrl": "files",
                |         "upperTr": "200",
                |         "weightingFactor": 100.123,
                |         "actualTrValue": null,
                |         "upperTrCalcNumber": "120"
                |     },
                |     "CardId": 3
                | }
-[ RECORD 2 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1073
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLSTATE": "22P02"
                | }
-[ RECORD 3 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1074
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLERRM": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 4 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1075
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-RETURNED_SQLSTATE
jsonb_pretty    | {
                |     "RETURNED_SQLSTATE": "22P02"
                | }
-[ RECORD 5 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1076
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-COLUMN_NAME
jsonb_pretty    | {
                |     "COLUMN_NAME": ""
                | }

-[ RECORD 6 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1077
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-CONSTRAINT_NAME
jsonb_pretty    | {
                |     "CONSTRAINT_NAME": ""
                | }
-[ RECORD 7 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1078
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_DATATYPE_NAME
jsonb_pretty    | {
                |     "PG_DATATYPE_NAME": ""
                | }
-[ RECORD 8 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1079
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 9 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1080
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-SCHEMA_NAME
jsonb_pretty    | {
                |     "SCHEMA_NAME": ""
                | }
-[ RECORD 10 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1081
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_DETAIL
jsonb_pretty    | {
                |     "PG_EXCEPTION_DETAIL": ""
                | }
-[ RECORD 11 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1082
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_HINT
jsonb_pretty    | {
                |     "PG_EXCEPTION_HINT": ""
                | }
-[ RECORD 12 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1083
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_CONTEXT
jsonb_pretty    | {
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }

Source: www.habr.com

Kuwonjezera ndemanga