Iwadi lori imuse ọgbọn iṣowo ni ipele ti awọn iṣẹ ipamọ PostgreSQL

Agbara fun kikọ aworan afọwọya yii ni nkan naa “Lakoko ipinya, iṣẹ ṣiṣe pọ si ni igba 5, ṣugbọn a ti ṣetan.” Bawo ni Lingualeo ṣe gbe lọ si PostgreSQL pẹlu awọn olumulo 23 milionu. Mo tun rii nkan ti a tẹjade ni ọdun 4 sẹhin ti o nifẹ si - Ṣiṣe iṣedede iṣowo ni MySQL.

O dabi enipe o dun pe ero kanna - "se owo kannaa ni database".

Iwadi lori imuse ọgbọn iṣowo ni ipele ti awọn iṣẹ ipamọ PostgreSQL

Kii ṣe emi nikan ni o wa si ọkan.

Pẹlupẹlu, fun ọjọ iwaju, Mo fẹ lati tọju, ni akọkọ, fun ara mi, awọn idagbasoke ti o nifẹ ti o dide lakoko imuse. Paapa ni akiyesi pe laipẹ laipẹ ipinnu ilana kan ti ṣe lati yi faaji pada ati gbigbe ọgbọn iṣowo lọ si ipele ẹhin. Ki ohun gbogbo ti o ti ni idagbasoke yoo laipe ko si anfani si ẹnikẹni ati ki o yoo ko si anfani si ẹnikẹni.

Awọn ọna ti a ṣapejuwe kii ṣe iru awari tabi iyasọtọ. mọ bi, Ohun gbogbo jẹ Ayebaye ati pe a ti ṣe imuse ni ọpọlọpọ igba (fun apẹẹrẹ, Mo lo iru ọna kanna ni 20 ọdun sẹyin lori Oracle) Mo kan pinnu lati gba ohun gbogbo ni aaye kan. Ni irú ti o ba wa ni ọwọ fun ẹnikan. Gẹgẹbi iṣe ti fihan, igbagbogbo imọran kanna wa si awọn eniyan oriṣiriṣi ni ominira. Ati pe o wulo lati tọju rẹ fun ara rẹ gẹgẹbi iranti.

Nitoribẹẹ, ko si nkankan ni agbaye yii ti o pe, awọn aṣiṣe ati awọn typos jẹ laanu ṣee ṣe. Lodi ati awọn asọye jẹ itẹwọgba ni agbara ati nireti. Ati pe alaye kekere kan diẹ sii - awọn alaye imuse kan pato ti yọkuro. Sibẹsibẹ, ohun gbogbo tun wa ni lilo ninu iṣẹ ṣiṣe gidi kan. Nitorinaa, nkan naa jẹ afọwọya kan ati apejuwe ti imọran gbogbogbo, ko si nkankan diẹ sii. Mo nireti pe awọn alaye to wa lati ni oye aworan gbogbogbo.

Ero gbogbogbo ni “pin ati ṣẹgun, tọju ati ti ara”

Ero naa jẹ Ayebaye - ero lọtọ fun awọn tabili, ero lọtọ fun awọn iṣẹ ti o fipamọ.
Onibara ko ni iwọle si data taara. Gbogbo alabara le ṣe ni pe iṣẹ ti o fipamọ ati ilana idahun ti o gba.

Awọn ipa

CREATE ROLE store;

CREATE ROLE sys_functions;

CREATE ROLE loc_audit_functions;

CREATE ROLE service_functions;

CREATE ROLE business_functions;

Awọn eto

Eto ipamọ tabili

Awọn tabili ibi-afẹde ti o ṣe awọn nkan koko-ọrọ.

CREATE SCHEMA store AUTHORIZATION store ;

Aworan iṣẹ eto

Awọn iṣẹ eto, ni pataki fun awọn iyipada tabili gedu.

CREATE SCHEMA sys_functions AUTHORIZATION sys_functions ;

Eto iṣayẹwo agbegbe

Awọn iṣẹ ati awọn tabili lati ṣe iṣatunṣe iṣatunṣe agbegbe ti ipaniyan ti awọn iṣẹ ipamọ ati awọn iyipada si awọn tabili ibi-afẹde.

CREATE SCHEMA loc_audit_functions AUTHORIZATION loc_audit_functions;

Aworan iṣẹ iṣẹ

Awọn iṣẹ fun iṣẹ ati awọn iṣẹ DML.

CREATE SCHEMA service_functions AUTHORIZATION service_functions;

Aworan iṣẹ iṣowo

Awọn iṣẹ fun awọn iṣẹ iṣowo ikẹhin ti a pe nipasẹ alabara.

CREATE SCHEMA business_functions AUTHORIZATION business_functions;

Awọn ẹtọ iraye si

Ipa - dba ni iwọle ni kikun si gbogbo awọn eto (yaya lati ipa Olohun DB).

CREATE ROLE dba_role;
GRANT store TO dba_role;
GRANT sys_functions TO dba_role;
GRANT loc_audit_functions TO dba_role;
GRANT service_functions TO dba_role;
GRANT business_functions TO dba_role;

Ipa - LILO ni anfani ṢE ninu aworan atọka awọn iṣẹ_iṣowo.

CREATE ROLE user_role;

Awọn anfani laarin awọn eto

FIFUN
Niwọn igba ti gbogbo awọn iṣẹ ti ṣẹda pẹlu abuda naa AABO asọye ilana ti nilo Fagilee ipaniyan LORI GBOGBO IṢẸ… LATI ita gbangba;

REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA sys_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  loc_audit_functions  FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  service_functions FROM public ; 
REVOKE EXECUTE ON ALL FUNCTION IN SCHEMA  business_functions FROM public ; 

GRANT USAGE ON SCHEMA sys_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA sys_functions TO dba_role ;
GRANT USAGE ON SCHEMA loc_audit_functions  TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA loc_audit_functions  TO dba_role ;
GRANT USAGE ON SCHEMA service_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA service_functions TO dba_role ;
GRANT USAGE ON SCHEMA business_functions TO dba_role ; 
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO dba_role ;
GRANT EXECUTE ON ALL FUNCTIONS IN SCHEMA business_functions TO user_role ;

GRANT ALL PRIVILEGES ON SCHEMA store TO GROUP business_functions ;
GRANT ALL PRIVILEGES ON ALL TABLES IN SCHEMA store TO business_functions ;
GRANT USAGE ON ALL SEQUENCES IN SCHEMA store TO business_functions ;

Nitorinaa ero data data ti ṣetan. O le bẹrẹ kikun ni data.

Awọn tabili ibi-afẹde

Ṣiṣẹda awọn tabili jẹ ohun kekere. Ko si awọn ẹya pataki, ayafi pe o pinnu lati ma lo Tẹlifisiọnu ki o si se ina awọn ọkọọkan kedere. Pẹlupẹlu, dajudaju, lilo awọn ilana ti o pọju

COMMENT ON ...

Comments fun всех ohun, lai sile.

Ayẹwo agbegbe

Lati wọle si ipaniyan ti awọn iṣẹ ti o fipamọ ati awọn ayipada si awọn tabili ibi-afẹde, tabili iṣayẹwo agbegbe ni a lo, eyiti o pẹlu, laarin awọn ohun miiran, awọn alaye ti asopọ alabara, aami ti module ti a pe, ati awọn idiyele gangan ti titẹ sii ati o wu sile ni awọn fọọmu ti JSON.

Awọn iṣẹ eto

Apẹrẹ fun gedu ayipada ninu afojusun tabili. Wọn jẹ awọn iṣẹ okunfa.

Awoṣe - eto iṣẹ

---------------------------------------------------------
-- INSERT
CREATE OR REPLACE FUNCTION sys_functions.table_insert_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'insert' , json_build_object('id', NEW.id)  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_insert AFTER INSERT ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_insert_log();

---------------------------------------------------------
-- UPDATE
CREATE OR REPLACE FUNCTION sys_functions.table_update_log ()
RETURNS TRIGGER AS $$
BEGIN
  IF OLD.column != NEW.column
  THEN
    PERFORM loc_audit_functions.make_log( ' '||'table' , 'update' , json_build_object('OLD.column', OLD.column , 'NEW.column' , NEW.column )  );
  END IF ;
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_update AFTER UPDATE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_update_log ();

---------------------------------------------------------
-- DELETE
CREATE OR REPLACE FUNCTION sys_functions.table_delete_log ()
RETURNS TRIGGER AS $$
BEGIN
  PERFORM loc_audit_functions.make_log( ' '||'table' , 'delete' , json_build_object('id', OLD.id )  );
  RETURN NULL ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

CREATE TRIGGER table_after_delete AFTER DELETE ON storage.table FOR EACH ROW EXECUTE PROCEDURE sys_functions.table_delete_log ();

Awọn iṣẹ iṣẹ

Ti ṣe apẹrẹ lati ṣe iṣẹ ati awọn iṣẹ DML lori awọn tabili ibi-afẹde.

Awoṣe - iṣẹ iṣẹ

--INSERT
--RETURN id OF NEW ROW
CREATE OR REPLACE FUNCTION service_functions.table_insert ( new_column store.table.column%TYPE )
RETURNS integer AS $$
DECLARE
  new_id integer ;
BEGIN
  -- Generate new id
  new_id = nextval('store.table.seq');

  -- Insert into table
  INSERT INTO store.table
  ( 
    id ,
    column
   )
  VALUES
  (
   new_id ,
   new_column
   );

RETURN new_id ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

--DELETE
--RETURN ROW NUMBERS DELETED
CREATE OR REPLACE FUNCTION service_functions.table_delete ( current_id integer ) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ;    
BEGIN
  DELETE FROM store.table WHERE id = current_id; 

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;
 
-- UPDATE DETAILS
-- RETURN ROW NUMBERS UPDATED
CREATE OR REPLACE FUNCTION service_functions.table_update_column 
(
  current_id integer 
  ,new_column store.table.column%TYPE
) 
RETURNS integer AS $$
DECLARE
  rows_count integer  ; 
BEGIN
  UPDATE  store.table
  SET
    column = new_column
  WHERE id = current_id;

  GET DIAGNOSTICS rows_count = ROW_COUNT;                                                                           

  RETURN rows_count ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Awọn iṣẹ iṣowo

Apẹrẹ fun awọn iṣẹ iṣowo ikẹhin ti a pe nipasẹ alabara. Wọn nigbagbogbo pada - JSON. Lati ṣe idilọwọ ati wọle awọn aṣiṣe ipaniyan, lo bulọọki naa YATO.

Awoṣe - owo iṣẹ

CREATE OR REPLACE FUNCTION business_functions.business_function_template(
--Input parameters        
 )
RETURNS JSON AS $$
DECLARE
  ------------------------
  --for exception catching
  error_message text ;
  error_json json ;
  result json ;
  ------------------------ 
BEGIN
--LOGGING
  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'STARTED',
    json_build_object
    (
	--IN Parameters
    ) 
   );

  PERFORM business_functions.notice('business_function_template');            

  --START BUSINESS PART
  --END BUSINESS PART

  -- SUCCESFULLY RESULT
  PERFORM business_functions.notice('result');
  PERFORM business_functions.notice(result);

  PERFORM loc_audit_functions.make_log
  (
    'business_function_template',
    'FINISHED', 
    json_build_object( 'result',result )
  );

  RETURN result ;
----------------------------------------------------------------------------------------------------------
-- EXCEPTION CATCHING
EXCEPTION                        
  WHEN OTHERS THEN    
    PERFORM loc_audit_functions.make_log
    (
      'business_function_template',
      'STARTED',
      json_build_object
      (
	--IN Parameters	
      ) , TRUE );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLSTATE',SQLSTATE ), TRUE 
     );

     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR',
       json_build_object('SQLERRM',SQLERRM  ), TRUE 
      );

     GET STACKED DIAGNOSTICS error_message = RETURNED_SQLSTATE ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-RETURNED_SQLSTATE',json_build_object('RETURNED_SQLSTATE',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = COLUMN_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-COLUMN_NAME',
       json_build_object('COLUMN_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = CONSTRAINT_NAME ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-CONSTRAINT_NAME',
      json_build_object('CONSTRAINT_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_DATATYPE_NAME ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_DATATYPE_NAME',
       json_build_object('PG_DATATYPE_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = MESSAGE_TEXT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-MESSAGE_TEXT',json_build_object('MESSAGE_TEXT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = SCHEMA_NAME ;
     PERFORM loc_audit_functions.make_log
     (s
       'business_function_template',
       ' ERROR-SCHEMA_NAME',json_build_object('SCHEMA_NAME',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_DETAIL ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_DETAIL',
      json_build_object('PG_EXCEPTION_DETAIL',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_HINT ;
     PERFORM loc_audit_functions.make_log
     (
       'business_function_template',
       ' ERROR-PG_EXCEPTION_HINT',json_build_object('PG_EXCEPTION_HINT',error_message  ), TRUE );

     GET STACKED DIAGNOSTICS error_message = PG_EXCEPTION_CONTEXT ;
     PERFORM loc_audit_functions.make_log
     (
      'business_function_template',
      ' ERROR-PG_EXCEPTION_CONTEXT',json_build_object('PG_EXCEPTION_CONTEXT',error_message  ), TRUE );                                      

    RAISE WARNING 'ALARM: %' , SQLERRM ;

    SELECT json_build_object
    (
      'isError' , TRUE ,
      'errorMsg' , SQLERRM
     ) INTO error_json ;

  RETURN  error_json ;
END
$$ LANGUAGE plpgsql SECURITY DEFINER;

Abajade

Lati ṣe apejuwe aworan gbogbogbo, Mo ro pe o to. Ti ẹnikẹni ba nifẹ si awọn alaye ati awọn abajade, kọ awọn asọye, Emi yoo dun lati ṣafikun awọn ifọwọkan afikun si aworan naa.

PS

Wọle aṣiṣe ti o rọrun - iru paramita titẹ sii

-[ RECORD 1 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1072
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          | STARTED
jsonb_pretty    | {
                |     "dko": {
                |         "id": 4,
                |         "type": "Type1",                                                                                                                                                                                            
                |         "title": "CREATED BY addKD",
                |         "Weight": 10,
                |         "Tr": "300",
                |         "reduction": 10,
                |         "isTrud": "TRUE",
                |         "description": "decription",
                |         "lowerTr": "100",
                |         "measurement": "measurement1",
                |         "methodology": "m1",                                                                                                                                                                                           
                |         "passportUrl": "files",
                |         "upperTr": "200",
                |         "weightingFactor": 100.123,
                |         "actualTrValue": null,
                |         "upperTrCalcNumber": "120"
                |     },
                |     "CardId": 3
                | }
-[ RECORD 2 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1073
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLSTATE": "22P02"
                | }
-[ RECORD 3 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1074
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR
jsonb_pretty    | {
                |     "SQLERRM": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 4 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1075
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-RETURNED_SQLSTATE
jsonb_pretty    | {
                |     "RETURNED_SQLSTATE": "22P02"
                | }
-[ RECORD 5 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1076
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-COLUMN_NAME
jsonb_pretty    | {
                |     "COLUMN_NAME": ""
                | }

-[ RECORD 6 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1077
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-CONSTRAINT_NAME
jsonb_pretty    | {
                |     "CONSTRAINT_NAME": ""
                | }
-[ RECORD 7 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1078
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_DATATYPE_NAME
jsonb_pretty    | {
                |     "PG_DATATYPE_NAME": ""
                | }
-[ RECORD 8 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1079
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }
-[ RECORD 9 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1080
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-SCHEMA_NAME
jsonb_pretty    | {
                |     "SCHEMA_NAME": ""
                | }
-[ RECORD 10 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1081
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_DETAIL
jsonb_pretty    | {
                |     "PG_EXCEPTION_DETAIL": ""
                | }
-[ RECORD 11 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1082
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_HINT
jsonb_pretty    | {
                |     "PG_EXCEPTION_HINT": ""
                | }
-[ RECORD 12 ]-
date_trunc      | 2020-08-19 13:15:46
id              | 1083
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-PG_EXCEPTION_CONTEXT
jsonb_pretty    | {
usename         | emp1
log_module      | addKD
log_module_hash | 0b4c1529a89af3ddf6af3821dc790e8a
status          |  ERROR-MESSAGE_TEXT
jsonb_pretty    | {
                |     "MESSAGE_TEXT": "invalid input syntax for type numeric: "null""
                | }

orisun: www.habr.com

Fi ọrọìwòye kun