ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืขื˜ืœืขื›ืข ืžืึธืœ ืฆื•ืจื™ืง, ืžื™ืจ ื–ืขื ืขืŸ ืคื™ื™ืกื˜ ืžื™ื˜ ื“ื™ ืงืฉื™ื ืคื•ืŸ ื˜ืฉื•ื–ื™ื ื’ ืึทืŸ ETL ื’ืขืฆื™ื™ึทื’ ืคึฟืึทืจ ืืจื‘ืขื˜ืŸ ืžื™ื˜ ื‘ื™ื’ ื“ืึทื˜ืึท. ื“ื™ ืคืจื™ืขืจ ื’ืขื•ื•ื™ื™ื ื˜ Informatica BDM ืœื™ื™ื–ื•ื ื’ ืื™ื– ื ื™ืฉื˜ ืคึผืึทืกื™ืง ืคึฟืึทืจ ืื•ื ื“ื– ืจืขื›ื˜ ืฆื• ืœื™ืžื™ื˜ืขื“ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™. ื“ื™ ื ื•ืฆืŸ ืื™ื– ืจื™ื“ื•ืกื˜ ืฆื• ืึท ืคืจื™ื™ืžื•ื•ืขืจืง ืคึฟืึทืจ ืœืึธื ื˜ืฉื™ื ื’ ืึธื ืฆื™ื ื“ืŸ-ืคืึธืจืœื™ื™ื’ืŸ ืงืึทืžืึทื ื“ื–. ืขืก ื–ืขื ืขืŸ ื ื™ืฉื˜ ืคื™ืœืข ืึทื ืึทืœืึธื’ื•ืขืก ืื•ื™ืฃ ื“ืขื ืžืึทืจืง ื•ื•ืึธืก, ืื™ืŸ ืคึผืจื™ื ืฆื™ืคึผ, ืงืขื ืขืŸ ืึทืจื‘ืขื˜ืŸ ืžื™ื˜ ื“ื™ ื‘ืึทื ื“ ืคื•ืŸ ื“ืึทื˜ืŸ ื•ื•ืึธืก ืžื™ืจ ื”ืึทื ื“ืœืขืŸ ืžื™ื˜ ื™ืขื“ืขืจ ื˜ืึธื’. ืื™ืŸ ื“ื™ ืกื•ืฃ ืžื™ืจ ืื•ื™ืกื“ืขืจื•ื•ื™ื™ืœื˜ Ab Initio. ื‘ืขืฉืึทืก ืคึผื™ืœืึธื˜ ื“ืขืžืึทื ืกื˜ืจื™ื™ืฉืึทื ื–, ื“ื™ ืคึผืจืึธื“ื•ืงื˜ ื’ืขื•ื•ื™ื–ืŸ ื–ื™ื™ืขืจ ื”ื•ื™ืš ื“ืึทื˜ืŸ ืคึผืจืึทืกืขืกื™ื ื’ ื’ื™ื›ืงื™ื™ึทื˜. ืขืก ืื™ื– ื›ึผืžืขื˜ ืงื™ื™ืŸ ืื™ื ืคึฟืึธืจืžืึทืฆื™ืข ื•ื•ืขื’ืŸ Ab Initio ืื™ืŸ ืจื•ืกื™ืฉ, ืึทื–ื•ื™ ืžื™ืจ ื‘ืึทืฉืœืึธืกืŸ ืฆื• ืจืขื“ืŸ ื•ื•ืขื’ืŸ ืื•ื ื“ื–ืขืจ ื“ืขืจืคืึทืจื•ื ื’ ืื•ื™ืฃ Habrรฉ.

Ab Initio ื”ืื˜ ืคื™ืœืข ืงืœืึทืกื™ืฉ ืื•ืŸ ื•ืžื’ืขื•ื•ื™ื™ื ื˜ืœืขืš ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื–, ื“ื™ ืงืึธื“ ืคื•ืŸ ื•ื•ืึธืก ืงืขื ืขืŸ ื–ื™ื™ืŸ ืขืงืกื˜ืขื ื“ืขื“ ืžื™ื˜ ื–ื™ื™ืŸ ืื™ื™ื’ืขื ืข PDL ืฉืคึผืจืึทืš. ืคึฟืึทืจ ืึท ืงืœื™ื™ืŸ ื’ืขืฉืขืคื˜, ืึทื–ืึท ืึท ืฉื˜ืึทืจืง ื’ืขืฆื™ื™ึทื’ ื•ื•ืขื˜ ืžืกืชึผืžื ื–ื™ื™ืŸ ืึธื•ื•ื•ืขืจืงื™ืœ, ืื•ืŸ ืจื•ื‘ึฟ ืคื•ืŸ ื–ื™ื™ึทืŸ ืงื™ื™ืคึผืึทื‘ื™ืœืึทื˜ื™ื– ืงืขืŸ ื–ื™ื™ืŸ ื˜ื™ื™ึทืขืจ ืื•ืŸ ืึทื ื™ื•ื–ื“. ืึธื‘ืขืจ ืื•ื™ื‘ ื“ื™ื™ืŸ ื•ื•ืึธื’ ืื™ื– ื ืึธืขื ื˜ ืฆื• ืกื‘ืขืจืึธื•ื• ืก, Ab Initio ืงืขืŸ ื–ื™ื™ืŸ ื˜ืฉื™ืงืึทื•ื•ืข ืคึฟืึทืจ ืื™ืจ.

ืขืก ื”ืขืœืคึผืก ืึท ื’ืขืฉืขืคื˜ ืฆื• ืึธื ืงืœื™ื™ึทื‘ืŸ ื•ื•ื™ืกืŸ ื’ืœืึธื•ื‘ืึทืœื™ ืื•ืŸ ืึทื ื˜ื•ื•ื™ืงืœืขืŸ ืึทืŸ ื™ืงืึธื•ืกื™ืกื˜ืึทื, ืื•ืŸ ืึท ื“ืขื•ื•ืขืœืึธืคึผืขืจ ืฆื• ืคึฟืึทืจื‘ืขืกืขืจืŸ ื–ื™ื™ืŸ ืกืงื™ืœื– ืื™ืŸ ETL, ืคึฟืึทืจื‘ืขืกืขืจืŸ ื–ื™ื™ืŸ ื•ื•ื™ืกืŸ ืื™ืŸ ื“ื™ ืฉืึธืœ, ื’ื™ื˜ ื“ื™ ื’ืขืœืขื’ื ื”ื™ื™ื˜ ืฆื• ื‘ืขืœ ื“ื™ PDL ืฉืคึผืจืึทืš, ื’ื™ื˜ ืึท ื•ื•ื™ื–ืฉืึทื•ื•ืึทืœ ื‘ื™ืœื“ ืคื•ืŸ ืœืึธื•ื“ื™ื ื’ ืคึผืจืึทืกืขืกืึทื– ืื•ืŸ ืกื™ืžืคึผืœืึทืคื™ื™ื– ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’. ืจืขื›ื˜ ืฆื• ื“ืขืจ ื–ืขื˜ ืคื•ืŸ ืคืึทื ื’ืงืฉืึทื ืึทืœ ืงืึทืžืคึผืึธื•ื ืึทื ืฅ.

ืื™ืŸ ื“ืขื ืคึผืึธืกื˜ืŸ, ืื™ืš ื•ื•ืขืœ ืจืขื“ืŸ ื•ื•ืขื’ืŸ ื“ื™ ืงื™ื™ืคึผืึทื‘ื™ืœืึทื˜ื™ื– ืคื•ืŸ Ab Initio ืื•ืŸ ืฆื•ืฉื˜ืขืœืŸ ืงืึธืžืคึผืึทืจืึทื˜ื™ื•ื•ืข ืงืขืจืึทืงื˜ืขืจื™ืกื˜ื™ืงืก ืคื•ืŸ ื–ื™ื™ืŸ ืึทืจื‘ืขื˜ ืžื™ื˜ ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum.

  • ื‘ืึทืฉืจื™ื™ึทื‘ื•ื ื’ ืคื•ืŸ ื“ื™ MDW ืคืจื™ื™ืžื•ื•ืขืจืง ืื•ืŸ ืึทืจื‘ืขื˜ ืื•ื™ืฃ ื–ื™ื™ืŸ ืงื•ืกื˜ืึธืžื™ื–ืึทื˜ื™ืึธืŸ ืคึฟืึทืจ GreenPlum
  • Ab Initio ืคืึธืจืฉื˜ืขืœื•ื ื’ ืคืึทืจื’ืœื™ื™ึทืš ืฆื•ื•ื™ืฉืŸ ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum
  • ืึทืจื‘ืขื˜ ืื™ืŸ ื“ื™ ืึธื ื”ื™ื™ื‘ ืžื™ื˜ GreenPlum ืื™ืŸ ืœืขื‘ืŸ ืคืึทืงื˜ื™ืฉ ืฆื™ื™ื˜ ืžืึธื“ืข


ื“ื™ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™ ืคื•ืŸ ื“ืขื ืคึผืจืึธื“ื•ืงื˜ ืื™ื– ื–ื™ื™ืขืจ ื‘ืจื™ื™ื˜ ืื•ืŸ ืจื™ืงื•ื•ื™ื™ืขืจื– ืึท ืคึผืœืึทืฅ ืคื•ืŸ ืฆื™ื™ื˜ ืฆื• ืœืขืจื ืขืŸ. ืึธื‘ืขืจ, ืžื™ื˜ ื“ื™ ื’ืขื”ืขืจื™ืง ืึทืจื‘ืขื˜ ืกืงื™ืœื– ืื•ืŸ ื“ื™ ืจืขื›ื˜ ืคืึธืจืฉื˜ืขืœื•ื ื’ ืกืขื˜ื˜ื™ื ื’ืก, ื“ื™ ืจืขื–ื•ืœื˜ืึทื˜ืŸ ืคื•ืŸ ื“ืึทื˜ืŸ ืคึผืจืึทืกืขืกื™ื ื’ ื–ืขื ืขืŸ ื–ื™ื™ืขืจ ื™ืžืคึผืจืขืกื™ื•ื•. ื ื™ืฆืŸ Ab Initio ืคึฟืึทืจ ืึท ื“ืขื•ื•ืขืœืึธืคึผืขืจ ืงืขื ืขืŸ ืฆื•ืฉื˜ืขืœืŸ ืึท ื˜ืฉื™ืงืึทื•ื•ืข ื“ืขืจืคืึทืจื•ื ื’. ื“ืึธืก ืื™ื– ืึท ื ื™ื™ึทืข ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’ ืคื•ืŸ ETL, ืึท ื›ื™ื™ื‘ืจื™ื“ ืฆื•ื•ื™ืฉืŸ ืึท ื•ื•ื™ื–ืฉืึทื•ื•ืึทืœ ืกื•ื•ื™ื•ื•ืข ืื•ืŸ ืืจืืคืงืืคื™ืข ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’ ืื™ืŸ ืึท ืฉืจื™ืคื˜-ื•ื•ื™ ืฉืคึผืจืึทืš.

ื’ืขืฉืขืคื˜ืŸ ืึทื ื˜ื•ื•ื™ืงืœืขืŸ ื–ื™ื™ืขืจ ื™ืงืึธื•ืกื™ืกื˜ืึทืžื– ืื•ืŸ ื“ืขื ื’ืขืฆื™ื™ึทื’ ืื™ื– ื ื•ืฆื™ืง ืžืขืจ ื•ื•ื™ ืืœืฅ. ืžื™ื˜ Ab Initio, ืื™ืจ ืงืขื ืขืŸ ืึธื ืงืœื™ื™ึทื‘ืŸ ื•ื•ื™ืกืŸ ื•ื•ืขื’ืŸ ื“ื™ื™ืŸ ืงืจืึทื ื˜ ื’ืขืฉืขืคื˜ ืื•ืŸ ื ื•ืฆืŸ ื“ืขื ื•ื•ื™ืกืŸ ืฆื• ื™ืงืกืคึผืึทื ื“ ืึทืœื˜ ืื•ืŸ ืขืคืขื ืขืŸ ื ื™ื™ึทืข ื’ืขืฉืขืคื˜ืŸ. ืึทืœื˜ืขืจื ืึทื˜ื™ื•ื•ืขืก ืฆื• Ab Initio ืึทืจื™ื™ึทื ื ืขืžืขืŸ ื•ื•ื™ื–ืฉืึทื•ื•ืึทืœ ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’ ื™ื ื•ื•ื™ื™ืจืึทื ืžืึทื ืฅ Informatica BDM ืื•ืŸ ื ื™ื˜-ื•ื•ื™ืกื•ืึทืœ ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’ ื™ื ื•ื•ื™ื™ืจืึทื ืžืึทื ืฅ Apache Spark.

ื‘ืึทืฉืจื™ื™ึทื‘ื•ื ื’ ืคื•ืŸ Ab Initio

Ab Initio, ื•ื•ื™ ืื ื“ืขืจืข ETL ืžื›ืฉื™ืจื™ื, ืื™ื– ืึท ื–ืึทืžืœื•ื ื’ ืคื•ืŸ ืคึผืจืึธื“ื•ืงื˜ืŸ.

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

Ab Initio GDE (ื’ืจืึทืคื™ืงืึทืœ ืื ื˜ื•ื•ื™ืงืœื•ื ื’ ืขื ื•ื•ื™ืจืึธื ืžืขื ื˜) ืื™ื– ืึท ืกื•ื•ื™ื•ื•ืข ืคึฟืึทืจ ื“ื™ ื“ืขื•ื•ืขืœืึธืคึผืขืจ ืื™ืŸ ื•ื•ืึธืก ืขืจ ืงืึทื ืคื™ื’ื™ืขืจ ื“ืึทื˜ืŸ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ืื•ืŸ ืงืึทื ืขืงืฅ ื–ื™ื™ ืžื™ื˜ ื“ืึทื˜ืŸ ืคืœืึธื•ื– ืื™ืŸ ื“ื™ ืคืึธืจืขื ืคื•ืŸ ืึทืจืึธื•ื–. ืื™ืŸ ื“ืขื ืคืึทืœ, ืึทื–ืึท ืึท ื’ืึทื ื’ ืคื•ืŸ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ืื™ื– ื’ืขืจื•ืคืŸ ืึท ื’ืจืึทืคื™ืง:

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ื“ื™ ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘ ืื•ืŸ ืจืขื–ื•ืœื˜ืึทื˜ ืงืึทื ืขืงืฉืึทื ื– ืคื•ืŸ ืคืึทื ื’ืงืฉืึทื ืึทืœ ืงืึทืžืคึผืึธื•ื ืึทื ืฅ ื–ืขื ืขืŸ ืคึผืึธืจืฅ ืื•ืŸ ืึทื ื˜ื”ืึทืœื˜ืŸ ืคืขืœื“ืขืจ ืงืึทืœืงื™ืึทืœื™ื™ื˜ื™ื“ ืื™ืŸ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข. ืขื˜ืœืขื›ืข ื’ืจืึทืคืก ืคืืจื‘ื•ื ื“ืŸ ื“ื•ืจืš ืคืœืึธื•ื– ืื™ืŸ ื“ื™ ืคืึธืจืขื ืคื•ืŸ ืึทืจืึธื•ื– ืื™ืŸ ื“ืขืจ ืกื“ืจ ืคื•ืŸ ื–ื™ื™ืขืจ ื“ื•ืจื›ืคื™ืจื•ื ื’ ื–ืขื ืขืŸ ื’ืขืจื•ืคืŸ ืึท ืคึผืœืึทืŸ.

ืขืก ื–ืขื ืขืŸ ืขื˜ืœืขื›ืข ื”ื•ื ื“ืขืจื˜ ืคืึทื ื’ืงืฉืึทื ืึทืœ ืงืึทืžืคึผืึธื•ื ืึทื ืฅ, ื•ื•ืึธืก ืื™ื– ืึท ืคึผืœืึทืฅ. ืคื™ืœืข ืคื•ืŸ โ€‹โ€‹ื–ื™ื™ ื–ืขื ืขืŸ ื”ืขื›ืกื˜ ืกืคึผืขืฉืึทืœื™ื™ื–ื“. ื“ื™ ืงื™ื™ืคึผืึทื‘ื™ืœืึทื˜ื™ื– ืคื•ืŸ ืงืœืึทืกื™ืฉ ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื– ืื™ืŸ Ab Initio ื–ืขื ืขืŸ ื‘ืจื™ื™ื˜ ื•ื•ื™ ืื™ืŸ ืื ื“ืขืจืข ETL ืžื›ืฉื™ืจื™ื. ืคึฟืึทืจ ื‘ื™ื™ึทืฉืคึผื™ืœ, Join ื”ืื˜ ืงื™ื™ืคืœ ืึทื•ื˜ืคึผื•ืฅ. ืื™ืŸ ืึทื“ื™ืฉืึทืŸ ืฆื• ื“ืขืจ ืจืขื–ื•ืœื˜ืึทื˜ ืคื•ืŸ ืงืึทื ืขืงื˜ื™ื ื’ ื“ืึทื˜ืึทืกืขืฅ, ืื™ืจ ืงืขื ืขืŸ ื‘ืึทืงื•ืžืขืŸ ืจืขื–ื•ืœื˜ืึทื˜ ืจืขืงืึธืจื“ืก ืคื•ืŸ ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘ ื“ืึทื˜ืึทืกืขืฅ ื•ื•ืขืžืขื ืก ืฉืœื™ืกืœืขืŸ ืงืขืŸ ื ื™ืฉื˜ ื–ื™ื™ืŸ ืงืึธื ื ืขืงื˜ืขื“. ืื™ืจ ืงืขื ื˜ ืื•ื™ืš ื‘ืึทืงื•ืžืขืŸ ืึธืคึผื–ืึธื’ืŸ, ืขืจืจืึธืจืก ืื•ืŸ ืึท ืงืœืึธืฅ ืคื•ืŸ ื“ื™ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ืึธืคึผืขืจืึทืฆื™ืข, ื•ื•ืึธืก ืงืขื ืขืŸ ื–ื™ื™ืŸ ืœื™ื™ืขื ืขืŸ ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ื–ื™ื™ึทืœ ื•ื•ื™ ืึท ื˜ืขืงืกื˜ ื˜ืขืงืข ืื•ืŸ ืคึผืจืึทืกืขืกื˜ ืžื™ื˜ ืื ื“ืขืจืข ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข:

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืึธื“ืขืจ, ืคึฟืึทืจ ื‘ื™ื™ึทืฉืคึผื™ืœ, ืื™ืจ ืงืขื ืขืŸ ืžืึทื˜ื™ืจื™ืึทืœื™ื™ื– ืึท ื“ืึทื˜ืŸ ื•ืคื ืขืžืขืจ ืื™ืŸ ื“ื™ ืคืึธืจืขื ืคื•ืŸ ืึท ื˜ื™ืฉ ืื•ืŸ ืœื™ื™ืขื ืขืŸ ื“ืึทื˜ืŸ ืคึฟื•ืŸ ืขืก ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ื–ื™ื™ึทืœ.

ืขืก ื–ืขื ืขืŸ ืึธืจื™ื’ื™ื ืขืœ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข. ืคึฟืึทืจ ื‘ื™ื™ึทืฉืคึผื™ืœ, ื“ื™ ื™ื‘ืขืจืงื•ืงืŸ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ื”ืื˜ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™ ืขื ืœืขืš ืฆื• ืึทื ืึทืœื™ื˜ื™ืงืึทืœ ืคืึทื ื’ืงืฉืึทื ื–. ืขืก ื–ืขื ืขืŸ ื˜ืจืึทื ื–ืคืึธืจืžื™ื™ืฉืึทื ื– ืžื™ื˜ ื–ื™ืš-ื™ืงืกืคึผืœืึทื ืึทื˜ืึธืจื™ ื ืขืžืขืŸ: ืฉืึทืคึฟืŸ ื“ืึทื˜ืึท, ืœื™ื™ืขื ืขืŸ ืขืงืกืกืขืœ, ื ืึธืจืžืึทืœื™ื™ื–, ืกืึธืจื˜ ืื™ืŸ ื’ืจื•ืคึผืขืก, ืœื•ื™ืคืŸ ืคึผืจืึธื’ืจืึทื, ืœื•ื™ืคืŸ ืกืงืœ, ืคืึทืจื‘ื™ื ื“ืŸ ืžื™ื˜ ื“ื‘, ืืื–"ื• ื•. ื’ืจืึทืคืก ืงืขื ืขืŸ ื ื•ืฆืŸ ืœื•ื™ืคืŸ-ืฆื™ื™ื˜ ืคึผืึทืจืึทืžืขื˜ืขืจืก, ืึทืจื™ื™ึทื ื’ืขืจืขื›ื ื˜ ื“ื™ ืžืขื’ืœืขื›ืงื™ื™ื˜ ืคื•ืŸ ืคืึธืจืŸ ืคึผืึทืจืึทืžืขื˜ืขืจืก ืคื•ืŸ ืึธื“ืขืจ ืฆื•. ื“ื™ ืึธืคึผืขืจื™ื™ื˜ื™ื ื’ ืกื™ืกื˜ืขื. ื˜ืขืงืขืก ืžื™ื˜ ืึท ืคืึทืจื˜ื™ืง ื’ืึทื ื’ ืคื•ืŸ ืคึผืึทืจืึทืžืขื˜ืขืจืก ื“ื•ืจื›ื’ืขื’ืื ื’ืขืŸ ืฆื• ื“ื™ ื’ืจืึทืคื™ืง ื–ืขื ืขืŸ ื’ืขืจื•ืคืŸ ืคึผืึทืจืึทืžืขื˜ืขืจ ืฉื˜ืขืœื˜ (ืคึผืกืขืฅ).

ื•ื•ื™ ื“ืขืจื•ื•ืึทืจื˜, Ab Initio GDE ื”ืื˜ ื–ื™ื™ืŸ ืื™ื™ื’ืขื ืข ืจื™ืคึผืึทื–ืึทื˜ืึธืจื™ ื’ืขืจื•ืคึฟืŸ EME (Enterprise Meta Environment). ื“ืขื•ื•ืขืœืึธืคึผืขืจืก ื”ืึธื‘ืŸ ื“ื™ ื’ืขืœืขื’ื ื”ื™ื™ื˜ ืฆื• ืึทืจื‘ืขื˜ืŸ ืžื™ื˜ ื”ื™ื’ืข ื•ื•ืขืจืกื™ืขืก ืคื•ืŸ ืงืึธื“ ืื•ืŸ ืงืึธื ื˜ืจืึธืœื™ืจืŸ ื–ื™ื™ืขืจ ื“ื™ื•ื•ืขืœืึทืคึผืžืึทื ืฅ ืื™ืŸ ื“ื™ ื”ื•ื™ืคื˜ ืจื™ืคึผืึทื–ืึทื˜ืึธืจื™.

ืขืก ืื™ื– ืžืขื’ืœืขืš, ื‘ืขืฉืึทืก ื“ื•ืจื›ืคื™ืจื•ื ื’ ืึธื“ืขืจ ื ืึธืš ืขืงืกืึทืงื™ื•ื˜ื™ื ื’ ื“ื™ ื’ืจืึทืคื™ืง, ืฆื• ื’ื™ื˜ ืื•ื™ืฃ ืงื™ื™ืŸ ืœื•ื™ืคืŸ ืงืึทื ืขืงื˜ื™ื ื’ ื“ื™ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ืื•ืŸ ืงื•ืง ืื™ืŸ ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืึธืก ื–ืขื ืขืŸ ื“ื•ืจื›ื’ืขื’ืื ื’ืขืŸ ืฆื•ื•ื™ืฉืŸ ื“ื™ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข:

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืขืก ืื™ื– ืื•ื™ืš ืžืขื’ืœืขืš ืฆื• ื’ื™ื˜ ืื•ื™ืฃ ืงื™ื™ืŸ ื˜ื™ื™ึทืš ืื•ืŸ ื–ืขืŸ ื˜ืจืึทืงื™ื ื’ ื“ืขื˜ืึทื™ืœืก - ื•ื•ื™ ืคื™ืœืข ืคึผืึทืจืึทืœืึทืœื– ื“ื™ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ื’ืขืืจื‘ืขื˜ ืื™ืŸ, ื•ื•ื™ ืคื™ืœืข ืฉื•ืจื•ืช ืื•ืŸ ื‘ื™ื˜ืขืก ื–ืขื ืขืŸ ืœืึธื•ื“ื™ื“ ืื™ืŸ ื•ื•ืึธืก ืคื•ืŸ ื“ื™ ืคึผืึทืจืึทืœืึทืœื–:

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืขืก ืื™ื– ืžืขื’ืœืขืš ืฆื• ื˜ื™ื™ืœืŸ ื“ื™ ื“ื•ืจื›ืคื™ืจื•ื ื’ ืคื•ืŸ ื“ื™ ื’ืจืึทืคื™ืง ืื™ืŸ ืคืึทืกืขืก ืื•ืŸ ืฆื™ื™ื›ืŸ ืึทื– ืขื˜ืœืขื›ืข ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื– ื“ืึทืจืคึฟืŸ ืฆื• ื–ื™ื™ืŸ ื“ื•ืจื›ื’ืขืงืึธื›ื˜ ืขืจืฉื˜ืขืจ (ืื™ืŸ ื“ื™ ื ื•ืœ ืคืึทืกืข), ื“ื™ ื•ื•ื™ื™ึทื˜ืขืจ ืึธื ืขืก ืื™ืŸ ื“ืขืจ ืขืจืฉื˜ืขืจ ืคืึทืกืข, ื“ื™ ื•ื•ื™ื™ึทื˜ืขืจ ืึธื ืขืก ืื™ืŸ ื“ื™ ืจื’ืข ืคืึทืกืข, ืืื–"ื• ื•.

ืคึฟืึทืจ ื™ืขื“ืขืจ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ืื™ืจ ืงืขื ืขืŸ ืงืœื™ื™ึทื‘ืŸ ื“ื™ ืึทื–ื•ื™ ื’ืขืจื•ืคืขื ืข ืื•ื™ืกืœื™ื™ื’ (ื•ื•ื• ืขืก ื•ื•ืขื˜ ื–ื™ื™ืŸ ืขืงืกืึทืงื™ื•ื˜ืึทื“): ืึธืŸ ืคึผืึทืจืึทืœืึทืœื– ืึธื“ืขืจ ืื™ืŸ ืคึผืึทืจืึทืœืขืœ ืคึฟืขื“ืขื, ื“ื™ ื ื•ืžืขืจ ืคื•ืŸ ื•ื•ืึธืก ืงืขื ืขืŸ ื–ื™ื™ืŸ ืกืคึผืขืกื™ืคื™ืขื“. ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ืฆื™ื™ื˜, ืฆื™ื™ื˜ื•ื•ื™ื™ืœื™ื’ืข ื˜ืขืงืขืก ืึทื– Ab Initio ืงืจื™ื™ื™ืฅ ื•ื•ืขืŸ ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื– ื–ืขื ืขืŸ ืคืœื™ืกื ื“ื™ืง ืงืขื ืขืŸ ื–ื™ื™ืŸ ื’ืขืฉื˜ืขืœื˜ ื‘ื™ื™ื“ืข ืื™ืŸ ื“ื™ ืกืขืจื•ื•ืขืจ ื˜ืขืงืข ืกื™ืกื˜ืขื ืื•ืŸ ืื™ืŸ HDFS.

ืื™ืŸ ื™ืขื“ืขืจ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข, ื‘ืื–ื™ืจื˜ ืื•ื™ืฃ ื“ื™ ืคืขืœื™ืงื™ื™ึทื˜ ืžื•ืกื˜ืขืจ, ืื™ืจ ืงืขื ืขืŸ ืžืึทื›ืŸ ื“ื™ื™ืŸ ืื™ื™ื’ืขื ืข ืฉืจื™ืคื˜ ืื™ืŸ PDL, ื•ื•ืึธืก ืื™ื– ืึท ื‘ื™ืกืœ ื•ื•ื™ ืึท ืฉืึธืœ.

ืžื™ื˜ PDL ืื™ืจ ืงืขื ืขืŸ ืคืึทืจื‘ืจื™ื™ื˜ืขืจืŸ ื“ื™ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™ ืคื•ืŸ ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื– ืื•ืŸ, ืื™ืŸ ื‘ืึทื–ื•ื ื“ืขืจ, ืื™ืจ ืงืขื ืขืŸ ื“ื™ื ืึทืžื™ืงืึทืœืœื™ (ืื™ืŸ ืจื•ื ื˜ื™ืžืข) ื“ื–ืฉืขื ืขืจื™ื™ื˜ ืึทืจื‘ื™ื˜ืจืึทืจื™ืฉ ืงืึธื“ ืคืจืึทื’ืžืึทื ืฅ ื“ื™ืคึผืขื ื“ื™ื ื’ ืื•ื™ืฃ ืจื•ื ื˜ื™ืžืข ืคึผืึทืจืึทืžืขื˜ืขืจืก.

Ab Initio ืื•ื™ืš ื”ืื˜ ื’ืขื–ื•ื ื˜-ื“ืขื•ื•ืขืœืึธืคึผืขื“ ื™ื ืึทื’ืจื™ื™ืฉืึทืŸ ืžื™ื˜ ื“ื™ ืึทืก ื“ื•ืจืš ืฉืึธืœ. ืกืคึผืขืฆื™ืขืœ, ืกื‘ืขืจื‘ืึทื ืง ื ื™ืฆื˜ ืœื™ื ื•ืงืก ืงืฉ. ืื™ืจ ืงืขื ืขืŸ ื•ื•ืขืงืกืœ ื•ื•ืขืจื™ืึทื‘ืึทืœื– ืžื™ื˜ ื“ื™ ืฉืึธืœ ืื•ืŸ ื ื•ืฆืŸ ื–ื™ื™ ื•ื•ื™ ื’ืจืึทืคื™ืง ืคึผืึทืจืึทืžืขื˜ืขืจืก. ืื™ืจ ืงืขื ืขืŸ ืจื•ืคืŸ ื“ื•ืจื›ืคื™ืจื•ื ื’ ืคื•ืŸ Ab Initio ื’ืจืึทืคืก ืคื•ืŸ ื“ื™ ืฉืึธืœ ืื•ืŸ ืคื™ืจืŸ Ab Initio.

ืื™ืŸ ืึทื“ื™ืฉืึทืŸ ืฆื• Ab Initio GDE, ืคื™ืœืข ืื ื“ืขืจืข ืคึผืจืึธื“ื•ืงื˜ืŸ ื–ืขื ืขืŸ ืึทืจื™ื™ึทื ื’ืขืจืขื›ื ื˜ ืื™ืŸ ื“ื™ ืขืงืกืคึผืจืขืก. ืขืก ืื™ื– ืึทืŸ ืื™ื™ื’ืขื ืข ืงืึธ> ืึธืคึผืขืจืึทืฆื™ืข ืกื™ืกื˜ืขื ืžื™ื˜ ืึท ืคืึธื“ืขืจืŸ ืฆื• ื–ื™ื™ืŸ ื’ืขืจื•ืคึฟืŸ ืึทืŸ ืึธืคึผืขืจื™ื™ื˜ื™ื ื’ ืกื™ืกื˜ืขื. ืขืก ืื™ื– ืึท ืงืึธื ื˜ืจืึธืœ> ืฆืขื ื˜ืขืจ ื•ื•ื• ืื™ืจ ืงืขื ืขืŸ ืคึผืœืึทืŸ ืื•ืŸ ืžืึธื ื™ื˜ืึธืจ ื“ื™ ืืจืืคืงืืคื™ืข ืคืœืึธื•ื–. ืขืก ื–ืขื ืขืŸ ืคึผืจืึธื“ื•ืงื˜ืŸ ืคึฟืึทืจ ืึทื ื˜ื•ื•ื™ืงืœื•ื ื’ ืื•ื™ืฃ ืึท ืžืขืจ ืคึผืจื™ืžื™ื˜ื™ื•ื• ืžื“ืจื’ื” ื•ื•ื™ Ab Initio GDE ืึทืœืึทื•ื–.

ื‘ืึทืฉืจื™ื™ึทื‘ื•ื ื’ ืคื•ืŸ ื“ื™ MDW ืคืจื™ื™ืžื•ื•ืขืจืง ืื•ืŸ ืึทืจื‘ืขื˜ ืื•ื™ืฃ ื–ื™ื™ืŸ ืงื•ืกื˜ืึธืžื™ื–ืึทื˜ื™ืึธืŸ ืคึฟืึทืจ GreenPlum

ืฆื•ื–ืืžืขืŸ ืžื™ื˜ ื–ื™ื™ืŸ ืคึผืจืึธื“ื•ืงื˜ืŸ, ื“ืขืจ ืคืึทืจืงื•ื™ืคืขืจ ืกืึทืคึผืœื™ื™ื– ื“ื™ MDW (Metadata Driven Warehouse) ืคึผืจืึธื“ื•ืงื˜, ื•ื•ืึธืก ืื™ื– ืึท ื’ืจืึทืคื™ืง ืงืึทื ืคื™ื’ื™ืขืจื™ื™ื˜ืขืจ ื“ื™ื–ื™ื™ื ื“ ืฆื• ื”ืขืœืคืŸ ืžื™ื˜ ื˜ื™ืคึผื™ืฉ ื˜ืึทืกืงืก ืคื•ืŸ ืคึผืึทืคึผื™ืึทืœื™ื™ื˜ื™ื ื’ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ืกื™ื– ืึธื“ืขืจ ื“ืึทื˜ืŸ ื•ื•ืึธืœืฅ.

ืขืก ื›ึผื•ืœืœ ืžื ื”ื’ (ืคึผืจืึธื™ืขืงื˜-ืกืคึผืขืฆื™ืคื™ืฉ) ืžืขื˜ืึทื“ืึทื˜ืึท ืคึผืึทืจืกืขืจื– ืื•ืŸ ืคืึทืจื˜ื™ืง ืงืึธื“ ื’ืขื ืขืจืึทื˜ืึธืจืก ืื•ื™ืก ืคื•ืŸ ื“ื™ ืงืขืกื˜ืœ.

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum
ื•ื•ื™ ืึทืจื™ื™ึทื ืฉืจื™ื™ึทื‘, MDW ื ืขืžื˜ ืึท ื“ืึทื˜ืŸ ืžืึธื“ืขืœ, ืึท ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืข ืคึฟืึทืจ ื‘ืึทืฉื˜ืขื˜ื™ืงืŸ ืึท ืงืฉืจ ืฆื• ืึท ื“ืึทื˜ืึทื‘ื™ื™ืก (Oracle, Teradata ืึธื“ืขืจ Hive) ืื•ืŸ ืขื˜ืœืขื›ืข ืื ื“ืขืจืข ืกืขื˜ื˜ื™ื ื’ืก. ื“ืขืจ ืคึผืจื•ื™ืขืงื˜-ืกืคึผืขืฆื™ืคื™ืฉ ื˜ื™ื™ืœ, ืคึฟืึทืจ ื‘ื™ื™ึทืฉืคึผื™ืœ, ื“ื™ืคึผืœื•ื™ื“ื– ื“ื™ ืžืึธื“ืขืœ ืฆื• ืึท ื“ืึทื˜ืึทื‘ื™ื™ืก. ื“ืขืจ ืึทืจื•ื™ืก-ืคื•ืŸ-ื“ืขื-ืงืขืกื˜ืœ ื˜ื™ื™ืœ ืคื•ืŸ ื“ื™ ืคึผืจืึธื“ื•ืงื˜ ื“ื–ืฉืขื ืขืจื™ื™ืฅ ื’ืจืึทืคืก ืื•ืŸ ืงืึทื ืคื™ื’ื™ืขืจื™ื™ืฉืึทืŸ ื˜ืขืงืขืก ืคึฟืึทืจ ื–ื™ื™ ื“ื•ืจืš ืœืึธื•ื“ื™ื ื’ ื“ืึทื˜ืŸ ืื™ืŸ ืžืึธื“ืขืœ ื˜ื™ืฉืŸ. ืื™ืŸ ื“ืขื ืคืึทืœ, ื’ืจืึทืคืก (ืื•ืŸ ืคึผืกืขืฅ) ื–ืขื ืขืŸ ื‘ืืฉืืคืŸ ืคึฟืึทืจ ืขื˜ืœืขื›ืข ืžืึธื“ืขืก ืคื•ืŸ ื™ื ื™ืฉืึทืœื™ื–ื™ื ื’ ืื•ืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืึทืจื‘ืขื˜ ืื•ื™ืฃ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืขื ื˜ื™ื˜ื™ื–.

ืื™ืŸ ื“ื™ ืงืึทืกืขืก ืคื•ืŸ ื”ื™ื•ื•ืข ืื•ืŸ RDBMS, ืคืึทืจืฉื™ื“ืขื ืข ื’ืจืึทืคืก ื–ืขื ืขืŸ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ืคึฟืึทืจ ื™ื ื™ื˜ื™ืึทืœื™ื–ืึทื˜ื™ืึธืŸ ืื•ืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ื“ืึทื˜ืŸ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงื•ื ื’ืขืŸ.

ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ ื”ื™ื•ื•ืข, ื“ื™ ื™ื ืงืึทืžื™ื ื’ ื“ืขืœื˜ืึท ื“ืึทื˜ืŸ ื–ืขื ืขืŸ ืคืืจื‘ื•ื ื“ืŸ ื“ื•ืจืš Ab Initio Join ืžื™ื˜ ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืึธืก ื–ืขื ืขืŸ ื’ืขื•ื•ืขืŸ ืื™ืŸ ื“ื™ ื˜ื™ืฉ ืื™ื™ื“ืขืจ ื“ื™ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ. ื“ืึทื˜ืึท ืœืึธื•ื“ืขืจื– ืื™ืŸ MDW (ื‘ื™ื™ื“ืข ืื™ืŸ ื”ื™ื•ื•ืข ืื•ืŸ RDBMS) ื ื™ื˜ ื‘ืœื•ื™ื– ืึทืจื™ื™ึทื ืœื™ื™ื’ืŸ ื ื™ื™ึท ื“ืึทื˜ืŸ ืคื•ืŸ ื“ื™ ื“ืขืœื˜ืึท, ืึธื‘ืขืจ ืื•ื™ืš ืคืึทืจืžืึทื›ืŸ ื“ื™ ืคึผื™ืจื™ืึทื“ื– ืคื•ืŸ ืฉื™ื™ื›ื•ืช ืคื•ืŸ ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืขืžืขื ืก ืขืจืฉื˜ื™ืง ืฉืœื™ืกืœืขืŸ ื‘ืืงื•ืžืขืŸ ื“ื™ ื“ืขืœื˜ืึท. ืื™ืŸ ื“ืขืจืฆื•, ืื™ืจ ื”ืึธื‘ืŸ ืฆื• ืจื™ืจื™ื™ื˜ ื“ื™ ืึทื ื˜ืฉื™ื™ื ื“ื–ืฉื“ ื˜ื™ื™ืœ ืคื•ืŸ ื“ื™ ื“ืึทื˜ืŸ. ืึธื‘ืขืจ ื“ืึธืก ื“ืึทืจืฃ ื–ื™ื™ืŸ ื’ืขื˜ืืŸ ื•ื•ื™ื™ึทืœ ื”ื™ื•ื•ืข ื˜ื•ื˜ ื ื™ืฉื˜ ื”ืึธื‘ืŸ ื•ื™ืกืžืขืงืŸ ืึธื“ืขืจ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ ืึทืคึผืขืจื™ื™ืฉืึทื ื–.

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ RDBMS, ื’ืจืึทืคืก ืคึฟืึทืจ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ื“ืึทื˜ืŸ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืงื•ืงืŸ ืžืขืจ ืึธืคึผื˜ื™ืžืึทืœ, ื•ื•ื™ื™ึทืœ RDBMS ื”ืึธื‘ืŸ ืคืึทืงื˜ื™ืฉ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืงื™ื™ืคึผืึทื‘ื™ืœืึทื˜ื™ื–.

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ื“ืขืจ ื‘ืืงื•ืžืขืŸ ื“ืขืœื˜ืึท ืื™ื– ืœืึธื•ื“ื™ื“ ืื™ืŸ ืึท ื™ื ื˜ืขืจืžื™ื“ื™ื™ื˜ ื˜ื™ืฉ ืื™ืŸ ื“ื™ ื“ืึทื˜ืึทื‘ื™ื™ืก. ื ืึธืš ื“ืขื, ื“ื™ ื“ืขืœื˜ืึท ืื™ื– ืคืืจื‘ื•ื ื“ืŸ ืฆื• ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืึธืก ืื™ื– ื’ืขื•ื•ืขืŸ ืื™ืŸ ื“ื™ ื˜ื™ืฉ ืื™ื™ื“ืขืจ ื“ื™ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ. ืื•ืŸ ื“ืึธืก ืื™ื– ื’ืขื˜ืืŸ ืžื™ื˜ SQL ื ื™ืฆืŸ ืึท ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ SQL ืึธื ืคึฟืจืขื’. ื“ืขืจื ืึธืš, ื ื™ืฆืŸ ื“ื™ SQL ืงืึทืžืึทื ื“ื– ื•ื™ืกืžืขืงืŸ + ืึทืจื™ื™ึทื ืœื™ื™ื’ืŸ, ื ื™ื™ึท ื“ืึทื˜ืŸ ืคื•ืŸ ื“ื™ ื“ืขืœื˜ืึท ื–ืขื ืขืŸ ื™ื ืกืขืจื˜ืึทื“ ืื™ืŸ ื“ื™ ืฆื™ืœ ื˜ื™ืฉ ืื•ืŸ ื“ื™ ืคึผื™ืจื™ืึทื“ื– ืคื•ืŸ ืฉื™ื™ื›ื•ืช ืคื•ืŸ ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืขืžืขื ืก ืขืจืฉื˜ื™ืง ืฉืœื™ืกืœืขืŸ ื‘ืืงื•ืžืขืŸ ื“ื™ ื“ืขืœื˜ืึท ื–ืขื ืขืŸ ืคืืจืžืื›ื˜.
ืขืก ืื™ื– ื ื™ื˜ ื“ืึทืจืคึฟืŸ ืฆื• ืจื™ืจื™ื™ื˜ ืึทื ื˜ืฉื™ื™ื ื“ื–ืฉื“ ื“ืึทื˜ืŸ.

ืึทื–ื•ื™ ืžื™ืจ ื’ืขืงื•ืžืขืŸ ืฆื• ื“ื™ ืžืกืงื ื ืึทื– ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ ื”ื™ื•ื•ืข, MDW ืžื•ื–ืŸ ื’ื™ื™ืŸ ืฆื• ื“ื™ ืžืึธืก ืคื•ืŸ ืจื™ืจื™ื™ื˜ื™ื ื’ ื“ื™ ื’ืื ืฆืข ื˜ื™ืฉ ื•ื•ื™ื™ึทืœ ื”ื™ื•ื•ืข ื˜ื•ื˜ ื ื™ืฉื˜ ื”ืึธื‘ืŸ ืึท ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ ืคื•ื ืงืฆื™ืข. ืื•ืŸ ื’ืึธืจื ื™ืฉื˜ ื‘ืขืกืขืจ ื•ื•ื™ ื’ืึธืจ ืจื™ืจื™ื™ื˜ื™ื ื’ ื“ื™ ื“ืึทื˜ืŸ ื•ื•ืขืŸ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืื™ื– ื™ื ื•ื•ืขื ื˜ืึทื“. ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ RDBMS, ืื•ื™ืฃ ื“ื™ ืคืึทืจืงืขืจื˜, ื“ื™ ืงืจื™ื™ื™ื˜ืขืจื– ืคื•ืŸ ื“ื™ ืคึผืจืึธื“ื•ืงื˜ ื’ืขืคื•ื ืขืŸ ืขืก ื ื™ื™ื˜ื™ืง ืฆื• ืขื ื˜ืจืึทืกื˜ ื“ื™ ืงืฉืจ ืื•ืŸ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืคื•ืŸ ื˜ื™ืฉืŸ ืฆื• ื“ื™ ื ื•ืฆืŸ ืคื•ืŸ ืกืงืœ.

ืคึฟืึทืจ ืึท ืคึผืจื•ื™ืขืงื˜ ืื™ืŸ ืกื‘ืขืจื‘ืึทื ืง, ืžื™ืจ ื‘ืืฉืืคืŸ ืึท ื ื™ื™ึทืข ืจื™ื•ื–ืึทื‘ืึทืœ ื™ืžืคึผืœืึทืžืขื ื˜ื™ื™ืฉืึทืŸ ืคื•ืŸ ืึท ื“ืึทื˜ืึทื‘ื™ื™ืก ืœืึธื•ื“ืขืจ ืคึฟืึทืจ GreenPlum. ื“ืึธืก ืื™ื– ื’ืขืฉืขืŸ ื‘ืื–ื™ืจื˜ ืื•ื™ืฃ ื“ื™ ื•ื•ืขืจืกื™ืข ื•ื•ืึธืก MDW ื“ื–ืฉืขื ืขืจื™ื™ืฅ ืคึฟืึทืจ Teradata. ืขืก ืื™ื– ื’ืขื•ื•ืขืŸ ื˜ืขืจืึทื“ืึทื˜ืึท, ืื•ืŸ ื ื™ืฉื˜ ืึธืจืึทืงืœืข, ื•ื•ืึธืก ืื™ื– ื’ืขื•ื•ืขืŸ ื ืึธืขื ื˜ ืื•ืŸ ื‘ืขืกื˜ืขืจ ืคึฟืึทืจ ื“ืขื, ื•ื•ื™ื™ึทืœ ... ืื™ื– ืื•ื™ืš ืึท MPP ืกื™ืกื˜ืขื. ื“ื™ ืึทืจื‘ืขื˜ ืžืขื˜ื”ืึธื“ืก, ื•ื•ื™ ื’ืขื–ื•ื ื˜ ื•ื•ื™ ื“ื™ ืกื™ื ื˜ืึทืงืก, ืคื•ืŸ Teradata ืื•ืŸ GreenPlum ืื™ื– ื’ืขื•ื•ืขืŸ ืขื ืœืขืš.

ื‘ื™ื™ืฉืคื™ืœืŸ ืคื•ืŸ MDW-ืงืจื™ื˜ื™ืฉ ื“ื™ืคืขืจืึทื ืกื™ื– ืฆื•ื•ื™ืฉืŸ ืคืึทืจืฉื™ื“ืขื ืข RDBMSs ื–ืขื ืขืŸ ื•ื•ื™ ื’ื™ื™ื˜. ืื™ืŸ GreenPlum, ื ื™ื˜ ืขื ืœืขืš Teradata, ื•ื•ืขืŸ ืื™ืจ ืฉืึทืคึฟืŸ ื˜ื™ืฉืŸ, ืื™ืจ ื“ืึทืจืคึฟืŸ ืฆื• ืฉืจื™ื™ึทื‘ืŸ ืึท ืคึผื•ื ืงื˜

distributed by

ื˜ืขืจืึทื“ืึทื˜ืึท ืฉืจื™ื™ื‘ื˜:

delete <table> all

, ืื•ืŸ ืื™ืŸ GreenPlum ื–ื™ื™ ืฉืจื™ื™ึทื‘ืŸ

delete from <table>

ืื™ืŸ ืึธืจืึทืงืœืข, ืคึฟืึทืจ ืึทืคึผื˜ืึทืžืึทื–ื™ื™ืฉืึทืŸ ืฆื•ื•ืขืงืŸ ื–ื™ื™ ืฉืจื™ื™ึทื‘ืŸ

delete from t where rowid in (<ัะพะตะดะธะฝะตะฝะธะต t ั ะดะตะปัŒั‚ะพะน>)

, ืื•ืŸ Teradata ืื•ืŸ GreenPlum ืฉืจื™ื™ึทื‘ืŸ

delete from t where exists (select * from delta where delta.pk=t.pk)

ืžื™ืจ ืื•ื™ืš ื˜ืึธืŸ ืึทื– ืคึฟืึทืจ Ab Initio ืฆื• ืึทืจื‘ืขื˜ืŸ ืžื™ื˜ GreenPlum, ืขืก ืื™ื– ื ื™ื™ื˜ื™ืง ืฆื• ื™ื ืกื˜ืึทืœื™ืจืŸ ื“ื™ GreenPlum ืงืœื™ืขื ื˜ ืื•ื™ืฃ ืึทืœืข ื ืึธื•ื“ื– ืคื•ืŸ ื“ื™ Ab Initio ืงื ื•ื™ืœ. ื“ืึธืก ืื™ื– ื•ื•ื™ื™ึทืœ ืžื™ืจ ืงืึธื ื ืขืงื˜ืขื“ ืฆื• GreenPlum ืกื™ื™ืžืึทืœื˜ื™ื™ื ื™ืึทืกืœื™ ืคึฟื•ืŸ ืึทืœืข ื ืึธื•ื“ื– ืื™ืŸ ืื•ื ื“ื–ืขืจ ืงื ื•ื™ืœ. ืื•ืŸ ื›ึผื“ื™ ืœื™ื™ืขื ืขืŸ ืคึฟื•ืŸ GreenPlum ืฆื• ื–ื™ื™ืŸ ืคึผืึทืจืึทืœืขืœ ืื•ืŸ ื™ืขื“ืขืจ ืคึผืึทืจืึทืœืขืœ Ab Initio ืคืึธื“ืขื ืฆื• ืœื™ื™ืขื ืขืŸ ื–ื™ื™ืŸ ืื™ื™ื’ืขื ืข ื—ืœืง ืคื•ืŸ ื“ืึทื˜ืŸ ืคึฟื•ืŸ GreenPlum, ืžื™ืจ ื”ืึธื‘ืŸ ืฆื• ืฉื˜ืขืœืŸ ืึท ืงืึทื ืกื˜ืจืึทืงืฉืึทืŸ ืคืืจืฉื˜ืื ืขืŸ ื“ื•ืจืš Ab Initio ืื™ืŸ ื“ื™ "ื•ื•ื•" ืึธืคึผื˜ื™ื™ืœื•ื ื’ ืคื•ืŸ SQL ืงื•ื•ื™ืจื™ื–

where ABLOCAL()

ืื•ืŸ ื‘ืึทืฉื˜ื™ืžืขืŸ ื“ื™ ื•ื•ืขืจื˜ ืคื•ืŸ ื“ืขื ืงืึทื ืกื˜ืจืึทืงืฉืึทืŸ ื“ื•ืจืš ืกืคึผืขืฆื™ืคื™ืฆื™ืจืŸ ื“ื™ ืคึผืึทืจืึทืžืขื˜ืขืจ ืœื™ื™ืขื ืขืŸ ืคื•ืŸ ื“ื™ ื˜ืจืึทื ืกืคืึธืจืžืึทืฆื™ืข ื“ืึทื˜ืึทื‘ื™ื™ืก

ablocal_expr=ยซstring_concat("mod(t.", string_filter_out("{$TABLE_KEY}","{}"), ",", (decimal(3))(number_of_partitions()),")=", (decimal(3))(this_partition()))ยป

, ื•ื•ืึธืก ืงืึทืžืคึผื™ื™ืœื– ืฆื• ืขืคึผืขืก ื•ื•ื™

mod(sk,10)=3

, ื“.ื”. ืื™ืจ ื”ืึธื‘ืŸ ืฆื• ืคึผื™ื ื˜ืœืขืš GreenPlum ืžื™ื˜ ืึท ื™ืงืกืคึผืœื™ืกืึทื˜ ืคื™ืœื˜ืขืจ ืคึฟืึทืจ ื™ืขื“ืขืจ ืฆืขื˜ื™ื™ืœื•ื ื’. ืคึฟืึทืจ ืื ื“ืขืจืข ื“ืึทื˜ืึทื‘ื™ื™ืกื™ื– (ื˜ืขืจืึทื“ืึทื˜ืึท, ืึธืจืึทืงืœืข), Ab Initio ืงืขื ืขืŸ ืื•ื™ื˜ืึธืžืึทื˜ื™ืฉ ื“ื•ืจื›ืคื™ืจืŸ ื“ืขื ืคึผืึทืจืึทืœืขืœื™ื–ืึทื˜ื™ืึธืŸ.

Ab Initio ืคืึธืจืฉื˜ืขืœื•ื ื’ ืคืึทืจื’ืœื™ื™ึทืš ืฆื•ื•ื™ืฉืŸ ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum

ืกื‘ืขืจื‘ืึทื ืง ื’ืขืคื™ืจื˜ ืึทืŸ ืขืงืกืคึผืขืจื™ืžืขื ื˜ ืฆื• ืคืึทืจื’ืœื™ื™ึทื›ืŸ ื“ื™ ืคืึธืจืฉื˜ืขืœื•ื ื’ ืคื•ืŸ MDW-ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื’ืจืึทืคืก ืื™ืŸ ื‘ืึทืฆื™ื•ื ื’ ืฆื• ื”ื™ื•ื•ืข ืื•ืŸ ืื™ืŸ ื‘ืึทืฆื™ื•ื ื’ ืฆื• GreenPlum. ื•ื•ื™ ืึท ื˜ื™ื™ืœ ืคื•ืŸ ื“ืขืจ ืขืงืกืคึผืขืจื™ืžืขื ื˜, ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ ื”ื™ื•ื•ืข, ืขืก ื–ืขื ืขืŸ ื’ืขื•ื•ืขืŸ 5 ื ืึธื•ื“ื– ืื•ื™ืฃ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ืงื ื•ื™ืœ ื•ื•ื™ Ab Initio, ืื•ืŸ ืื™ืŸ ื“ืขื ืคืึทืœ ืคื•ืŸ GreenPlum ืขืก ื–ืขื ืขืŸ ื’ืขื•ื•ืขืŸ 4 ื ืึธื•ื“ื– ืื•ื™ืฃ ืึท ื‘ืึทื–ื•ื ื“ืขืจ ืงื ื•ื™ืœ. ื™ืขื ืข. ื”ื™ื•ื•ืข ื”ืื˜ ืขื˜ืœืขื›ืข ื™ื™ึทื–ื ื•ื•ืึทืจื’ ืžื™ื™ึทืœืข ืื™ื‘ืขืจ GreenPlum.

ืžื™ืจ ื‘ืึทื˜ืจืึทื›ื˜ืŸ ืฆื•ื•ื™ื™ ืคึผืขืจื– ืคื•ืŸ ื’ืจืึทืคืก ื“ื•ืจื›ืคื™ืจืŸ ื“ื™ ื–ืขืœื‘ืข ืึทืจื‘ืขื˜ ืคื•ืŸ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ื“ืึทื˜ืŸ ืื™ืŸ ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum. ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ืฆื™ื™ื˜, ื“ื™ ื’ืจืึทืคืก ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ื•ืจืš ื“ื™ MDW ืงืึทื ืคื™ื’ื™ืขืจื™ื™ื˜ืขืจ ื–ืขื ืขืŸ ืœืึธื ื˜ืฉื˜:

  • ืขืจืฉื˜ ืžืึทืกืข + ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืžืึทืกืข ืคื•ืŸ โ€‹โ€‹ืจืึทื ื“ืึทืžืœื™ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ืึทื˜ืŸ ืื™ืŸ ืึท ื”ื™ื•ื•ืข ื˜ื™ืฉ
  • ืขืจืฉื˜ ืžืึทืกืข + ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืžืึทืกืข ืคื•ืŸ โ€‹โ€‹ืจืึทื ื“ืึทืžืœื™ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ืึทื˜ืŸ ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ GreenPlum ื˜ื™ืฉ

ืื™ืŸ ื‘ื™ื™ื“ืข ืงืึทืกืขืก (ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum) ื–ื™ื™ ืœื•ื™ืคืŸ ื•ืคึผืœืึธืึทื“ืก ืฆื• 10 ืคึผืึทืจืึทืœืขืœ ืคึฟืขื“ืขื ืื•ื™ืฃ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ Ab Initio ืงื ื•ื™ืœ. Ab Initio ื’ืขืจืื˜ืขื•ื•ืขื˜ ื™ื ื˜ืขืจืžื™ื“ื™ื™ื˜ ื“ืึทื˜ืŸ ืคึฟืึทืจ ื—ืฉื‘ื•ื ื•ืช ืื™ืŸ HDFS (ืื™ืŸ ื˜ืขืจืžื™ื ืขืŸ ืคื•ืŸ Ab Initio, MFS ืื•ื™ืกืœื™ื™ื’ ืžื™ื˜ HDFS ืื™ื– ื’ืขื ื™ืฆื˜). ืื™ื™ืŸ ืฉื•ืจื” ืคื•ืŸ ืจืึทื ื“ืึทืžืœื™ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ืึทื˜ืŸ ืคืึทืจื ื•ืžืขืŸ 200 ื‘ื™ื˜ืขืก ืื™ืŸ ื‘ื™ื™ื“ืข ืงืึทืกืขืก.

ื“ืขืจ ืจืขื–ื•ืœื˜ืึทื˜ ืื™ื– ื’ืขื•ื•ืขืŸ ื•ื•ื™ ื“ืึธืก:

ื›ื™ื™ื•ื•:

ืขืจืฉื˜ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ ื”ื™ื•ื•ืข

ืจื™ื™ืขืŸ ืืจื™ื™ื ื’ืขืœื™ื™ื’ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื’ืขื“ื•ื™ืขืจ ืคื•ืŸ ื™ื ื™ื˜ื™ืึทืœื™ื–ืึทื˜ื™ืึธืŸ
ื“ืึทื•ื ืœืึธื•ื“ื– ืื™ืŸ ืกืขืงื•ื ื“ืขืก
41
203
1 601

ื™ื ืงืจืขืžืขื ื˜ืึทืœ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ ื”ื™ื•ื•ืข

ื ื•ืžืขืจ ืคื•ืŸ ืจืึธื•ื– ื‘ื ื™ืžืฆื ืื™ืŸ
ืฆื™ืœ ื˜ื™ืฉ ืื™ืŸ ื“ื™ ืึธื ื”ื™ื™ื‘ ืคื•ืŸ ื“ืขืจ ืขืงืกืคึผืขืจื™ืžืขื ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื ื•ืžืขืจ ืคื•ืŸ ื“ืขืœื˜ืึท ืฉื•ืจื•ืช ื’ืขื•ื•ืขื ื“ื˜ ืฆื•
ืฆื™ืœ ื˜ื™ืฉ ื‘ืขืฉืึทืก ื“ืขืจ ืขืงืกืคึผืขืจื™ืžืขื ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื’ืขื“ื•ื™ืขืจ ืคื•ืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ
ื“ืึทื•ื ืœืึธื•ื“ื– ืื™ืŸ ืกืขืงื•ื ื“ืขืก
88
299
2 541

GreenPlum:

ืขืจืฉื˜ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ GreenPlum

ืจื™ื™ืขืŸ ืืจื™ื™ื ื’ืขืœื™ื™ื’ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื’ืขื“ื•ื™ืขืจ ืคื•ืŸ ื™ื ื™ื˜ื™ืึทืœื™ื–ืึทื˜ื™ืึธืŸ
ื“ืึทื•ื ืœืึธื•ื“ื– ืื™ืŸ ืกืขืงื•ื ื“ืขืก
72
360
3 631

ื™ื ืงืจืขืžืขื ื˜ืึทืœ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ GreenPlum

ื ื•ืžืขืจ ืคื•ืŸ ืจืึธื•ื– ื‘ื ื™ืžืฆื ืื™ืŸ
ืฆื™ืœ ื˜ื™ืฉ ืื™ืŸ ื“ื™ ืึธื ื”ื™ื™ื‘ ืคื•ืŸ ื“ืขืจ ืขืงืกืคึผืขืจื™ืžืขื ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื ื•ืžืขืจ ืคื•ืŸ ื“ืขืœื˜ืึท ืฉื•ืจื•ืช ื’ืขื•ื•ืขื ื“ื˜ ืฆื•
ืฆื™ืœ ื˜ื™ืฉ ื‘ืขืฉืึทืก ื“ืขืจ ืขืงืกืคึผืขืจื™ืžืขื ื˜
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก

ื’ืขื“ื•ื™ืขืจ ืคื•ืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ
ื“ืึทื•ื ืœืึธื•ื“ื– ืื™ืŸ ืกืขืงื•ื ื“ืขืก
159
199
321

ืžื™ืจ ื–ืขืŸ ืึทื– ื“ื™ ื’ื™ื›ืงื™ื™ึทื˜ ืคื•ืŸ ืขืจืฉื˜ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ ื‘ื™ื™ื“ืข ื”ื™ื•ื•ืข ืื•ืŸ GreenPlum ืœื™ื ืขืึทืจืœื™ ื“ืขืคึผืขื ื“ืก ืื•ื™ืฃ ื“ื™ ืกื•ืžืข ืคื•ืŸ โ€‹โ€‹โ€‹โ€‹ื“ืึทื˜ืŸ ืื•ืŸ, ืคึฟืึทืจ ื‘ืขืกืขืจ ื™ื™ึทื–ื ื•ื•ืึทืจื’, ืขืก ืื™ื– ืึท ื‘ื™ืกืœ ืคืึทืกื˜ืขืจ ืคึฟืึทืจ ื”ื™ื•ื•ืข ื•ื•ื™ ืคึฟืึทืจ GreenPlum.

ื™ื ืงืจืขืžืขื ื˜ืึทืœ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ ื”ื™ื•ื•ืข ืื•ื™ืš ืœื™ื ืขืึทืจืœื™ ื“ืขืคึผืขื ื“ืก ืื•ื™ืฃ ื“ื™ ื‘ืึทื ื“ ืคื•ืŸ ืคืจื™ืขืจ ืœืึธื•ื“ื™ื“ ื“ืึทื˜ืŸ ื‘ื ื™ืžืฆื ืื™ืŸ ื“ื™ ืฆื™ืœ ื˜ื™ืฉ ืื•ืŸ ืื™ื– ื’ืึทื ืฅ ืกืœืึธื•ืœื™ ื•ื•ื™ ื“ื™ ื‘ืึทื ื“ ื•ื•ืืงืกื˜. ื“ืขื ืื™ื– ื’ืขืคึฟื™ืจื˜ ื“ื•ืจืš ื“ื™ ื ื•ื™ื˜ ืฆื• ืจื™ืจื™ื™ื˜ ื“ื™ ืฆื™ืœ ื˜ื™ืฉ ื’ืึธืจ. ื“ืขื ืžื™ื˜ืœ ืึทื– ืึทืคึผืœื™ื™ื™ื ื’ ืงืœื™ื™ืŸ ืขื ื“ืขืจื•ื ื’ืขืŸ ืฆื• ืจื™ื–ื™ืง ื˜ื™ืฉืŸ ืื™ื– ื ื™ืฉื˜ ืึท ื’ื•ื˜ ื ื•ืฆืŸ ืคืึทืœ ืคึฟืึทืจ ื”ื™ื•ื•ืข.

ื™ื ืงืจืขืžืขื ื˜ืึทืœ ืœืึธื•ื“ื™ื ื’ ืื™ืŸ GreenPlum ื“ืขืคึผืขื ื“ืก ืฉื•ื•ืึทืš ืื•ื™ืฃ ื“ื™ ื‘ืึทื ื“ ืคื•ืŸ ืคืจื™ืขืจ ืœืึธื•ื“ื™ื“ ื“ืึทื˜ืŸ ื‘ื ื™ืžืฆื ืื™ืŸ ื“ื™ ืฆื™ืœ ื˜ื™ืฉ ืื•ืŸ ืื™ื– ื’ืึทื ืฅ ื’ืขืฉื•ื•ื™ื ื“. ื“ืึธืก ืื™ื– ื’ืขืฉืขืŸ ื“ืึทื ืง ืฆื• SQL ื“ื–ืฉืึธื™ื ืก ืื•ืŸ ื“ื™ GreenPlum ืึทืจืงืึทื˜ืขืงื˜ืฉืขืจ, ื•ื•ืึธืก ืึทืœืึทื•ื– ื“ื™ ื•ื™ืกืžืขืงืŸ ืึธืคึผืขืจืึทืฆื™ืข.

ืึทื–ื•ื™, GreenPlum ืžื•ืกื™ืฃ ื“ื™ ื“ืขืœื˜ืึท ื ื™ืฆืŸ ื“ื™ ื•ื™ืกืžืขืงืŸ + ืึทืจื™ื™ึทื ืœื™ื™ื’ืŸ ืื•ืคึฟืŸ, ืึธื‘ืขืจ ื”ื™ื•ื•ืข ื˜ื•ื˜ ื ื™ืฉื˜ ื”ืึธื‘ืŸ ื•ื™ืกืžืขืงืŸ ืึธื“ืขืจ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ ืึทืคึผืขืจื™ื™ืฉืึทื ื–, ืึทื–ื•ื™ ื“ื™ ื’ืื ืฆืข ื“ืึทื˜ืŸ ืžืขื ื’ืข ืื™ื– ื’ืขื•ื•ืขืŸ ื’ืขืฆื•ื•ื•ื ื’ืขืŸ ืฆื• ื–ื™ื™ืŸ ืจื™ืจื™ื™ื˜ ืื™ืŸ ืึท ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ. ื“ืขืจ ืคืึทืจื’ืœื™ื™ึทืš ืคื•ืŸ ื“ื™ ืกืขืœื– ื›ื™ื™ืœื™ื™ื˜ื™ื“ ืื™ืŸ ื“ืจื™ื™ืกื˜ ืื™ื– ืžืขืจืกื˜ ืจื™ื•ื•ื™ืœื™ื ื’, ื•ื•ื™ื™ึทืœ ืขืก ืงืึธืจืึทืกืคึผืึทื ื“ื– ืฆื• ื“ื™ ืžืขืจืกื˜ ืคึผืจืึธืกื˜ ืึธืคึผืฆื™ืข ืคึฟืึทืจ ื ื™ืฆืŸ ืžื™ื˜ืœ-ืื™ื ื˜ืขื ืกื™ื•ื•ืข ื“ืึทื•ื ืœืึธื•ื“ื–. ืžื™ืจ ื–ืขืŸ ืึทื– GreenPlum ืฉืœืึธื’ืŸ Hive ืื™ืŸ ื“ืขื ืคึผืจืึธื‘ืข ืžื™ื˜ 8 ืžืืœ.

ืึทืจื‘ืขื˜ ืื™ืŸ ื“ื™ ืึธื ื”ื™ื™ื‘ ืžื™ื˜ GreenPlum ืื™ืŸ ืœืขื‘ืŸ ืคืึทืงื˜ื™ืฉ ืฆื™ื™ื˜ ืžืึธื“ืข

ืื™ืŸ ื“ืขื ืขืงืกืคึผืขืจื™ืžืขื ื˜, ืžื™ืจ ื•ื•ืขืœืŸ ืคึผืจื•ื‘ื™ืจืŸ ื“ื™ ืคื™ื™ื™ืงื™ื™ื˜ ืคื•ืŸ Ab Initio ืฆื• ื“ืขืจื”ื™ื™ึทื ื˜ื™ืงืŸ ื“ื™ GreenPlum ื˜ื™ืฉ ืžื™ื˜ ืจืึทื ื“ืึทืžืœื™ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื˜ืฉืึทื ื’ืงืก ืคื•ืŸ ื“ืึทื˜ืŸ ืื™ืŸ ื›ึผืžืขื˜ ืคืึทืงื˜ื™ืฉ ืฆื™ื™ื˜. ื–ืืœ ืก ื‘ืึทื˜ืจืึทื›ื˜ืŸ ื“ื™ GreenPlum ื˜ื™ืฉ dev42_1_db_usl.TESTING_SUBJ_org_finval, ืžื™ื˜ ื•ื•ืึธืก ืžื™ืจ ื•ื•ืขืœืŸ ืึทืจื‘ืขื˜ืŸ.

ืžื™ืจ ื•ื•ืขืœืŸ ื ื•ืฆืŸ ื“ืจื™ื™ Ab Initio ื’ืจืึทืคืก ืฆื• ืึทืจื‘ืขื˜ืŸ ืžื™ื˜ ืื™ื:

1) ื’ืจืึทืคื™ืง Create_test_data.mp - ืงืจื™ื™ื™ืฅ ื“ืึทื˜ืŸ ื˜ืขืงืขืก ืื™ืŸ HDFS ืžื™ื˜ 10 ืจืึธื•ื– ืื™ืŸ 6 ืคึผืึทืจืึทืœืขืœ ืคึฟืขื“ืขื. ื“ื™ ื“ืึทื˜ืŸ ื–ืขื ืขืŸ ื˜ืจืึทืค, ื“ื™ ืกื˜ืจื•ืงื˜ื•ืจ ืื™ื– ืึธืจื’ืึทื ื™ื–ื™ืจื˜ ืคึฟืึทืจ ื™ื ืกืขืจืฉืึทืŸ ืื™ืŸ ืื•ื ื“ื–ืขืจ ื˜ื™ืฉ

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

2) ื’ืจืึทืคื™ืง mdw_load.day_one.current.dev42_1_db_usl_testing_subj_org_finval.pset - MDW ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื’ืจืึทืคื™ืง ื“ื•ืจืš ื™ื ื™ื˜ื™ืึทืœื™ื–ื™ื ื’ ื“ืึทื˜ืŸ ื™ื ืกืขืจืฉืึทืŸ ืื™ืŸ ืื•ื ื“ื–ืขืจ ื˜ื™ืฉ ืื™ืŸ 10 ืคึผืึทืจืึทืœืขืœ ืคึฟืขื“ืขื (ืคึผืจื•ื‘ื™ืจืŸ ื“ืึทื˜ืŸ ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ื•ืจืš ื’ืจืึทืคื™ืง (1) ืื™ื– ื’ืขื ื™ืฆื˜)

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

3) ื’ืจืึทืคื™ืง mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset - ืึท ื’ืจืึทืคื™ืง ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ื•ืจืš MDW ืคึฟืึทืจ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืึทืคึผื“ื™ื™ื˜ื™ื ื’ ืคื•ืŸ ืื•ื ื“ื–ืขืจ ื˜ื™ืฉ ืื™ืŸ 10 ืคึผืึทืจืึทืœืขืœ ืคึฟืขื“ืขื ื ื™ืฆืŸ ืึท ื˜ื™ื™ืœ ืคื•ืŸ ืคืจื™ืฉ ื‘ืืงื•ืžืขืŸ ื“ืึทื˜ืŸ (ื“ืขืœื˜ืึท) ื“ื–ืฉืขื ืขืจื™ื™ื˜ืึทื“ ื“ื•ืจืš ื’ืจืึทืคื™ืง (1)

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum

ืœืึธืžื™ืจ ืœื•ื™ืคืŸ ื“ื™ ืื•ื ื˜ืŸ ืฉืจื™ืคื˜ ืื™ืŸ NRT ืžืึธื“ืข:

  • ื“ื–ืฉืขื ืขืจื™ื™ื˜ 6 ืคึผืจื•ื‘ื™ืจืŸ ืฉื•ืจื•ืช
  • ื“ื•ืจื›ืคื™ืจืŸ ืึทืŸ ืขืจืฉื˜ ืžืึทืกืข ืึทืจื™ื™ึทื ืœื™ื™ื’ืŸ 6 ืคึผืจื•ื‘ื™ืจืŸ ืจืึธื•ื– ืื™ืŸ ืึท ืœื™ื™ื“ื™ืง ื˜ื™ืฉ
  • ืื™ื‘ืขืจื—ื–ืจืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืืจืืคืงืืคื™ืข 5 ืžืืœ
    • ื“ื–ืฉืขื ืขืจื™ื™ื˜ 6 ืคึผืจื•ื‘ื™ืจืŸ ืฉื•ืจื•ืช
    • ื“ื•ืจื›ืคื™ืจืŸ ืึทืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืึทืจื™ื™ึทื ืœื™ื™ื’ืŸ ืคื•ืŸ 6 ืคึผืจื•ื‘ื™ืจืŸ ืจืึธื•ื– ืื™ืŸ ื“ื™ ื˜ื™ืฉ (ืื™ืŸ ื“ืขื ืคืึทืœ, ื“ื™ valid_to_ts ืขืงืกืคึผืขืจื™ื™ืฉืึทืŸ ืฆื™ื™ื˜ ืื™ื– ื‘ืึทืฉื˜ื™ืžื˜ ืฆื• ื“ื™ ืึทืœื˜ ื“ืึทื˜ืŸ ืื•ืŸ ืžืขืจ ืคืจื™ืฉ ื“ืึทื˜ืŸ ืžื™ื˜ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ืขืจืฉื˜ื™ืง ืฉืœื™ืกืœ ืื™ื– ื™ื ืกืขืจื˜ืึทื“)

ื“ืขืจ ืกืฆืขื ืึทืจ ืขืžื™ืึทืœื™ื™ืฅ ื“ื™ ืžืึธื“ืข ืคื•ืŸ โ€‹โ€‹ืคืึทืงื˜ื™ืฉ ืึธืคึผืขืจืึทืฆื™ืข ืคื•ืŸ โ€‹โ€‹ืึท ื–ื™ื›ืขืจ ื’ืขืฉืขืคื˜ ืกื™ืกื˜ืขื - ืึท ืคืขืจืœื™ ื’ืจื•ื™ืก ื˜ื™ื™ืœ ืคื•ืŸ ื ื™ื™ึทืข ื“ืึทื˜ืŸ ืื™ื– ืืจื•ื™ืก ืื™ืŸ ืคืึทืงื˜ื™ืฉ ืฆื™ื™ื˜ ืื•ืŸ ืื™ื– ื’ืœื™ื™ืš ืื•ื™ืกื’ืขื’ืืกืŸ ืื™ืŸ GreenPlum.

ืื™ืฆื˜ ืœืึธื–ืŸ ืก ืงื•ืง ืื™ืŸ ื“ื™ ืฉืจื™ืคื˜ ืก ืงืœืึธืฅ:

ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:49:11
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:49:37
ืึธื ื”ื™ื™ื‘ mdw_load.day_one.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:49:37
ืขื ื“ื™ืงืŸ mdw_load.day_one.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:50:42
ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:50:42
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:51:06
ืึธื ื”ื™ื™ื‘ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:51:06
ืขื ื“ื™ืงืŸ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:53:41
ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:53:41
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:54:04
ืึธื ื”ื™ื™ื‘ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:54:04
ืขื ื“ื™ืงืŸ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:56:51
ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:56:51
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:57:14
ืึธื ื”ื™ื™ื‘ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:57:14
ืขื ื“ื™ืงืŸ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 11:59:55
ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 11:59:55
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 12:00:23
ืึธื ื”ื™ื™ื‘ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 12:00:23
ืขื ื“ื™ืงืŸ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 12:03:23
ืึธื ื”ื™ื™ื‘ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 12:03:23
ืขื ื“ื™ืงืŸ Create_test_data.input.pset ื‘ื™ื™ 2020-06-04 12:03:49
ืึธื ื”ื™ื™ื‘ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 12:03:49
ืขื ื“ื™ืงืŸ mdw_load.regular.current.dev42_1_db_usl_testing_subj_org_finval.pset ื‘ื™ื™ 2020-06-04 12:06:46

ืขืก ื˜ื•ืจื ืก ืื•ื™ืก ื“ืขื ื‘ื™ืœื“:

ื’ืจืึทืคื™ืง
ืึธื ื”ื™ื™ื‘ ืฆื™ื™ึทื˜
ืขื ื“ื™ืงืŸ ืฆื™ื™ึทื˜
ืœืขื ื’

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:26

mdw_load.day_one.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:01:05

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:24

mdw_load.regular.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:02:35

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:23

mdw_load.regular.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:02:47

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:23

mdw_load.regular.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:02:41

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:28

mdw_load.regular.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:03:00

Create_test_data.input.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:00:26

mdw_load.regular.current.
dev42_1_db_usl_testing_subj_org_finval.pset
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
ืงืกื ื•ืžืงืก ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก: ืงืกื ื•ืžืงืก
00:02:57

ืžื™ืจ ื–ืขืŸ ืึทื– 6 ื™ื ืงืจืึทืžืึทื ื˜ ืฉื•ืจื•ืช ื–ืขื ืขืŸ ืคึผืจืึทืกืขืกื˜ ืื™ืŸ 000 ืžื™ื ื•ื˜, ื•ื•ืึธืก ืื™ื– ื’ืึทื ืฅ ืฉื ืขืœ.
ื“ื™ ื“ืึทื˜ืŸ ืื™ืŸ ื“ื™ ืฆื™ืœ ื˜ื™ืฉ ืื™ื– ื’ืขื•ื•ืขืŸ ืคื•ื ืื ื“ืขืจื’ืขื˜ื™ื™ืœื˜ ื•ื•ื™ ื’ื™ื™ื˜:

select valid_from_ts, valid_to_ts, count(1), min(sk), max(sk) from dev42_1_db_usl.TESTING_SUBJ_org_finval group by valid_from_ts, valid_to_ts order by 1,2;

ื•ื•ืขืŸ ืื™ืจ ื”ืึธื‘ืŸ ืกื‘ืขืจ ื•ื•ืึธื’. ื ื™ืฆืŸ Ab Initio ืžื™ื˜ Hive ืื•ืŸ GreenPlum
ืื™ืจ ืงืขื ืขืŸ ื–ืขืŸ ื“ื™ ืงืึธืจืขืกืคึผืึธื ื“ืขื ืฅ ืคื•ืŸ ื“ื™ ื™ื ืกืขืจื˜ืึทื“ ื“ืึทื˜ืŸ ืฆื• ื“ื™ ืฆื™ื™ื˜ ื•ื•ืขืŸ ื“ื™ ื’ืจืึทืคืก ื–ืขื ืขืŸ ืœืึธื ื˜ืฉื˜.
ื“ืขื ืžื™ื˜ืœ ืื™ืจ ืงืขื ืขืŸ ืœื•ื™ืคืŸ ื™ื ืงืจืึทืžืขื ื˜ืึทืœ ืœืึธื•ื“ื™ื ื’ ืคื•ืŸ ื“ืึทื˜ืŸ ืื™ืŸ GreenPlum ืื™ืŸ Ab Initio ืžื™ื˜ ืึท ื–ื™ื™ืขืจ ื”ื•ื™ืš ืึธืคื˜ืงื™ื™ึทื˜ ืื•ืŸ ืึธื‘ืกืขืจื•ื•ื™ืจืŸ ืึท ื”ื•ื™ืš ื’ื™ื›ืงื™ื™ึทื˜ ืคื•ืŸ ื™ื ืกืขืจื˜ื™ื ื’ ื“ื™ ื“ืึทื˜ืŸ ืื™ืŸ GreenPlum. ืคื•ืŸ ืงื•ืจืก, ืขืก ื•ื•ืขื˜ ื ื™ืฉื˜ ื–ื™ื™ืŸ ืžืขื’ืœืขืš ืฆื• ืงืึทื˜ืขืจ ืึทืžืึธืœ ืึท ืจื’ืข, ื–ื™ื ื˜ Ab Initio, ื•ื•ื™ ืงื™ื™ืŸ ETL ื’ืขืฆื™ื™ึทื’, ืจื™ืงื•ื•ื™ื™ืขืจื– ืฆื™ื™ื˜ ืฆื• "ืึธื ื”ื™ื™ื‘ ืึทืจื•ื™ืฃ" ื•ื•ืขืŸ ืœืึธื ื˜ืฉื˜.

ืกืึธืฃ

Ab Initio ืื™ื– ื“ืขืจื•ื•ื™ื™ึทืœ ื’ืขื ื™ืฆื˜ ืื™ืŸ Sberbank ืฆื• ื‘ื•ื™ืขืŸ ืึท ื•ื ื™ืคื™ืขื“ ืกืขืžืึทื ื˜ื™ืง ื“ืึทื˜ืึท ืฉื™ื›ื˜ืข (ESS). ื“ืขื ืคึผืจื•ื™ืขืงื˜ ื™ื ื•ื•ืึทืœื•ื•ื– ื‘ื ื™ืŸ ืึท ื™ื•ื ืึทืคื™ื™ื“ ื•ื•ืขืจืกื™ืข ืคื•ืŸ โ€‹โ€‹ื“ื™ ืฉื˜ืึทื˜ ืคื•ืŸ ืคืึทืจืฉื™ื“ืŸ ื‘ืึทื ืงื™ื ื’ ื’ืขืฉืขืคื˜ ืขื ื˜ื™ื˜ื™ื–. ืื™ื ืคึฟืึธืจืžืึทืฆื™ืข ืงื•ืžื˜ ืคื•ืŸ ืคืึทืจืฉื™ื“ืŸ ืงื•ื•ืืœืŸ, ื“ื™ ืจืขืคึผืœืึทืงืึทื– ืคื•ืŸ ื•ื•ืึธืก ื–ืขื ืขืŸ ืฆื•ื’ืขื’ืจื™ื™ื˜ ืื•ื™ืฃ Hadoop. ื‘ืึทื–ื™ืจื˜ ืื•ื™ืฃ ื’ืขืฉืขืคื˜ ื‘ืื“ืขืจืคืขื ื™ืฉืŸ, ืึท ื“ืึทื˜ืŸ ืžืึธื“ืขืœ ืื™ื– ืฆื•ื’ืขื’ืจื™ื™ื˜ ืื•ืŸ ื“ืึทื˜ืŸ ื˜ืจืึทื ืกืคืขืจืžื™ื™ืฉืึทื ื– ื–ืขื ืขืŸ ื“ื™ืกืงืจื™ื™ื‘ื“. Ab Initio ืœืึธื•ื“ื– ืื™ื ืคึฟืึธืจืžืึทืฆื™ืข ืื™ืŸ ื“ื™ ESN ืื•ืŸ ื“ื™ ื“ืึทื•ื ืœืึธื•ื“ื™ื“ ื“ืึทื˜ืŸ ืื™ื– ื ื™ื˜ ื‘ืœื•ื™ื– ืคื•ืŸ ืื™ื ื˜ืขืจืขืก ืฆื• ื“ื™ ื’ืขืฉืขืคื˜ ืื™ืŸ ื–ื™ืš, ืึธื‘ืขืจ ืื•ื™ืš ื“ื™ื ืขืŸ ื•ื•ื™ ืึท ืžืงื•ืจ ืคึฟืึทืจ ื‘ื ื™ืŸ ื“ืึทื˜ืŸ ืžืึทืจืง. ืื™ืŸ ื“ืขืจ ื–ืขืœื‘ื™ืงืขืจ ืฆื™ื™ื˜, ื“ื™ ืคืึทื ื’ืงืฉืึทื ืึทืœื™ื˜ื™ ืคื•ืŸ ื“ื™ ืคึผืจืึธื“ื•ืงื˜ ืึทืœืึทื•ื– ืื™ืจ ืฆื• ื ื•ืฆืŸ ืคืึทืจืฉื™ื“ืŸ ืกื™ืกื˜ืขืžืขืŸ ื•ื•ื™ ืึท ื•ืคื ืขืžืขืจ (Hive, Greenplum, Teradata, Oracle), ื•ื•ืึธืก ืžืื›ื˜ ืขืก ืžืขื’ืœืขืš ืฆื• ืœื™ื™ื›ื˜ ืฆื•ื’ืจื™ื™ื˜ืŸ ื“ืึทื˜ืŸ ืคึฟืึทืจ ืึท ื’ืขืฉืขืคื˜ ืื™ืŸ ื“ื™ ืคืึทืจืฉื™ื“ืŸ ืคึฟืึธืจืžืึทื˜ื™ืจื•ื ื’ืขืŸ ืขืก ืจื™ืงื•ื•ื™ื™ืขืจื–.

ื“ื™ ืงื™ื™ืคึผืึทื‘ื™ืœืึทื˜ื™ื– ืคื•ืŸ Ab Initio ื–ืขื ืขืŸ ื‘ืจื™ื™ื˜, ืœืžืฉืœ, ื“ื™ ืึทืจื™ื™ึทื ื’ืขืจืขื›ื ื˜ MDW ืคืจื™ื™ืžื•ื•ืขืจืง ืžืื›ื˜ ืขืก ืžืขื’ืœืขืš ืฆื• ื‘ื•ื™ืขืŸ ื˜ืขื›ื ื™ืฉ ืื•ืŸ ื’ืขืฉืขืคื˜ ื”ื™ืกื˜ืืจื™ืฉืข ื“ืึทื˜ืŸ. ืคึฟืึทืจ ื“ืขื•ื•ืขืœืึธืคึผืขืจืก, Ab Initio ืžืื›ื˜ ืขืก ืžืขื’ืœืขืš ื ื™ืฉื˜ ืฆื• ืจื™ื™ื ื•ื•ืขื ื˜ ื“ื™ ืจืึธื“, ืึธื‘ืขืจ ืฆื• ื ื•ืฆืŸ ืคื™ืœืข ื™ื’ื–ื™ืกื˜ื™ื ื’ ืคืึทื ื’ืงืฉืึทื ืึทืœ ืงืึทืžืคึผืึธื•ื ืึทื ืฅ, ื•ื•ืึธืก ื–ืขื ืขืŸ ื™ืกืขื ืฉืึทืœื™ ืœื™ื™ื‘ืจืขืจื™ื– ื“ืืจืฃ ื•ื•ืขืŸ ืืจื‘ืขื˜ืŸ ืžื™ื˜ ื“ืึทื˜ืŸ.

ื“ืขืจ ืžื—ื‘ืจ ืื™ื– ืึท ืžื•ืžื—ื” ืื™ืŸ ื“ืขืจ ืคืึทื›ืžืึทืŸ ืงื”ืœ ืคื•ืŸ Sberbank SberProfi DWH/BigData. ื“ื™ SberProfi DWH / BigData ืคืึทื›ืžืึทืŸ ืงื”ืœ ืื™ื– ืคืึทืจืึทื ื˜ื•ื•ืึธืจื˜ืœืขืš ืคึฟืึทืจ ื“ืขื•ื•ืขืœืึธืคึผื™ื ื’ ืงืึทืžืคึผืึทื˜ื™ื ืกื™ื– ืื™ืŸ ืึทื–ืึท ื’ืขื‘ื™ื˜ืŸ ื•ื•ื™ ื“ื™ Hadoop ื™ืงืึธื•ืกื™ืกื˜ืึทื, Teradata, Oracle DB, GreenPlum, ื•ื•ื™ ื’ืขื–ื•ื ื˜ ื•ื•ื™ BI ืžื›ืฉื™ืจื™ื Qlik, SAP BO, Tableau, ืขื˜ืง.

ืžืงื•ืจ: www.habr.com

ืœื™ื™ื’ืŸ ืึท ื‘ืึทืžืขืจืงื•ื ื’