ืœืขื•ื•ืขืœื™ื ื’ ืคึผืœืึทืŸ ืคึฟืึทืจ ื‘ืืงื•ืžืขืŸ ื“ื™ ืคืึทืš ื“ืึทื˜ืึท ื™ื ื–ืฉืขื ื™ืจ

ืื™ืš ื”ืื‘ ืฉื•ื™ืŸ ืืจื‘ืขื˜ืŸ ื•ื•ื™ ืึท ืคึผืจื•ื™ืขืงื˜ ืคืึทืจื•ื•ืึทืœื˜ืขืจ ืคึฟืึทืจ ื“ื™ ืœืขืฆื˜ืข ืึทื›ื˜ ื™ืึธืจ (ืื™ืš ื˜ืึธืŸ ื ื™ื˜ ืฉืจื™ื™ึทื‘ืŸ ืงืึธื“ ืื™ืŸ ืึทืจื‘ืขื˜), ื•ื•ืึธืก ื’ืขื•ื•ื™ื™ื ื˜ืœืขืš ื”ืื˜ ืึท ื ืขื’ืึทื˜ื™ื•ื• ืคึผืจืึทืœ ืื•ื™ืฃ ืžื™ื™ืŸ ื˜ืขื›ื ืึธืœืึธื’ื™ืข ื‘ืึทืงืขื ื“. ืื™ืš ื‘ืึทืฉืœืึธืกืŸ ืฆื• ืจืขื“ื•ืฆื™ืจืŸ ืžื™ื™ืŸ ื˜ืขืงื ืึทืœืึทื“ื–ืฉื™ืงืึทืœ ืจื™ืก ืื•ืŸ ื‘ืึทืงื•ืžืขืŸ ื“ื™ ืคืึทืš ืคื•ืŸ ื“ืึทื˜ืึท ื™ื ื–ืฉืขื ื™ืจ. ื“ื™ ื”ื•ื™ืคึผื˜ ืกืงื™ืœื– ืคื•ืŸ ืึท ื“ืึทื˜ืึท ื™ื ื–ืฉืขื ื™ืจ ืื™ื– ื“ื™ ืคื™ื™ื™ืงื™ื™ื˜ ืฆื• ืคึผืœืึทืŸ, ื‘ื•ื™ืขืŸ ืื•ืŸ ื˜ื™ื™ึทื ืขืŸ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ื–ื™ื–.

ืื™ืš ื”ืึธื‘ืŸ ื’ืขืฆื•ื™ื’ืŸ ืึท ื˜ืจื™ื™ื ื™ื ื’ ืคึผืœืึทืŸ, ืื™ืš ื˜ืจืึทื›ื˜ืŸ ืขืก ื•ื•ืขื˜ ื–ื™ื™ืŸ ื ื•ืฆื™ืง ื ื™ื˜ ื‘ืœื•ื™ื– ืคึฟืึทืจ ืžื™ืจ. ื“ืขืจ ืคึผืœืึทืŸ ืื™ื– ืคืึธื•ืงื™ืกื˜ ืื•ื™ืฃ ืคืจื™ื™ึท ืœืขืจื ืขืŸ ืคื•ืŸ ืงืึธืจืกืึทื–. ื‘ื™ืœื›ืขืจืงื™ื™ึทื˜ ืื™ื– ื’ืขื’ืขื‘ืŸ ืฆื• ืคืจื™ื™ ืงืึธืจืกืึทื– ืื™ืŸ ืจื•ืกื™ืฉ.

ืกืขืงืฆื™ืขืก:

  • ืึทืœื’ืขืจื™ื“ืึทืžื– ืื•ืŸ ื“ืึทื˜ืŸ ืกื˜ืจืึทืงื˜ืฉืขืจื–. ืฉืœื™ืกืœ ืึธืคึผื˜ื™ื™ืœื•ื ื’. ืื•ื™ื‘ ืื™ืจ ืœืขืจื ืขืŸ ืขืก, ืึทืœืฅ ืึทื ื“ืขืจืฉ ื•ื•ืขื˜ ืื•ื™ืš ืึทืจื‘ืขื˜ ืื•ื™ืก. ืขืก ืื™ื– ื•ื•ื™ื›ื˜ื™ืง ืฆื• ื•ื•ืขืจืŸ ื’ืขื ื™ื˜ ืื™ืŸ ืฉืจื™ื™ื‘ืŸ ืงืึธื“ ืื•ืŸ ื ื™ืฆืŸ ื™ืงืขืจื“ื™ืง ืกื˜ืจืึทืงื˜ืฉืขืจื– ืื•ืŸ ืึทืœื’ืขืจื™ื“ืึทืžื–.
  • ื“ืึทื˜ืึทื‘ื™ื™ืกื™ื– ืื•ืŸ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ื–ื™ื–, ื‘ื™ื–ื ืขืก ื™ื ื˜ืขืœืœื™ื’ืขื ืกืข. ืžื™ืจ ืžืึทืš ืคื•ืŸ ืึทืœื’ืขืจื™ื“ืึทืžื– ืฆื• ื“ืึทื˜ืŸ ืกื˜ืึธืจื™ื“ื–ืฉ ืื•ืŸ ืคึผืจืึทืกืขืกื™ื ื’.
  • Hadoop ืื•ืŸ ื‘ื™ื’ ื“ืึทื˜ืึท. ื•ื•ืขืŸ ื“ื™ ื“ืึทื˜ืึทื‘ืึทืกืข ื˜ื•ื˜ ื ื™ืฉื˜ ืคึผืึทืกื™ืง ืื•ื™ืฃ ื“ื™ ืฉื•ื•ืขืจ ืคืึธืจ, ืึธื“ืขืจ ื•ื•ืขืŸ ื“ื™ ื“ืึทื˜ืŸ ื“ืึทืจืฃ ื–ื™ื™ืŸ ืึทื ืึทืœื™ื™ื–ื“, ืึธื‘ืขืจ ืขืงืกืกืขืœ ืงืขื ืขืŸ ื ื™ื˜ ืžืขืจ ืœืึธื“ืŸ ืขืก, ื’ืจื•ื™ืก ื“ืึทื˜ืŸ ื”ื™ื™ื‘ื˜. ืื™ืŸ ืžื™ื™ืŸ ืžื™ื™ื ื•ื ื’, ืื™ืจ ื“ืึทืจืคึฟืŸ ืฆื• ื’ื™ื™ืŸ ืื•ื™ืฃ ืฆื• ื“ืขื ืึธืคึผื˜ื™ื™ืœื•ื ื’ ื‘ืœื•ื™ื– ื ืึธืš ืึท ื˜ื™ืฃ ืœืขืจื ืขืŸ ืคื•ืŸ ื“ื™ ืคืจื™ืขืจื“ื™ืงืข ืฆื•ื•ื™ื™.

ืึทืœื’ืขืจื™ื“ืึทืžื– ืื•ืŸ ื“ืึทื˜ืŸ ืกื˜ืจืึทืงื˜ืฉืขืจื–

ืื™ืŸ ืžื™ื™ืŸ ืคึผืœืึทืŸ ืื™ืš ืึทืจื™ื™ึทื ื’ืขืจืขื›ื ื˜ ืœืขืจื ืขืŸ ืคึผื™ื˜ื”ืึธืŸ, ืจื™ื•ื•ื™ื•ื™ื ื’ ื“ื™ ื‘ืึทืกื™ืงืก ืคื•ืŸ ืžืื˜ืขืžืื˜ื™ืง ืื•ืŸ ืึทืœื’ืขืจื™ื“ืึทืžื–.

ื“ืึทื˜ืึทื‘ื™ื™ืกื™ื– ืื•ืŸ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ื–ื™ื–, ื‘ื™ื–ื ืขืก ื™ื ื˜ืขืœืœื™ื’ืขื ืกืข

ื˜ืขืžืขืก ืฉื™ื™ึทื›ื•ืช ืฆื• ื‘ื ื™ืŸ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ืกื™ื–, ETL, OLAP ืงื™ื•ื‘ื– ื–ืขื ืขืŸ ื”ืขื›ืกื˜ ืึธืคืขื ื’ื™ืง ืื•ื™ืฃ ื“ื™ ืžื›ืฉื™ืจื™ื, ืึทื–ื•ื™ ืื™ืŸ ื“ืขื ื“ืึธืงื•ืžืขื ื˜ ืื™ืš ื˜ืึธืŸ ื ื™ื˜ ืฆื•ืฉื˜ืขืœืŸ ืœื™ื ืงืก ืฆื• ืงืึธืจืกืึทื–. ืขืก ืื™ื– ืงืขื“ื™ื™ึทื™ืง ืฆื• ืœืขืจื ืขืŸ ืึทื–ืึท ืกื™ืกื˜ืขืžืขืŸ ื•ื•ืขืŸ ืื™ืจ ืึทืจื‘ืขื˜ ืื•ื™ืฃ ืึท ืกืคึผืขืฆื™ืคื™ืฉ ืคึผืจื•ื™ืขืงื˜ ืื™ืŸ ืึท ืกืคึผืขืฆื™ืคื™ืฉ ืคื™ืจืžืข. ืฆื• ื‘ืึทืงื•ืžืขืŸ ื‘ืึทืงืึทื ื˜ ืžื™ื˜ ETL ืื™ืจ ืงืขื ืขืŸ ืคึผืจื•ื‘ื™ืจืŸ ื˜ืึทืœืขื ื“ ืึธื“ืขืจ ืึทื™ืจืคืœืึธื•ื•.

ืื™ืŸ ืžื™ื™ืŸ ืžื™ื™ื ื•ื ื’, ืขืก ืื™ื– ื•ื•ื™ื›ื˜ื™ืง ืฆื• ืœืขืจื ืขืŸ ืžืึธื“ืขืจืŸ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ืก ืคึผืœืึทืŸ ืžืขื˜ืึทื“ืึทืœืึทื“ื–ืฉื™ Data Vault 1 ืœื™ื ืง, 2 ืœื™ื ืง. ืื•ืŸ ื“ืขืจ ื‘ืขืกื˜ืขืจ ื•ื•ืขื’ ืฆื• ืœืขืจื ืขืŸ ืขืก ืื™ื– ืฆื• ื ืขืžืขืŸ ืขืก ืื•ืŸ ื™ื ืกื˜ืจื•ืžืขื ื˜ ืขืก ืžื™ื˜ ืึท ืคึผืฉื•ื˜ ื‘ื™ื™ึทืฉืคึผื™ืœ. ืขืก ื–ืขื ืขืŸ ืขื˜ืœืขื›ืข ื‘ื™ื™ืฉืคื™ืœืŸ ืคื•ืŸ Data Vault ื™ืžืคึผืœืึทืžืึทื ืฅ ืื•ื™ืฃ GitHub ืจื•ื ื’. ื ืžืึธื“ืขืจืŸ ื‘ื•ืš ืื•ื™ืฃ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ืกื™ื–: ืžืึธื“ืขืœื™ื ื’ ื“ื™ ืคืœื™ื ืง ื“ืึทื˜ืึท ื•ื•ืึทืจืขื”ืึธื•ืกืข ืžื™ื˜ ื“ืึทื˜ืึท ื•ื•ืึธืœื˜ ื“ื•ืจืš Hans Hultgren.

ืฆื• ื‘ืึทืงืขื ืขืŸ ื–ื™ืš ืžื™ื˜ ื‘ื™ื–ื ืขืก ื™ื ื˜ืขืœืœื™ื’ืขื ืกืข ืžื›ืฉื™ืจื™ื ืคึฟืึทืจ ืกื•ืฃ ื ื™ืฆืขืจืก, ืื™ืจ ืงืขื ืขืŸ ื ื•ืฆืŸ ื“ื™ ืคืจื™ื™ ื“ื™ื–ื™ื™ื ืขืจ ืคื•ืŸ ืจื™ืคึผืึธืจืฅ, ื“ืึทืฉื‘ืึธืจื“ื– ืื•ืŸ ืžื™ื ื™ ื“ืึทื˜ืŸ ื•ื•ืขืจื›ืึทื•ื–ื™ื– Power BI Desktop. ื‘ื™ืœื“ื•ื ื’ืงืจื™ื™ื– ืžืึทื˜ืขืจื™ืึทืœืก: 1 ืœื™ื ืง, 2 ืœื™ื ืง.

Hadoop ืื•ืŸ ื‘ื™ื’ ื“ืึทื˜ืึท

ืกืึธืฃ

ื ื™ื˜ ืึทืœืฅ ืื™ืจ ืœืขืจื ืขืŸ ืงืขื ืขืŸ ื–ื™ื™ืŸ ื’ืขื•ื•ืขื ื“ื˜ ืื™ืŸ ืึทืจื‘ืขื˜. ื“ืขืจื™ื‘ืขืจ, ืื™ืจ ื“ืึทืจืคึฟืŸ ืึท ื’ืจืึทื“ื–ืฉืึทื•ื•ื™ื™ืฉืึทืŸ ืคึผืจื•ื™ืขืงื˜ ืื™ืŸ ื•ื•ืึธืก ืื™ืจ ื•ื•ืขื˜ ืคึผืจื•ื‘ื™ืจืŸ ืฆื• ืฆื•ืœื™ื™ื’ืŸ ื ื™ื™ึทืข ื•ื•ื™ืกืŸ.

ื“ืขืจ ืคึผืœืึทืŸ ื™ื ืงืœื•ื“ื– ื ื™ืฉื˜ ื˜ืขืžืขืก ืฉื™ื™ึทื›ื•ืช ืฆื• ื“ืึทื˜ืŸ ืึทื ืึทืœื™ืกื™ืก ืื•ืŸ ืžืึทืฉื™ืŸ ืœืขืจื ืขืŸ, ื•ื•ื™ื™ึทืœ ื“ืึธืก ืื™ื– ืžืขืจ ื‘ืึทื˜ื™ื™ึทื˜ื™ืง ืคึฟืึทืจ ื“ื™ ื“ืึทื˜ืึท ืกืกื™ืขื ื˜ื™ืกื˜ ืคืึทืš. ืขืก ื–ืขื ืขืŸ ืื•ื™ืš ืงื™ื™ืŸ ื˜ืขืžืขืก ืฉื™ื™ึทื›ื•ืช ืฆื• AWS ืื•ืŸ Azure ื•ื•ืืœืงื ืก. ื“ื™ ื˜ืขืžืขืก ื–ืขื ืขืŸ ื”ืขื›ืกื˜ ืึธืคืขื ื’ื™ืง ืื•ื™ืฃ ื“ื™ ื‘ืจื™ืจื” ืคื•ืŸ ืคึผืœืึทื˜ืคืึธืจืžืข.

ืคืจืื’ืขืก ืคืืจ ื“ื™ ืงื”ื™ืœื”:
ื•ื•ื™ ื˜ื•ื™ื’ืŸ ืื™ื– ืžื™ื™ืŸ ืคึผืึทืžืคึผื™ื ื’ ืคึผืœืึทืŸ? ื•ื•ืึธืก ืฆื• ื‘ืึทื–ื™ื™ึทื˜ื™ืงืŸ ืึธื“ืขืจ ืœื™ื™ื’ืŸ?
ื•ื•ืึธืก ืคึผืจื•ื™ืขืงื˜ ื•ื•ืึธืœื˜ ืื™ืจ ืจืขืงืึธืžืขื ื“ื™ืจืŸ ื•ื•ื™ ืึท ื˜ืขื–ื™ืก?

ืžืงื•ืจ: www.habr.com

ืœื™ื™ื’ืŸ ืึท ื‘ืึทืžืขืจืงื•ื ื’