ืขืก ืืื ืืืกืืึธืืข ืงืืื ืกืื ืึทื ืืขืฆืืข ืืึธืจ ืืื ืืขืืืขื ืึท ืืึธืจ ืคืื ืืจืืืก ืขื ืืขืจืื ืืขื ืคึฟืึทืจ Apache Hadoop. ืืขืฆืืข ืืึธืจ, ืงืืึธืืืขืจืึท ืืื ืืึธืจืืึธืืืืึธืจืงืก ืืึธืื ืืื ืฆืื ืืืคืืืกื (ืืขืืงืจ, ืื ืึทืงืืืึทืืืฉืึทื ืคืื ืื ืืขืฆืืข), ืืื Mapr, ืจืขืื ืฆื ืขืจื ืกื ืคืื ืึทื ืฆืืขื ืคึผืจืึธืืืขืืก, ืืื ืกืึธืื ืฆื ืืขืืืืขืื ืคึผืึทืงืงืึทืจื. ืืื ืืืื ืึท ืืืกื ืืึธืจื ืคืจืืขืจ, ืืื ืืขื ืคืึทื ืคืื ืื ืกืืึทืืืืฉืึทื ื ืืื ืืึธืงืึทื, ืื ืืจืืจื ืึธืคื ืืื ืฆื ืืืื ืืขืืืื ืฆืืืืฉื Cloudera ืืื Hortonworks, ืืืึทื ื, ืืืื, ืืืจ ืืึธื ื ืื ืืึธืื ืื ืืจืืจื. ืื ืื ืืขืจ ืืืขืจืจืึทืฉื ืืื ืืขืืืขื ืืขืจ ืคืึทืงื ืึทื ืงืืึธืืืขืจืึท ืืืืืข ืืื ืคืขืืจืืืจ ืคืื ืืขื ืืึธืจ ืึทื ืขืก ืืืึธืื ืืึทืืื ืจืืืืกืื ื ืืืื ืขืจื ืึทืกืขืืืืื ืคืื ืืืึทื ืคืึทืจืฉืคึผืจืืืืื ื ืืื ืื ืฆืืืืจ ืจืืคึผืึทืืึทืืึธืจื, ืืื ืืื ืืขื ืขื ืืืฆื ืื ืืืฆื ืืืืื ืืืจื ืึท ืืึทืฆืึธืื ืึทืืึธื ืขืืขื ื. ืืึธื, ืขืก ืืื ื ืึธื ืืขืืืขื ืฆื ืึธืคึผืืึธืืืจื ืื ืืขืฆืืข ืืืขืจืกืืขืก ืคืื CDH ืืื HDP ืคืจืื ืืืืืขืจ ืื ืกืืฃ ืคืื 2019, ืืื ืฉืืืฆื ืคึฟืึทืจ ืืื ืืื ืืขืจืืื ืคึฟืึทืจ ืืืื ืฆื ืฆืืืื ืืึธืจ. ืืืขืจ ืืืึธืก ืฆื ืืึธื ืืืืึทืืขืจ? ืคึฟืึทืจ ืื ืืืืก ืคืจืืขืจ ืืึทืฆืึธืื ืคึฟืึทืจ ืึท ืึทืืึธื ืขืืขื ื, ืืึธืจื ืืฉื ืืื ืืขืืืื. ืืื ืคึฟืึทืจ ืื ืืืืก ืืึธื ื ืืฉื ืืืขืื ืฆื ืืึทืฉืืืืขื ืฆื ืื ืืึทืฆืึธืื ืืืขืจืกืืข ืคืื โโืื ืคืึทืจืฉืคึผืจืืืืื ื, ืึธืืขืจ ืืื ืืขืจ ืืขืืืืงืขืจ ืฆืืื ืืืืื ืฆื ืืึทืงืืืขื ืื ืืขืฆืืข ืืืขืจืกืืขืก ืคืื ืงื ืืื ืงืึทืืคึผืึธืื ืึทื ืฅ, ืืื ืืขืืื ื ืืื ืคึผืึทืืฉืึทื ืืื ืื ืืขืจืข ืืขืจืืืึทื ืืืงืื ืืขื, ืืืจ ืืึธืื ืฆืืืขืืจืืื ืืขื ืึทืจืืืงื. ืืื ืขืก ืืืจ ืืืขืื ืืึทืืจืึทืืื ืืขืืืขื ืึธืคึผืฆืืขืก ืฆื ืืึทืงืืืขื ืืืืก ืคืื ืืขื ืกืืืืึทืฆืืข.
ืืขืจ ืึทืจืืืงื ืืื ืืขืจ ืึท ืจืขืฆืขื ืืืข. ืขืก ืืืขื ื ืืฉื ืึทื ืืืึทืืื ืึท ืคืึทืจืืืืึทื ืคืื ืืืกืืจืืืืืฉืึทื ื ืืื ืึท ืืืืืืื ืึทื ืึทืืืกืืก ืคืื ืืื, ืืื ืขืก ืืืขื ืืืื ืงืืื ืจืขืกืึทืคึผืื ืคึฟืึทืจ ืื ืกืืึธืืื ื ืืื ืงืึทื ืคืืืืขืจ ืืื. ืืืืก ืืืขื ืืขืฉืขื? ืืืจ ืืืขืื ืืขืงืืฆืขืจ ืจืขืื ืืืขืื ืึทืืึท ืึท ืคืึทืจืฉืคึผืจืืืืื ื ืืื Arenadata Hadoop, ืืืึธืก ืจืืืืคืึทืื ืคืืจืืื ื ืืื ืืืขืจ ืืคืืขืจืงืืึทืืงืืื ืจืขืื ืฆื ืืืื ืึทืืืืืืึทืืืืึทืื, ืืืึธืก ืืื ืืืืขืจ ืืขืืื ืืืึทื ื. ืืื ืืขืจื ืึธื ืืืจ ืืืขืื ืจืขืื ืืืขืื Vanilla Hadoop, ืืขืจ ืืืืคึผื ืืืขืื ืืื ืขืก ืงืขื ืขื ืืืื "ืงืึธืื" ืืื Apache Bigtop. ืืจืืื? ืืขืืึธืื ืืึทืืจืืกื ืฆื ืงืึทืฅ.
Arenadata Hadoop
ืืึธืก ืืื ืึท ืืึธืจ ื ืืึทืข ืืื, ืืื ื ืึธื, ืงืืืื-ืืืงืื ื ืคืึทืจืฉืคึผืจืืืืื ื ืื ืืืขื ืืึทืจ ืคืื ืืื ืขืจ ืึทื ืืืืืงืืื ื. ืฆืื ืืึทืืืืขืจื, ืืื ืืขื ืืึธืืขื ื ืืืืฃ Habrรฉ ืขืก ืืื ืืืืื .
ืืขืจ ืืื ืคึฟืึธืจืืึทืฆืืข ืงืขื ืขื ืืืื ืืขืคึฟืื ืขื ืืืืฃ ืืขืจ ืืึทืึทืืืขืจ ืคึผืจืืืขืงื. ืื ืืขืฆืืข ืืืขืจืกืืขืก ืคืื ืืขืจ ืคืึทืจืฉืคึผืจืืืืื ื ืืขื ืขื ืืืืืจื ืืืืฃ Hadoop 3.1.2 ืคึฟืึทืจ ืืืขืจืกืืข 3 ืืื 2.8.5 ืคึฟืึทืจ ืืืขืจืกืืข 2.
ืืื ืคึฟืึธืจืืึทืฆืืข ืืืขืื ืื ืจืึธืึทืืืึทืคึผ ืงืขื ืขื ืืืื ืืขืคึฟืื ืขื .
ืึทืจืขื ืึทืืึทืืึท ืงืืึทืกืืขืจ ืืึทื ืึทืืขืจ ืฆืืืื ื
ืื ืืึทืจืฅ ืคึผืจืึธืืืงื ืคืื Arenadata ืืื , ืืืึธืก ืืื ืืขื ืืฆื ืฆื ืื ืกืืึทืืืจื, ืงืึทื ืคืืืืขืจ ืืื ืืึธื ืืืึธืจ ืคืึทืจืฉืืื ืคืืจืืข ืืืืืืืืืจื ืกืึทืืืฉืึทื ื. ADCM ืืื ืคืื ืื ืืขืจืืขืืืืื ืคืจืื, ืืื ืืืึทื ืคืึทื ืืงืฉืึทื ืึทืืืื ืืื ืืงืกืคึผืึทื ืืื ืืืจื ืึทืืื ื ืืึทื ืืึทืื, ืืืึธืก ืืขื ืขื ืึท ืกืืื ืคืื ืึทื ืกืืืืข-ืคึผืืืึทืืึธืึธืงืก. ืืื ืืืขืก ืืขื ืขื ืฆืขืืืืื ืืื ืฆืืืื ืืืืคึผืก: ืคืึทืจื ืขืืื ื ืืื ืงืื. ืื ืืขืฆืืข ืืขื ืขื ืืืจืขืืืืื ืคึฟืึทืจ ืคืจืื ืืจืืคืงืืคืืข ืคึฟืื ืื Arenadata ืืืขืืืืืื. ืขืก ืืื ืืืื ืืขืืืขื ืฆื ืึทื ืืืืืงืืขื ืืืื ืืืืืขื ืข ืคึผืขืงื ืืื ืคืึทืจืืื ืื ืขืก ืฆื ADCM.
ืคึฟืึทืจ ืืืคึผืืืืืึทื ื ืืื ืคืึทืจืืืึทืืืื ื ืคืื Hadoop 3, ืึท ืงืื ืืืขืจืกืืข ืคืื โโโโืืขื ืคึผืขืงื ืืื ืืขืคึฟืื ื ืืื ืงืึทื ืืืฉืึทื ืืงืฉืึทื ืืื ADCM, ืึธืืขืจ ืคึฟืึทืจ Hadoop 2 ืขืก ืืื ืืืืื ืืื ืึทื ืื ืืขืจ ืืจืืจื. ืืื ืคึฟืึทืจ ืจืืคึผืึทืืึทืืึธืจืื ืืื ืคึผืึทืงืึทืืืฉืึทื, ืืื ืืขื ืขื ืึธืคื ืคึฟืึทืจ ืฆืืืืจ ืึทืงืกืขืก, ืืื ืงืขื ืขื ืืืื ืืึทืื ืืึธืืืื ืืื ืืื ืกืืึทืืืจื ืืืืฃ ืื ืืขืืืืื ืืืขื ืืืขื ืคึฟืึทืจ ืึทืืข ืงืึทืืคึผืึธืื ืึทื ืฅ ืคืื ืืขื ืงื ืืื. ืงืืืืขืืืืง, ืื ืคืึทืจืฉืคึผืจืืืืื ื ืงืืงื ืืืืขืจ ืืฉืืงืึทืืืข. ืืื ืืื ืืืืขืจ ืึทื ืขืก ืืืขื ืืืื ืื ืืืืก ืืขื ืขื ืฆืืืขืืืืื ื ืฆื ืกืึทืืืฉืึทื ื ืึทืืึท ืืื Cloudera ืืึทื ืึทืืขืจ ืืื Ambari, ืืื ืืืึธืก ืืืขืื ืืื ADCM ืืื. ืคึฟืึทืจ ืขืืืขืืข, ืขืก ืืืขื ืืืื ืืืื ืึท ืจืืืืง ืคึผืืืก ืึทื ืื ืคืึทืจืฉืคึผืจืืืืื ื ืคึฟืึทืจ ืึทืจืืึทื ืคืืจ ืกืึทืืกืืืืืฉืึทื.
ืืืื ืืืจ ืจืขืื ืืืขืื ืื ืืืกืึทืืืืึทื ืืืืืฉืื, ืืื ืืืขืื ืืืื ืื ืืขืืืข ืืื ืคึฟืึทืจ ืึทืืข ืื ืืขืจืข Hadoop ืืืกืืจืืืืืฉืึทื ื. ื ืขืืืื:
- ืื ืึทืืื ืืขืจืืคืขื ืข "ืคืึทืจืงืืืคืขืจ ืืึทืง-ืืื". ื ืืฆื ืื ืืืืฉืคืืื ืคืื Cloudera ืืื Hortonworks, ืืืจ ืืึธืื ืฉืืื ืืืื ืืขืืขื ืึทื ืขืก ืืื ืฉืืขื ืืืง ืึท ืจืืืืงืืจื ืคืื ืืฉืึทื ืืื ื ืคืืจืืข ืคึผืึธืืืืืง.
- ืืึทืืืืืืง ืึธืคึผืฉืืื ืืื ืืขืจ ืึทืคึผืึทืืฉื ืึทืคึผืกืืจืื.
Vanilla Hadoop
ืืื ืืืจ ืืืืกื, Hadoop ืืื ื ืืฉื ืึท ืืึทื ืึทืืืืืง ืคึผืจืึธืืืงื, ืึธืืขืจ, ืืื ืคืึทืงื, ืึท ืืึทื ืฅ ืืึทืืึทืงืกื ืคืื ืกืขืจืืืืกืขืก ืึทืจืื ืืืึทื ืคืื ืื ืืขืจืืขืืืืื ืืขืงืข ืกืืกืืขื HDFS. ืืืืื ืืง ืืขื ืืฉื ืืืขืื ืืึธืื ืืขื ืื ืคืื ืืืื ืืขืงืข ืงื ืืื. ืขืืืขืืข ืืึทืจืคึฟื ืืืืืข, ืื ืืขืจืข Presto, ืืื ืืขืืึธืื ืขืก ืืขื ืขื HBase ืืื Phoenix; ืกืคึผืึทืจืง ืืื ืื ืงืจืืกืื ืืื ืืขื ืืฆื. ืคึฟืึทืจ ืึธืจืงืขืกืืจืึทืืืึธื ืืื ืืึธืืืื ื ืคืื ืืึทืื, Oozie, Sqoop ืืื Flume ืืขื ืขื ืืื ืืขืคึฟืื ืขื. ืืื ืืืื ืื ืึทืจืืืกืืขืื ืคืื ืืืืขืจืืืื ืขืจืืืืึทื, ืืขืืึธืื Kerberos ืืื ืงืึทื ืืืฉืึทื ืืงืฉืึทื ืืื Ranger ืืืืื ืงืืื ืฆื ืืืื ืื ื.
ืืืื ืขืจื ืืืขืจืกืืขืก ืคืื Hadoop ืงืึทืืคึผืึธืื ืึทื ืฅ ืืขื ืขื ืื ืืืฆื ืืืืฃ ืืขืจ ืืืขืืืืืื ืคืื ืืขืืขืจ ืคืื ืื ืืงืึธืืกืืกืืึทื ืคึผืจืึทืืืฉืขืงืก ืืื ืื ืคืึธืจืขื ืคืื ืืึทืจืืึทืืืก. ืืืจ ืงืขื ืขื ืืจืืคืงืืคืืข ืืื ืืื ืึธื ืืืืื ืืึทื ืืึธื ืืืจืื ื, ืึธืืขืจ ืืื ืืืื ืฆืืฉืืึทื ื: ืืื ืึทืืืฉืึทื ืฆื ืื ืืืคึผืขื ืืึทื ืืื ืึทืกืขืืืึทื ืคึผืึทืงืึทืืืฉืึทื ืคืื "ืจืื" ืืื ืึทืจืืขืก, ืืืึธืก ืืืจ ืจืืึฟ ืืกืชึผืื ืืืืื ืฆื ืืึธื, ืืืจ ืืืขื ื ืืฉื ืืึธืื ืงืืื ืฆืืืจืื ืืื ืื ืงืึทืืคึผืึทืืึทืืืืึทืื ืคืื ืื ืืึทืื ืืึธืืืื ืืืขืจืกืืขืก ืคืื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืื ืืขืืขืจ. ืื ืืขืจืข. ืื ืืืืืขืจ ืึธืคึผืฆืืข ืืื ืฆื ืืืืขื ืืื Apache Bigtop. ืืืืืึธืคึผ ืืืขื ืืึธืื ืืืจ ืฆื ืืืืขื ืคึฟืื ืึทืคึผืึทืืฉื ืืึทืืืขื ืจืืคึผืึทืืึทืืึธืจืื, ืืืืคื ืืขืกืฅ ืืื ืืืืขื ืคึผืึทืงืึทืืืฉืึทื. ืึธืืขืจ, ืืืึธืก ืืื ืืืืขืจ ืืืืืืืง ืคึฟืึทืจ ืืื ืื, Bigtop ืืืขื ืึทืกืขืืืึทื ืื ืืืขืจืกืืขืก ืคืื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืืึธืก ืืขื ืขื ืงืึทืืคึผืึทืืึทืืึทื ืืื ืืขืืขืจ ืื ืืขืจืขืจ. ืืืจ ืืืขืื ืจืขืื ืืืขืื ืืื ืืื ืืขืจ ืืขืืึทื ืืื ืื.
ืึทืคึผืึทืืฉื ืืืืืึธืคึผ
Apache Bigtop ืืื ืึท ืืขืฆืืึทื ืคึฟืึทืจ ืื ืื, ืคึผืึทืงืงืึทืืื ื ืืื ืืขืกืืื ื ืึท ื ืืืขืจ ืคืื
ืขืคึฟืขื ืขื ืืงืืจ ืคืจืืืขืงืื, ืึทืืึท ืืื Hadoop ืืื Greenplum. ืืืืืึธืคึผ ืืื ืคืืืข
ืจืืืืกืื. ืืื ืืขืจ ืฆืืื ืคืื ืฉืจืืืื, ืื ืืขืฆืืข ืกืืึทืืื ืืขืืืื ื ืืื ืืขืืืขื ืืืขืจืกืืข 1.4,
ืืื ืืื ืืขื ืืื ืืขืืืขื 1.5. ืคืึทืจืฉืืืขื ืข ืืืขืจืกืืขืก ืคืื ืจืืืืกืื ื ืืฆื ืคืึทืจืฉืืืขื ืข ืืืขืจืกืืขืก
ืงืึทืืคึผืึธืื ืึทื ืฅ. ืคึฟืึทืจ ืืืึทืฉืคึผืื, ืคึฟืึทืจ 1.4 Hadoop ืืึทืจืฅ ืงืึทืืคึผืึธืื ืึทื ืฅ ืืึธืื ืืืขืจืกืืข 2.8.5, ืืื ืืื ืืขื
2.10.0. ืืขืจ ืืึทืฅ ืคืื ืฉืืืฆื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืื ืืืื ืืฉืึทื ืืื ื. ืขืคึผืขืก ืึทืืืืืืืื ืืื
ืื ืึทื ืจืื ืืึทืืึทื ืืืื ืึทืืืขืง, ืืื ืืื ืืืึทื ืึธืจื ืงืืื ืขืคึผืขืก ื ืืึท, ืืขืจ ืืื ืืึธื ืขื, ืืื
ืขืก ืืื ื ืืฉื ืืึทืืืงืข ืขืคึผืขืก ืคืื ืื ืึทืคึผืึทืืฉื ืืฉืคึผืื ืืื.
ืืื ืืขืจืฆื, Bigtop ืืื ืคืืืข .
ืืืขื ืืืจ ืืึธืื ืึธื ืืขืืืืื ืืื ืืึทืงืขื ืขื ืืื ืืืืืึธืคึผ, ืืขื ืขื ืืืจ ืงืืื-ืื ืกืึทืคึผืจืืืื ืืขืืืึธืจื ืคึฟืื ืืฒึทื ืืึทืฉืืืื, ืืื ืคึฟืึทืจืืืฒึทื ืืื ืึทื ืืขืจืข ืึทืคึผืึทืืฉืึพืคึผืจืึธืืขืงืื, ืคึผืจืขืืืึทืืึทื ืก ืืื ืคึผืึธืคึผืืืึทืจืืืขื, ืืื ืืืื ืคึฟืื ืึท ืืืืขืจ ืงืืืื ืืขืืืื ืืข. ืขืก ืืืื ืืขืจืคืื ืึทื ืขืก ืืื ืืื ืืืึทื ืืื ืคึฟืึธืจืืึทืฆืืข ืืืขืื ืืขื ืคึผืจืึธืืืงื, ืืื ืืืื ืคึฟืึทืจ ืกืึทืืืฉืึทื ื ืคึฟืึทืจ ืคึผืจืึธืืืขืืก ืืืึธืก ืืขื ืขื ืืืืคืืขืฉืืื ืขื ืืืืฃ ืืจืืคึผืขืก ืืื ืืืืืื ื ืจืฉืืืืช ืงืขื ื ืืฉื ืืขืื ืขืคึผืขืก. ืืื ืขืจืฉืืขืจ, ืขืก ืืื ืืขืืืขื ืึท ืฉืืืขืจ ืึทืจืืขื ืคึฟืึทืจ ืืื ืื ืฆื ืคืึทืจืขื ืืืงื ืื ืืึทื ืฅ ืคึฟืึทืจืืึทืืืื ื ืคืื ืื ืคืึทืจืฉืคึผืจืืืืื ื ืจืขืื ืฆื ืื ืคึฟืขืึดืงืืืื ืคืื ืื ืืขืฆืืึทื ืืื, ืึธืืขืจ ืืืจ ืืืขืื ืจืขืื ืืืขืื ืืขื ืึท ืืืกื ืฉืคึผืขืืขืจ.
ืืื ืึท ืืืืขืจ, ืืขื ืข ืืืึธืก ืึทืืึธื ืืขืืืขื ืืื ืืขืจืขืกืืจื ืืื ืึทืืึท ืคึผืจืึทืืืฉืขืงืก ืคืื ืื ืืื ืืงืก ืึทืืืืขืื ืืื Gentoo ืืื LFS ืงืขื ืืขืคึฟืื ืขื ืขืก ืคืึทืจืืขื ืงื ืฆื ืึทืจืืขืื ืืื ืืขื ืืึทื ืืื ืืขืืขื ืงืขื ืื "ืขืคึผืึธืก" ืฆืืื ืืืขื ืืืจ ืืื ืงืืงื ืคึฟืึทืจ (ืึธืืขืจ ืืคืืื ืฉืจืืืื) ebuilds ืืื ืงืขืกืืืืขืจ ืจืืืืื ืืึธืืืืืึท ืืื ื ืืึทืข ืคึผืึทืืฉืึทื.
ืื ืืจืืืก ืืืึทืืข ืคืื โโืืืืืึธืคึผ ืืื ืื ืึธืืคึผืึทื ื ืึทืก ืืื ืืืขืจืกืึทืืืืึทืื ืคืื ืื ืืืฉืืจืื ืืืืฃ ืืืึธืก ืขืก ืืื ืืืืืจื. ืขืก ืืื ืืืืืจื ืืืืฃ Gradle ืืื Apache Maven. Gradle ืืื ืืึทื ืฅ ืืึทืืืืกื ืืื ืื ืืขืฆืืึทื Google ื ืืฆื ืฆื ืืืืขื ืึทื ืืจืืื. ืขืก ืืื ืคืืขืงืกืึทืืึทื, ืืื, ืืื ืืื ืืึธืื, "ืงืึทืืฃ-ืืขืกืืขื." Maven ืืื ืึท ื ืึธืจืืึทื ืืขืฆืืึทื ืคึฟืึทืจ ืื ืื ืคึผืจืึทืืืฉืขืงืก ืืื ืึทืคึผืึทืืฉื ืืื, ืืื ืืื ื ืจืืึฟ ืคืื ืืืึทื ืคึผืจืึธืืืงืื ืืขื ืขื ืจืขืืขืึทืกืขื ืืืจื Maven, ืขืก ืงืขื ื ืืฉื ืืืื ืืขืืื ืึธื ืขืก ืืึธ. ืขืก ืืื ืืืขืจื ืฆื ืืึทืฆืึธืื ืืคืืขืจืงืืึทืืงืืื ืฆื ืื POM (ืคึผืจืึธืืขืงื ืืืืคืขืฅ ืืึธืืขื) - ืื "ืคืื ืืึทืืขื ืืึทื" ืงืกืื ืืขืงืข ืืืกืงืจืืืืื ื ืึทืืฅ ื ืืืืืง ืคึฟืึทืจ Maven ืฆื ืึทืจืืขืื ืืื ืืืื ืคึผืจืืืขืงื, ืึทืจืื ืืืึธืก ืึทืืข ืึทืจืืขื ืืื ืืขืืืื. ืคึผืื ืงื ืืื
ืืืื ืคืื Maven ืืื ืขืก ืืขื ืขื ืขืืืขืืข ืื ืืขืืช ืึทื ืขืจืฉืืขืจ-ืฆืืึทื ืืืืืึธืคึผ ืืืืขืจื ืืืืฉืึทืืืึทืื ืืจืขืคื.
ืคืืจ
ืึทืืื ืืื ืืึธื ืืืจ ืึธื ืืืืื? ืืืื ืฆื ืื ืืจืืคืงืืคืืข ืืืึทื ืืื ืืจืืคืงืืคืืข ืื ืืขืฆืืข ืกืืึทืืื ืืืขืจืกืืข ืืื ืึทื ืึทืจืงืืืื. ืืืจ ืงืขื ื ืืืื ืืขืคึฟืื ืขื ืืืื ืขืจื ืึทืจืืึทืคืึทืงืฅ ืืขืืืืื ืืืจื Bigtop ืืึธืจื. ืืืจื ืืขื ืืืขื, ืฆืืืืฉื ืื ืคึผืจืึธืกื ืคึผืขืงื ืืึทื ืึทืืืฉืขืจื, YUM ืืื APT ืืขื ืขื ืืขืฉืืืฆื.
ืึทืืืขืจื ืึทืืืืืขืื, ืืืจ ืงืขื ืขื ืืจืืคืงืืคืืข ืื ืืขืฆืืข ืกืืึทืืื ืืขืืืื ื ืืืืื ืคึฟืื
ืืืืืื:
$ git clone --branch branch-1.4 https://github.com/apache/bigtop.gitืงืืึธืื ืื ื ืืื "ืืืืืึธืคึผ" ...
remote: Enumerating objects: 46, done.
remote: Counting objects: 100% (46/46), done.
remote: Compressing objects: 100% (41/41), done.
remote: Total 40217 (delta 14), reused 10 (delta 1), pack-reused 40171
ะะพะปััะตะฝะธะต ะพะฑัะตะบัะพะฒ: 100% (40217/40217), 43.54 MiB | 1.05 MiB/s, ะณะพัะพะฒะพ.
ะะฟัะตะดะตะปะตะฝะธะต ะธะทะผะตะฝะตะฝะธะน: 100% (20503/20503), ะณะพัะพะฒะพ.
Updating files: 100% (1998/1998), ะณะพัะพะฒะพ.ืื ืจืืืึทืืืื ื ./bigtop ืืืขืืืืืึทืืขืจ ืงืืงื ืขืคึผืขืก ืืื ืืึธืก:
./bigtop-bigpetstore - ืืขืืึธ ืึทืคึผืืึทืงืืืฉืึทื ื, ืกืื ืืขืืืฉ ืืืืฉืคืืื
./bigtop-ci - ืกื ืืืฉืืจืื, ืืืฉืขื ืงืื ืก
./bigtop-data-generators - ืืึทืื ืืืฉืขื ืขืจืืืฉืึทื, ืกืื ืืขืืืงืก, ืคึฟืึทืจ ืจืืื ืืขืกืฅ, ืขืืง.
./bigtop-deploy - ืืืคึผืืืืืึทื ื ืืืฉืืจืื
./bigtop-packages - ืงืึธื ืคืืืก, ืกืงืจืืคึผืก, ืคึผืึทืืฉืึทื ืคึฟืึทืจ ืคึฟืึทืจืืึทืืืื ื, ืืขืจ ืืืืคึผื ืืืื ืคืื ืื ืืขืฆืืึทื
./bigtop-test-framework - ืืขืกืืื ื ืคืจืืืืืืขืจืง
./bigtop-tests โ ืื ืคึผืจืึธืืข ืืื, ืืึธืื ืืื ืจืืื
./bigtop_toolchain - ืกืืืืืืข ืคึฟืึทืจ ืคึฟืึทืจืืึทืืืื ื, ืคึผืจืืคึผืขืจืื ื ืื ืกืืืืืืข ืคึฟืึทืจ ืื ืืขืฆืืึทื ืฆื ืึทืจืืขืื
./build - ืืืืขื ืืจืืขืื ืืืขืืืืืึทืืขืจ
./dl - ืืืขืืืืืึทืืขืจ ืคึฟืึทืจ ืืึทืื ืืึธืืืื ืงืืืืื
./docker - ืืืืขื ืืื ืืึธืงืงืขืจ ืืืืืขืจ, ืืขืกืืื ื
./gradle - gradle config
./output - ืืขืจ ืืืขืืืืืึทืืขืจ ืืื ืืืืขื ืึทืจืืึทืคืึทืงืฅ ืืืื
./provisioner - ืคึผืจืึทืืืืืฉืึทื ื
ืื ืืขืจืกื ืืฉืืงืึทืืืข ืืึทื ืคึฟืึทืจ ืืื ืื ืืื ืืขื ืืื ืข ืืื ืื ืืืืคึผื ืงืึทื ืคืืืืขืจืืืฉืึทื ./bigtop/bigtop.bom, ืืื ืืืึธืก ืืืจ ืืขื ืึทืืข ืฉืืืฆื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืื ืืืขืจืกืืขืก. ืืึธืก ืืื ืืื ืืืจ ืงืขื ืขื ืกืคึผืขืฆืืคืืฆืืจื ืึท ืึทื ืืขืจืฉ ืืืขืจืกืืข ืคืื โโโโืื ืคึผืจืึธืืืงื (ืืืื ืืืจ ืคึผืืืฆืืื ื ืืืืื ืฆื ืคึผืจืืืืจื ืฆื ืืืืขื ืขืก) ืึธืืขืจ ืึท ืืืืขื ืืืขืจืกืืข (ืืืื, ืคึฟืึทืจ ืืืึทืฉืคึผืื, ืืืจ ืฆืืืขืืขืื ืึท ืืึทืืืืืืง ืืึทืืข).
ืื ืกืืืืืจืขืงืืึธืจื ืืื ืืืื ืคืื ืืจืืืก ืืื ืืขืจืขืก ./bigtop/bigtop-packages, ืืืึธืก ืืื ืืืืึทื ืฉืืึทืืืช ืฆื ืืขื ืคึผืจืึธืฆืขืก ืคืื ืึทืกืขืืืึทืืื ื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืื ืคึผืึทืงืึทืืืฉืึทื ืืื ืืื.
ืึทืืื ืืืจ ืืึทืื ืืึธืืืื ืืขื ืึทืจืงืืืื, ืึทื ืคึผืึทืงื ืขืก ืึธืืขืจ ืืขืืืื ืึท ืงืืึธืื ืคึฟืื ืืืืืื, ืงืขื ืขื ืืืจ ืึธื ืืืืื ืฆื ืืืืขื?
ื ืืื, ืืืืืจ ืงืืื ืืจืืืื ืื ืกืืืื.
ืคึผืจืืคึผืขืจืื ื ืื ืกืืืืืืข
ืืื ืืึธ ืืืจ ืืึทืจืคึฟื ืึท ืงืืืื ืฆืืจืืงืฆืืขื ืืื. ืฆื ืืืืขื ืึผืืขื ืงืืื ืืขืจ ืึธืืขืจ ืืืืื ืืงืขืจ ืงืึธืืคึผืืืฆืืจื ืคึผืจืึธืืืงื, ืืืจ ืืึทืจืคึฟื ืึท ืืืืขืจ ืกืืืืืืข - ืืื ืืื ืืืขืจ ืคืึทื, ืืึธืก ืืื ืื JDK, ืื ืืขืืืข ืฉืขืจื ืืืืืจืขืจืื, ืืขืืขืจ ืืขืงืขืก, ืืื"ื ื, ืืืฉืืจืื, ืืืฉื, ืืืจืึทืฉืงืข, ืืืื 2 ืืื ืคืื ืืขืจ. ืืืื ืขืจ ืคืื ืื ืึธืคึผืฆืืขืก ืฆื ืืึทืงืืืขื ืื ืกืืืืืืข ืืืจ ืืึทืจืคึฟื ืคึฟืึทืจ ืืืืืึธืคึผ ืืื ืฆื ืื ืกืืึทืืืจื ืื ื ืืืืืง ืงืึทืืคึผืึธืื ืึทื ืฅ ืืืืฃ ืื ืืืืขื ืืึทืืขืืึธืก. ืืื ืงืขื ืืืื ืคืึทืืฉ ืืื ืื ืงืจืึทื ืึทืืึทืืืฉื, ืึธืืขืจ ืขืก ืืืื ื ืึทื ืืื ืืืขืจืกืืข 1.0 ืขืก ืืื ืืืื ืึทื ืึธืคึผืฆืืข ืฆื ืืืืขื ืืื ืคืึทืจ-ืงืึทื ืคืืืืขืจื ืืื ืฆืืืจืืืืขื ืืึธืงืงืขืจ ืืืืืขืจ, ืืืึธืก ืงืขื ืขื ืืืื ืืขืคึฟืื ืขื ืืึธ.
ืืื ืคึฟืึทืจ ืคึผืจืืคึผืขืจืื ื ืื ืกืืืืืืข, ืขืก ืืื ืึท ืึทืกืืกืืึทื ื ืคึฟืึทืจ ืืขื - ืืืึทืืงืข.
ืืืจ ืงืขื ืขื ื ืืฆื ืื ืคืืืืขื ืืข ืงืึทืืึทื ืื, ืืืืคื ืคึฟืื ืืขืจ ืืืึธืจืฆื ืืืขืืืืืึทืืขืจ
ืืขืฆืืึทื, ./bigtop:
./gradlew toolchain
./gradlew toolchain-devtools
./gradlew toolchain-puppetmodules
ืึธืืขืจ ืืืืึทื ืืืจื ืืืึทืืงืข:
puppet apply --modulepath=<path_to_bigtop> -e "include bigtop_toolchain::installer"
puppet apply --modulepath=<path_to_bigtop> -e "include bigtop_toolchain::deployment-tools"
puppet apply --modulepath=<path_to_bigtop> -e "include bigtop_toolchain::development-tools"ืฆืื ืืึทืืืืขืจื, ืฉืืืขืจืืงืืืื ืงืขื ืขื ืืืืคืฉืืืื ืฉืืื ืืื ืืขื ืืื ืข. ืืขืจ ืืขื ืขืจืึทื ืขืฆื ืืึธ ืืื ืฆื ื ืืฆื ืึท ืืขืฉืืืฆื ืคืึทืจืฉืคึผืจืืืืื ื, ืืขืจืืืึทื ืืืงื ืืืืฃ ืื ืืืืขื ืืึทืืขืืึธืก, ืึธืืขืจ ืคึผืจืืืืจื ืื ืืึธืงืงืขืจ ืืึทืจืฉืจืื.
Assembly
ืืืึธืก ืงืขื ืขื ืืืจ ืคึผืจืืืืจื ืฆื ืงืืืึทืื? ืืขืจ ืขื ืืคืขืจ ืฆื ืืขื ืงืฉืื ืืืขื ืืืื ืืขืืขืื ืืืจื ืื ืจืขืืืืืึทื ืคืื ืื ืืึทืคึฟืขื
./gradlew tasks
ืืื ืื ืคึผืึทืงืงืึทืืข ืืึทืกืงืก ืึธืคึผืืืืืื ื ืขืก ืืขื ืขื ืึท ื ืืืขืจ ืคืื ืคึผืจืึธืืืงืื ืืืึธืก ืืขื ืขื ืื ืืขืฆื ืึทืจืืึทืคืึทืงืฅ ืคืื Bigtop.
ืืื ืงืขื ืขื ืืืื ืืืืขื ืึทืคืืื ืืืจื ืื ืกืึทืคืืงืก -rpm ืึธืืขืจ -pkg-ind (ืืื ืืขื ืคืึทื ืคืื ืื ืื
ืืื ืืึธืงืงืขืจ). ืืื ืืื ืืืขืจ ืคืึทื, ืื ืืขืจืกื ืืฉืืงืึทืืืข ืืื Hadoop.
ืืึธืืืจ ืคึผืจืืืืจื ืฆื ืืืืขื ืืื ืื ืกืืืืืืข ืคืื โโืืื ืืืขืจ ืืืืขื ืกืขืจืืืขืจ:
./gradlew hadoop-rpmืืืืืึธืคึผ ืืื ืืืขื ืืจืืคืงืืคืืข ืื ื ืืืืืง ืงืืืืื ืคึฟืึทืจ ืึท ืกืคึผืขืฆืืคืืฉ ืงืึธืืคึผืึธื ืขื ื ืืื ืึธื ืืืืื ืคึฟืึทืจืืึทืืืื ื. ืืืื, ืื ืึธืคึผืขืจืึทืฆืืข ืคืื โโืื ืืขืฆืืึทื ืืื ืึธืคืขื ืืืง ืืืืฃ Maven ืจืืคึผืึทืืึทืืึธืจืื ืืื ืื ืืขืจืข ืงืืืืื, ืืึธืก ืืื, ืขืก ืจืืงืืืืืขืจื ืืื ืืขืจื ืขื ืึทืงืกืขืก.
ืืขืฉืึทืก ืึธืคึผืขืจืึทืฆืืข, ื ืึธืจืืึทื ืจืขืืืืืึทื ืืื ืืืฉืขื ืขืจืืืืึทื. ืืื ืขืก ืืื ืืขืืช ืึทืจืืืงืืขื ืงืขื ืขื ืืขืืคื ืืืจ ืคึฟืึทืจืฉืืืื ืืืึธืก ืืื ืคืึทืืฉ. ืืื ืืื ืืืจ ืืึทืจืคึฟื ืฆื ืืึทืงืืืขื ื ืึธื ืืื ืคึฟืึธืจืืึทืฆืืข. ืืื ืืขื ืคืึทื ืขืก ืืื ืืืขืจื ืฆื ืืืืื ืืขื ืืช --info ืึธืืขืจ --debug, ืืื ืงืขื ืืืื ืืืื ื ืืฆืืง โstacktrace. ืขืก ืืื ืึท ืืึทืงืืืขื ืืืขื ืฆื ืืืฉืขื ืขืจืืื ืึท ืืึทืื ืฉืืขืื ืคึฟืึทืจ ืกืึทืืกืึทืงืืืึทื ื ืึทืงืกืขืก ืฆื ืืืืืื ื ืจืฉืืืืช, ืืขืจ ืฉืืืกื --scan.
ืืื ืืืื ืืืืฃ, ืืืืืึธืคึผ ืืืขื ืงืืืึทืื ืึทืืข ืื ืืื ืคึฟืึธืจืืึทืฆืืข ืืื ืฉืืขืื ืขืก ืืื ืืจืึทืืืข, ื ืึธื ืืืึธืก ืขืก ืืืขื ืฆืืฉืืขืื ืึท ืืื ืง,
ืืืจื ืืขื ืืืขื ืึท ืงืึธืืคึผืขืืขื ื ืืขื ืืฉ ืงืขื ืขื ืคึฟืึทืจืฉืืืื ืืืึธืก ืื ืคึฟืึทืจืืึทืืืื ื ืืื ืืืจืืืขืงืึธืื.
ืืืืข ืืืื ืึทืืืขืจ ืึทื ืื ืึธืคึผืฆืืข ืงืขื ืืืกืฉืืขืื ืืื ืคึฟืึธืจืืึทืฆืืข ืืืจ ืืึธื ื ืื ืืืขืื, ืึทืืึท ืืื ืืกืขืจื ืึทืืขืก, ื ืึธืืื, ืกืืืืืืข ืืืขืจืืึทืืึทืื, ืืื"ื ื, ืึทืืื ืืืื ืึธืคึผืืขืืื.
ืึธืคื ืขืจืจืึธืจืก ืืขื ืขื ืึท ืงืึทื ืกืึทืงืืืึทื ืก ืคืื ืื ืื ืึทืืืืืื ืฆื ืืึทืงืืืขื ืงืืื ืงืึทืืคึผืึธืื ืึทื ืฅ ื ืืืืืง ืคึฟืึทืจ ืคึฟืึทืจืืึทืืืื ื. ืืืคึผืืงืึทืืื, ืืืจ ืงืขื ืขื ืคืึทืจืจืืืื ืืขื ืคึผืจืึธืืืขื ืืืจื ืงืจืืืืืื ื ืึท ืืึทืืข ืฆื ืคืึทืจืจืืืื ืขืคึผืขืก ืืื ืื ืงืืืืื, ืืืฉื, ืึทืืจืขืกืขืก ืืื pom.xml ืืื ืืขืจ ืืืึธืจืฆื ืืืขืืืืืึทืืขืจ ืคืื ืื ืงืืืืื. ืืขื ืืื ืืขืืื ืืืจื ืงืจืืืืืื ื ืืื ืคึผืืืืกืื ื ืขืก ืืื ืื ืฆืื ืขืืขื ืืืขืืืืืึทืืขืจ ./bigtop/bigtop-packages/src/common/oozie/ ืืึทืืข, ืืืฉื, ืืื ืื ืคืึธืจืขื patch2-fix.diff.
--- a/pom.xml
+++ b/pom.xml
@@ -136,7 +136,7 @@
<repositories>
<repository>
<id>central</id>
- <url>http://repo1.maven.org/maven2</url>
+ <url>https://repo1.maven.org/maven2</url>
<snapshots>
<enabled>false</enabled>
</snapshots>
ืจืืึฟ ืืกืชึผืื, ืืื ืืขืจ ืฆืืื ืคืื ืืืืขื ืขื ืืขื ืึทืจืืืงื, ืืืจ ืืืขื ื ืืฉื ืืึธืื ืฆื ืืึธื ืื ืืืืื ืคืึทืจืจืืืื ืืื.
ืืืขื ืื ืืจืึธืืืืกืื ื ืงืืื ืคึผืึทืืฉืึทื ืืื ืขื ืืขืจืื ืืขื ืฆื ืื ืคึฟืึทืจืืึทืืืื ื ืืขืงืึทื ืืืึทื, ืืืจ ืงืขื ืืึทืจืคึฟื ืฆื "ืืึทืฉืืขืืืง" ืื ืคึฟืึทืจืืึทืืืื ื ืืื ืื ืงืืื ืึทืคึผ ืืึทืคึฟืขื:
./gradlew hadoop-clean
> Task :hadoop_vardefines
> Task :hadoop-clean
BUILD SUCCESSFUL in 5s
2 actionable tasks: 2 executedืื ืึธืคึผืขืจืึทืฆืืข ืืืขื ืฆืืจืืงืงืจืืื ืึทืืข ืขื ืืขืจืื ืืขื ืืื ืื ืคึฟืึทืจืืึทืืืื ื ืคืื ืืขื ืงืึธืืคึผืึธื ืขื ื, ื ืึธื ืืืึธืก ืื ืคึฟืึทืจืืึทืืืื ื ืืืขื ืืืื ืืืจืืืขืงืึธืื ืืืืืขืจ. ืืึธืก ืืึธื ืืืจ ืืืขืื ืคึผืจืืืืจื ืฆื ืืืืขื ืืขื ืคึผืจืืืขืงื ืืื ืึท ืืึธืงืงืขืจ ืืืื:
./gradlew -POS=centos-7 -Pprefix=1.2.1 hadoop-pkg-ind
> Task :hadoop-pkg-ind
Building 1.2.1 hadoop-pkg on centos-7 in Docker...
+++ dirname ./bigtop-ci/build.sh
++ cd ./bigtop-ci/..
++ pwd
+ BIGTOP_HOME=/tmp/bigtop
+ '[' 6 -eq 0 ']'
+ [[ 6 -gt 0 ]]
+ key=--prefix
+ case $key in
+ PREFIX=1.2.1
+ shift
+ shift
+ [[ 4 -gt 0 ]]
+ key=--os
+ case $key in
+ OS=centos-7
+ shift
+ shift
+ [[ 2 -gt 0 ]]
+ key=--target
+ case $key in
+ TARGET=hadoop-pkg
+ shift
+ shift
+ [[ 0 -gt 0 ]]
+ '[' -z x ']'
+ '[' -z x ']'
+ '[' '' == true ']'
+ IMAGE_NAME=bigtop/slaves:1.2.1-centos-7
++ uname -m
+ ARCH=x86_64
+ '[' x86_64 '!=' x86_64 ']'
++ docker run -d bigtop/slaves:1.2.1-centos-7 /sbin/init
+
CONTAINER_ID=0ce5ac5ca955b822a3e6c5eb3f477f0a152cd27d5487680f77e33fbe66b5bed8
+ trap 'docker rm -f
0ce5ac5ca955b822a3e6c5eb3f477f0a152cd27d5487680f77e33fbe66b5bed8' EXIT
....
ะผะฝะพะณะพ ะฒัะฒะพะดะฐ
....
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-yarn-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-mapreduce-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-namenode-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-secondarynamenode-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-zkfc-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-journalnode-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-datanode-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-httpfs-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-yarn-resourcemanager-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-yarn-nodemanager-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-yarn-proxyserver-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-yarn-timelineserver-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-mapreduce-historyserver-2.8.5-
1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-client-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-conf-pseudo-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-doc-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-libhdfs-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-libhdfs-devel-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-hdfs-fuse-2.8.5-1.el7.x86_64.rpm
Wrote: /bigtop/build/hadoop/rpm/RPMS/x86_64/hadoop-debuginfo-2.8.5-1.el7.x86_64.rpm
+ umask 022
+ cd /bigtop/build/hadoop/rpm//BUILD
+ cd hadoop-2.8.5-src
+ /usr/bin/rm -rf /bigtop/build/hadoop/rpm/BUILDROOT/hadoop-2.8.5-1.el7.x86_64
Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.uQ2FCn
+ exit 0
+ umask 022
Executing(--clean): /bin/sh -e /var/tmp/rpm-tmp.CwDb22
+ cd /bigtop/build/hadoop/rpm//BUILD
+ rm -rf hadoop-2.8.5-src
+ exit 0
[ant:touch] Creating /bigtop/build/hadoop/.rpm
:hadoop-rpm (Thread[Task worker for ':',5,main]) completed. Took 38 mins 1.151 secs.
:hadoop-pkg (Thread[Task worker for ':',5,main]) started.
> Task :hadoop-pkg
Task ':hadoop-pkg' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:hadoop-pkg (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
BUILD SUCCESSFUL in 40m 37s
6 actionable tasks: 6 executed
+ RESULT=0
+ mkdir -p output
+ docker cp
ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb:/bigtop/build .
+ docker cp
ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb:/bigtop/output .
+ docker rm -f ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb
ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb
+ '[' 0 -ne 0 ']'
+ docker rm -f ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb
Error: No such container:
ac46014fd9501bdc86b6c67d08789fbdc6ee46a2645550ff6b6712f7d02ffebb
BUILD SUCCESSFUL in 41m 24s
1 actionable task: 1 executedืื ืืืืขื ืืื ืืืจืืืขืงืึธืื ืืื ืืขืจ CentOS, ืึธืืขืจ ืงืขื ืขื ืืืื ืืืื ืืขืืื ืืื ืืขืจ ืืืื ืื:
./gradlew -POS=ubuntu-16.04 -Pprefix=1.2.1 hadoop-pkg-indืืื ืึทืืืฉืึทื ืฆื ืืืืขื ืคึผืึทืงืึทืืืฉืึทื ืคึฟืึทืจ ืคืึทืจืฉืืื ืืื ืืงืก ืืืกืืจืืืืืฉืึทื ื, ืื ืืขืฆืืึทื ืงืขื ืขื ืฉืึทืคึฟื ืึท ืจืืคึผืึทืืึทืืึธืจื ืืื ืงืึทืืคึผืืืื ืคึผืึทืงืึทืืืฉืึทื, ืืืฉื:
./gradlew yumืืืจ ืงืขื ื ืืืื ืืขืืขื ืงืขื ืจืืื ืืขืกืฅ ืืื ืืืคึผืืืืืึทื ื ืืื ืืึธืงืงืขืจ.
ืฉืึทืคึฟื ืึท ืงื ืืื ืคืื ืืจืืึท ื ืึธืืื:
./gradlew -Pnum_instances=3 docker-provisionerืืืืคื ืจืืื ืืขืกืฅ ืืื ืึท ืงื ืืื ืคืื ืืจืื ื ืึธืืื:
./gradlew -Pnum_instances=3 -Prun_smoke_tests docker-provisionerืืืกืืขืงื ืึท ืงื ืืื:
./gradlew docker-provisioner-destroyืืึทืงืืืขื ืงืึทืืึทื ืื ืคึฟืึทืจ ืงืึทื ืขืงืืื ื ืื ืืึธืงืงืขืจ ืงืึทื ืืืื ืขืจื:
./gradlew docker-provisioner-sshืืืืึทืื ืกืืึทืืืก:
./gradlew docker-provisioner-statusืืืจ ืงืขื ืขื ืืืืขื ืขื ืืขืจ ืืืขืื ืืืคึผืืืืืึทื ื ืืึทืกืงืก ืืื ืื ืืึทืงืืืืขื ืืืืฉืึทื.
ืืืื ืืืจ ืจืขืื ืืืขืื ืืขืกืฅ, ืขืก ืืขื ืขื ืืึทื ืฅ ืึท ืืจืืืก ื ืืืขืจ ืคืื ืืื, ืืขืจ ืืืืคึผื ืจืืื ืืื ืื ืืึทืืจืืืฉืึทื. ืืืืขืจ ืึทื ืึทืืืกืืก ืืื ืืืืึทืืขืจ ืคืื ืื ืคืึทืจื ืขื ืคืื ืืขื ืึทืจืืืงื. ืืึธืื ืืืจ ื ืึธืจ ืืึธืื ืึทื ืึทืกืขืืืึทืืื ื ืึท ืคืึทืจืฉืคึผืจืืืืื ื ืื ืืืขื ืืึทืจ ืืื ื ืืฉื ืึท ืฉืืืขืจ ืึทืจืืขื ืืื ืขืก ืงืขื ืืืกืงืืืขื ืืืึท ืขืจืฉืืขืจ ืืืืง. ืืืจ ืืขืจืืื ืฆื ืึทืกืขืืืึทื ืืื ืืืจืืืืื ืืขืกืฅ ืืืืฃ ืึทืืข ืื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืืึธืก ืืืจ ื ืืฆื ืืื ืืื ืืืขืจ ืคึผืจืึธืืืงืฆืืข, ืืื ืืืจ ืืืื ืืึธืื ืงืืื ืคืจืืืืขืืขื ืืื ืืืคึผืืืืื ื ืืื ืืื ืืืจืืคืืจื ืืงืขืจืืืง ืึทืคึผืขืจืืืฉืึทื ื ืืื ืื ืคึผืจืึธืืข ืกืืืืืืข.
ืืื ืึทืืืฉืึทื ืฆื ืื ืืืืืกืืื ื ืงืึทืืคึผืึธืื ืึทื ืฅ ืืื Bigtop, ืขืก ืืื ืืขืืืขื ืฆื ืืืืื ืขืคึผืขืก ืึทื ืืขืจืฉ, ืืคืืื ืืืื ืืืืืขื ืข ืืืืืืืืืจื ืึทื ืืืืืงืืื ื. ืึทืืข ืืขื ืืื ืืืฉืืืืืขืก ืึธืืึทืืืืืื ืืื ืคืืฅ ืืื ืื ืกื / ืกื ืืึทืืจืืฃ.
ืกืึธืฃ
ืืึธื, ืื ืคืึทืจืฉืคึผืจืืืืื ื ืฆืื ืืืคืืขืฉืืขืื ืืื ืืขื ืืืขื ืืึธื ื ืื ืืืื ืืื ืืขืฉืืงื ืฆื ืคึผืจืึธืืืงืฆืืข. ืืืจ ืืึทืจืคึฟื ืฆื ืคึฟืึทืจืฉืืืื ืึทื ืืืื ืขืก ืืื ืึท ืคืึทืงืืืฉ ื ืืื ืฆื ืืืืขื ืืื ืฉืืืฆื ืืืื ืคืึทืจืฉืคึผืจืืืืื ื, ืืืจ ืืึทืจืคึฟื ืฆื ืื ืืืขืกืืืจื ืืขืื ืืื ืฆืืื ืืื ืืขื.
ืึธืืขืจ, ืืื ืงืึธืืืื ืึทืฆืืข ืืื ืื ืจืขืื ืฆืืืึทื ื ืืื ืึท ืคืึทืืืึทื ืืึทื ืฉืึทืคึฟื, ืขืก ืืื ืืึทื ืฅ ืืขืืืขื ืฆื ืืึธื ืึธื ืืขืฉืขืคื ืกืึทืืืฉืึทื ื.
ืขืก ืืื ืืืืืืืง ืฆื ืืึธื ืึทื ืื ืืืืืึธืคึผ ืคึผืจืืืขืงื ืืื ืืื ืืื ื ืืื ืคืื ืึทื ืืืืืงืืื ื ืืื ืืื ื ืืฉื ืึทืงืืืืืื ืืขืืืขืืึธืคึผืขื ืืืึทื ื. ืืขืจ ืคึผืจืึธืกืคึผืขืงื ืคืื Hadoop 3 ืืื ืืืื ืืืงืืึธืจ, ืืืจื ืื ืืืขื, ืืืื ืืืจ ืืึธืื ืึท ืคืึทืงืืืฉ ื ืืื ืฆื ืืืืขื Hadoop 3, ืืืจ ืงืขื ืขื ืงืืงื ืืื ืคืื ืึทืจืขื ืึทืืึทืืึท, ืืื ืืืึธืก, ืืื ืืขืจืฆื ืฆื ื ืึธืจืืึทื
ืขืก ืืขื ืขื ืึท ื ืืืขืจ ืคืื ื ืึธื ืงืึทืืคึผืึธืื ืึทื ืฅ (ืจืึทื ืืขืจ, ื ืึธืงืก, ื ืืคื).
ืืื ืคึฟืึทืจ Rostelecom, ืคึฟืึทืจ ืืื ืื Bigtop ืืื ืืืื ืขืจ ืคืื ืื ืึธืคึผืฆืืขืก ืืืึธืก ืืขื ืขื ืงืึทื ืกืืืขืจื ืืืึทื ื. ืฆื ืืืจ ืงืืืึทืื ืขืก ืึธืืขืจ ื ืืฉื, ืื ืฆืืื ืืืขื ืืึธืื.
ืึทืคึผืคึผืขื ืืืงืก
ืฆื ืึทืจืืึทื ื ืขืืขื ืึท ื ืืึทืข ืงืึธืืคึผืึธื ืขื ื ืืื ืืขืจ ืคึฟืึทืจืืึทืืืื ื, ืืืจ ืืึทืจืคึฟื ืฆื ืืืืื ืืืื ืืึทืฉืจืืึทืืื ื ืฆื bigtop.bom ืืื ./bigtop-packages. ืืืจ ืงืขื ืขื ืคึผืจืืืืจื ืฆื ืืึธื ืืึธืก ืืืจื ืึทื ืึทืืึทืืืฉื ืืื ืื ืืืืืกืืื ื ืงืึทืืคึผืึธืื ืึทื ืฅ. ืคึผืจืืืืจื ืฆื ืจืขืืขื ืขื ืขืก ืืืืก. ืขืก ืืื ื ืืฉื ืึทืืื ืฉืืืขืจ ืืื ืขืก ืืืื ื ืืืึท ืขืจืฉืืขืจ ืืืืง.
ืืืืก ืืืื ื ืืืจ? ืืืจ ืืืขืื ืืืื ืฆืืคืจืืื ืฆื ืืขื ืืืื ืืืื ืื ื ืืื ืื ืืึทืืขืจืงืื ืืขื ืืื ืืึทื ืงืขื ืืืจ ืคึฟืึทืจ ืืืื ืืคืืขืจืงืืึทืืงืืึทื!
ืืขืจ ืึทืจืืืงื ืืื ืืขืืืขื ืฆืืืขืืจืืื ืืืจื ืื Rostelecom ืืึทืื ืคืึทืจืืืึทืืืื ื ืืึทื ืฉืึทืคึฟื
ืืงืืจ: www.habr.com