ืฉื—ืจื•ืจ ืฉืœ ืžืขืจื›ืช ืชืจื’ื•ื ืžื›ื•ื ื” OpenNMT 2.28.0

ืคืจืกื•ื ืžืขืจื›ืช ื”ืชืจื’ื•ื ื”ืžื›ื•ื ื” OpenNMT 0.28.0 (Open Neural Machine Translation), ื”ืžืฉืชืžืฉืช ื‘ืฉื™ื˜ื•ืช ืœืžื™ื“ืช ืžื›ื•ื ื”, ืคื•ืจืกืžื”. ื›ื“ื™ ืœื‘ื ื•ืช ืจืฉืช ืขืฆื‘ื™ืช, ื”ืคืจื•ื™ืงื˜ ืžืฉืชืžืฉ ื‘ื™ื›ื•ืœื•ืช ืฉืœ ืกืคืจื™ื™ืช ืœืžื™ื“ืช ืžื›ื•ื ื” ืขืžื•ืงื” ืฉืœ TensorFlow. ื”ืงื•ื“ ืฉืœ ื”ืžื•ื“ื•ืœื™ื ืฉืคื•ืชื—ื• ืขืœ ื™ื“ื™ ืคืจื•ื™ืงื˜ OpenNMT ื›ืชื•ื‘ ื‘-Python ื•ืžื•ืคืฅ ืชื—ืช ืจื™ืฉื™ื•ืŸ MIT. ืžื•ื“ืœื™ื ืžื•ื›ื ื™ื ืžื•ื›ื ื™ื ืœืฉืคื•ืช ืื ื’ืœื™ืช, ื’ืจืžื ื™ืช ื•ืงื˜ืœื•ื ื™ืช; ืœืฉืคื•ืช ืื—ืจื•ืช, ื ื™ืชืŸ ืœื™ืฆื•ืจ ื‘ืื•ืคืŸ ืขืฆืžืื™ ืžื•ื“ืœ ื”ืžื‘ื•ืกืก ืขืœ ืกื˜ ื ืชื•ื ื™ื ืžืคืจื•ื™ืงื˜ OPUS (ืœื”ื“ืจื›ื” ืžื•ืขื‘ืจื™ื ืœืžืขืจื›ืช ืฉื ื™ ืงื‘ืฆื™ื - ืื—ื“ ืขื ืžืฉืคื˜ื™ื ื‘- ืฉืคืช ื”ืžืงื•ืจ, ื•ื”ืฉื ื™ื™ื” ืขื ืชืจื’ื•ื ืื™ื›ื•ืชื™ ืฉืœ ืžืฉืคื˜ื™ื ืืœื• ืœืฉืคืช ื”ื™ืขื“).

ื”ืคืจื•ื™ืงื˜ ืžืคื•ืชื— ื‘ื”ืฉืชืชืคื•ืช SYSTRAN, ื—ื‘ืจื” ื”ืžืชืžื—ื” ื‘ื™ืฆื™ืจืช ื›ืœื™ ืชืจื’ื•ื ืžื›ื•ื ื”, ื•ืงื‘ื•ืฆืช ื—ื•ืงืจื™ ื”ืจื•ื•ืืจื“ ื”ืžืคืชื—ื™ื ืžื•ื“ืœื™ื ืฉืœ ืฉืคื•ืช ืื ื•ืฉื™ื•ืช ืœืžืขืจื›ื•ืช ืœืžื™ื“ืช ืžื›ื•ื ื”. ืžืžืฉืง ื”ืžืฉืชืžืฉ ืคืฉื•ื˜ ื›ื›ืœ ื”ืืคืฉืจ ื•ื“ื•ืจืฉ ืจืง ืฆื™ื•ืŸ ืงื•ื‘ืฅ ืงืœื˜ ืขื ื˜ืงืกื˜ ื•ืงื•ื‘ืฅ ืœืฉืžื™ืจืช ืชื•ืฆืืช ื”ืชืจื’ื•ื. ืžืขืจื›ืช ื”ื”ืจื—ื‘ื” ืžืืคืฉืจืช ืœื™ื™ืฉื ืคื•ื ืงืฆื™ื•ื ืœื™ื•ืช ื ื•ืกืคืช ื”ืžื‘ื•ืกืกืช ืขืœ OpenNMT, ืœืžืฉืœ, ืกื™ื›ื•ื ืื•ื˜ื•ืžื˜ื™, ืกื™ื•ื•ื’ ื˜ืงืกื˜ ื•ื”ืคืงืช ื›ืชื•ื‘ื™ื•ืช.

ื”ืฉื™ืžื•ืฉ ื‘-TensorFlow ืžืืคืฉืจ ืœื”ืฉืชืžืฉ ื‘ื™ื›ื•ืœื•ืช ืฉืœ ื”-GPU (ื›ื“ื™ ืœื”ืื™ืฅ ืืช ืชื”ืœื™ืš ื”ืื™ืžื•ืŸ ืฉืœ ืจืฉืช ืขืฆื‘ื™ืช. ื›ื“ื™ ืœืคืฉื˜ ืืช ื”ืคืฆืช ื”ืžื•ืฆืจ, ื”ืคืจื•ื™ืงื˜ ืžืคืชื— ื’ื ื’ืจืกื” ืขืฆืžืื™ืช ืฉืœ ื”ืžืชืจื’ื ื‘-C++ - CTranslate2 , ื”ืžืฉืชืžืฉืช ื‘ืžื•ื“ืœื™ื ืฉื”ื•ื›ืฉืจื• ืžืจืืฉ ืœืœื ื”ืชื™ื™ื—ืกื•ืช ืœืชืœื•ืช ื ื•ืกืคื•ืช.

ื”ื’ืจืกื” ื”ื—ื“ืฉื” ืžื•ืกื™ืคื” ืืช ื”ืคืจืžื˜ืจ initial_learning_rate ื•ืžื™ื™ืฉืžืช ืžืกืคืจ ืืจื’ื•ืžื ื˜ื™ื ื—ื“ืฉื™ื (mha_bias ื•-out_layer_bias) ื›ื“ื™ ืœื”ื’ื“ื™ืจ ืืช ืžื—ื•ืœืœ ืžื•ื“ืœ ื”-Transformer. ื”ืฉืืจ ืžืกื•ืžืŸ ืขืœ ื™ื“ื™ ืชื™ืงื•ื ื™ ื‘ืื’ื™ื.

ืžืงื•ืจ: OpenNet.ru

ื”ื•ืกืคืช ืชื’ื•ื‘ื”