OpenNMT is a full-featured, open-source (MIT) neural machine translation system utilizing the Torch mathematical toolkit.
The system is designed to be simple to use and easy to extend, while maintaining efficiency and state-of-the-art translation accuracy. Features include:
Speed and memory optimizations for high-performance GPU training.
Simple general-purpose interface, only requires and source/target data files.
C++ implementation of the translator for easy deployment.
Extensions to allow other sequence generation tasks such as summarization and image captioning.
Installation
OpenNMT only requires a Torch installation with few dependencies.
Install Torch
Install additional packages:
luarocks install tds
luarocks install bit32 # if using LuaJIT
For other installation methods including Docker, visit the documentation.
Quickstart
OpenNMT consists of three commands:
Preprocess the data.
th preprocess.lua -train_src data/src-train.txt -train_tgt data/tgt-train.txt -valid_src data/src-val.txt -valid_tgt data/tgt-val.txt -save_data data/demo
Train the model.
th train.lua -data data/demo-train.t7 -save_model model
Translate sentences.
th translate.lua -model model_final.t7 -src data/src-test.txt -output pred.txt
For more details, visit the documentation.
Citation
A technical report on OpenNMT is available. If you use the system for academic work, please cite:
@ARTICLE{2017opennmt,
author = {{Klein}, G. and {Kim}, Y. and {Deng}, Y. and {Senellart}, J. and {Rush}, A.~M.},
title = "{OpenNMT: Open-Source Toolkit for Neural Machine Translation}",
journal = {ArXiv e-prints},
eprint = {1701.02810}
}
Acknowledgments
Our implementation utilizes code from the following:
Andrej Karpathy's char-rnn repo
Wojciech Zaremba's lstm repo
Element rnn library
Additional resources
Documentation
Example models
Forum
Gitter channel
Live demo
Bibliography
Posted on Utopian.io - Rewarding Open Source Contributors