Quantcast
Channel: Hacker News
Viewing all articles
Browse latest Browse all 25817

OpenNMT: Open-Source Neural Machine Translation

$
0
0

README.md

Build Status

OpenNMT is a full-featured, open-source (MIT) neural machine translation system utilizing theTorch mathematical toolkit.

The system is designed to be simple to use and easy to extend , while maintaining efficiency and state-of-the-art translation accuracy. Features include:

  • Speed and memory optimizations for high-performance GPU training.
  • Simple general-purpose interface, only requires and source/target data files.
  • C++ implementation of the translator for easy deployment.
  • Extensions to allow other sequence generation tasks such as summarization and image captioning.

Installation

OpenNMT only requires a vanilla Torch install with few dependencies. Alternatively there is a (CUDA) Docker container.

Dependencies

GPU training requires:

Multi-GPU training additionally requires:

Quickstart

OpenNMT consists of three commands:

1) Preprocess the data.

th preprocess.lua -train_src data/src-train.txt -train_tgt data/tgt-train.txt -valid_src data/src-val.txt -valid_tgt data/tgt-val.txt -save_data data/demo

2) Train the model.

th train.lua -data data/demo-train.t7 -save_model model

3) Translate sentences.

th translate.lua -model model_final.t7 -src data/src-test.txt -output pred.txt

See the guide for more details.

Documentation


Viewing all articles
Browse latest Browse all 25817

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>