WAT 2015

The 2nd Workshop on Asian Translation

10:30am-17:00pm, October 16, 2015
The second conference room, 4th floor,
Campus Plaza Kyoto, Japan [MAP]

WAT 2016 is now open.
PHOTOS is now open (2015/10/21)
PAPERS was updated (2015/10/21)


The Workshop on Asian Translation (WAT) is a new open evaluation campaign focusing on Asian languages. We would like to invite a broad range of participants and conduct various forms of machine translation experiments and evaluation. Collecting and sharing our knowledge will allow us to understand the essence of machine translation and the problems to be solved. We are working toward the practical use of machine translation among all Asian countries.

For the 2nd WAT, we chose scientific papers and patents as the targeted domain, and selected the languages Japanese, Chinese, Korean and English.

What makes WAT unique:




10:30 - 10:35Welcome: Hideya Mino
10:35 - 11:05Invited talk Ⅰ: Eiichiro Sumita
11:05 - 11:10Break
11:10 - 11:30Overview of WAT2015: Isao Goto
11:30 - 12:30Oral Presentation Ⅰ (3 systems: TOSHIBA, naver and Sense)
11:30 - 11:50 Toshiba MT System Description for the WAT2015 Workshop: Satoshi Sonoh and Satoshi Kinoshita
11:50 - 12:10 NAVER Machine Translation System for WAT 2015: Hyoung-Gyu Lee, Jaesong Lee, Jun-Seok Kim and Chang-Ki Lee
12:10 - 12:30 An Awkward Disparity between BLEU / RIBES Scores and Human Judgements in Machine Translation: Liling Tan, Jon Dehdari and Josef van Genabith
12:30 - 13:30Lunch
13:30 - 14:15Invited talk Ⅱ: Haizhou Li
14:15 - 14:20Break
14:20 - 15:00Oral Presentation Ⅱ (2 systems: NAIST and Kyoto-U)
14:20 - 14:40 Neural Reranking Improves Subjective Quality of Machine Translation: NAIST at WAT2015: Graham Neubig, Makoto Morishita and Satoshi Nakamura
14:40 - 15:00 KyotoEBMT System Description for the 2nd Workshop on Asian Translation: John Richardson, Raj Dabre, Chenhui Chu, Fabien Cromières, Toshiaki Nakazawa and Sadao Kurohashi
15:00 - 15:15Poster Booster Session
15:15 - 16:45Poster Presentation (all systems)
16:45 - 16:55Closing: Toshiaki Nakazawa
16:55 - 17:00Commemorative photo

notice: Lunch, Poster Presentation, Closing, and Commemorative photo will be held at the hall of 2nd floor.

Back to top


Dr. Eiichiro Sumita, Associate Director General of Universal Communication Research Institute and Director of Multilingual Translation Laboratory (NICT)
[Short bio.]

Title: Government project for multi-lingual speech translation system to bridge the language barrier in Japan

(Click here to more information. )

Time:10:35 - 11:05

Dr. Haizhou Li, Research Director of the Institute for Infocomm Research in Singapore, Principal Scientist and Department Head of Human Language Technology
[Short bio.]

Title: Adequacy-Fluency Metrics: Evaluating MT in the Continuous Space Model Framework

(Click here to more information. )

Time:13:30 - 14:15
Back to top


Submission due for pairwise crowdsourcing evaluationAugust 31, 2015August 16, 2015
System description draft paper dueSeptember 27, 2015September 20, 2015
Review feedbackOctober 4, 2015September 27, 2015
System description camera-ready paper dueOctober 11, 2015October 4, 2015
WAT 2015October 16, 2015 (whole day)

All deadlines are calculated at 11:59PM Pacific Time (UTC/GMT -8 hours)

notice: Task participants should submit the translation results for pairwise crowdsourcing evaluation.
Back to top


The task is to improve the text translation quality for scientific papers and patents. Participants choose any of the subtasks in which they would like to participate and translate the test data using their machine translation systems. The WAT organizers will evaluate the results submitted using automatic evaluation and human evaluation. We also provide a baseline machine translation system using Moses.



Baseline system:

Baseline systems site is now open.

Back to top


We will evaluate the translation performance of the results submitted through automatic evaluation and human evaluation.

Automatic evaluation:
We will prepare an automatic evaluation server. You will be able to evaluate the translation results at any time using this server.

Human evaluation:
Human evaluation will be carried out with two kinds of method, which are Pairwise Crowdsourcing Evaluation and JPO Adequacy Evaluation.


Submission site is now open.
(User Name and Password is necessary to access.)

Evaluation results:

Evaluation results site is now open.

Back to top


Participants who submit results for human evaluation should submit description papers of their translation systems and evaluation results. All submissions and feedback are handled electronically as below.

Back to top


Back to top


Back to top


For questions, comments, etc. please email to "wat -at- nlp.ist.i.kyoto-u.ac.jp".

Back to top

Japan Patent Office
JPO Patent Corpus
The Association for Natural Language Processing (Japanese Page)
Asian Scientific Paper Excerpt Corpus (ASPEC)
Japan Science and Technology Agency (JST)
National Institute of Information and Communications Technology (NICT)

Back to top



2015-10-21: PHOTOS open
2015-10-15: PAPERS open
2015-10-08: TIMETABLE was updated
2015-09-09: TIMETABLE
2015-08-24: SPONSOR
2015-08-10: Evaluation was updated
2015-08-10: IMPORTANT DATES was updated
2015-04-16: Patents Subtask (Korean-Japanese)
2015-03-24: INVITED TALK
2015-02-26: Patents Subtask (Chinese-Japanese)
2015-02-26: REGISTRATION open
2015-02-26: site open

Back to top

JST (Japan Science and Technology Agency)
NICT (National Institute of Information and Communications Technology)
Kyoto University
Last Modified: 2015-10-21