JST_LOGO.JPG NICT_LOGO.JPG KYOTO-U_LOGO.JPG

WAT 2016

The 3rd Workshop on Asian Translation

December 12, 2016
Osaka, Japan

[SPONSOR] | [TIMETABLE] | [INVITED TALK] | [IMPORTANT DATES] | [RESEARCH PAPER] | [TASK] | [EVALUATION] | [BASELINE SYSTEM] | [PAPER SUBMISSION INFORMATION] | [TRANSLATION RESULTS SUBMISSION INFORMATION] | [REGISTRATION] | [CONTACT] | [PREVIOUS WORKSHOPS]

NOTICE:Participants can submit translation results for the human evaluation a maximum of twice until the pairwise crowdsourcing evaluation is due.

INTRODUCTION

The Workshop on Asian Translation (WAT) is a new open evaluation campaign focusing on Asian languages. We would like to invite a broad range of participants and conduct various forms of machine translation experiments and evaluation. Collecting and sharing our knowledge will allow us to understand the essence of machine translation and the problems to be solved. We are working toward the practical use of machine translation among all Asian countries.

For the 3rd WAT, we chose scientific papers, patents, news, and TED talks as the targeted domain, and selected the languages Japanese, Chinese, Korean, Hindi, Indonesian, and English. In addtion to the shared tasks, the 3rd WAT calls for research papers on topics related to machine translation, especially for Asian languages.

What makes WAT unique:

SPONSOR

TBA

TIMETABLE

TBA

INVITED TALK

TBA

IMPORTANT DATES

Submission due for pairwise crowdsourcing evaluationAugust 19, 2016
System description draft paper and research paper (new!) dueSeptember 25, 2016
System description draft review feedbackOctober 16, 2016
Research paper acceptance notificationOctober 16, 2016
System description and resaerch paper camera-ready copy dueOctober 30, 2016

All deadlines are calculated at 11:59PM Pacific Time (UTC/GMT -8 hours)

notice: Task participants should submit the translation results for pairwise crowdsourcing evaluation.
Back to top

RESEARCH PAPER

WAT 2016 invites researchers to submit their original work on machine translation for Asian languages. The scope covers studies and reports on theories, techniques, and resources to improve the machines translation of Asian languages. All submitted research papers will be examined under a double-blind peer-reviewing to decide if they will appear at the workshop. Topics of interest include, but are not limited to:

The format of research paper is identital to the format of system description, please refer to the section of PAPER SUBMISSION INFORMATION.

Back to top

TASK

# We are sorry that the Chinese / Japanese <--> English translation in Newswire Subtasks has been canceled in WAT2016.

The task is to improve the text translation quality for various domains, including scientific papers, patent documents and news articles. Participants choose any of the subtasks in which they would like to participate, and translate the test data using their machine translation systems. The WAT organizers will evaluate the results submitted using automatic evaluation and human evaluation. We will also provide a baseline machine translation.

Subtasks:

Dataset:

Baseline system:

Baseline systems site is now open.

Back to top

EVALUATION

We will evaluate the translation performance of the results submitted through automatic evaluation and human evaluation.

Automatic evaluation:
We will prepare an automatic evaluation server. You will be able to evaluate the translation results at any time using this server.

Human evaluation:
Human evaluation will be carried out with two kinds of method, which are Pairwise Crowdsourcing Evaluation and JPO Adequacy Evaluation.

Submission:

Submission site is now open.
(User Name and Password is necessary to access.)

Evaluation results:

Evaluation results site is now open.

Back to top

PAPER SUBMISSION INFORMATION

Participants who submit results for human evaluation should submit description papers of their translation systems and evaluation results. All submissions and feedback are handled electronically as below.

Back to top

TRANSLATION RESULT SUBMISSION INFORMATION

The applicating site for task participants of WAT2016 is now open.

Back to top

REGISTRATION

The registration will be handled by COLING 2016

Back to top

ORGANIZERS

Back to top

PROGRAM COMMITTEE MEMBERS

Back to top

TECHNICAL COLLABORATOR

Back to top

CONTACT

For questions, comments, etc. please email to "wat -at- nlp -dot- ist -dot- i -dot- kyoto -hyphen- u -dot- ac -dot- jp".

Back to top

COLING 2016
Japan Patent Office
JPO Patent Corpus
The Association for Natural Language Processing (Japanese Page)
Asian Scientific Paper Excerpt Corpus (ASPEC)
Japan Science and Technology Agency (JST)
National Institute of Information and Communications Technology (NICT)

Back to top

PREVIOUS WORKSHOPS

CHANGE LOG

2015-07-14: data preparation for patent CJ updated, PB SMT baseline for JK updated
2015-07-12: paper submission site open
2015-06-29: links for baseline system and evaluation results are added
2015-06-28: tasks modified, data preparation / PB SMT baseline for IE / EI updated, data preparation for patent JE / EJ updated
2015-06-14: application site open
2015-06-11: schedule fixed
2015-05-25: site open

Back to top

JST (Japan Science and Technology Agency)
NICT (National Institute of Information and Communications Technology)
Kyoto University
Last Modified: 2016-07-14